[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:12:10.701608 30972 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.30.63.62:42305
I20260709 13:12:10.703336 30972 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:12:10.704612 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:10.723148 30981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:10.723658 30979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:10.723158 30978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:11.958336 30980 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260709 13:12:11.958449 30972 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260709 13:12:11.963071 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:11.963359 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:11.963651 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783602731963605 us; error 0 us; skew 500 ppm
I20260709 13:12:11.964534 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:11.971413 30972 webserver.cc:533] Webserver started at http://127.30.63.62:38947/ using document root <none> and password file <none>
I20260709 13:12:11.972364 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:11.972644 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:11.973162 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:11.979090 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602730526113-30972-0/minicluster-data/master-0-root/instance:
uuid: "6f30195e42bf4e5fbcdf30b52fd35012"
format_stamp: "Formatted at 2026-07-09 13:12:11 on dist-test-slave-c08m"
I20260709 13:12:11.987457 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.004s
I20260709 13:12:11.993270 30987 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:11.994696 30972 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:12:11.995087 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602730526113-30972-0/minicluster-data/master-0-root
uuid: "6f30195e42bf4e5fbcdf30b52fd35012"
format_stamp: "Formatted at 2026-07-09 13:12:11 on dist-test-slave-c08m"
I20260709 13:12:11.995445 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602730526113-30972-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602730526113-30972-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602730526113-30972-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:12.048977 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:12.050621 30972 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:12:12.051128 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:12.130731 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.62:42305
I20260709 13:12:12.130829 31038 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.62:42305 every 8 connection(s)
I20260709 13:12:12.139748 31039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:12.165119 31039 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f30195e42bf4e5fbcdf30b52fd35012: Bootstrap starting.
I20260709 13:12:12.173641 31039 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f30195e42bf4e5fbcdf30b52fd35012: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.175627 31039 log.cc:826] T 00000000000000000000000000000000 P 6f30195e42bf4e5fbcdf30b52fd35012: Log is configured to *not* fsync() on all Append() calls
I20260709 13:12:12.184309 31039 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f30195e42bf4e5fbcdf30b52fd35012: No bootstrap required, opened a new log
I20260709 13:12:12.225776 31039 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6f30195e42bf4e5fbcdf30b52fd35012 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f30195e42bf4e5fbcdf30b52fd35012" member_type: VOTER }
I20260709 13:12:12.226697 31039 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6f30195e42bf4e5fbcdf30b52fd35012 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.227087 31039 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6f30195e42bf4e5fbcdf30b52fd35012 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30195e42bf4e5fbcdf30b52fd35012, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.228507 31039 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f30195e42bf4e5fbcdf30b52fd35012 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f30195e42bf4e5fbcdf30b52fd35012" member_type: VOTER }
I20260709 13:12:12.229497 31039 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6f30195e42bf4e5fbcdf30b52fd35012 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:12.230000 31039 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6f30195e42bf4e5fbcdf30b52fd35012 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:12.230552 31039 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6f30195e42bf4e5fbcdf30b52fd35012 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.239281 31039 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6f30195e42bf4e5fbcdf30b52fd35012 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f30195e42bf4e5fbcdf30b52fd35012" member_type: VOTER }
I20260709 13:12:12.240614 31039 leader_election.cc:304] T 00000000000000000000000000000000 P 6f30195e42bf4e5fbcdf30b52fd35012 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6f30195e42bf4e5fbcdf30b52fd35012; no voters: 
I20260709 13:12:12.243490 31039 leader_election.cc:290] T 00000000000000000000000000000000 P 6f30195e42bf4e5fbcdf30b52fd35012 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:12.243683 31042 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6f30195e42bf4e5fbcdf30b52fd35012 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:12.247262 31042 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6f30195e42bf4e5fbcdf30b52fd35012 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30195e42bf4e5fbcdf30b52fd35012, State: Running, Role: LEADER
I20260709 13:12:12.248307 31042 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f30195e42bf4e5fbcdf30b52fd35012 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f30195e42bf4e5fbcdf30b52fd35012" member_type: VOTER }
I20260709 13:12:12.249190 31039 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6f30195e42bf4e5fbcdf30b52fd35012 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:12.261662 31044 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f30195e42bf4e5fbcdf30b52fd35012 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6f30195e42bf4e5fbcdf30b52fd35012" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f30195e42bf4e5fbcdf30b52fd35012" member_type: VOTER } }
I20260709 13:12:12.261665 31043 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f30195e42bf4e5fbcdf30b52fd35012 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6f30195e42bf4e5fbcdf30b52fd35012. Latest consensus state: current_term: 1 leader_uuid: "6f30195e42bf4e5fbcdf30b52fd35012" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f30195e42bf4e5fbcdf30b52fd35012" member_type: VOTER } }
I20260709 13:12:12.262583 31043 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f30195e42bf4e5fbcdf30b52fd35012 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:12.262563 31044 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f30195e42bf4e5fbcdf30b52fd35012 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:12.265569 31052 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:12.277280 31052 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:12.279654 30972 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:12.294193 31052 catalog_manager.cc:1383] Generated new cluster ID: bcfee8064dd742b28c9b26fc6828c2a4
I20260709 13:12:12.294509 31052 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:12.315155 31052 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:12.316803 31052 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:12.329900 31052 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6f30195e42bf4e5fbcdf30b52fd35012: Generated new TSK 0
I20260709 13:12:12.330982 31052 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:12.346704 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:12.356490 31061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:12.358239 31062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:12.361581 30972 server_base.cc:1061] running on GCE node
W20260709 13:12:12.362071 31064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:12.363021 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:12.363209 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:12.363449 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783602732363411 us; error 0 us; skew 500 ppm
I20260709 13:12:12.364082 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:12.368921 30972 webserver.cc:533] Webserver started at http://127.30.63.1:40561/ using document root <none> and password file <none>
I20260709 13:12:12.369511 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:12.369714 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:12.370034 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:12.371194 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602730526113-30972-0/minicluster-data/ts-0-root/instance:
uuid: "c642698d21b74372809ac4b52afb84ac"
format_stamp: "Formatted at 2026-07-09 13:12:12 on dist-test-slave-c08m"
I20260709 13:12:12.377409 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.002s
I20260709 13:12:12.382197 31069 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:12.383148 30972 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 13:12:12.383530 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602730526113-30972-0/minicluster-data/ts-0-root
uuid: "c642698d21b74372809ac4b52afb84ac"
format_stamp: "Formatted at 2026-07-09 13:12:12 on dist-test-slave-c08m"
I20260709 13:12:12.383946 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602730526113-30972-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602730526113-30972-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602730526113-30972-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:12.415187 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:12.417065 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:12.419962 30972 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:12.425726 30972 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:12.426076 30972 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:12.426393 30972 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:12.426625 30972 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:12.521337 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.1:36579
I20260709 13:12:12.521466 31131 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.1:36579 every 8 connection(s)
I20260709 13:12:12.529282 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:12.547607 31136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:12.550498 31137 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:12.558635 30972 server_base.cc:1061] running on GCE node
W20260709 13:12:12.560401 31139 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:12.561753 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:12.562099 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:12.562338 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783602732562320 us; error 0 us; skew 500 ppm
I20260709 13:12:12.563284 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:12.569952 30972 webserver.cc:533] Webserver started at http://127.30.63.2:41109/ using document root <none> and password file <none>
I20260709 13:12:12.570628 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:12.570878 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:12.570919 31132 heartbeater.cc:344] Connected to a master server at 127.30.63.62:42305
I20260709 13:12:12.571275 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:12.571417 31132 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:12.572665 31132 heartbeater.cc:507] Master 127.30.63.62:42305 requested a full tablet report, sending...
I20260709 13:12:12.572821 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602730526113-30972-0/minicluster-data/ts-1-root/instance:
uuid: "3a308d97210c4aa2b2e354face3eaba6"
format_stamp: "Formatted at 2026-07-09 13:12:12 on dist-test-slave-c08m"
I20260709 13:12:12.576848 31004 ts_manager.cc:194] Registered new tserver with Master: c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579)
I20260709 13:12:12.579344 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:12:12.580525 31004 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39748
I20260709 13:12:12.585951 31144 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:12.587414 30972 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:12:12.587740 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602730526113-30972-0/minicluster-data/ts-1-root
uuid: "3a308d97210c4aa2b2e354face3eaba6"
format_stamp: "Formatted at 2026-07-09 13:12:12 on dist-test-slave-c08m"
I20260709 13:12:12.588099 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602730526113-30972-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602730526113-30972-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602730526113-30972-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:12.607712 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:12.609109 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:12.611819 30972 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:12.615842 30972 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:12.616045 30972 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:12.616344 30972 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:12.616487 30972 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:12.726258 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.2:46265
I20260709 13:12:12.726536 31206 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.2:46265 every 8 connection(s)
I20260709 13:12:12.737063 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:12.746234 31210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:12.750249 31211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:12.753119 31207 heartbeater.cc:344] Connected to a master server at 127.30.63.62:42305
I20260709 13:12:12.753729 31207 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:12.755760 31207 heartbeater.cc:507] Master 127.30.63.62:42305 requested a full tablet report, sending...
I20260709 13:12:12.759822 31004 ts_manager.cc:194] Registered new tserver with Master: 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265)
I20260709 13:12:12.763248 31004 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39764
W20260709 13:12:12.771574 31213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:12.772356 30972 server_base.cc:1061] running on GCE node
I20260709 13:12:12.773427 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:12.773684 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:12.773875 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783602732773859 us; error 0 us; skew 500 ppm
I20260709 13:12:12.774464 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:12.778030 30972 webserver.cc:533] Webserver started at http://127.30.63.3:34631/ using document root <none> and password file <none>
I20260709 13:12:12.778700 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:12.778944 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:12.779201 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:12.780547 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602730526113-30972-0/minicluster-data/ts-2-root/instance:
uuid: "bd884325e7c04a4881234aab42242565"
format_stamp: "Formatted at 2026-07-09 13:12:12 on dist-test-slave-c08m"
I20260709 13:12:12.785184 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:12:12.788858 31218 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:12.789762 30972 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:12:12.790081 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602730526113-30972-0/minicluster-data/ts-2-root
uuid: "bd884325e7c04a4881234aab42242565"
format_stamp: "Formatted at 2026-07-09 13:12:12 on dist-test-slave-c08m"
I20260709 13:12:12.790508 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602730526113-30972-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602730526113-30972-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602730526113-30972-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:12.805814 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:12.807096 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:12.809001 30972 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:12.812201 30972 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:12.812458 30972 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:12.812743 30972 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:12.812927 30972 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:12.913064 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.3:37049
I20260709 13:12:12.913585 31280 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.3:37049 every 8 connection(s)
I20260709 13:12:12.931237 31281 heartbeater.cc:344] Connected to a master server at 127.30.63.62:42305
I20260709 13:12:12.931672 31281 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:12.932662 31281 heartbeater.cc:507] Master 127.30.63.62:42305 requested a full tablet report, sending...
I20260709 13:12:12.934834 31004 ts_manager.cc:194] Registered new tserver with Master: bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:12.935075 30972 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016191978s
I20260709 13:12:12.936908 31004 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39780
I20260709 13:12:12.992681 31004 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39786:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:12.996927 31004 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:13.114315 31096 tablet_service.cc:1511] Processing CreateTablet for tablet fe04b62ac7494d05afaa4d1b0df2b52b (DEFAULT_TABLE table=test-workload [id=d2c2d98001474d2298a0edf4711ee18e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:13.116287 31097 tablet_service.cc:1511] Processing CreateTablet for tablet d600bdfab3484da2bdc8b47a47edfced (DEFAULT_TABLE table=test-workload [id=d2c2d98001474d2298a0edf4711ee18e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:13.117715 31094 tablet_service.cc:1511] Processing CreateTablet for tablet f381d6577987460089dd2bafc44bd7f0 (DEFAULT_TABLE table=test-workload [id=d2c2d98001474d2298a0edf4711ee18e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:13.117842 31172 tablet_service.cc:1511] Processing CreateTablet for tablet d600bdfab3484da2bdc8b47a47edfced (DEFAULT_TABLE table=test-workload [id=d2c2d98001474d2298a0edf4711ee18e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:13.119330 31172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d600bdfab3484da2bdc8b47a47edfced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.119570 31095 tablet_service.cc:1511] Processing CreateTablet for tablet 2023200c6d3742889adb5d28fb3614d9 (DEFAULT_TABLE table=test-workload [id=d2c2d98001474d2298a0edf4711ee18e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:13.120311 31171 tablet_service.cc:1511] Processing CreateTablet for tablet fe04b62ac7494d05afaa4d1b0df2b52b (DEFAULT_TABLE table=test-workload [id=d2c2d98001474d2298a0edf4711ee18e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:13.116321 31096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe04b62ac7494d05afaa4d1b0df2b52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.120808 31092 tablet_service.cc:1511] Processing CreateTablet for tablet aa80f98d0ce4477aa88171401d262c3f (DEFAULT_TABLE table=test-workload [id=d2c2d98001474d2298a0edf4711ee18e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:13.122243 31095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2023200c6d3742889adb5d28fb3614d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.122141 31170 tablet_service.cc:1511] Processing CreateTablet for tablet 2023200c6d3742889adb5d28fb3614d9 (DEFAULT_TABLE table=test-workload [id=d2c2d98001474d2298a0edf4711ee18e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:13.122948 31092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa80f98d0ce4477aa88171401d262c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.123073 31090 tablet_service.cc:1511] Processing CreateTablet for tablet d084968581fc49f5bb08a64e65c22b69 (DEFAULT_TABLE table=test-workload [id=d2c2d98001474d2298a0edf4711ee18e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:13.124571 31097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d600bdfab3484da2bdc8b47a47edfced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.126047 31171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe04b62ac7494d05afaa4d1b0df2b52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.133514 31090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d084968581fc49f5bb08a64e65c22b69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.144958 31168 tablet_service.cc:1511] Processing CreateTablet for tablet 01a1c64224014d3081d51a1b8b6bcacb (DEFAULT_TABLE table=test-workload [id=d2c2d98001474d2298a0edf4711ee18e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:13.138715 31170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2023200c6d3742889adb5d28fb3614d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.147642 31093 tablet_service.cc:1511] Processing CreateTablet for tablet 01a1c64224014d3081d51a1b8b6bcacb (DEFAULT_TABLE table=test-workload [id=d2c2d98001474d2298a0edf4711ee18e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:13.150233 31169 tablet_service.cc:1511] Processing CreateTablet for tablet f381d6577987460089dd2bafc44bd7f0 (DEFAULT_TABLE table=test-workload [id=d2c2d98001474d2298a0edf4711ee18e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:13.151520 31166 tablet_service.cc:1511] Processing CreateTablet for tablet 58e537dfd4154312b2eb43471b19774d (DEFAULT_TABLE table=test-workload [id=d2c2d98001474d2298a0edf4711ee18e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:13.152554 31165 tablet_service.cc:1511] Processing CreateTablet for tablet d084968581fc49f5bb08a64e65c22b69 (DEFAULT_TABLE table=test-workload [id=d2c2d98001474d2298a0edf4711ee18e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:13.152655 31167 tablet_service.cc:1511] Processing CreateTablet for tablet aa80f98d0ce4477aa88171401d262c3f (DEFAULT_TABLE table=test-workload [id=d2c2d98001474d2298a0edf4711ee18e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:13.149928 31094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f381d6577987460089dd2bafc44bd7f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.152760 31091 tablet_service.cc:1511] Processing CreateTablet for tablet 58e537dfd4154312b2eb43471b19774d (DEFAULT_TABLE table=test-workload [id=d2c2d98001474d2298a0edf4711ee18e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:13.166287 31093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01a1c64224014d3081d51a1b8b6bcacb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.156271 31168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01a1c64224014d3081d51a1b8b6bcacb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.168762 31167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa80f98d0ce4477aa88171401d262c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.170189 31169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f381d6577987460089dd2bafc44bd7f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.172058 31165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d084968581fc49f5bb08a64e65c22b69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.173631 31166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58e537dfd4154312b2eb43471b19774d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.175437 31091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58e537dfd4154312b2eb43471b19774d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.210202 31089 tablet_service.cc:1511] Processing CreateTablet for tablet f927a373038947bb917685c470b28d9d (DEFAULT_TABLE table=test-workload [id=d2c2d98001474d2298a0edf4711ee18e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:13.211963 31089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f927a373038947bb917685c470b28d9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.227223 31246 tablet_service.cc:1511] Processing CreateTablet for tablet d600bdfab3484da2bdc8b47a47edfced (DEFAULT_TABLE table=test-workload [id=d2c2d98001474d2298a0edf4711ee18e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:13.228670 31299 tablet_bootstrap.cc:492] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac: Bootstrap starting.
I20260709 13:12:13.243266 31246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d600bdfab3484da2bdc8b47a47edfced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.259007 31242 tablet_service.cc:1511] Processing CreateTablet for tablet 01a1c64224014d3081d51a1b8b6bcacb (DEFAULT_TABLE table=test-workload [id=d2c2d98001474d2298a0edf4711ee18e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:13.265066 31242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01a1c64224014d3081d51a1b8b6bcacb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.265249 31164 tablet_service.cc:1511] Processing CreateTablet for tablet f927a373038947bb917685c470b28d9d (DEFAULT_TABLE table=test-workload [id=d2c2d98001474d2298a0edf4711ee18e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:13.258930 31240 tablet_service.cc:1511] Processing CreateTablet for tablet 58e537dfd4154312b2eb43471b19774d (DEFAULT_TABLE table=test-workload [id=d2c2d98001474d2298a0edf4711ee18e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:13.285468 31238 tablet_service.cc:1511] Processing CreateTablet for tablet f927a373038947bb917685c470b28d9d (DEFAULT_TABLE table=test-workload [id=d2c2d98001474d2298a0edf4711ee18e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:13.289311 31243 tablet_service.cc:1511] Processing CreateTablet for tablet f381d6577987460089dd2bafc44bd7f0 (DEFAULT_TABLE table=test-workload [id=d2c2d98001474d2298a0edf4711ee18e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:13.299820 31243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f381d6577987460089dd2bafc44bd7f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.286772 31164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f927a373038947bb917685c470b28d9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.302605 31239 tablet_service.cc:1511] Processing CreateTablet for tablet d084968581fc49f5bb08a64e65c22b69 (DEFAULT_TABLE table=test-workload [id=d2c2d98001474d2298a0edf4711ee18e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:13.255254 31241 tablet_service.cc:1511] Processing CreateTablet for tablet aa80f98d0ce4477aa88171401d262c3f (DEFAULT_TABLE table=test-workload [id=d2c2d98001474d2298a0edf4711ee18e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:13.303373 31245 tablet_service.cc:1511] Processing CreateTablet for tablet fe04b62ac7494d05afaa4d1b0df2b52b (DEFAULT_TABLE table=test-workload [id=d2c2d98001474d2298a0edf4711ee18e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
W20260709 13:12:13.319228 31051 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:13.318303 31244 tablet_service.cc:1511] Processing CreateTablet for tablet 2023200c6d3742889adb5d28fb3614d9 (DEFAULT_TABLE table=test-workload [id=d2c2d98001474d2298a0edf4711ee18e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:13.325980 31238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f927a373038947bb917685c470b28d9d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:13.323992 30991 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.30.63.1:36579, user_credentials={real_user=slave}} blocked reactor thread for 43858.6us
I20260709 13:12:13.328303 31240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58e537dfd4154312b2eb43471b19774d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.332437 31244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2023200c6d3742889adb5d28fb3614d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.333659 31245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe04b62ac7494d05afaa4d1b0df2b52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.340271 31241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa80f98d0ce4477aa88171401d262c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.373638 31239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d084968581fc49f5bb08a64e65c22b69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.460484 31301 tablet_bootstrap.cc:492] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565: Bootstrap starting.
I20260709 13:12:13.470439 31299 tablet_bootstrap.cc:654] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.475200 31301 tablet_bootstrap.cc:654] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.485553 31300 tablet_bootstrap.cc:492] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6: Bootstrap starting.
I20260709 13:12:13.499037 31299 tablet_bootstrap.cc:492] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac: No bootstrap required, opened a new log
I20260709 13:12:13.501614 31299 ts_tablet_manager.cc:1403] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac: Time spent bootstrapping tablet: real 0.273s	user 0.015s	sys 0.010s
I20260709 13:12:13.507017 31301 tablet_bootstrap.cc:492] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565: No bootstrap required, opened a new log
I20260709 13:12:13.507339 31300 tablet_bootstrap.cc:654] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.507637 31301 ts_tablet_manager.cc:1403] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565: Time spent bootstrapping tablet: real 0.048s	user 0.021s	sys 0.006s
I20260709 13:12:13.509167 31299 raft_consensus.cc:359] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.511484 31299 raft_consensus.cc:385] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.512511 31299 raft_consensus.cc:740] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c642698d21b74372809ac4b52afb84ac, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.512835 31301 raft_consensus.cc:359] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.513651 31301 raft_consensus.cc:385] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.513384 31299 consensus_queue.cc:260] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.514021 31301 raft_consensus.cc:740] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd884325e7c04a4881234aab42242565, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.514385 31300 tablet_bootstrap.cc:492] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6: No bootstrap required, opened a new log
I20260709 13:12:13.514840 31300 ts_tablet_manager.cc:1403] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6: Time spent bootstrapping tablet: real 0.047s	user 0.000s	sys 0.014s
I20260709 13:12:13.514909 31301 consensus_queue.cc:260] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.518731 31132 heartbeater.cc:499] Master 127.30.63.62:42305 was elected leader, sending a full tablet report...
I20260709 13:12:13.521858 31299 ts_tablet_manager.cc:1434] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.006s
I20260709 13:12:13.522964 31299 tablet_bootstrap.cc:492] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac: Bootstrap starting.
I20260709 13:12:13.525538 31300 raft_consensus.cc:359] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.526494 31300 raft_consensus.cc:385] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.526852 31300 raft_consensus.cc:740] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a308d97210c4aa2b2e354face3eaba6, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.527925 31300 consensus_queue.cc:260] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.530251 31301 ts_tablet_manager.cc:1434] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.008s
I20260709 13:12:13.531144 31281 heartbeater.cc:499] Master 127.30.63.62:42305 was elected leader, sending a full tablet report...
I20260709 13:12:13.536427 31301 tablet_bootstrap.cc:492] T 01a1c64224014d3081d51a1b8b6bcacb P bd884325e7c04a4881234aab42242565: Bootstrap starting.
W20260709 13:12:13.537695 31133 tablet.cc:2406] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:12:13.545902 31301 tablet_bootstrap.cc:654] T 01a1c64224014d3081d51a1b8b6bcacb P bd884325e7c04a4881234aab42242565: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.563429 31299 tablet_bootstrap.cc:654] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.588009 31207 heartbeater.cc:499] Master 127.30.63.62:42305 was elected leader, sending a full tablet report...
I20260709 13:12:13.588723 31300 ts_tablet_manager.cc:1434] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6: Time spent starting tablet: real 0.073s	user 0.031s	sys 0.035s
I20260709 13:12:13.589857 31300 tablet_bootstrap.cc:492] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6: Bootstrap starting.
I20260709 13:12:13.597054 31300 tablet_bootstrap.cc:654] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.599676 31299 tablet_bootstrap.cc:492] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac: No bootstrap required, opened a new log
I20260709 13:12:13.600208 31299 ts_tablet_manager.cc:1403] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac: Time spent bootstrapping tablet: real 0.077s	user 0.006s	sys 0.013s
I20260709 13:12:13.603176 31299 raft_consensus.cc:359] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.603945 31299 raft_consensus.cc:385] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.604863 31299 raft_consensus.cc:740] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c642698d21b74372809ac4b52afb84ac, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.605614 31299 consensus_queue.cc:260] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.606629 31301 tablet_bootstrap.cc:492] T 01a1c64224014d3081d51a1b8b6bcacb P bd884325e7c04a4881234aab42242565: No bootstrap required, opened a new log
I20260709 13:12:13.607359 31301 ts_tablet_manager.cc:1403] T 01a1c64224014d3081d51a1b8b6bcacb P bd884325e7c04a4881234aab42242565: Time spent bootstrapping tablet: real 0.071s	user 0.018s	sys 0.035s
I20260709 13:12:13.612388 31301 raft_consensus.cc:359] T 01a1c64224014d3081d51a1b8b6bcacb P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.613250 31301 raft_consensus.cc:385] T 01a1c64224014d3081d51a1b8b6bcacb P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.613541 31301 raft_consensus.cc:740] T 01a1c64224014d3081d51a1b8b6bcacb P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd884325e7c04a4881234aab42242565, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.614269 31301 consensus_queue.cc:260] T 01a1c64224014d3081d51a1b8b6bcacb P bd884325e7c04a4881234aab42242565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.615267 31300 tablet_bootstrap.cc:492] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6: No bootstrap required, opened a new log
I20260709 13:12:13.615792 31300 ts_tablet_manager.cc:1403] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.012s
I20260709 13:12:13.619140 31301 ts_tablet_manager.cc:1434] T 01a1c64224014d3081d51a1b8b6bcacb P bd884325e7c04a4881234aab42242565: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:12:13.618700 31300 raft_consensus.cc:359] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.619812 31300 raft_consensus.cc:385] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.620330 31301 tablet_bootstrap.cc:492] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565: Bootstrap starting.
I20260709 13:12:13.620280 31300 raft_consensus.cc:740] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a308d97210c4aa2b2e354face3eaba6, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.621025 31299 ts_tablet_manager.cc:1434] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.001s
I20260709 13:12:13.621323 31300 consensus_queue.cc:260] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.623927 31300 ts_tablet_manager.cc:1434] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:12:13.625070 31300 tablet_bootstrap.cc:492] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6: Bootstrap starting.
I20260709 13:12:13.627470 31299 tablet_bootstrap.cc:492] T f927a373038947bb917685c470b28d9d P c642698d21b74372809ac4b52afb84ac: Bootstrap starting.
I20260709 13:12:13.628144 31301 tablet_bootstrap.cc:654] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.632962 31300 tablet_bootstrap.cc:654] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.642979 31299 tablet_bootstrap.cc:654] T f927a373038947bb917685c470b28d9d P c642698d21b74372809ac4b52afb84ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.649606 31301 tablet_bootstrap.cc:492] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565: No bootstrap required, opened a new log
I20260709 13:12:13.650112 31301 ts_tablet_manager.cc:1403] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.008s
I20260709 13:12:13.650856 31300 tablet_bootstrap.cc:492] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6: No bootstrap required, opened a new log
I20260709 13:12:13.651372 31300 ts_tablet_manager.cc:1403] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.008s
I20260709 13:12:13.654179 31301 raft_consensus.cc:359] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.654342 31300 raft_consensus.cc:359] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.654978 31301 raft_consensus.cc:385] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.655355 31300 raft_consensus.cc:385] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.655288 31301 raft_consensus.cc:740] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd884325e7c04a4881234aab42242565, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.655808 31300 raft_consensus.cc:740] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a308d97210c4aa2b2e354face3eaba6, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.656224 31301 consensus_queue.cc:260] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.656615 31300 consensus_queue.cc:260] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.658460 31301 ts_tablet_manager.cc:1434] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:12:13.661949 31300 ts_tablet_manager.cc:1434] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:12:13.663017 31300 tablet_bootstrap.cc:492] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6: Bootstrap starting.
I20260709 13:12:13.663489 31301 tablet_bootstrap.cc:492] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565: Bootstrap starting.
I20260709 13:12:13.670136 31300 tablet_bootstrap.cc:654] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.673451 31301 tablet_bootstrap.cc:654] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.677817 31299 tablet_bootstrap.cc:492] T f927a373038947bb917685c470b28d9d P c642698d21b74372809ac4b52afb84ac: No bootstrap required, opened a new log
I20260709 13:12:13.678342 31299 ts_tablet_manager.cc:1403] T f927a373038947bb917685c470b28d9d P c642698d21b74372809ac4b52afb84ac: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.007s
I20260709 13:12:13.681354 31299 raft_consensus.cc:359] T f927a373038947bb917685c470b28d9d P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.682116 31299 raft_consensus.cc:385] T f927a373038947bb917685c470b28d9d P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.682413 31299 raft_consensus.cc:740] T f927a373038947bb917685c470b28d9d P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c642698d21b74372809ac4b52afb84ac, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.682766 31300 tablet_bootstrap.cc:492] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6: No bootstrap required, opened a new log
I20260709 13:12:13.682825 31301 tablet_bootstrap.cc:492] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565: No bootstrap required, opened a new log
I20260709 13:12:13.683367 31300 ts_tablet_manager.cc:1403] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:12:13.683403 31301 ts_tablet_manager.cc:1403] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.002s
I20260709 13:12:13.683156 31299 consensus_queue.cc:260] T f927a373038947bb917685c470b28d9d P c642698d21b74372809ac4b52afb84ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.687314 31301 raft_consensus.cc:359] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.688238 31299 ts_tablet_manager.cc:1434] T f927a373038947bb917685c470b28d9d P c642698d21b74372809ac4b52afb84ac: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:12:13.688304 31301 raft_consensus.cc:385] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.688890 31301 raft_consensus.cc:740] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd884325e7c04a4881234aab42242565, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.689357 31299 tablet_bootstrap.cc:492] T d084968581fc49f5bb08a64e65c22b69 P c642698d21b74372809ac4b52afb84ac: Bootstrap starting.
I20260709 13:12:13.689842 31301 consensus_queue.cc:260] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.694226 31301 ts_tablet_manager.cc:1434] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:12:13.686779 31300 raft_consensus.cc:359] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.695302 31300 raft_consensus.cc:385] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.695549 31301 tablet_bootstrap.cc:492] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565: Bootstrap starting.
I20260709 13:12:13.695638 31300 raft_consensus.cc:740] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a308d97210c4aa2b2e354face3eaba6, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.696676 31300 consensus_queue.cc:260] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.698848 31300 ts_tablet_manager.cc:1434] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:12:13.699806 31300 tablet_bootstrap.cc:492] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6: Bootstrap starting.
I20260709 13:12:13.706516 31300 tablet_bootstrap.cc:654] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.713665 31299 tablet_bootstrap.cc:654] T d084968581fc49f5bb08a64e65c22b69 P c642698d21b74372809ac4b52afb84ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.719765 31301 tablet_bootstrap.cc:654] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.724328 31300 tablet_bootstrap.cc:492] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6: No bootstrap required, opened a new log
I20260709 13:12:13.725040 31300 ts_tablet_manager.cc:1403] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.009s
I20260709 13:12:13.728345 31306 raft_consensus.cc:493] T 01a1c64224014d3081d51a1b8b6bcacb P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.728924 31306 raft_consensus.cc:515] T 01a1c64224014d3081d51a1b8b6bcacb P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.729467 31300 raft_consensus.cc:359] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.730181 31300 raft_consensus.cc:385] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.730476 31300 raft_consensus.cc:740] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a308d97210c4aa2b2e354face3eaba6, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.731204 31300 consensus_queue.cc:260] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.734356 31300 ts_tablet_manager.cc:1434] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 13:12:13.737118 31299 tablet_bootstrap.cc:492] T d084968581fc49f5bb08a64e65c22b69 P c642698d21b74372809ac4b52afb84ac: No bootstrap required, opened a new log
I20260709 13:12:13.742049 31306 leader_election.cc:290] T 01a1c64224014d3081d51a1b8b6bcacb P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265)
I20260709 13:12:13.745543 31299 ts_tablet_manager.cc:1403] T d084968581fc49f5bb08a64e65c22b69 P c642698d21b74372809ac4b52afb84ac: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.016s
I20260709 13:12:13.750967 31306 raft_consensus.cc:493] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.752132 31306 raft_consensus.cc:515] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.754282 31306 leader_election.cc:290] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265)
I20260709 13:12:13.765316 31300 tablet_bootstrap.cc:492] T 2023200c6d3742889adb5d28fb3614d9 P 3a308d97210c4aa2b2e354face3eaba6: Bootstrap starting.
I20260709 13:12:13.773638 31299 raft_consensus.cc:359] T d084968581fc49f5bb08a64e65c22b69 P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.774209 31301 tablet_bootstrap.cc:492] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565: No bootstrap required, opened a new log
I20260709 13:12:13.774411 31299 raft_consensus.cc:385] T d084968581fc49f5bb08a64e65c22b69 P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.774677 31301 ts_tablet_manager.cc:1403] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565: Time spent bootstrapping tablet: real 0.080s	user 0.024s	sys 0.027s
I20260709 13:12:13.774695 31299 raft_consensus.cc:740] T d084968581fc49f5bb08a64e65c22b69 P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c642698d21b74372809ac4b52afb84ac, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.778360 31299 consensus_queue.cc:260] T d084968581fc49f5bb08a64e65c22b69 P c642698d21b74372809ac4b52afb84ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.781039 31299 ts_tablet_manager.cc:1434] T d084968581fc49f5bb08a64e65c22b69 P c642698d21b74372809ac4b52afb84ac: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.003s
I20260709 13:12:13.782027 31299 tablet_bootstrap.cc:492] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac: Bootstrap starting.
I20260709 13:12:13.783241 31300 tablet_bootstrap.cc:654] T 2023200c6d3742889adb5d28fb3614d9 P 3a308d97210c4aa2b2e354face3eaba6: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.785503 31301 raft_consensus.cc:359] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.786420 31301 raft_consensus.cc:385] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.787177 31301 raft_consensus.cc:740] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd884325e7c04a4881234aab42242565, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.788192 31301 consensus_queue.cc:260] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.790916 31301 ts_tablet_manager.cc:1434] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.001s
I20260709 13:12:13.796834 31301 tablet_bootstrap.cc:492] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565: Bootstrap starting.
I20260709 13:12:13.806440 31181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084968581fc49f5bb08a64e65c22b69" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a308d97210c4aa2b2e354face3eaba6" is_pre_election: true
I20260709 13:12:13.807680 31181 raft_consensus.cc:2468] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd884325e7c04a4881234aab42242565 in term 0.
I20260709 13:12:13.805706 31182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a1c64224014d3081d51a1b8b6bcacb" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a308d97210c4aa2b2e354face3eaba6" is_pre_election: true
I20260709 13:12:13.808899 31299 tablet_bootstrap.cc:654] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.810884 31219 leader_election.cc:304] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a308d97210c4aa2b2e354face3eaba6, bd884325e7c04a4881234aab42242565; no voters: 
I20260709 13:12:13.812075 31306 raft_consensus.cc:493] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.814213 31307 raft_consensus.cc:493] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.818189 31307 raft_consensus.cc:515] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.813124 31306 raft_consensus.cc:515] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.821273 31106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084968581fc49f5bb08a64e65c22b69" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c642698d21b74372809ac4b52afb84ac" is_pre_election: true
I20260709 13:12:13.822125 31106 raft_consensus.cc:2468] T d084968581fc49f5bb08a64e65c22b69 P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd884325e7c04a4881234aab42242565 in term 0.
I20260709 13:12:13.822851 31306 leader_election.cc:290] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265), c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579)
I20260709 13:12:13.820415 31107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a1c64224014d3081d51a1b8b6bcacb" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c642698d21b74372809ac4b52afb84ac" is_pre_election: true
I20260709 13:12:13.823542 31306 raft_consensus.cc:2804] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:13.824016 31306 raft_consensus.cc:493] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.825280 31306 raft_consensus.cc:3060] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:13.826828 31307 leader_election.cc:290] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
W20260709 13:12:13.829918 31222 leader_election.cc:343] T 01a1c64224014d3081d51a1b8b6bcacb P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:13.831981 31107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d600bdfab3484da2bdc8b47a47edfced" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c642698d21b74372809ac4b52afb84ac" is_pre_election: true
I20260709 13:12:13.842219 31107 raft_consensus.cc:2468] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd884325e7c04a4881234aab42242565 in term 0.
I20260709 13:12:13.843834 31222 leader_election.cc:304] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd884325e7c04a4881234aab42242565, c642698d21b74372809ac4b52afb84ac; no voters: 
I20260709 13:12:13.848439 31324 raft_consensus.cc:2804] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:13.849050 31324 raft_consensus.cc:493] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.849493 31324 raft_consensus.cc:3060] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:13.840230 31219 leader_election.cc:343] T 01a1c64224014d3081d51a1b8b6bcacb P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:13.868862 31300 tablet_bootstrap.cc:492] T 2023200c6d3742889adb5d28fb3614d9 P 3a308d97210c4aa2b2e354face3eaba6: No bootstrap required, opened a new log
I20260709 13:12:13.874449 31182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d600bdfab3484da2bdc8b47a47edfced" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a308d97210c4aa2b2e354face3eaba6" is_pre_election: true
I20260709 13:12:13.878639 31300 ts_tablet_manager.cc:1403] T 2023200c6d3742889adb5d28fb3614d9 P 3a308d97210c4aa2b2e354face3eaba6: Time spent bootstrapping tablet: real 0.114s	user 0.021s	sys 0.004s
I20260709 13:12:13.885900 31299 tablet_bootstrap.cc:492] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac: No bootstrap required, opened a new log
I20260709 13:12:13.886427 31299 ts_tablet_manager.cc:1403] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac: Time spent bootstrapping tablet: real 0.105s	user 0.010s	sys 0.009s
I20260709 13:12:13.886574 31301 tablet_bootstrap.cc:654] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.889217 31329 raft_consensus.cc:493] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.889948 31329 raft_consensus.cc:515] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.890861 31299 raft_consensus.cc:359] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.891839 31299 raft_consensus.cc:385] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.892128 31299 raft_consensus.cc:740] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c642698d21b74372809ac4b52afb84ac, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.893242 31299 consensus_queue.cc:260] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.893987 31300 raft_consensus.cc:359] T 2023200c6d3742889adb5d28fb3614d9 P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.894675 31300 raft_consensus.cc:385] T 2023200c6d3742889adb5d28fb3614d9 P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.894959 31300 raft_consensus.cc:740] T 2023200c6d3742889adb5d28fb3614d9 P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a308d97210c4aa2b2e354face3eaba6, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.897262 31219 leader_election.cc:304] T 01a1c64224014d3081d51a1b8b6bcacb P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd884325e7c04a4881234aab42242565; no voters: 3a308d97210c4aa2b2e354face3eaba6, c642698d21b74372809ac4b52afb84ac
I20260709 13:12:13.899294 31329 leader_election.cc:290] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265)
I20260709 13:12:13.899842 31329 raft_consensus.cc:2749] T 01a1c64224014d3081d51a1b8b6bcacb P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:13.902423 31299 ts_tablet_manager.cc:1434] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 13:12:13.897624 31306 raft_consensus.cc:515] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.900171 31300 consensus_queue.cc:260] T 2023200c6d3742889adb5d28fb3614d9 P 3a308d97210c4aa2b2e354face3eaba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.904215 31324 raft_consensus.cc:515] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.907863 31107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2023200c6d3742889adb5d28fb3614d9" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c642698d21b74372809ac4b52afb84ac" is_pre_election: true
I20260709 13:12:13.908550 31107 raft_consensus.cc:2468] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd884325e7c04a4881234aab42242565 in term 0.
I20260709 13:12:13.912921 31299 tablet_bootstrap.cc:492] T 58e537dfd4154312b2eb43471b19774d P c642698d21b74372809ac4b52afb84ac: Bootstrap starting.
I20260709 13:12:13.913492 31106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d600bdfab3484da2bdc8b47a47edfced" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c642698d21b74372809ac4b52afb84ac"
I20260709 13:12:13.914053 31106 raft_consensus.cc:3060] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:13.909430 31324 leader_election.cc:290] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 election: Requested vote from peers 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265), c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579)
I20260709 13:12:13.917506 31222 leader_election.cc:304] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd884325e7c04a4881234aab42242565, c642698d21b74372809ac4b52afb84ac; no voters: 
I20260709 13:12:13.924454 31324 raft_consensus.cc:2804] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:13.925199 31324 raft_consensus.cc:493] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.925540 31324 raft_consensus.cc:3060] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:13.927551 31107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084968581fc49f5bb08a64e65c22b69" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c642698d21b74372809ac4b52afb84ac"
I20260709 13:12:13.928267 31107 raft_consensus.cc:3060] T d084968581fc49f5bb08a64e65c22b69 P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:13.935587 31299 tablet_bootstrap.cc:654] T 58e537dfd4154312b2eb43471b19774d P c642698d21b74372809ac4b52afb84ac: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:13.937122 31219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:46265, user_credentials={real_user=slave}} blocked reactor thread for 107524us
I20260709 13:12:13.950677 31306 leader_election.cc:290] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 election: Requested vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265)
I20260709 13:12:13.962756 31181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d600bdfab3484da2bdc8b47a47edfced" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
W20260709 13:12:13.966492 31219 leader_election.cc:343] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:13.970533 31219 leader_election.cc:343] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:13.972508 31324 raft_consensus.cc:515] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.973333 31105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f381d6577987460089dd2bafc44bd7f0" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c642698d21b74372809ac4b52afb84ac" is_pre_election: true
I20260709 13:12:13.955621 31182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2023200c6d3742889adb5d28fb3614d9" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a308d97210c4aa2b2e354face3eaba6" is_pre_election: true
W20260709 13:12:13.976078 31148 leader_election.cc:343] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:13.975659 31181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084968581fc49f5bb08a64e65c22b69" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
I20260709 13:12:13.976639 31105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2023200c6d3742889adb5d28fb3614d9" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c642698d21b74372809ac4b52afb84ac"
I20260709 13:12:13.977221 31105 raft_consensus.cc:3060] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:13.977373 31182 raft_consensus.cc:2468] T 2023200c6d3742889adb5d28fb3614d9 P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd884325e7c04a4881234aab42242565 in term 0.
I20260709 13:12:13.977190 31181 raft_consensus.cc:3060] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:13.952821 31305 raft_consensus.cc:493] T f927a373038947bb917685c470b28d9d P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.977905 31300 ts_tablet_manager.cc:1434] T 2023200c6d3742889adb5d28fb3614d9 P 3a308d97210c4aa2b2e354face3eaba6: Time spent starting tablet: real 0.096s	user 0.005s	sys 0.003s
I20260709 13:12:13.982005 31300 tablet_bootstrap.cc:492] T d600bdfab3484da2bdc8b47a47edfced P 3a308d97210c4aa2b2e354face3eaba6: Bootstrap starting.
I20260709 13:12:13.988207 31324 leader_election.cc:290] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 election: Requested vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265)
I20260709 13:12:13.989946 31182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2023200c6d3742889adb5d28fb3614d9" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
I20260709 13:12:13.990546 31182 raft_consensus.cc:3060] T 2023200c6d3742889adb5d28fb3614d9 P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:13.986186 31305 raft_consensus.cc:515] T f927a373038947bb917685c470b28d9d P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:13.984961 31330 raft_consensus.cc:493] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.991523 31106 raft_consensus.cc:2468] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd884325e7c04a4881234aab42242565 in term 1.
I20260709 13:12:14.001380 31222 leader_election.cc:304] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bd884325e7c04a4881234aab42242565, c642698d21b74372809ac4b52afb84ac; no voters: 3a308d97210c4aa2b2e354face3eaba6
I20260709 13:12:14.002714 31324 raft_consensus.cc:2804] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:14.007690 31301 tablet_bootstrap.cc:492] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565: No bootstrap required, opened a new log
I20260709 13:12:14.004501 31324 raft_consensus.cc:697] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 1 LEADER]: Becoming Leader. State: Replica: bd884325e7c04a4881234aab42242565, State: Running, Role: LEADER
I20260709 13:12:13.999507 31330 raft_consensus.cc:515] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.008720 31324 consensus_queue.cc:237] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.012159 31301 ts_tablet_manager.cc:1403] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565: Time spent bootstrapping tablet: real 0.216s	user 0.020s	sys 0.053s
I20260709 13:12:14.005551 31107 raft_consensus.cc:2468] T d084968581fc49f5bb08a64e65c22b69 P c642698d21b74372809ac4b52afb84ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd884325e7c04a4881234aab42242565 in term 1.
I20260709 13:12:14.012722 31305 leader_election.cc:290] T f927a373038947bb917685c470b28d9d P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:14.015524 31305 raft_consensus.cc:493] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.016103 31305 raft_consensus.cc:515] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.025365 31222 leader_election.cc:304] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd884325e7c04a4881234aab42242565, c642698d21b74372809ac4b52afb84ac; no voters: 
I20260709 13:12:14.026216 31306 raft_consensus.cc:2804] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:14.028262 31306 raft_consensus.cc:697] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [term 1 LEADER]: Becoming Leader. State: Replica: bd884325e7c04a4881234aab42242565, State: Running, Role: LEADER
I20260709 13:12:14.032707 31307 raft_consensus.cc:493] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.033012 31306 consensus_queue.cc:237] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.033196 31307 raft_consensus.cc:515] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.033442 31107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f381d6577987460089dd2bafc44bd7f0" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c642698d21b74372809ac4b52afb84ac" is_pre_election: true
W20260709 13:12:14.035211 31222 leader_election.cc:343] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:14.035673 31307 leader_election.cc:290] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:14.036978 31106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa80f98d0ce4477aa88171401d262c3f" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c642698d21b74372809ac4b52afb84ac" is_pre_election: true
I20260709 13:12:14.038054 31106 raft_consensus.cc:2468] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a308d97210c4aa2b2e354face3eaba6 in term 0.
I20260709 13:12:14.040381 31148 leader_election.cc:304] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a308d97210c4aa2b2e354face3eaba6, c642698d21b74372809ac4b52afb84ac; no voters: 
I20260709 13:12:14.043242 31307 raft_consensus.cc:2804] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:14.043633 31307 raft_consensus.cc:493] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.043970 31307 raft_consensus.cc:3060] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.046118 31180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f381d6577987460089dd2bafc44bd7f0" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a308d97210c4aa2b2e354face3eaba6" is_pre_election: true
I20260709 13:12:14.039660 31305 leader_election.cc:290] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:14.049580 31181 raft_consensus.cc:2468] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd884325e7c04a4881234aab42242565 in term 1.
I20260709 13:12:14.047945 31180 raft_consensus.cc:2468] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd884325e7c04a4881234aab42242565 in term 0.
I20260709 13:12:14.050290 31105 raft_consensus.cc:2468] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd884325e7c04a4881234aab42242565 in term 1.
I20260709 13:12:14.054912 31219 leader_election.cc:304] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a308d97210c4aa2b2e354face3eaba6, bd884325e7c04a4881234aab42242565; no voters: c642698d21b74372809ac4b52afb84ac
I20260709 13:12:14.045228 31330 leader_election.cc:290] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265)
I20260709 13:12:14.057583 31256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f381d6577987460089dd2bafc44bd7f0" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd884325e7c04a4881234aab42242565" is_pre_election: true
I20260709 13:12:14.056134 31182 raft_consensus.cc:2468] T 2023200c6d3742889adb5d28fb3614d9 P 3a308d97210c4aa2b2e354face3eaba6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd884325e7c04a4881234aab42242565 in term 1.
I20260709 13:12:14.058895 31255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa80f98d0ce4477aa88171401d262c3f" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd884325e7c04a4881234aab42242565" is_pre_election: true
I20260709 13:12:14.060472 31222 leader_election.cc:304] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd884325e7c04a4881234aab42242565, c642698d21b74372809ac4b52afb84ac; no voters: 
I20260709 13:12:14.061581 31256 raft_consensus.cc:2468] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a308d97210c4aa2b2e354face3eaba6 in term 0.
I20260709 13:12:14.060487 31301 raft_consensus.cc:359] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.062251 31330 raft_consensus.cc:2804] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:14.063055 31329 raft_consensus.cc:2804] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:14.065712 31329 raft_consensus.cc:493] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.066116 31329 raft_consensus.cc:3060] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.063213 31301 raft_consensus.cc:385] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.070343 31147 leader_election.cc:304] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a308d97210c4aa2b2e354face3eaba6, bd884325e7c04a4881234aab42242565; no voters: c642698d21b74372809ac4b52afb84ac
I20260709 13:12:14.070873 31301 raft_consensus.cc:740] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd884325e7c04a4881234aab42242565, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.077797 31299 tablet_bootstrap.cc:492] T 58e537dfd4154312b2eb43471b19774d P c642698d21b74372809ac4b52afb84ac: No bootstrap required, opened a new log
I20260709 13:12:14.078509 31299 ts_tablet_manager.cc:1403] T 58e537dfd4154312b2eb43471b19774d P c642698d21b74372809ac4b52afb84ac: Time spent bootstrapping tablet: real 0.169s	user 0.011s	sys 0.013s
I20260709 13:12:14.084241 31299 raft_consensus.cc:359] T 58e537dfd4154312b2eb43471b19774d P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.085389 31299 raft_consensus.cc:385] T 58e537dfd4154312b2eb43471b19774d P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.085856 31299 raft_consensus.cc:740] T 58e537dfd4154312b2eb43471b19774d P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c642698d21b74372809ac4b52afb84ac, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.086864 31299 consensus_queue.cc:260] T 58e537dfd4154312b2eb43471b19774d P c642698d21b74372809ac4b52afb84ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.088521 31307 raft_consensus.cc:515] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.111341 31299 ts_tablet_manager.cc:1434] T 58e537dfd4154312b2eb43471b19774d P c642698d21b74372809ac4b52afb84ac: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.001s
I20260709 13:12:14.112550 31299 tablet_bootstrap.cc:492] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac: Bootstrap starting.
I20260709 13:12:14.130124 31338 raft_consensus.cc:2804] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:14.130721 31338 raft_consensus.cc:493] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.131212 31338 raft_consensus.cc:3060] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.095405 31301 consensus_queue.cc:260] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.142783 31255 raft_consensus.cc:2468] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a308d97210c4aa2b2e354face3eaba6 in term 0.
I20260709 13:12:14.155284 31256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa80f98d0ce4477aa88171401d262c3f" candidate_uuid: "c642698d21b74372809ac4b52afb84ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd884325e7c04a4881234aab42242565" is_pre_election: true
I20260709 13:12:14.156689 31256 raft_consensus.cc:2468] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c642698d21b74372809ac4b52afb84ac in term 0.
I20260709 13:12:14.149911 31300 tablet_bootstrap.cc:654] T d600bdfab3484da2bdc8b47a47edfced P 3a308d97210c4aa2b2e354face3eaba6: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.160552 31072 leader_election.cc:304] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd884325e7c04a4881234aab42242565, c642698d21b74372809ac4b52afb84ac; no voters: 
I20260709 13:12:14.161681 31255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f927a373038947bb917685c470b28d9d" candidate_uuid: "c642698d21b74372809ac4b52afb84ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd884325e7c04a4881234aab42242565" is_pre_election: true
I20260709 13:12:14.164337 31307 leader_election.cc:290] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 1 election: Requested vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:14.166158 31256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa80f98d0ce4477aa88171401d262c3f" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd884325e7c04a4881234aab42242565"
I20260709 13:12:14.156800 31002 catalog_manager.cc:5697] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd884325e7c04a4881234aab42242565 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "bd884325e7c04a4881234aab42242565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:14.170033 31341 raft_consensus.cc:493] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.172245 31305 raft_consensus.cc:2804] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:14.175366 31301 ts_tablet_manager.cc:1434] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565: Time spent starting tablet: real 0.162s	user 0.006s	sys 0.002s
I20260709 13:12:14.175958 31330 raft_consensus.cc:697] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [term 1 LEADER]: Becoming Leader. State: Replica: bd884325e7c04a4881234aab42242565, State: Running, Role: LEADER
I20260709 13:12:14.177532 31256 raft_consensus.cc:3060] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.178678 31305 raft_consensus.cc:493] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:14.179963 31072 leader_election.cc:343] T f927a373038947bb917685c470b28d9d P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd884325e7c04a4881234aab42242565 (127.30.63.3:37049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:14.179445 31105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa80f98d0ce4477aa88171401d262c3f" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c642698d21b74372809ac4b52afb84ac"
I20260709 13:12:14.178872 31307 raft_consensus.cc:493] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.181442 31305 raft_consensus.cc:3060] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.183584 31307 raft_consensus.cc:515] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.182482 31330 consensus_queue.cc:237] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.190045 31301 tablet_bootstrap.cc:492] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565: Bootstrap starting.
I20260709 13:12:14.194037 31182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f927a373038947bb917685c470b28d9d" candidate_uuid: "c642698d21b74372809ac4b52afb84ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a308d97210c4aa2b2e354face3eaba6" is_pre_election: true
I20260709 13:12:14.191213 31338 raft_consensus.cc:515] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.181596 31341 raft_consensus.cc:515] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.220048 31305 raft_consensus.cc:515] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.227242 31106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe04b62ac7494d05afaa4d1b0df2b52b" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c642698d21b74372809ac4b52afb84ac" is_pre_election: true
I20260709 13:12:14.195325 31181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa80f98d0ce4477aa88171401d262c3f" candidate_uuid: "c642698d21b74372809ac4b52afb84ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a308d97210c4aa2b2e354face3eaba6" is_pre_election: true
I20260709 13:12:14.211618 31299 tablet_bootstrap.cc:654] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:14.230790 31070 leader_election.cc:343] T f927a373038947bb917685c470b28d9d P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:14.239661 31148 leader_election.cc:343] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:14.240163 31105 raft_consensus.cc:2393] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3a308d97210c4aa2b2e354face3eaba6 in current term 1: Already voted for candidate c642698d21b74372809ac4b52afb84ac in this term.
I20260709 13:12:14.203644 31329 raft_consensus.cc:515] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.240780 31070 leader_election.cc:304] T f927a373038947bb917685c470b28d9d P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c642698d21b74372809ac4b52afb84ac; no voters: 3a308d97210c4aa2b2e354face3eaba6, bd884325e7c04a4881234aab42242565
I20260709 13:12:14.245618 31255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe04b62ac7494d05afaa4d1b0df2b52b" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd884325e7c04a4881234aab42242565" is_pre_election: true
I20260709 13:12:14.248078 31332 raft_consensus.cc:2749] T f927a373038947bb917685c470b28d9d P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:14.242260 31181 raft_consensus.cc:2393] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c642698d21b74372809ac4b52afb84ac in current term 1: Already voted for candidate 3a308d97210c4aa2b2e354face3eaba6 in this term.
I20260709 13:12:14.226271 31256 raft_consensus.cc:2468] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a308d97210c4aa2b2e354face3eaba6 in term 1.
W20260709 13:12:14.248332 31147 leader_election.cc:343] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd884325e7c04a4881234aab42242565 (127.30.63.3:37049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:14.230394 31307 leader_election.cc:290] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:14.251041 31147 leader_election.cc:304] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a308d97210c4aa2b2e354face3eaba6; no voters: bd884325e7c04a4881234aab42242565, c642698d21b74372809ac4b52afb84ac
I20260709 13:12:14.258955 31329 leader_election.cc:290] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 election: Requested vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265)
I20260709 13:12:14.255393 31342 raft_consensus.cc:2749] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:14.260910 31147 leader_election.cc:304] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a308d97210c4aa2b2e354face3eaba6, bd884325e7c04a4881234aab42242565; no voters: c642698d21b74372809ac4b52afb84ac
I20260709 13:12:14.261104 31105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f381d6577987460089dd2bafc44bd7f0" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c642698d21b74372809ac4b52afb84ac"
I20260709 13:12:14.262334 31181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f381d6577987460089dd2bafc44bd7f0" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
I20260709 13:12:14.263038 31307 raft_consensus.cc:2804] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:14.263304 31181 raft_consensus.cc:2393] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bd884325e7c04a4881234aab42242565 in current term 1: Already voted for candidate 3a308d97210c4aa2b2e354face3eaba6 in this term.
W20260709 13:12:14.263208 31222 leader_election.cc:343] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:14.263921 31300 tablet_bootstrap.cc:492] T d600bdfab3484da2bdc8b47a47edfced P 3a308d97210c4aa2b2e354face3eaba6: No bootstrap required, opened a new log
I20260709 13:12:14.264393 31219 leader_election.cc:304] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd884325e7c04a4881234aab42242565; no voters: 3a308d97210c4aa2b2e354face3eaba6, c642698d21b74372809ac4b52afb84ac
I20260709 13:12:14.264668 31300 ts_tablet_manager.cc:1403] T d600bdfab3484da2bdc8b47a47edfced P 3a308d97210c4aa2b2e354face3eaba6: Time spent bootstrapping tablet: real 0.283s	user 0.017s	sys 0.001s
I20260709 13:12:14.268493 31300 raft_consensus.cc:359] T d600bdfab3484da2bdc8b47a47edfced P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.269907 31300 raft_consensus.cc:385] T d600bdfab3484da2bdc8b47a47edfced P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.270207 31300 raft_consensus.cc:740] T d600bdfab3484da2bdc8b47a47edfced P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a308d97210c4aa2b2e354face3eaba6, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.271014 31300 consensus_queue.cc:260] T d600bdfab3484da2bdc8b47a47edfced P 3a308d97210c4aa2b2e354face3eaba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.273451 31182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa80f98d0ce4477aa88171401d262c3f" candidate_uuid: "c642698d21b74372809ac4b52afb84ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
I20260709 13:12:14.274693 31300 ts_tablet_manager.cc:1434] T d600bdfab3484da2bdc8b47a47edfced P 3a308d97210c4aa2b2e354face3eaba6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:12:14.279762 31106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e537dfd4154312b2eb43471b19774d" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c642698d21b74372809ac4b52afb84ac" is_pre_election: true
I20260709 13:12:14.280083 31341 leader_election.cc:290] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:14.280303 31256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e537dfd4154312b2eb43471b19774d" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd884325e7c04a4881234aab42242565" is_pre_election: true
I20260709 13:12:14.280462 31106 raft_consensus.cc:2468] T 58e537dfd4154312b2eb43471b19774d P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a308d97210c4aa2b2e354face3eaba6 in term 0.
I20260709 13:12:14.281184 31305 leader_election.cc:290] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 1 election: Requested vote from peers 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
W20260709 13:12:14.281656 31147 leader_election.cc:343] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd884325e7c04a4881234aab42242565 (127.30.63.3:37049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:14.282229 31105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f381d6577987460089dd2bafc44bd7f0" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c642698d21b74372809ac4b52afb84ac"
I20260709 13:12:14.282523 31255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa80f98d0ce4477aa88171401d262c3f" candidate_uuid: "c642698d21b74372809ac4b52afb84ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd884325e7c04a4881234aab42242565"
I20260709 13:12:14.275095 31329 raft_consensus.cc:2749] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:14.284217 31338 leader_election.cc:290] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 1 election: Requested vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:14.284829 31255 raft_consensus.cc:2393] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c642698d21b74372809ac4b52afb84ac in current term 1: Already voted for candidate 3a308d97210c4aa2b2e354face3eaba6 in this term.
I20260709 13:12:14.283651 31148 leader_election.cc:304] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a308d97210c4aa2b2e354face3eaba6, c642698d21b74372809ac4b52afb84ac; no voters: bd884325e7c04a4881234aab42242565
W20260709 13:12:14.286451 31148 leader_election.cc:343] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:14.292366 31256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f381d6577987460089dd2bafc44bd7f0" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd884325e7c04a4881234aab42242565"
I20260709 13:12:14.293869 31338 raft_consensus.cc:2804] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:14.293980 31299 tablet_bootstrap.cc:492] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac: No bootstrap required, opened a new log
I20260709 13:12:14.294271 31338 raft_consensus.cc:493] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.294502 31299 ts_tablet_manager.cc:1403] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac: Time spent bootstrapping tablet: real 0.182s	user 0.007s	sys 0.011s
I20260709 13:12:14.294649 31338 raft_consensus.cc:3060] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.289790 31307 raft_consensus.cc:697] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [term 1 LEADER]: Becoming Leader. State: Replica: 3a308d97210c4aa2b2e354face3eaba6, State: Running, Role: LEADER
I20260709 13:12:14.295819 31307 consensus_queue.cc:237] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.298046 31256 raft_consensus.cc:2393] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3a308d97210c4aa2b2e354face3eaba6 in current term 1: Already voted for candidate bd884325e7c04a4881234aab42242565 in this term.
I20260709 13:12:14.299118 31299 raft_consensus.cc:359] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.299949 31299 raft_consensus.cc:385] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.300287 31299 raft_consensus.cc:740] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c642698d21b74372809ac4b52afb84ac, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.299317 31147 leader_election.cc:304] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a308d97210c4aa2b2e354face3eaba6; no voters: bd884325e7c04a4881234aab42242565, c642698d21b74372809ac4b52afb84ac
I20260709 13:12:14.301157 31299 consensus_queue.cc:260] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.310832 31346 raft_consensus.cc:2749] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:14.316021 31299 ts_tablet_manager.cc:1434] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.004s
I20260709 13:12:14.317088 31299 tablet_bootstrap.cc:492] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac: Bootstrap starting.
I20260709 13:12:14.317209 31301 tablet_bootstrap.cc:654] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.314324 31300 tablet_bootstrap.cc:492] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6: Bootstrap starting.
W20260709 13:12:14.321852 31051 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:14.313983 31338 raft_consensus.cc:515] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.337564 31105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e537dfd4154312b2eb43471b19774d" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c642698d21b74372809ac4b52afb84ac"
I20260709 13:12:14.338301 31105 raft_consensus.cc:3060] T 58e537dfd4154312b2eb43471b19774d P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.339073 31300 tablet_bootstrap.cc:654] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.345023 31338 leader_election.cc:290] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 1 election: Requested vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:14.346021 31070 leader_election.cc:304] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c642698d21b74372809ac4b52afb84ac; no voters: 3a308d97210c4aa2b2e354face3eaba6, bd884325e7c04a4881234aab42242565
I20260709 13:12:14.346211 31299 tablet_bootstrap.cc:654] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.346307 31256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e537dfd4154312b2eb43471b19774d" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd884325e7c04a4881234aab42242565"
I20260709 13:12:14.347656 31305 raft_consensus.cc:2749] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:12:14.348686 31147 leader_election.cc:343] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bd884325e7c04a4881234aab42242565 (127.30.63.3:37049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:14.355103 31105 raft_consensus.cc:2468] T 58e537dfd4154312b2eb43471b19774d P c642698d21b74372809ac4b52afb84ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a308d97210c4aa2b2e354face3eaba6 in term 1.
I20260709 13:12:14.355705 31301 tablet_bootstrap.cc:492] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565: No bootstrap required, opened a new log
I20260709 13:12:14.356213 31301 ts_tablet_manager.cc:1403] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565: Time spent bootstrapping tablet: real 0.169s	user 0.022s	sys 0.017s
I20260709 13:12:14.356834 31148 leader_election.cc:304] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a308d97210c4aa2b2e354face3eaba6, c642698d21b74372809ac4b52afb84ac; no voters: bd884325e7c04a4881234aab42242565
I20260709 13:12:14.360783 31338 raft_consensus.cc:2804] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:14.361415 31338 raft_consensus.cc:697] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 [term 1 LEADER]: Becoming Leader. State: Replica: 3a308d97210c4aa2b2e354face3eaba6, State: Running, Role: LEADER
I20260709 13:12:14.363076 31338 consensus_queue.cc:237] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.363474 31004 catalog_manager.cc:5697] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "3a308d97210c4aa2b2e354face3eaba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:14.366047 31301 raft_consensus.cc:359] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.367074 31301 raft_consensus.cc:385] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.367457 31301 raft_consensus.cc:740] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd884325e7c04a4881234aab42242565, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.370312 31301 consensus_queue.cc:260] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.371642 31299 tablet_bootstrap.cc:492] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac: No bootstrap required, opened a new log
I20260709 13:12:14.372182 31299 ts_tablet_manager.cc:1403] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac: Time spent bootstrapping tablet: real 0.055s	user 0.007s	sys 0.013s
I20260709 13:12:14.376914 31299 raft_consensus.cc:359] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.377779 31299 raft_consensus.cc:385] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.378127 31299 raft_consensus.cc:740] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c642698d21b74372809ac4b52afb84ac, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.378444 31301 ts_tablet_manager.cc:1434] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.003s
I20260709 13:12:14.378997 31299 consensus_queue.cc:260] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.379619 31301 tablet_bootstrap.cc:492] T 58e537dfd4154312b2eb43471b19774d P bd884325e7c04a4881234aab42242565: Bootstrap starting.
I20260709 13:12:14.379684 31300 tablet_bootstrap.cc:492] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6: No bootstrap required, opened a new log
I20260709 13:12:14.380304 31300 ts_tablet_manager.cc:1403] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6: Time spent bootstrapping tablet: real 0.068s	user 0.004s	sys 0.010s
I20260709 13:12:14.381222 31299 ts_tablet_manager.cc:1434] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:12:14.382084 31299 tablet_bootstrap.cc:492] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac: Bootstrap starting.
I20260709 13:12:14.384665 31329 raft_consensus.cc:493] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.385171 31329 raft_consensus.cc:515] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.387235 31002 catalog_manager.cc:5697] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd884325e7c04a4881234aab42242565 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "bd884325e7c04a4881234aab42242565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:14.389012 31305 raft_consensus.cc:493] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.387250 31329 leader_election.cc:290] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265)
I20260709 13:12:14.390506 31182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe04b62ac7494d05afaa4d1b0df2b52b" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a308d97210c4aa2b2e354face3eaba6" is_pre_election: true
I20260709 13:12:14.390301 31305 raft_consensus.cc:515] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.391322 31182 raft_consensus.cc:2468] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd884325e7c04a4881234aab42242565 in term 0.
I20260709 13:12:14.392802 31219 leader_election.cc:304] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a308d97210c4aa2b2e354face3eaba6, bd884325e7c04a4881234aab42242565; no voters: 
I20260709 13:12:14.390331 31002 catalog_manager.cc:5697] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd884325e7c04a4881234aab42242565 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "bd884325e7c04a4881234aab42242565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:14.394495 31305 leader_election.cc:290] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:14.395212 31105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe04b62ac7494d05afaa4d1b0df2b52b" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c642698d21b74372809ac4b52afb84ac" is_pre_election: true
I20260709 13:12:14.395563 31300 raft_consensus.cc:359] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.395820 31105 raft_consensus.cc:2468] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd884325e7c04a4881234aab42242565 in term 0.
I20260709 13:12:14.396697 31300 raft_consensus.cc:385] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.397008 31300 raft_consensus.cc:740] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a308d97210c4aa2b2e354face3eaba6, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.396998 31182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe04b62ac7494d05afaa4d1b0df2b52b" candidate_uuid: "c642698d21b74372809ac4b52afb84ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a308d97210c4aa2b2e354face3eaba6" is_pre_election: true
I20260709 13:12:14.397679 31256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe04b62ac7494d05afaa4d1b0df2b52b" candidate_uuid: "c642698d21b74372809ac4b52afb84ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd884325e7c04a4881234aab42242565" is_pre_election: true
I20260709 13:12:14.397940 31300 consensus_queue.cc:260] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.397837 31182 raft_consensus.cc:2468] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c642698d21b74372809ac4b52afb84ac in term 0.
I20260709 13:12:14.398408 31256 raft_consensus.cc:2468] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c642698d21b74372809ac4b52afb84ac in term 0.
I20260709 13:12:14.398663 31301 tablet_bootstrap.cc:654] T 58e537dfd4154312b2eb43471b19774d P bd884325e7c04a4881234aab42242565: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.399664 31072 leader_election.cc:304] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd884325e7c04a4881234aab42242565, c642698d21b74372809ac4b52afb84ac; no voters: 
I20260709 13:12:14.399947 31300 ts_tablet_manager.cc:1434] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 13:12:14.400552 31329 raft_consensus.cc:2804] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:14.401322 31300 tablet_bootstrap.cc:492] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6: Bootstrap starting.
I20260709 13:12:14.401502 31329 raft_consensus.cc:493] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.401891 31329 raft_consensus.cc:3060] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.404596 31299 tablet_bootstrap.cc:654] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.404785 31305 raft_consensus.cc:2804] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:14.405210 31305 raft_consensus.cc:493] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.405287 31338 raft_consensus.cc:493] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.405575 31305 raft_consensus.cc:3060] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.405825 31338 raft_consensus.cc:515] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.405864 31003 catalog_manager.cc:5697] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "3a308d97210c4aa2b2e354face3eaba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:14.409176 31105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f927a373038947bb917685c470b28d9d" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c642698d21b74372809ac4b52afb84ac" is_pre_election: true
I20260709 13:12:14.409818 31105 raft_consensus.cc:2468] T f927a373038947bb917685c470b28d9d P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a308d97210c4aa2b2e354face3eaba6 in term 0.
I20260709 13:12:14.410964 31256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f927a373038947bb917685c470b28d9d" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd884325e7c04a4881234aab42242565" is_pre_election: true
I20260709 13:12:14.411057 31148 leader_election.cc:304] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a308d97210c4aa2b2e354face3eaba6, c642698d21b74372809ac4b52afb84ac; no voters: 
I20260709 13:12:14.413712 31307 raft_consensus.cc:2804] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:12:14.413803 31147 leader_election.cc:343] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd884325e7c04a4881234aab42242565 (127.30.63.3:37049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:14.414142 31307 raft_consensus.cc:493] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.414543 31307 raft_consensus.cc:3060] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.419589 31329 raft_consensus.cc:515] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.414553 31338 leader_election.cc:290] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:14.423735 31307 raft_consensus.cc:515] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.431044 31307 leader_election.cc:290] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 1 election: Requested vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:14.432041 31300 tablet_bootstrap.cc:654] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.434891 31256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f927a373038947bb917685c470b28d9d" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd884325e7c04a4881234aab42242565"
W20260709 13:12:14.437956 31147 leader_election.cc:343] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bd884325e7c04a4881234aab42242565 (127.30.63.3:37049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:14.438277 31105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe04b62ac7494d05afaa4d1b0df2b52b" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c642698d21b74372809ac4b52afb84ac"
I20260709 13:12:14.438505 31329 leader_election.cc:290] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 election: Requested vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265)
I20260709 13:12:14.439509 31106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f927a373038947bb917685c470b28d9d" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c642698d21b74372809ac4b52afb84ac"
I20260709 13:12:14.440708 31106 raft_consensus.cc:3060] T f927a373038947bb917685c470b28d9d P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.441977 31182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe04b62ac7494d05afaa4d1b0df2b52b" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
I20260709 13:12:14.442696 31182 raft_consensus.cc:3060] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.450291 31106 raft_consensus.cc:2468] T f927a373038947bb917685c470b28d9d P c642698d21b74372809ac4b52afb84ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a308d97210c4aa2b2e354face3eaba6 in term 1.
I20260709 13:12:14.461701 31148 leader_election.cc:304] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a308d97210c4aa2b2e354face3eaba6, c642698d21b74372809ac4b52afb84ac; no voters: bd884325e7c04a4881234aab42242565
I20260709 13:12:14.463353 31307 raft_consensus.cc:2804] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:14.464105 31307 raft_consensus.cc:697] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 [term 1 LEADER]: Becoming Leader. State: Replica: 3a308d97210c4aa2b2e354face3eaba6, State: Running, Role: LEADER
I20260709 13:12:14.465376 31307 consensus_queue.cc:237] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.457078 31182 raft_consensus.cc:2468] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd884325e7c04a4881234aab42242565 in term 1.
I20260709 13:12:14.474172 31301 tablet_bootstrap.cc:492] T 58e537dfd4154312b2eb43471b19774d P bd884325e7c04a4881234aab42242565: No bootstrap required, opened a new log
I20260709 13:12:14.474305 31219 leader_election.cc:304] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a308d97210c4aa2b2e354face3eaba6, bd884325e7c04a4881234aab42242565; no voters: 
I20260709 13:12:14.474670 31301 ts_tablet_manager.cc:1403] T 58e537dfd4154312b2eb43471b19774d P bd884325e7c04a4881234aab42242565: Time spent bootstrapping tablet: real 0.095s	user 0.014s	sys 0.027s
I20260709 13:12:14.475273 31329 raft_consensus.cc:2804] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:14.475780 31329 raft_consensus.cc:697] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [term 1 LEADER]: Becoming Leader. State: Replica: bd884325e7c04a4881234aab42242565, State: Running, Role: LEADER
I20260709 13:12:14.476673 31329 consensus_queue.cc:237] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.477908 31301 raft_consensus.cc:359] T 58e537dfd4154312b2eb43471b19774d P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.478799 31301 raft_consensus.cc:385] T 58e537dfd4154312b2eb43471b19774d P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.479146 31301 raft_consensus.cc:740] T 58e537dfd4154312b2eb43471b19774d P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd884325e7c04a4881234aab42242565, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.479722 31301 consensus_queue.cc:260] T 58e537dfd4154312b2eb43471b19774d P bd884325e7c04a4881234aab42242565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.481567 31301 ts_tablet_manager.cc:1434] T 58e537dfd4154312b2eb43471b19774d P bd884325e7c04a4881234aab42242565: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:12:14.483705 31299 tablet_bootstrap.cc:492] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac: No bootstrap required, opened a new log
I20260709 13:12:14.484160 31299 ts_tablet_manager.cc:1403] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac: Time spent bootstrapping tablet: real 0.102s	user 0.014s	sys 0.028s
I20260709 13:12:14.486421 31299 raft_consensus.cc:359] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.486922 31299 raft_consensus.cc:385] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.487123 31299 raft_consensus.cc:740] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c642698d21b74372809ac4b52afb84ac, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.487754 31299 consensus_queue.cc:260] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.489603 31299 ts_tablet_manager.cc:1434] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:12:14.481585 31300 tablet_bootstrap.cc:492] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6: No bootstrap required, opened a new log
I20260709 13:12:14.490599 31300 ts_tablet_manager.cc:1403] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6: Time spent bootstrapping tablet: real 0.089s	user 0.012s	sys 0.006s
I20260709 13:12:14.489306 31003 catalog_manager.cc:5697] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "3a308d97210c4aa2b2e354face3eaba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:14.493357 31300 raft_consensus.cc:359] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.494118 31300 raft_consensus.cc:385] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.494423 31300 raft_consensus.cc:740] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a308d97210c4aa2b2e354face3eaba6, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.495414 31300 consensus_queue.cc:260] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.496745 31301 tablet_bootstrap.cc:492] T f927a373038947bb917685c470b28d9d P bd884325e7c04a4881234aab42242565: Bootstrap starting.
I20260709 13:12:14.498553 31330 raft_consensus.cc:493] T 58e537dfd4154312b2eb43471b19774d P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.499058 31330 raft_consensus.cc:515] T 58e537dfd4154312b2eb43471b19774d P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.501140 31330 leader_election.cc:290] T 58e537dfd4154312b2eb43471b19774d P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265)
I20260709 13:12:14.474315 31305 raft_consensus.cc:515] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.502414 31105 raft_consensus.cc:2393] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bd884325e7c04a4881234aab42242565 in current term 1: Already voted for candidate c642698d21b74372809ac4b52afb84ac in this term.
I20260709 13:12:14.503954 31301 tablet_bootstrap.cc:654] T f927a373038947bb917685c470b28d9d P bd884325e7c04a4881234aab42242565: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.503552 31182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e537dfd4154312b2eb43471b19774d" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a308d97210c4aa2b2e354face3eaba6" is_pre_election: true
I20260709 13:12:14.505245 31305 leader_election.cc:290] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 1 election: Requested vote from peers 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:14.507918 31256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe04b62ac7494d05afaa4d1b0df2b52b" candidate_uuid: "c642698d21b74372809ac4b52afb84ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd884325e7c04a4881234aab42242565"
I20260709 13:12:14.508175 31300 ts_tablet_manager.cc:1434] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:12:14.511574 31330 consensus_queue.cc:1048] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:14.511502 31106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e537dfd4154312b2eb43471b19774d" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c642698d21b74372809ac4b52afb84ac" is_pre_election: true
I20260709 13:12:14.519923 31106 raft_consensus.cc:2393] T 58e537dfd4154312b2eb43471b19774d P c642698d21b74372809ac4b52afb84ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd884325e7c04a4881234aab42242565 in current term 1: Already voted for candidate 3a308d97210c4aa2b2e354face3eaba6 in this term.
I20260709 13:12:14.521414 31222 leader_election.cc:304] T 58e537dfd4154312b2eb43471b19774d P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd884325e7c04a4881234aab42242565; no voters: 3a308d97210c4aa2b2e354face3eaba6, c642698d21b74372809ac4b52afb84ac
I20260709 13:12:14.522692 31330 raft_consensus.cc:3060] T 58e537dfd4154312b2eb43471b19774d P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.526679 31182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe04b62ac7494d05afaa4d1b0df2b52b" candidate_uuid: "c642698d21b74372809ac4b52afb84ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
I20260709 13:12:14.544492 31182 raft_consensus.cc:2393] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c642698d21b74372809ac4b52afb84ac in current term 1: Already voted for candidate bd884325e7c04a4881234aab42242565 in this term.
I20260709 13:12:14.546237 31070 leader_election.cc:304] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c642698d21b74372809ac4b52afb84ac; no voters: 3a308d97210c4aa2b2e354face3eaba6, bd884325e7c04a4881234aab42242565
I20260709 13:12:14.547289 31305 raft_consensus.cc:2749] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:14.548264 31305 raft_consensus.cc:493] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.548735 31305 raft_consensus.cc:515] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.549885 31181 raft_consensus.cc:3060] T d600bdfab3484da2bdc8b47a47edfced P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.552392 31180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f381d6577987460089dd2bafc44bd7f0" candidate_uuid: "c642698d21b74372809ac4b52afb84ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a308d97210c4aa2b2e354face3eaba6" is_pre_election: true
I20260709 13:12:14.553315 31180 raft_consensus.cc:2393] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c642698d21b74372809ac4b52afb84ac in current term 1: Already voted for candidate 3a308d97210c4aa2b2e354face3eaba6 in this term.
I20260709 13:12:14.553414 31256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f381d6577987460089dd2bafc44bd7f0" candidate_uuid: "c642698d21b74372809ac4b52afb84ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd884325e7c04a4881234aab42242565" is_pre_election: true
I20260709 13:12:14.552814 31002 catalog_manager.cc:5697] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd884325e7c04a4881234aab42242565 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "bd884325e7c04a4881234aab42242565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:14.554195 31256 raft_consensus.cc:2393] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c642698d21b74372809ac4b52afb84ac in current term 1: Already voted for candidate bd884325e7c04a4881234aab42242565 in this term.
I20260709 13:12:14.554893 31305 leader_election.cc:290] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:14.533901 31330 raft_consensus.cc:2749] T 58e537dfd4154312b2eb43471b19774d P bd884325e7c04a4881234aab42242565 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:14.555440 31072 leader_election.cc:304] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c642698d21b74372809ac4b52afb84ac; no voters: 3a308d97210c4aa2b2e354face3eaba6, bd884325e7c04a4881234aab42242565
I20260709 13:12:14.557196 31305 raft_consensus.cc:3060] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.563791 31305 raft_consensus.cc:2749] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:14.564368 31330 consensus_queue.cc:1048] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:14.572204 31332 raft_consensus.cc:493] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.573076 31332 raft_consensus.cc:515] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.577364 31332 leader_election.cc:290] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:14.577482 31182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a1c64224014d3081d51a1b8b6bcacb" candidate_uuid: "c642698d21b74372809ac4b52afb84ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a308d97210c4aa2b2e354face3eaba6" is_pre_election: true
I20260709 13:12:14.578348 31182 raft_consensus.cc:2468] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c642698d21b74372809ac4b52afb84ac in term 0.
I20260709 13:12:14.578442 31256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a1c64224014d3081d51a1b8b6bcacb" candidate_uuid: "c642698d21b74372809ac4b52afb84ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd884325e7c04a4881234aab42242565" is_pre_election: true
I20260709 13:12:14.579048 31256 raft_consensus.cc:2468] T 01a1c64224014d3081d51a1b8b6bcacb P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c642698d21b74372809ac4b52afb84ac in term 0.
I20260709 13:12:14.579793 31070 leader_election.cc:304] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a308d97210c4aa2b2e354face3eaba6, c642698d21b74372809ac4b52afb84ac; no voters: 
I20260709 13:12:14.589301 31332 raft_consensus.cc:2804] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:14.592624 31332 raft_consensus.cc:493] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.593257 31332 raft_consensus.cc:3060] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.599581 31324 consensus_queue.cc:1048] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:14.610251 31301 tablet_bootstrap.cc:492] T f927a373038947bb917685c470b28d9d P bd884325e7c04a4881234aab42242565: No bootstrap required, opened a new log
I20260709 13:12:14.610803 31301 ts_tablet_manager.cc:1403] T f927a373038947bb917685c470b28d9d P bd884325e7c04a4881234aab42242565: Time spent bootstrapping tablet: real 0.114s	user 0.047s	sys 0.034s
I20260709 13:12:14.614069 31301 raft_consensus.cc:359] T f927a373038947bb917685c470b28d9d P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.614836 31301 raft_consensus.cc:385] T f927a373038947bb917685c470b28d9d P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.615160 31301 raft_consensus.cc:740] T f927a373038947bb917685c470b28d9d P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd884325e7c04a4881234aab42242565, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.615082 31332 raft_consensus.cc:515] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.618992 31182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a1c64224014d3081d51a1b8b6bcacb" candidate_uuid: "c642698d21b74372809ac4b52afb84ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
I20260709 13:12:14.619596 31182 raft_consensus.cc:3060] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.623708 31256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a1c64224014d3081d51a1b8b6bcacb" candidate_uuid: "c642698d21b74372809ac4b52afb84ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd884325e7c04a4881234aab42242565"
I20260709 13:12:14.624400 31256 raft_consensus.cc:3060] T 01a1c64224014d3081d51a1b8b6bcacb P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.616043 31301 consensus_queue.cc:260] T f927a373038947bb917685c470b28d9d P bd884325e7c04a4881234aab42242565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.627887 31301 ts_tablet_manager.cc:1434] T f927a373038947bb917685c470b28d9d P bd884325e7c04a4881234aab42242565: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:12:14.632908 31329 consensus_queue.cc:1048] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:14.635875 31182 raft_consensus.cc:2468] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c642698d21b74372809ac4b52afb84ac in term 1.
I20260709 13:12:14.637292 31070 leader_election.cc:304] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a308d97210c4aa2b2e354face3eaba6, c642698d21b74372809ac4b52afb84ac; no voters: 
I20260709 13:12:14.638114 31305 raft_consensus.cc:2804] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:14.640103 31305 raft_consensus.cc:697] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [term 1 LEADER]: Becoming Leader. State: Replica: c642698d21b74372809ac4b52afb84ac, State: Running, Role: LEADER
I20260709 13:12:14.640982 31305 consensus_queue.cc:237] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.645089 31332 leader_election.cc:290] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 1 election: Requested vote from peers 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:14.648232 31339 consensus_queue.cc:1048] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:14.648183 31256 raft_consensus.cc:2468] T 01a1c64224014d3081d51a1b8b6bcacb P bd884325e7c04a4881234aab42242565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c642698d21b74372809ac4b52afb84ac in term 1.
I20260709 13:12:14.666253 31339 consensus_queue.cc:1048] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:14.682332 31004 catalog_manager.cc:5697] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac reported cstate change: term changed from 0 to 1, leader changed from <none> to c642698d21b74372809ac4b52afb84ac (127.30.63.1). New cstate: current_term: 1 leader_uuid: "c642698d21b74372809ac4b52afb84ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:14.756177 31329 raft_consensus.cc:493] T f927a373038947bb917685c470b28d9d P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.756857 31329 raft_consensus.cc:515] T f927a373038947bb917685c470b28d9d P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:14.760272 31329 leader_election.cc:290] T f927a373038947bb917685c470b28d9d P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265)
I20260709 13:12:14.760733 31106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f927a373038947bb917685c470b28d9d" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c642698d21b74372809ac4b52afb84ac" is_pre_election: true
I20260709 13:12:14.760859 31181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f927a373038947bb917685c470b28d9d" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a308d97210c4aa2b2e354face3eaba6" is_pre_election: true
I20260709 13:12:14.762171 31106 raft_consensus.cc:2393] T f927a373038947bb917685c470b28d9d P c642698d21b74372809ac4b52afb84ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd884325e7c04a4881234aab42242565 in current term 1: Already voted for candidate 3a308d97210c4aa2b2e354face3eaba6 in this term.
I20260709 13:12:14.763079 31222 leader_election.cc:304] T f927a373038947bb917685c470b28d9d P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd884325e7c04a4881234aab42242565; no voters: 3a308d97210c4aa2b2e354face3eaba6, c642698d21b74372809ac4b52afb84ac
I20260709 13:12:14.763772 31329 raft_consensus.cc:3060] T f927a373038947bb917685c470b28d9d P bd884325e7c04a4881234aab42242565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.772720 31329 raft_consensus.cc:2749] T f927a373038947bb917685c470b28d9d P bd884325e7c04a4881234aab42242565 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:14.835776 31307 consensus_queue.cc:1048] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:14.848302 31307 consensus_queue.cc:1048] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:14.937227 31307 consensus_queue.cc:1048] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:14.950362 31375 consensus_queue.cc:1048] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:14.955585 31329 consensus_queue.cc:1048] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:14.958308 31375 consensus_queue.cc:1048] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:14.984632 31307 consensus_queue.cc:1048] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:14.989018 31324 consensus_queue.cc:1048] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:15.092060 31305 consensus_queue.cc:1048] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:15.104959 31369 consensus_queue.cc:1048] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:15.325795 31051 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:15.979786 31307 raft_consensus.cc:493] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.980338 31307 raft_consensus.cc:515] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:15.982097 31307 leader_election.cc:290] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:15.983105 31106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f381d6577987460089dd2bafc44bd7f0" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c642698d21b74372809ac4b52afb84ac" is_pre_election: true
I20260709 13:12:15.983163 31256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f381d6577987460089dd2bafc44bd7f0" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd884325e7c04a4881234aab42242565" is_pre_election: true
I20260709 13:12:15.983788 31106 raft_consensus.cc:2468] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a308d97210c4aa2b2e354face3eaba6 in term 1.
I20260709 13:12:15.983863 31256 raft_consensus.cc:2468] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a308d97210c4aa2b2e354face3eaba6 in term 1.
I20260709 13:12:15.984905 31148 leader_election.cc:304] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a308d97210c4aa2b2e354face3eaba6, c642698d21b74372809ac4b52afb84ac; no voters: 
I20260709 13:12:15.985589 31307 raft_consensus.cc:2804] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.985903 31307 raft_consensus.cc:493] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:15.986173 31307 raft_consensus.cc:3060] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.991063 31307 raft_consensus.cc:515] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:15.993091 31307 leader_election.cc:290] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 2 election: Requested vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:15.993875 31106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f381d6577987460089dd2bafc44bd7f0" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c642698d21b74372809ac4b52afb84ac"
I20260709 13:12:15.994257 31256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f381d6577987460089dd2bafc44bd7f0" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd884325e7c04a4881234aab42242565"
I20260709 13:12:15.994518 31106 raft_consensus.cc:3060] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.994848 31256 raft_consensus.cc:3060] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.999832 31106 raft_consensus.cc:2468] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a308d97210c4aa2b2e354face3eaba6 in term 2.
I20260709 13:12:15.999843 31256 raft_consensus.cc:2468] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a308d97210c4aa2b2e354face3eaba6 in term 2.
I20260709 13:12:16.001171 31147 leader_election.cc:304] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3a308d97210c4aa2b2e354face3eaba6, bd884325e7c04a4881234aab42242565, c642698d21b74372809ac4b52afb84ac; no voters: 
I20260709 13:12:16.001904 31307 raft_consensus.cc:2804] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:16.002418 31307 raft_consensus.cc:697] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 2 LEADER]: Becoming Leader. State: Replica: 3a308d97210c4aa2b2e354face3eaba6, State: Running, Role: LEADER
I20260709 13:12:16.003168 31307 consensus_queue.cc:237] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:16.010445 31004 catalog_manager.cc:5697] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 reported cstate change: term changed from 0 to 2, leader changed from <none> to 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "3a308d97210c4aa2b2e354face3eaba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:16.409227 31106 raft_consensus.cc:1275] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [term 2 FOLLOWER]: Refusing update from remote peer 3a308d97210c4aa2b2e354face3eaba6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:16.410553 31307 consensus_queue.cc:1048] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:16.423434 31256 raft_consensus.cc:1275] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [term 2 FOLLOWER]: Refusing update from remote peer 3a308d97210c4aa2b2e354face3eaba6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:16.424751 31396 consensus_queue.cc:1048] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:16.491839 31256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d600bdfab3484da2bdc8b47a47edfced"
dest_uuid: "bd884325e7c04a4881234aab42242565"
mode: GRACEFUL
new_leader_uuid: "c642698d21b74372809ac4b52afb84ac"
 from {username='slave'} at 127.0.0.1:43532
I20260709 13:12:16.492515 31256 raft_consensus.cc:606] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 1 LEADER]: Received request to transfer leadership to TS c642698d21b74372809ac4b52afb84ac
I20260709 13:12:16.498106 31256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe04b62ac7494d05afaa4d1b0df2b52b"
dest_uuid: "bd884325e7c04a4881234aab42242565"
mode: GRACEFUL
new_leader_uuid: "c642698d21b74372809ac4b52afb84ac"
 from {username='slave'} at 127.0.0.1:43532
I20260709 13:12:16.498696 31256 raft_consensus.cc:606] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [term 1 LEADER]: Received request to transfer leadership to TS c642698d21b74372809ac4b52afb84ac
I20260709 13:12:16.503696 31256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2023200c6d3742889adb5d28fb3614d9"
dest_uuid: "bd884325e7c04a4881234aab42242565"
mode: GRACEFUL
new_leader_uuid: "c642698d21b74372809ac4b52afb84ac"
 from {username='slave'} at 127.0.0.1:43532
I20260709 13:12:16.504290 31256 raft_consensus.cc:606] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [term 1 LEADER]: Received request to transfer leadership to TS c642698d21b74372809ac4b52afb84ac
I20260709 13:12:16.513705 31388 raft_consensus.cc:993] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565: : Instructing follower c642698d21b74372809ac4b52afb84ac to start an election
I20260709 13:12:16.514163 31399 raft_consensus.cc:1081] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [term 1 LEADER]: Signalling peer c642698d21b74372809ac4b52afb84ac to start an election
I20260709 13:12:16.516050 31106 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2023200c6d3742889adb5d28fb3614d9"
dest_uuid: "c642698d21b74372809ac4b52afb84ac"
 from {username='slave'} at 127.0.0.1:44162
I20260709 13:12:16.516562 31106 raft_consensus.cc:493] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:16.516922 31106 raft_consensus.cc:3060] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.519472 31182 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f381d6577987460089dd2bafc44bd7f0"
dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
mode: GRACEFUL
new_leader_uuid: "c642698d21b74372809ac4b52afb84ac"
 from {username='slave'} at 127.0.0.1:43590
I20260709 13:12:16.520062 31182 raft_consensus.cc:606] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 2 LEADER]: Received request to transfer leadership to TS c642698d21b74372809ac4b52afb84ac
I20260709 13:12:16.523097 31106 raft_consensus.cc:515] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:16.525229 31106 leader_election.cc:290] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 2 election: Requested vote from peers 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:16.525849 31182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2023200c6d3742889adb5d28fb3614d9" candidate_uuid: "c642698d21b74372809ac4b52afb84ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
I20260709 13:12:16.526446 31182 raft_consensus.cc:3060] T 2023200c6d3742889adb5d28fb3614d9 P 3a308d97210c4aa2b2e354face3eaba6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.526518 31256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2023200c6d3742889adb5d28fb3614d9" candidate_uuid: "c642698d21b74372809ac4b52afb84ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd884325e7c04a4881234aab42242565"
I20260709 13:12:16.527102 31256 raft_consensus.cc:3055] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:16.527427 31256 raft_consensus.cc:740] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd884325e7c04a4881234aab42242565, State: Running, Role: LEADER
I20260709 13:12:16.528375 31256 consensus_queue.cc:260] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:16.529938 31256 raft_consensus.cc:3060] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.533641 31182 raft_consensus.cc:2468] T 2023200c6d3742889adb5d28fb3614d9 P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c642698d21b74372809ac4b52afb84ac in term 2.
I20260709 13:12:16.535075 31070 leader_election.cc:304] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a308d97210c4aa2b2e354face3eaba6, c642698d21b74372809ac4b52afb84ac; no voters: 
I20260709 13:12:16.535944 31394 raft_consensus.cc:2804] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:16.537056 31106 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01a1c64224014d3081d51a1b8b6bcacb"
dest_uuid: "c642698d21b74372809ac4b52afb84ac"
mode: GRACEFUL
new_leader_uuid: "3a308d97210c4aa2b2e354face3eaba6"
 from {username='slave'} at 127.0.0.1:44176
I20260709 13:12:16.537576 31106 raft_consensus.cc:606] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [term 1 LEADER]: Received request to transfer leadership to TS 3a308d97210c4aa2b2e354face3eaba6
I20260709 13:12:16.537663 31256 raft_consensus.cc:2468] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c642698d21b74372809ac4b52afb84ac in term 2.
I20260709 13:12:16.541054 31394 raft_consensus.cc:697] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac [term 2 LEADER]: Becoming Leader. State: Replica: c642698d21b74372809ac4b52afb84ac, State: Running, Role: LEADER
I20260709 13:12:16.544421 31394 consensus_queue.cc:237] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:16.548943 31256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d084968581fc49f5bb08a64e65c22b69"
dest_uuid: "bd884325e7c04a4881234aab42242565"
mode: GRACEFUL
new_leader_uuid: "3a308d97210c4aa2b2e354face3eaba6"
 from {username='slave'} at 127.0.0.1:43532
I20260709 13:12:16.549834 31256 raft_consensus.cc:606] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [term 1 LEADER]: Received request to transfer leadership to TS 3a308d97210c4aa2b2e354face3eaba6
I20260709 13:12:16.556090 31182 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f927a373038947bb917685c470b28d9d"
dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
mode: GRACEFUL
new_leader_uuid: "bd884325e7c04a4881234aab42242565"
 from {username='slave'} at 127.0.0.1:43590
I20260709 13:12:16.556710 31182 raft_consensus.cc:606] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 [term 1 LEADER]: Received request to transfer leadership to TS bd884325e7c04a4881234aab42242565
I20260709 13:12:16.559053 31004 catalog_manager.cc:5697] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac reported cstate change: term changed from 1 to 2, leader changed from bd884325e7c04a4881234aab42242565 (127.30.63.3) to c642698d21b74372809ac4b52afb84ac (127.30.63.1). New cstate: current_term: 2 leader_uuid: "c642698d21b74372809ac4b52afb84ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:16.606063 31388 raft_consensus.cc:993] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565: : Instructing follower 3a308d97210c4aa2b2e354face3eaba6 to start an election
I20260709 13:12:16.606570 31399 raft_consensus.cc:1081] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [term 1 LEADER]: Signalling peer 3a308d97210c4aa2b2e354face3eaba6 to start an election
I20260709 13:12:16.608047 31182 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d084968581fc49f5bb08a64e65c22b69"
dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
 from {username='slave'} at 127.0.0.1:43584
I20260709 13:12:16.608467 31182 raft_consensus.cc:493] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:16.608750 31182 raft_consensus.cc:3060] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.613096 31182 raft_consensus.cc:515] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:16.614661 31182 leader_election.cc:290] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 2 election: Requested vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:16.615661 31106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084968581fc49f5bb08a64e65c22b69" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c642698d21b74372809ac4b52afb84ac"
I20260709 13:12:16.615979 31256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084968581fc49f5bb08a64e65c22b69" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd884325e7c04a4881234aab42242565"
I20260709 13:12:16.616340 31106 raft_consensus.cc:3060] T d084968581fc49f5bb08a64e65c22b69 P c642698d21b74372809ac4b52afb84ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.616556 31256 raft_consensus.cc:3055] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:16.616957 31256 raft_consensus.cc:740] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd884325e7c04a4881234aab42242565, State: Running, Role: LEADER
I20260709 13:12:16.617682 31256 consensus_queue.cc:260] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:16.618615 31256 raft_consensus.cc:3060] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.621774 31106 raft_consensus.cc:2468] T d084968581fc49f5bb08a64e65c22b69 P c642698d21b74372809ac4b52afb84ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a308d97210c4aa2b2e354face3eaba6 in term 2.
I20260709 13:12:16.623000 31148 leader_election.cc:304] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a308d97210c4aa2b2e354face3eaba6, c642698d21b74372809ac4b52afb84ac; no voters: 
I20260709 13:12:16.623724 31396 raft_consensus.cc:2804] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:16.623744 31256 raft_consensus.cc:2468] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a308d97210c4aa2b2e354face3eaba6 in term 2.
I20260709 13:12:16.624280 31396 raft_consensus.cc:697] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6 [term 2 LEADER]: Becoming Leader. State: Replica: 3a308d97210c4aa2b2e354face3eaba6, State: Running, Role: LEADER
I20260709 13:12:16.625121 31396 consensus_queue.cc:237] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:16.631613 31004 catalog_manager.cc:5697] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6 reported cstate change: term changed from 1 to 2, leader changed from bd884325e7c04a4881234aab42242565 (127.30.63.3) to 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "3a308d97210c4aa2b2e354face3eaba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:16.801838 31388 raft_consensus.cc:993] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565: : Instructing follower c642698d21b74372809ac4b52afb84ac to start an election
I20260709 13:12:16.802285 31399 raft_consensus.cc:1081] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 1 LEADER]: Signalling peer c642698d21b74372809ac4b52afb84ac to start an election
I20260709 13:12:16.803927 31106 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d600bdfab3484da2bdc8b47a47edfced"
dest_uuid: "c642698d21b74372809ac4b52afb84ac"
 from {username='slave'} at 127.0.0.1:44162
I20260709 13:12:16.804410 31106 raft_consensus.cc:493] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:16.804746 31106 raft_consensus.cc:3060] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.809866 31106 raft_consensus.cc:515] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:16.811496 31106 leader_election.cc:290] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 2 election: Requested vote from peers 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:16.812486 31182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d600bdfab3484da2bdc8b47a47edfced" candidate_uuid: "c642698d21b74372809ac4b52afb84ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
I20260709 13:12:16.812714 31256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d600bdfab3484da2bdc8b47a47edfced" candidate_uuid: "c642698d21b74372809ac4b52afb84ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd884325e7c04a4881234aab42242565"
I20260709 13:12:16.813050 31182 raft_consensus.cc:3060] T d600bdfab3484da2bdc8b47a47edfced P 3a308d97210c4aa2b2e354face3eaba6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.813410 31256 raft_consensus.cc:3055] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:16.813683 31256 raft_consensus.cc:740] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd884325e7c04a4881234aab42242565, State: Running, Role: LEADER
I20260709 13:12:16.814359 31256 consensus_queue.cc:260] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:16.815236 31256 raft_consensus.cc:3060] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.818302 31182 raft_consensus.cc:2468] T d600bdfab3484da2bdc8b47a47edfced P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c642698d21b74372809ac4b52afb84ac in term 2.
I20260709 13:12:16.819413 31070 leader_election.cc:304] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a308d97210c4aa2b2e354face3eaba6, c642698d21b74372809ac4b52afb84ac; no voters: 
I20260709 13:12:16.820083 31256 raft_consensus.cc:2468] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c642698d21b74372809ac4b52afb84ac in term 2.
I20260709 13:12:16.820263 31394 raft_consensus.cc:2804] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:16.820811 31394 raft_consensus.cc:697] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac [term 2 LEADER]: Becoming Leader. State: Replica: c642698d21b74372809ac4b52afb84ac, State: Running, Role: LEADER
I20260709 13:12:16.821692 31394 consensus_queue.cc:237] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:16.829135 31004 catalog_manager.cc:5697] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac reported cstate change: term changed from 1 to 2, leader changed from bd884325e7c04a4881234aab42242565 (127.30.63.3) to c642698d21b74372809ac4b52afb84ac (127.30.63.1). New cstate: current_term: 2 leader_uuid: "c642698d21b74372809ac4b52afb84ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:16.830070 31307 raft_consensus.cc:993] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6: : Instructing follower c642698d21b74372809ac4b52afb84ac to start an election
I20260709 13:12:16.830502 31307 raft_consensus.cc:1081] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 2 LEADER]: Signalling peer c642698d21b74372809ac4b52afb84ac to start an election
I20260709 13:12:16.832319 31106 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f381d6577987460089dd2bafc44bd7f0"
dest_uuid: "c642698d21b74372809ac4b52afb84ac"
 from {username='slave'} at 127.0.0.1:44174
I20260709 13:12:16.833005 31106 raft_consensus.cc:493] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:16.833377 31106 raft_consensus.cc:3060] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:16.838825 31106 raft_consensus.cc:515] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:16.840509 31106 leader_election.cc:290] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 3 election: Requested vote from peers 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:16.841317 31182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f381d6577987460089dd2bafc44bd7f0" candidate_uuid: "c642698d21b74372809ac4b52afb84ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
I20260709 13:12:16.841698 31256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f381d6577987460089dd2bafc44bd7f0" candidate_uuid: "c642698d21b74372809ac4b52afb84ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "bd884325e7c04a4881234aab42242565"
I20260709 13:12:16.841905 31182 raft_consensus.cc:3055] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:16.842247 31256 raft_consensus.cc:3060] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:16.842259 31182 raft_consensus.cc:740] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3a308d97210c4aa2b2e354face3eaba6, State: Running, Role: LEADER
I20260709 13:12:16.843132 31182 consensus_queue.cc:260] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:16.844062 31182 raft_consensus.cc:3060] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:16.847755 31256 raft_consensus.cc:2468] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c642698d21b74372809ac4b52afb84ac in term 3.
I20260709 13:12:16.848389 31182 raft_consensus.cc:2468] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c642698d21b74372809ac4b52afb84ac in term 3.
I20260709 13:12:16.848958 31072 leader_election.cc:304] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd884325e7c04a4881234aab42242565, c642698d21b74372809ac4b52afb84ac; no voters: 
I20260709 13:12:16.849874 31394 raft_consensus.cc:2804] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:16.850335 31394 raft_consensus.cc:697] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [term 3 LEADER]: Becoming Leader. State: Replica: c642698d21b74372809ac4b52afb84ac, State: Running, Role: LEADER
I20260709 13:12:16.851156 31394 consensus_queue.cc:237] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:16.857905 31004 catalog_manager.cc:5697] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac reported cstate change: term changed from 2 to 3, leader changed from 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2) to c642698d21b74372809ac4b52afb84ac (127.30.63.1). New cstate: current_term: 3 leader_uuid: "c642698d21b74372809ac4b52afb84ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:16.973819 31396 raft_consensus.cc:993] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6: : Instructing follower bd884325e7c04a4881234aab42242565 to start an election
I20260709 13:12:16.974375 31376 raft_consensus.cc:1081] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 [term 1 LEADER]: Signalling peer bd884325e7c04a4881234aab42242565 to start an election
I20260709 13:12:16.975973 31256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f927a373038947bb917685c470b28d9d"
dest_uuid: "bd884325e7c04a4881234aab42242565"
 from {username='slave'} at 127.0.0.1:43510
I20260709 13:12:16.976548 31256 raft_consensus.cc:493] T f927a373038947bb917685c470b28d9d P bd884325e7c04a4881234aab42242565 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:16.976958 31256 raft_consensus.cc:3060] T f927a373038947bb917685c470b28d9d P bd884325e7c04a4881234aab42242565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.981676 31256 raft_consensus.cc:515] T f927a373038947bb917685c470b28d9d P bd884325e7c04a4881234aab42242565 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:16.983544 31256 leader_election.cc:290] T f927a373038947bb917685c470b28d9d P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 2 election: Requested vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265)
I20260709 13:12:16.984493 31106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f927a373038947bb917685c470b28d9d" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c642698d21b74372809ac4b52afb84ac"
I20260709 13:12:16.984687 31182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f927a373038947bb917685c470b28d9d" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
I20260709 13:12:16.985169 31106 raft_consensus.cc:3060] T f927a373038947bb917685c470b28d9d P c642698d21b74372809ac4b52afb84ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.985334 31182 raft_consensus.cc:3055] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:16.985754 31182 raft_consensus.cc:740] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3a308d97210c4aa2b2e354face3eaba6, State: Running, Role: LEADER
I20260709 13:12:16.986773 31182 consensus_queue.cc:260] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:16.987759 31182 raft_consensus.cc:3060] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.989327 31406 raft_consensus.cc:993] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac: : Instructing follower 3a308d97210c4aa2b2e354face3eaba6 to start an election
I20260709 13:12:16.989814 31394 raft_consensus.cc:1081] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [term 1 LEADER]: Signalling peer 3a308d97210c4aa2b2e354face3eaba6 to start an election
I20260709 13:12:16.991918 31181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01a1c64224014d3081d51a1b8b6bcacb"
dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
 from {username='slave'} at 127.0.0.1:43586
I20260709 13:12:16.992319 31106 raft_consensus.cc:2468] T f927a373038947bb917685c470b28d9d P c642698d21b74372809ac4b52afb84ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd884325e7c04a4881234aab42242565 in term 2.
I20260709 13:12:16.992542 31181 raft_consensus.cc:493] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:16.993017 31181 raft_consensus.cc:3060] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.993728 31222 leader_election.cc:304] T f927a373038947bb917685c470b28d9d P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd884325e7c04a4881234aab42242565, c642698d21b74372809ac4b52afb84ac; no voters: 
I20260709 13:12:16.994505 31399 raft_consensus.cc:2804] T f927a373038947bb917685c470b28d9d P bd884325e7c04a4881234aab42242565 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:16.994882 31182 raft_consensus.cc:2468] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd884325e7c04a4881234aab42242565 in term 2.
I20260709 13:12:16.994979 31399 raft_consensus.cc:697] T f927a373038947bb917685c470b28d9d P bd884325e7c04a4881234aab42242565 [term 2 LEADER]: Becoming Leader. State: Replica: bd884325e7c04a4881234aab42242565, State: Running, Role: LEADER
I20260709 13:12:16.995975 31399 consensus_queue.cc:237] T f927a373038947bb917685c470b28d9d P bd884325e7c04a4881234aab42242565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:17.000576 31181 raft_consensus.cc:515] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:17.002756 31181 leader_election.cc:290] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 2 election: Requested vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:17.003458 31106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a1c64224014d3081d51a1b8b6bcacb" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c642698d21b74372809ac4b52afb84ac"
I20260709 13:12:17.003743 31256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a1c64224014d3081d51a1b8b6bcacb" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd884325e7c04a4881234aab42242565"
I20260709 13:12:17.004083 31106 raft_consensus.cc:3055] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:17.004317 31256 raft_consensus.cc:3060] T 01a1c64224014d3081d51a1b8b6bcacb P bd884325e7c04a4881234aab42242565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.004478 31106 raft_consensus.cc:740] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c642698d21b74372809ac4b52afb84ac, State: Running, Role: LEADER
I20260709 13:12:17.004555 31004 catalog_manager.cc:5697] T f927a373038947bb917685c470b28d9d P bd884325e7c04a4881234aab42242565 reported cstate change: term changed from 1 to 2, leader changed from 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2) to bd884325e7c04a4881234aab42242565 (127.30.63.3). New cstate: current_term: 2 leader_uuid: "bd884325e7c04a4881234aab42242565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:17.005432 31106 consensus_queue.cc:260] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:17.006472 31106 raft_consensus.cc:3060] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.009928 31256 raft_consensus.cc:2468] T 01a1c64224014d3081d51a1b8b6bcacb P bd884325e7c04a4881234aab42242565 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a308d97210c4aa2b2e354face3eaba6 in term 2.
I20260709 13:12:17.011389 31147 leader_election.cc:304] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a308d97210c4aa2b2e354face3eaba6, bd884325e7c04a4881234aab42242565; no voters: 
I20260709 13:12:17.012166 31376 raft_consensus.cc:2804] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:17.012684 31376 raft_consensus.cc:697] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6 [term 2 LEADER]: Becoming Leader. State: Replica: 3a308d97210c4aa2b2e354face3eaba6, State: Running, Role: LEADER
I20260709 13:12:17.012883 31106 raft_consensus.cc:2468] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a308d97210c4aa2b2e354face3eaba6 in term 2.
I20260709 13:12:17.013525 31376 consensus_queue.cc:237] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:17.020733 31004 catalog_manager.cc:5697] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6 reported cstate change: term changed from 1 to 2, leader changed from c642698d21b74372809ac4b52afb84ac (127.30.63.1) to 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "3a308d97210c4aa2b2e354face3eaba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:17.061431 31256 raft_consensus.cc:1275] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [term 2 FOLLOWER]: Refusing update from remote peer c642698d21b74372809ac4b52afb84ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:17.062626 31394 consensus_queue.cc:1048] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:17.073068 31181 raft_consensus.cc:1275] T 2023200c6d3742889adb5d28fb3614d9 P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Refusing update from remote peer c642698d21b74372809ac4b52afb84ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:17.076695 31394 consensus_queue.cc:1048] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:17.112423 31388 raft_consensus.cc:993] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565: : Instructing follower c642698d21b74372809ac4b52afb84ac to start an election
I20260709 13:12:17.112879 31399 raft_consensus.cc:1081] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [term 1 LEADER]: Signalling peer c642698d21b74372809ac4b52afb84ac to start an election
I20260709 13:12:17.114434 31106 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe04b62ac7494d05afaa4d1b0df2b52b"
dest_uuid: "c642698d21b74372809ac4b52afb84ac"
 from {username='slave'} at 127.0.0.1:44162
I20260709 13:12:17.115039 31106 raft_consensus.cc:493] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:17.115425 31106 raft_consensus.cc:3060] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.116267 31105 raft_consensus.cc:1275] T d084968581fc49f5bb08a64e65c22b69 P c642698d21b74372809ac4b52afb84ac [term 2 FOLLOWER]: Refusing update from remote peer 3a308d97210c4aa2b2e354face3eaba6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:17.117576 31376 consensus_queue.cc:1048] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:17.120538 31106 raft_consensus.cc:515] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:17.123165 31181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe04b62ac7494d05afaa4d1b0df2b52b" candidate_uuid: "c642698d21b74372809ac4b52afb84ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
I20260709 13:12:17.123380 31256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe04b62ac7494d05afaa4d1b0df2b52b" candidate_uuid: "c642698d21b74372809ac4b52afb84ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd884325e7c04a4881234aab42242565"
I20260709 13:12:17.123821 31181 raft_consensus.cc:3060] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.123917 31256 raft_consensus.cc:3055] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:17.124261 31256 raft_consensus.cc:740] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd884325e7c04a4881234aab42242565, State: Running, Role: LEADER
I20260709 13:12:17.125164 31256 consensus_queue.cc:260] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:17.126267 31256 raft_consensus.cc:3060] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.127924 31255 raft_consensus.cc:1275] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [term 2 FOLLOWER]: Refusing update from remote peer 3a308d97210c4aa2b2e354face3eaba6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:17.131173 31376 consensus_queue.cc:1048] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:17.131168 31181 raft_consensus.cc:2468] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c642698d21b74372809ac4b52afb84ac in term 2.
I20260709 13:12:17.133723 31256 raft_consensus.cc:2468] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c642698d21b74372809ac4b52afb84ac in term 2.
I20260709 13:12:17.134310 31070 leader_election.cc:304] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a308d97210c4aa2b2e354face3eaba6, c642698d21b74372809ac4b52afb84ac; no voters: 
I20260709 13:12:17.135136 31394 raft_consensus.cc:2804] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:17.123183 31106 leader_election.cc:290] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 2 election: Requested vote from peers 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:17.135681 31394 raft_consensus.cc:697] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [term 2 LEADER]: Becoming Leader. State: Replica: c642698d21b74372809ac4b52afb84ac, State: Running, Role: LEADER
I20260709 13:12:17.136565 31394 consensus_queue.cc:237] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:17.154263 31001 catalog_manager.cc:5697] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac reported cstate change: term changed from 1 to 2, leader changed from bd884325e7c04a4881234aab42242565 (127.30.63.3) to c642698d21b74372809ac4b52afb84ac (127.30.63.1). New cstate: current_term: 2 leader_uuid: "c642698d21b74372809ac4b52afb84ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:17.222344 31255 raft_consensus.cc:1275] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 2 FOLLOWER]: Refusing update from remote peer c642698d21b74372809ac4b52afb84ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:17.223712 31394 consensus_queue.cc:1048] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:17.234040 31181 raft_consensus.cc:1275] T d600bdfab3484da2bdc8b47a47edfced P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Refusing update from remote peer c642698d21b74372809ac4b52afb84ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:17.236240 31406 consensus_queue.cc:1048] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:17.256445 31181 raft_consensus.cc:1275] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 3 FOLLOWER]: Refusing update from remote peer c642698d21b74372809ac4b52afb84ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:17.257685 31406 consensus_queue.cc:1048] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:17.265005 31255 raft_consensus.cc:1275] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [term 3 FOLLOWER]: Refusing update from remote peer c642698d21b74372809ac4b52afb84ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:17.266673 31394 consensus_queue.cc:1048] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:17.402787 31255 raft_consensus.cc:1275] T 01a1c64224014d3081d51a1b8b6bcacb P bd884325e7c04a4881234aab42242565 [term 2 FOLLOWER]: Refusing update from remote peer 3a308d97210c4aa2b2e354face3eaba6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:17.404235 31307 consensus_queue.cc:1048] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:17.413981 31105 raft_consensus.cc:1275] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [term 2 FOLLOWER]: Refusing update from remote peer 3a308d97210c4aa2b2e354face3eaba6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:17.415477 31307 consensus_queue.cc:1048] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:17.447358 31181 raft_consensus.cc:1275] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Refusing update from remote peer bd884325e7c04a4881234aab42242565: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:17.448972 31399 consensus_queue.cc:1048] T f927a373038947bb917685c470b28d9d P bd884325e7c04a4881234aab42242565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:17.459985 31105 raft_consensus.cc:1275] T f927a373038947bb917685c470b28d9d P c642698d21b74372809ac4b52afb84ac [term 2 FOLLOWER]: Refusing update from remote peer bd884325e7c04a4881234aab42242565: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:17.461623 31399 consensus_queue.cc:1048] T f927a373038947bb917685c470b28d9d P bd884325e7c04a4881234aab42242565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:17.659042 31255 raft_consensus.cc:1275] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [term 2 FOLLOWER]: Refusing update from remote peer c642698d21b74372809ac4b52afb84ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:17.660944 31394 consensus_queue.cc:1048] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:17.669868 31181 raft_consensus.cc:1275] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Refusing update from remote peer c642698d21b74372809ac4b52afb84ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:17.671252 31417 consensus_queue.cc:1048] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:19.597810 30972 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:12:19.598693 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:19.623656 31181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa80f98d0ce4477aa88171401d262c3f"
dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
mode: GRACEFUL
new_leader_uuid: "bd884325e7c04a4881234aab42242565"
 from {username='slave'} at 127.0.0.1:42232
I20260709 13:12:19.624419 31181 raft_consensus.cc:606] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [term 1 LEADER]: Received request to transfer leadership to TS bd884325e7c04a4881234aab42242565
I20260709 13:12:19.637395 31105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d600bdfab3484da2bdc8b47a47edfced"
dest_uuid: "c642698d21b74372809ac4b52afb84ac"
mode: GRACEFUL
new_leader_uuid: "bd884325e7c04a4881234aab42242565"
 from {username='slave'} at 127.0.0.1:43564
I20260709 13:12:19.637956 31105 raft_consensus.cc:606] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac [term 2 LEADER]: Received request to transfer leadership to TS bd884325e7c04a4881234aab42242565
I20260709 13:12:19.639207 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:19.639644 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:19.819466 31440 raft_consensus.cc:993] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6: : Instructing follower bd884325e7c04a4881234aab42242565 to start an election
I20260709 13:12:19.819952 31440 raft_consensus.cc:1081] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [term 1 LEADER]: Signalling peer bd884325e7c04a4881234aab42242565 to start an election
I20260709 13:12:19.821465 31256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa80f98d0ce4477aa88171401d262c3f"
dest_uuid: "bd884325e7c04a4881234aab42242565"
 from {username='slave'} at 127.0.0.1:43510
I20260709 13:12:19.821980 31256 raft_consensus.cc:493] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:19.822278 31256 raft_consensus.cc:3060] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:19.826668 31256 raft_consensus.cc:515] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:19.828537 31256 leader_election.cc:290] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 2 election: Requested vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265)
I20260709 13:12:19.829608 31105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa80f98d0ce4477aa88171401d262c3f" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c642698d21b74372809ac4b52afb84ac"
I20260709 13:12:19.830127 31181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa80f98d0ce4477aa88171401d262c3f" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
I20260709 13:12:19.830307 31105 raft_consensus.cc:3060] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:19.830709 31181 raft_consensus.cc:3055] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:19.831214 31181 raft_consensus.cc:740] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3a308d97210c4aa2b2e354face3eaba6, State: Running, Role: LEADER
I20260709 13:12:19.831985 31181 consensus_queue.cc:260] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:19.833088 31181 raft_consensus.cc:3060] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:19.835721 31105 raft_consensus.cc:2468] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd884325e7c04a4881234aab42242565 in term 2.
I20260709 13:12:19.837445 31222 leader_election.cc:304] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd884325e7c04a4881234aab42242565, c642698d21b74372809ac4b52afb84ac; no voters: 
I20260709 13:12:19.838194 31436 raft_consensus.cc:2804] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:19.838395 31181 raft_consensus.cc:2468] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd884325e7c04a4881234aab42242565 in term 2.
I20260709 13:12:19.839777 31436 raft_consensus.cc:697] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565 [term 2 LEADER]: Becoming Leader. State: Replica: bd884325e7c04a4881234aab42242565, State: Running, Role: LEADER
I20260709 13:12:19.841058 31436 consensus_queue.cc:237] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:19.848308 31004 catalog_manager.cc:5697] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565 reported cstate change: term changed from 1 to 2, leader changed from 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2) to bd884325e7c04a4881234aab42242565 (127.30.63.3). New cstate: current_term: 2 leader_uuid: "bd884325e7c04a4881234aab42242565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:19.930083 31447 raft_consensus.cc:993] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac: : Instructing follower bd884325e7c04a4881234aab42242565 to start an election
I20260709 13:12:19.930548 31417 raft_consensus.cc:1081] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac [term 2 LEADER]: Signalling peer bd884325e7c04a4881234aab42242565 to start an election
I20260709 13:12:19.932632 31256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d600bdfab3484da2bdc8b47a47edfced"
dest_uuid: "bd884325e7c04a4881234aab42242565"
 from {username='slave'} at 127.0.0.1:43520
I20260709 13:12:19.933192 31256 raft_consensus.cc:493] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:19.933480 31256 raft_consensus.cc:3060] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:19.937493 31256 raft_consensus.cc:515] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:19.938927 31256 leader_election.cc:290] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 3 election: Requested vote from peers 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265), c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579)
I20260709 13:12:19.939898 31181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d600bdfab3484da2bdc8b47a47edfced" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
I20260709 13:12:19.940068 31105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d600bdfab3484da2bdc8b47a47edfced" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c642698d21b74372809ac4b52afb84ac"
I20260709 13:12:19.940397 31181 raft_consensus.cc:3060] T d600bdfab3484da2bdc8b47a47edfced P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:19.940817 31105 raft_consensus.cc:3055] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:19.941128 31105 raft_consensus.cc:740] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c642698d21b74372809ac4b52afb84ac, State: Running, Role: LEADER
I20260709 13:12:19.941915 31105 consensus_queue.cc:260] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:19.943063 31105 raft_consensus.cc:3060] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:19.946002 31181 raft_consensus.cc:2468] T d600bdfab3484da2bdc8b47a47edfced P 3a308d97210c4aa2b2e354face3eaba6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd884325e7c04a4881234aab42242565 in term 3.
I20260709 13:12:19.947113 31219 leader_election.cc:304] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a308d97210c4aa2b2e354face3eaba6, bd884325e7c04a4881234aab42242565; no voters: 
I20260709 13:12:19.947892 31436 raft_consensus.cc:2804] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:19.948268 31105 raft_consensus.cc:2468] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd884325e7c04a4881234aab42242565 in term 3.
I20260709 13:12:19.948396 31436 raft_consensus.cc:697] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 3 LEADER]: Becoming Leader. State: Replica: bd884325e7c04a4881234aab42242565, State: Running, Role: LEADER
I20260709 13:12:19.949216 31436 consensus_queue.cc:237] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:19.956775 31004 catalog_manager.cc:5697] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 reported cstate change: term changed from 2 to 3, leader changed from c642698d21b74372809ac4b52afb84ac (127.30.63.1) to bd884325e7c04a4881234aab42242565 (127.30.63.3). New cstate: current_term: 3 leader_uuid: "bd884325e7c04a4881234aab42242565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:20.266559 31105 raft_consensus.cc:1275] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac [term 2 FOLLOWER]: Refusing update from remote peer bd884325e7c04a4881234aab42242565: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:20.268007 31436 consensus_queue.cc:1048] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:20.278918 31182 raft_consensus.cc:1275] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Refusing update from remote peer bd884325e7c04a4881234aab42242565: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:20.280526 31441 consensus_queue.cc:1048] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:20.334926 31105 raft_consensus.cc:1275] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac [term 3 FOLLOWER]: Refusing update from remote peer bd884325e7c04a4881234aab42242565: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:20.336323 31441 consensus_queue.cc:1048] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:20.340065 31182 raft_consensus.cc:1275] T d600bdfab3484da2bdc8b47a47edfced P 3a308d97210c4aa2b2e354face3eaba6 [term 3 FOLLOWER]: Refusing update from remote peer bd884325e7c04a4881234aab42242565: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:20.341866 31441 consensus_queue.cc:1048] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:20.640640 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:20.654008 31256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d600bdfab3484da2bdc8b47a47edfced"
dest_uuid: "bd884325e7c04a4881234aab42242565"
mode: GRACEFUL
new_leader_uuid: "3a308d97210c4aa2b2e354face3eaba6"
 from {username='slave'} at 127.0.0.1:43532
I20260709 13:12:20.654486 31256 raft_consensus.cc:606] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 3 LEADER]: Received request to transfer leadership to TS 3a308d97210c4aa2b2e354face3eaba6
I20260709 13:12:20.660315 31105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe04b62ac7494d05afaa4d1b0df2b52b"
dest_uuid: "c642698d21b74372809ac4b52afb84ac"
mode: GRACEFUL
new_leader_uuid: "3a308d97210c4aa2b2e354face3eaba6"
 from {username='slave'} at 127.0.0.1:44176
I20260709 13:12:20.660914 31105 raft_consensus.cc:606] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [term 2 LEADER]: Received request to transfer leadership to TS 3a308d97210c4aa2b2e354face3eaba6
I20260709 13:12:20.667009 31105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2023200c6d3742889adb5d28fb3614d9"
dest_uuid: "c642698d21b74372809ac4b52afb84ac"
mode: GRACEFUL
new_leader_uuid: "3a308d97210c4aa2b2e354face3eaba6"
 from {username='slave'} at 127.0.0.1:44176
I20260709 13:12:20.667500 31105 raft_consensus.cc:606] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac [term 2 LEADER]: Received request to transfer leadership to TS 3a308d97210c4aa2b2e354face3eaba6
I20260709 13:12:20.673089 31105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f381d6577987460089dd2bafc44bd7f0"
dest_uuid: "c642698d21b74372809ac4b52afb84ac"
mode: GRACEFUL
new_leader_uuid: "3a308d97210c4aa2b2e354face3eaba6"
 from {username='slave'} at 127.0.0.1:44176
I20260709 13:12:20.673586 31105 raft_consensus.cc:606] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [term 3 LEADER]: Received request to transfer leadership to TS 3a308d97210c4aa2b2e354face3eaba6
I20260709 13:12:20.682979 31256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa80f98d0ce4477aa88171401d262c3f"
dest_uuid: "bd884325e7c04a4881234aab42242565"
mode: GRACEFUL
new_leader_uuid: "3a308d97210c4aa2b2e354face3eaba6"
 from {username='slave'} at 127.0.0.1:43532
I20260709 13:12:20.683665 31256 raft_consensus.cc:606] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565 [term 2 LEADER]: Received request to transfer leadership to TS 3a308d97210c4aa2b2e354face3eaba6
I20260709 13:12:20.762946 31436 raft_consensus.cc:993] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565: : Instructing follower 3a308d97210c4aa2b2e354face3eaba6 to start an election
I20260709 13:12:20.764222 31455 raft_consensus.cc:1081] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 3 LEADER]: Signalling peer 3a308d97210c4aa2b2e354face3eaba6 to start an election
I20260709 13:12:20.766506 31182 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d600bdfab3484da2bdc8b47a47edfced"
dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
 from {username='slave'} at 127.0.0.1:43584
I20260709 13:12:20.767226 31182 raft_consensus.cc:493] T d600bdfab3484da2bdc8b47a47edfced P 3a308d97210c4aa2b2e354face3eaba6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:20.767575 31182 raft_consensus.cc:3060] T d600bdfab3484da2bdc8b47a47edfced P 3a308d97210c4aa2b2e354face3eaba6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:20.774341 31182 raft_consensus.cc:515] T d600bdfab3484da2bdc8b47a47edfced P 3a308d97210c4aa2b2e354face3eaba6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:20.776537 31182 leader_election.cc:290] T d600bdfab3484da2bdc8b47a47edfced P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 4 election: Requested vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:20.778363 31106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d600bdfab3484da2bdc8b47a47edfced" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c642698d21b74372809ac4b52afb84ac"
I20260709 13:12:20.778743 31256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d600bdfab3484da2bdc8b47a47edfced" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bd884325e7c04a4881234aab42242565"
I20260709 13:12:20.779203 31106 raft_consensus.cc:3060] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:20.779253 31256 raft_consensus.cc:3055] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:20.779699 31256 raft_consensus.cc:740] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bd884325e7c04a4881234aab42242565, State: Running, Role: LEADER
I20260709 13:12:20.780692 31256 consensus_queue.cc:260] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:20.782338 31256 raft_consensus.cc:3060] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:20.787533 31106 raft_consensus.cc:2468] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a308d97210c4aa2b2e354face3eaba6 in term 4.
I20260709 13:12:20.789053 31148 leader_election.cc:304] T d600bdfab3484da2bdc8b47a47edfced P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a308d97210c4aa2b2e354face3eaba6, c642698d21b74372809ac4b52afb84ac; no voters: 
I20260709 13:12:20.790244 31256 raft_consensus.cc:2468] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a308d97210c4aa2b2e354face3eaba6 in term 4.
I20260709 13:12:20.790289 31440 raft_consensus.cc:2804] T d600bdfab3484da2bdc8b47a47edfced P 3a308d97210c4aa2b2e354face3eaba6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:20.792934 31440 raft_consensus.cc:697] T d600bdfab3484da2bdc8b47a47edfced P 3a308d97210c4aa2b2e354face3eaba6 [term 4 LEADER]: Becoming Leader. State: Replica: 3a308d97210c4aa2b2e354face3eaba6, State: Running, Role: LEADER
I20260709 13:12:20.794107 31440 consensus_queue.cc:237] T d600bdfab3484da2bdc8b47a47edfced P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:20.802402 31004 catalog_manager.cc:5697] T d600bdfab3484da2bdc8b47a47edfced P 3a308d97210c4aa2b2e354face3eaba6 reported cstate change: term changed from 3 to 4, leader changed from bd884325e7c04a4881234aab42242565 (127.30.63.3) to 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2). New cstate: current_term: 4 leader_uuid: "3a308d97210c4aa2b2e354face3eaba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:20.855549 31463 raft_consensus.cc:993] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac: : Instructing follower 3a308d97210c4aa2b2e354face3eaba6 to start an election
I20260709 13:12:20.855991 31463 raft_consensus.cc:1081] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [term 3 LEADER]: Signalling peer 3a308d97210c4aa2b2e354face3eaba6 to start an election
I20260709 13:12:20.857824 31182 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f381d6577987460089dd2bafc44bd7f0"
dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
 from {username='slave'} at 127.0.0.1:43586
I20260709 13:12:20.858486 31182 raft_consensus.cc:493] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:20.858798 31182 raft_consensus.cc:3060] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:20.864262 31182 raft_consensus.cc:515] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:20.867522 31182 leader_election.cc:290] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 4 election: Requested vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:20.867820 31106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f381d6577987460089dd2bafc44bd7f0" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "c642698d21b74372809ac4b52afb84ac"
I20260709 13:12:20.868067 31256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f381d6577987460089dd2bafc44bd7f0" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "bd884325e7c04a4881234aab42242565"
I20260709 13:12:20.868458 31106 raft_consensus.cc:3055] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:20.868726 31256 raft_consensus.cc:3060] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:20.869063 31106 raft_consensus.cc:740] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c642698d21b74372809ac4b52afb84ac, State: Running, Role: LEADER
I20260709 13:12:20.869843 31106 consensus_queue.cc:260] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:20.871122 31106 raft_consensus.cc:3060] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:20.875273 31256 raft_consensus.cc:2468] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a308d97210c4aa2b2e354face3eaba6 in term 4.
I20260709 13:12:20.877039 31147 leader_election.cc:304] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a308d97210c4aa2b2e354face3eaba6, bd884325e7c04a4881234aab42242565; no voters: 
I20260709 13:12:20.877475 31106 raft_consensus.cc:2468] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a308d97210c4aa2b2e354face3eaba6 in term 4.
I20260709 13:12:20.877854 31440 raft_consensus.cc:2804] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:20.878326 31440 raft_consensus.cc:697] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 4 LEADER]: Becoming Leader. State: Replica: 3a308d97210c4aa2b2e354face3eaba6, State: Running, Role: LEADER
I20260709 13:12:20.879206 31440 consensus_queue.cc:237] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:20.888166 31004 catalog_manager.cc:5697] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 reported cstate change: term changed from 3 to 4, leader changed from c642698d21b74372809ac4b52afb84ac (127.30.63.1) to 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2). New cstate: current_term: 4 leader_uuid: "3a308d97210c4aa2b2e354face3eaba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:20.889765 31455 raft_consensus.cc:993] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565: : Instructing follower 3a308d97210c4aa2b2e354face3eaba6 to start an election
I20260709 13:12:20.890268 31455 raft_consensus.cc:1081] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565 [term 2 LEADER]: Signalling peer 3a308d97210c4aa2b2e354face3eaba6 to start an election
I20260709 13:12:20.894871 31182 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa80f98d0ce4477aa88171401d262c3f"
dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
 from {username='slave'} at 127.0.0.1:43584
I20260709 13:12:20.895500 31182 raft_consensus.cc:493] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:20.896422 31182 raft_consensus.cc:3060] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:20.903314 31182 raft_consensus.cc:515] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:20.904865 31182 leader_election.cc:290] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 3 election: Requested vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:20.906157 31106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa80f98d0ce4477aa88171401d262c3f" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c642698d21b74372809ac4b52afb84ac"
I20260709 13:12:20.906155 31256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa80f98d0ce4477aa88171401d262c3f" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd884325e7c04a4881234aab42242565"
I20260709 13:12:20.907155 31106 raft_consensus.cc:3060] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:20.907178 31256 raft_consensus.cc:3055] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:20.907634 31256 raft_consensus.cc:740] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bd884325e7c04a4881234aab42242565, State: Running, Role: LEADER
I20260709 13:12:20.908455 31256 consensus_queue.cc:260] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:20.909835 31256 raft_consensus.cc:3060] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:20.914180 31106 raft_consensus.cc:2468] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a308d97210c4aa2b2e354face3eaba6 in term 3.
I20260709 13:12:20.915671 31148 leader_election.cc:304] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a308d97210c4aa2b2e354face3eaba6, c642698d21b74372809ac4b52afb84ac; no voters: 
I20260709 13:12:20.916455 31256 raft_consensus.cc:2468] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a308d97210c4aa2b2e354face3eaba6 in term 3.
I20260709 13:12:20.916832 31440 raft_consensus.cc:2804] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:20.917382 31440 raft_consensus.cc:697] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [term 3 LEADER]: Becoming Leader. State: Replica: 3a308d97210c4aa2b2e354face3eaba6, State: Running, Role: LEADER
I20260709 13:12:20.918370 31440 consensus_queue.cc:237] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:20.925323 31004 catalog_manager.cc:5697] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 reported cstate change: term changed from 2 to 3, leader changed from bd884325e7c04a4881234aab42242565 (127.30.63.3) to 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2). New cstate: current_term: 3 leader_uuid: "3a308d97210c4aa2b2e354face3eaba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:21.156394 31417 raft_consensus.cc:993] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac: : Instructing follower 3a308d97210c4aa2b2e354face3eaba6 to start an election
I20260709 13:12:21.156929 31463 raft_consensus.cc:1081] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac [term 2 LEADER]: Signalling peer 3a308d97210c4aa2b2e354face3eaba6 to start an election
I20260709 13:12:21.158592 31182 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2023200c6d3742889adb5d28fb3614d9"
dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
 from {username='slave'} at 127.0.0.1:43586
I20260709 13:12:21.158984 31182 raft_consensus.cc:493] T 2023200c6d3742889adb5d28fb3614d9 P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:21.159207 31182 raft_consensus.cc:3060] T 2023200c6d3742889adb5d28fb3614d9 P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:21.163230 31182 raft_consensus.cc:515] T 2023200c6d3742889adb5d28fb3614d9 P 3a308d97210c4aa2b2e354face3eaba6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:21.164745 31182 leader_election.cc:290] T 2023200c6d3742889adb5d28fb3614d9 P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 3 election: Requested vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:21.165630 31106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2023200c6d3742889adb5d28fb3614d9" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c642698d21b74372809ac4b52afb84ac"
I20260709 13:12:21.165822 31255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2023200c6d3742889adb5d28fb3614d9" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd884325e7c04a4881234aab42242565"
I20260709 13:12:21.166282 31106 raft_consensus.cc:3055] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:21.166311 31255 raft_consensus.cc:3060] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:21.166785 31106 raft_consensus.cc:740] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c642698d21b74372809ac4b52afb84ac, State: Running, Role: LEADER
I20260709 13:12:21.167583 31106 consensus_queue.cc:260] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:21.168856 31106 raft_consensus.cc:3060] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:21.169934 31417 raft_consensus.cc:993] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac: : Instructing follower 3a308d97210c4aa2b2e354face3eaba6 to start an election
I20260709 13:12:21.170428 31463 raft_consensus.cc:1081] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [term 2 LEADER]: Signalling peer 3a308d97210c4aa2b2e354face3eaba6 to start an election
I20260709 13:12:21.172050 31182 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe04b62ac7494d05afaa4d1b0df2b52b"
dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
 from {username='slave'} at 127.0.0.1:43586
I20260709 13:12:21.172577 31182 raft_consensus.cc:493] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:21.172923 31182 raft_consensus.cc:3060] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:21.173799 31255 raft_consensus.cc:2468] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a308d97210c4aa2b2e354face3eaba6 in term 3.
I20260709 13:12:21.174922 31147 leader_election.cc:304] T 2023200c6d3742889adb5d28fb3614d9 P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a308d97210c4aa2b2e354face3eaba6, bd884325e7c04a4881234aab42242565; no voters: 
I20260709 13:12:21.175316 31106 raft_consensus.cc:2468] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a308d97210c4aa2b2e354face3eaba6 in term 3.
I20260709 13:12:21.175789 31440 raft_consensus.cc:2804] T 2023200c6d3742889adb5d28fb3614d9 P 3a308d97210c4aa2b2e354face3eaba6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:21.176440 31440 raft_consensus.cc:697] T 2023200c6d3742889adb5d28fb3614d9 P 3a308d97210c4aa2b2e354face3eaba6 [term 3 LEADER]: Becoming Leader. State: Replica: 3a308d97210c4aa2b2e354face3eaba6, State: Running, Role: LEADER
I20260709 13:12:21.177348 31440 consensus_queue.cc:237] T 2023200c6d3742889adb5d28fb3614d9 P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:21.178458 31182 raft_consensus.cc:515] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:21.180375 31182 leader_election.cc:290] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 3 election: Requested vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:21.181037 31106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe04b62ac7494d05afaa4d1b0df2b52b" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c642698d21b74372809ac4b52afb84ac"
I20260709 13:12:21.181653 31106 raft_consensus.cc:3055] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:21.182090 31106 raft_consensus.cc:740] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c642698d21b74372809ac4b52afb84ac, State: Running, Role: LEADER
I20260709 13:12:21.182090 31255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe04b62ac7494d05afaa4d1b0df2b52b" candidate_uuid: "3a308d97210c4aa2b2e354face3eaba6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd884325e7c04a4881234aab42242565"
I20260709 13:12:21.182883 31255 raft_consensus.cc:3060] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:21.183099 31106 consensus_queue.cc:260] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:21.184294 31106 raft_consensus.cc:3060] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:21.187731 31004 catalog_manager.cc:5697] T 2023200c6d3742889adb5d28fb3614d9 P 3a308d97210c4aa2b2e354face3eaba6 reported cstate change: term changed from 2 to 3, leader changed from c642698d21b74372809ac4b52afb84ac (127.30.63.1) to 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2). New cstate: current_term: 3 leader_uuid: "3a308d97210c4aa2b2e354face3eaba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:21.189467 31106 raft_consensus.cc:2468] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a308d97210c4aa2b2e354face3eaba6 in term 3.
I20260709 13:12:21.190287 31255 raft_consensus.cc:2468] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a308d97210c4aa2b2e354face3eaba6 in term 3.
I20260709 13:12:21.190596 31148 leader_election.cc:304] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a308d97210c4aa2b2e354face3eaba6, c642698d21b74372809ac4b52afb84ac; no voters: 
I20260709 13:12:21.191861 31440 raft_consensus.cc:2804] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:21.192302 31440 raft_consensus.cc:697] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [term 3 LEADER]: Becoming Leader. State: Replica: 3a308d97210c4aa2b2e354face3eaba6, State: Running, Role: LEADER
I20260709 13:12:21.193169 31440 consensus_queue.cc:237] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:21.202018 31004 catalog_manager.cc:5697] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 reported cstate change: term changed from 2 to 3, leader changed from c642698d21b74372809ac4b52afb84ac (127.30.63.1) to 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2). New cstate: current_term: 3 leader_uuid: "3a308d97210c4aa2b2e354face3eaba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:21.296728 31106 raft_consensus.cc:1275] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [term 4 FOLLOWER]: Refusing update from remote peer 3a308d97210c4aa2b2e354face3eaba6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:21.298046 31440 consensus_queue.cc:1048] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:21.312674 31255 raft_consensus.cc:1275] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [term 4 FOLLOWER]: Refusing update from remote peer 3a308d97210c4aa2b2e354face3eaba6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:21.314494 31440 consensus_queue.cc:1048] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:21.316670 31106 raft_consensus.cc:1275] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac [term 4 FOLLOWER]: Refusing update from remote peer 3a308d97210c4aa2b2e354face3eaba6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:21.318149 31440 consensus_queue.cc:1048] T d600bdfab3484da2bdc8b47a47edfced P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:21.326884 31255 raft_consensus.cc:1275] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 4 FOLLOWER]: Refusing update from remote peer 3a308d97210c4aa2b2e354face3eaba6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:21.328593 31458 consensus_queue.cc:1048] T d600bdfab3484da2bdc8b47a47edfced P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:21.362401 31255 raft_consensus.cc:1275] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565 [term 3 FOLLOWER]: Refusing update from remote peer 3a308d97210c4aa2b2e354face3eaba6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:21.363729 31458 consensus_queue.cc:1048] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:21.376391 31106 raft_consensus.cc:1275] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac [term 3 FOLLOWER]: Refusing update from remote peer 3a308d97210c4aa2b2e354face3eaba6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:21.377823 31458 consensus_queue.cc:1048] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:21.640841 31106 raft_consensus.cc:1275] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [term 3 FOLLOWER]: Refusing update from remote peer 3a308d97210c4aa2b2e354face3eaba6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:21.642092 31440 consensus_queue.cc:1048] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:21.651566 31255 raft_consensus.cc:1275] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [term 3 FOLLOWER]: Refusing update from remote peer 3a308d97210c4aa2b2e354face3eaba6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:21.653466 31469 consensus_queue.cc:1048] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:21.696662 31106 raft_consensus.cc:1275] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac [term 3 FOLLOWER]: Refusing update from remote peer 3a308d97210c4aa2b2e354face3eaba6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:21.698032 31440 consensus_queue.cc:1048] T 2023200c6d3742889adb5d28fb3614d9 P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:21.707880 31255 raft_consensus.cc:1275] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [term 3 FOLLOWER]: Refusing update from remote peer 3a308d97210c4aa2b2e354face3eaba6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:21.709643 31469 consensus_queue.cc:1048] T 2023200c6d3742889adb5d28fb3614d9 P 3a308d97210c4aa2b2e354face3eaba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:23.696930 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:23.704389 31182 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01a1c64224014d3081d51a1b8b6bcacb"
dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
mode: GRACEFUL
new_leader_uuid: "c642698d21b74372809ac4b52afb84ac"
 from {username='slave'} at 127.0.0.1:42232
I20260709 13:12:23.705080 31182 raft_consensus.cc:606] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6 [term 2 LEADER]: Received request to transfer leadership to TS c642698d21b74372809ac4b52afb84ac
I20260709 13:12:23.707908 31182 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58e537dfd4154312b2eb43471b19774d"
dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
mode: GRACEFUL
new_leader_uuid: "c642698d21b74372809ac4b52afb84ac"
 from {username='slave'} at 127.0.0.1:42232
I20260709 13:12:23.708406 31182 raft_consensus.cc:606] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 [term 1 LEADER]: Received request to transfer leadership to TS c642698d21b74372809ac4b52afb84ac
I20260709 13:12:23.710685 31182 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d084968581fc49f5bb08a64e65c22b69"
dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
mode: GRACEFUL
new_leader_uuid: "bd884325e7c04a4881234aab42242565"
 from {username='slave'} at 127.0.0.1:42232
I20260709 13:12:23.711143 31182 raft_consensus.cc:606] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6 [term 2 LEADER]: Received request to transfer leadership to TS bd884325e7c04a4881234aab42242565
I20260709 13:12:23.713387 31182 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f381d6577987460089dd2bafc44bd7f0"
dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
mode: GRACEFUL
new_leader_uuid: "bd884325e7c04a4881234aab42242565"
 from {username='slave'} at 127.0.0.1:42232
I20260709 13:12:23.713788 31182 raft_consensus.cc:606] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 4 LEADER]: Received request to transfer leadership to TS bd884325e7c04a4881234aab42242565
I20260709 13:12:23.716216 31182 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe04b62ac7494d05afaa4d1b0df2b52b"
dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
mode: GRACEFUL
new_leader_uuid: "c642698d21b74372809ac4b52afb84ac"
 from {username='slave'} at 127.0.0.1:42232
I20260709 13:12:23.716845 31182 raft_consensus.cc:606] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [term 3 LEADER]: Received request to transfer leadership to TS c642698d21b74372809ac4b52afb84ac
I20260709 13:12:23.717831 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:12:23.718278 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:23.844372 31481 raft_consensus.cc:993] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6: : Instructing follower c642698d21b74372809ac4b52afb84ac to start an election
I20260709 13:12:23.844903 31469 raft_consensus.cc:1081] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6 [term 2 LEADER]: Signalling peer c642698d21b74372809ac4b52afb84ac to start an election
I20260709 13:12:23.846342 31106 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01a1c64224014d3081d51a1b8b6bcacb"
dest_uuid: "c642698d21b74372809ac4b52afb84ac"
 from {username='slave'} at 127.0.0.1:44174
I20260709 13:12:23.846781 31106 raft_consensus.cc:493] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:23.847054 31106 raft_consensus.cc:3060] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:23.851153 31106 raft_consensus.cc:515] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:23.852573 31106 leader_election.cc:290] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 3 election: Requested vote from peers 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:23.853547 31256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a1c64224014d3081d51a1b8b6bcacb" candidate_uuid: "c642698d21b74372809ac4b52afb84ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd884325e7c04a4881234aab42242565"
I20260709 13:12:23.853564 31182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a1c64224014d3081d51a1b8b6bcacb" candidate_uuid: "c642698d21b74372809ac4b52afb84ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
I20260709 13:12:23.854179 31256 raft_consensus.cc:3060] T 01a1c64224014d3081d51a1b8b6bcacb P bd884325e7c04a4881234aab42242565 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:23.854200 31182 raft_consensus.cc:3055] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:23.854593 31182 raft_consensus.cc:740] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3a308d97210c4aa2b2e354face3eaba6, State: Running, Role: LEADER
I20260709 13:12:23.855185 31182 consensus_queue.cc:260] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:23.856037 31182 raft_consensus.cc:3060] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:23.858603 31256 raft_consensus.cc:2468] T 01a1c64224014d3081d51a1b8b6bcacb P bd884325e7c04a4881234aab42242565 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c642698d21b74372809ac4b52afb84ac in term 3.
I20260709 13:12:23.859954 31072 leader_election.cc:304] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd884325e7c04a4881234aab42242565, c642698d21b74372809ac4b52afb84ac; no voters: 
I20260709 13:12:23.860751 31182 raft_consensus.cc:2468] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c642698d21b74372809ac4b52afb84ac in term 3.
I20260709 13:12:23.861590 31482 raft_consensus.cc:2804] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:23.862555 31482 raft_consensus.cc:697] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [term 3 LEADER]: Becoming Leader. State: Replica: c642698d21b74372809ac4b52afb84ac, State: Running, Role: LEADER
I20260709 13:12:23.863307 31482 consensus_queue.cc:237] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:23.871109 31003 catalog_manager.cc:5697] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac reported cstate change: term changed from 2 to 3, leader changed from 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2) to c642698d21b74372809ac4b52afb84ac (127.30.63.1). New cstate: current_term: 3 leader_uuid: "c642698d21b74372809ac4b52afb84ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:23.916435 31481 raft_consensus.cc:993] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6: : Instructing follower bd884325e7c04a4881234aab42242565 to start an election
I20260709 13:12:23.917006 31469 raft_consensus.cc:1081] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 4 LEADER]: Signalling peer bd884325e7c04a4881234aab42242565 to start an election
I20260709 13:12:23.918557 31256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f381d6577987460089dd2bafc44bd7f0"
dest_uuid: "bd884325e7c04a4881234aab42242565"
 from {username='slave'} at 127.0.0.1:43510
I20260709 13:12:23.918959 31256 raft_consensus.cc:493] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:23.919183 31256 raft_consensus.cc:3060] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:23.923169 31256 raft_consensus.cc:515] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:23.924525 31256 leader_election.cc:290] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 5 election: Requested vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265)
I20260709 13:12:23.925570 31182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f381d6577987460089dd2bafc44bd7f0" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
I20260709 13:12:23.925570 31106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f381d6577987460089dd2bafc44bd7f0" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "c642698d21b74372809ac4b52afb84ac"
I20260709 13:12:23.926298 31182 raft_consensus.cc:3055] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:23.926326 31106 raft_consensus.cc:3060] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:23.926750 31182 raft_consensus.cc:740] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3a308d97210c4aa2b2e354face3eaba6, State: Running, Role: LEADER
I20260709 13:12:23.927503 31182 consensus_queue.cc:260] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:23.928577 31182 raft_consensus.cc:3060] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:23.933049 31106 raft_consensus.cc:2468] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd884325e7c04a4881234aab42242565 in term 5.
I20260709 13:12:23.934350 31222 leader_election.cc:304] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd884325e7c04a4881234aab42242565, c642698d21b74372809ac4b52afb84ac; no voters: 
I20260709 13:12:23.934805 31182 raft_consensus.cc:2468] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd884325e7c04a4881234aab42242565 in term 5.
I20260709 13:12:23.935315 31436 raft_consensus.cc:2804] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:23.936522 31436 raft_consensus.cc:697] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [term 5 LEADER]: Becoming Leader. State: Replica: bd884325e7c04a4881234aab42242565, State: Running, Role: LEADER
I20260709 13:12:23.937312 31436 consensus_queue.cc:237] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:23.944027 31003 catalog_manager.cc:5697] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 reported cstate change: term changed from 4 to 5, leader changed from 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2) to bd884325e7c04a4881234aab42242565 (127.30.63.3). New cstate: current_term: 5 leader_uuid: "bd884325e7c04a4881234aab42242565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:23.985872 31481 raft_consensus.cc:993] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6: : Instructing follower c642698d21b74372809ac4b52afb84ac to start an election
I20260709 13:12:23.986330 31481 raft_consensus.cc:1081] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 [term 1 LEADER]: Signalling peer c642698d21b74372809ac4b52afb84ac to start an election
I20260709 13:12:23.987819 31106 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58e537dfd4154312b2eb43471b19774d"
dest_uuid: "c642698d21b74372809ac4b52afb84ac"
 from {username='slave'} at 127.0.0.1:44174
I20260709 13:12:23.988222 31106 raft_consensus.cc:493] T 58e537dfd4154312b2eb43471b19774d P c642698d21b74372809ac4b52afb84ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:23.988507 31106 raft_consensus.cc:3060] T 58e537dfd4154312b2eb43471b19774d P c642698d21b74372809ac4b52afb84ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:23.993072 31106 raft_consensus.cc:515] T 58e537dfd4154312b2eb43471b19774d P c642698d21b74372809ac4b52afb84ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:23.994679 31106 leader_election.cc:290] T 58e537dfd4154312b2eb43471b19774d P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 2 election: Requested vote from peers 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:23.995630 31256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e537dfd4154312b2eb43471b19774d" candidate_uuid: "c642698d21b74372809ac4b52afb84ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd884325e7c04a4881234aab42242565"
I20260709 13:12:23.996161 31256 raft_consensus.cc:3060] T 58e537dfd4154312b2eb43471b19774d P bd884325e7c04a4881234aab42242565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:23.995628 31182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e537dfd4154312b2eb43471b19774d" candidate_uuid: "c642698d21b74372809ac4b52afb84ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
I20260709 13:12:23.996973 31182 raft_consensus.cc:3055] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:23.997279 31182 raft_consensus.cc:740] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3a308d97210c4aa2b2e354face3eaba6, State: Running, Role: LEADER
I20260709 13:12:23.997978 31182 consensus_queue.cc:260] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:23.999100 31182 raft_consensus.cc:3060] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.002369 31256 raft_consensus.cc:2468] T 58e537dfd4154312b2eb43471b19774d P bd884325e7c04a4881234aab42242565 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c642698d21b74372809ac4b52afb84ac in term 2.
I20260709 13:12:24.003475 31072 leader_election.cc:304] T 58e537dfd4154312b2eb43471b19774d P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd884325e7c04a4881234aab42242565, c642698d21b74372809ac4b52afb84ac; no voters: 
I20260709 13:12:24.004331 31482 raft_consensus.cc:2804] T 58e537dfd4154312b2eb43471b19774d P c642698d21b74372809ac4b52afb84ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:24.004783 31482 raft_consensus.cc:697] T 58e537dfd4154312b2eb43471b19774d P c642698d21b74372809ac4b52afb84ac [term 2 LEADER]: Becoming Leader. State: Replica: c642698d21b74372809ac4b52afb84ac, State: Running, Role: LEADER
I20260709 13:12:24.005146 31182 raft_consensus.cc:2468] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c642698d21b74372809ac4b52afb84ac in term 2.
I20260709 13:12:24.005681 31482 consensus_queue.cc:237] T 58e537dfd4154312b2eb43471b19774d P c642698d21b74372809ac4b52afb84ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:24.012252 31003 catalog_manager.cc:5697] T 58e537dfd4154312b2eb43471b19774d P c642698d21b74372809ac4b52afb84ac reported cstate change: term changed from 1 to 2, leader changed from 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2) to c642698d21b74372809ac4b52afb84ac (127.30.63.1). New cstate: current_term: 2 leader_uuid: "c642698d21b74372809ac4b52afb84ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.145313 31469 raft_consensus.cc:993] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6: : Instructing follower c642698d21b74372809ac4b52afb84ac to start an election
I20260709 13:12:24.145787 31481 raft_consensus.cc:1081] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [term 3 LEADER]: Signalling peer c642698d21b74372809ac4b52afb84ac to start an election
I20260709 13:12:24.147258 31106 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe04b62ac7494d05afaa4d1b0df2b52b"
dest_uuid: "c642698d21b74372809ac4b52afb84ac"
 from {username='slave'} at 127.0.0.1:44174
I20260709 13:12:24.147686 31106 raft_consensus.cc:493] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:24.147931 31106 raft_consensus.cc:3060] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:24.152175 31106 raft_consensus.cc:515] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:24.153654 31106 leader_election.cc:290] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 4 election: Requested vote from peers 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265), bd884325e7c04a4881234aab42242565 (127.30.63.3:37049)
I20260709 13:12:24.154582 31256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe04b62ac7494d05afaa4d1b0df2b52b" candidate_uuid: "c642698d21b74372809ac4b52afb84ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bd884325e7c04a4881234aab42242565"
I20260709 13:12:24.154510 31182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe04b62ac7494d05afaa4d1b0df2b52b" candidate_uuid: "c642698d21b74372809ac4b52afb84ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
I20260709 13:12:24.155177 31256 raft_consensus.cc:3060] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:24.155288 31182 raft_consensus.cc:3055] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:24.155627 31182 raft_consensus.cc:740] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3a308d97210c4aa2b2e354face3eaba6, State: Running, Role: LEADER
I20260709 13:12:24.156334 31182 consensus_queue.cc:260] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:24.157217 31182 raft_consensus.cc:3060] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:24.159613 31256 raft_consensus.cc:2468] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c642698d21b74372809ac4b52afb84ac in term 4.
I20260709 13:12:24.160749 31072 leader_election.cc:304] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd884325e7c04a4881234aab42242565, c642698d21b74372809ac4b52afb84ac; no voters: 
I20260709 13:12:24.161499 31182 raft_consensus.cc:2468] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c642698d21b74372809ac4b52afb84ac in term 4.
I20260709 13:12:24.161460 31482 raft_consensus.cc:2804] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:24.162084 31482 raft_consensus.cc:697] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [term 4 LEADER]: Becoming Leader. State: Replica: c642698d21b74372809ac4b52afb84ac, State: Running, Role: LEADER
I20260709 13:12:24.162946 31482 consensus_queue.cc:237] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:24.169539 31003 catalog_manager.cc:5697] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac reported cstate change: term changed from 3 to 4, leader changed from 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2) to c642698d21b74372809ac4b52afb84ac (127.30.63.1). New cstate: current_term: 4 leader_uuid: "c642698d21b74372809ac4b52afb84ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.250389 31469 raft_consensus.cc:993] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6: : Instructing follower bd884325e7c04a4881234aab42242565 to start an election
I20260709 13:12:24.250939 31469 raft_consensus.cc:1081] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6 [term 2 LEADER]: Signalling peer bd884325e7c04a4881234aab42242565 to start an election
I20260709 13:12:24.252626 31256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d084968581fc49f5bb08a64e65c22b69"
dest_uuid: "bd884325e7c04a4881234aab42242565"
 from {username='slave'} at 127.0.0.1:43510
I20260709 13:12:24.253212 31256 raft_consensus.cc:493] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:24.253634 31256 raft_consensus.cc:3060] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:24.257995 31256 raft_consensus.cc:515] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:24.259438 31256 leader_election.cc:290] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 3 election: Requested vote from peers c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579), 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2:46265)
I20260709 13:12:24.260470 31106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084968581fc49f5bb08a64e65c22b69" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c642698d21b74372809ac4b52afb84ac"
I20260709 13:12:24.260413 31182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d084968581fc49f5bb08a64e65c22b69" candidate_uuid: "bd884325e7c04a4881234aab42242565" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3a308d97210c4aa2b2e354face3eaba6"
I20260709 13:12:24.261163 31182 raft_consensus.cc:3055] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:24.261164 31106 raft_consensus.cc:3060] T d084968581fc49f5bb08a64e65c22b69 P c642698d21b74372809ac4b52afb84ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:24.261549 31182 raft_consensus.cc:740] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3a308d97210c4aa2b2e354face3eaba6, State: Running, Role: LEADER
I20260709 13:12:24.262205 31182 consensus_queue.cc:260] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:24.263010 31182 raft_consensus.cc:3060] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:24.265854 31106 raft_consensus.cc:2468] T d084968581fc49f5bb08a64e65c22b69 P c642698d21b74372809ac4b52afb84ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd884325e7c04a4881234aab42242565 in term 3.
I20260709 13:12:24.266877 31222 leader_election.cc:304] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd884325e7c04a4881234aab42242565, c642698d21b74372809ac4b52afb84ac; no voters: 
I20260709 13:12:24.267352 31182 raft_consensus.cc:2468] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd884325e7c04a4881234aab42242565 in term 3.
I20260709 13:12:24.267558 31436 raft_consensus.cc:2804] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:24.268065 31436 raft_consensus.cc:697] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [term 3 LEADER]: Becoming Leader. State: Replica: bd884325e7c04a4881234aab42242565, State: Running, Role: LEADER
I20260709 13:12:24.268898 31436 consensus_queue.cc:237] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } }
I20260709 13:12:24.275621 31003 catalog_manager.cc:5697] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 reported cstate change: term changed from 2 to 3, leader changed from 3a308d97210c4aa2b2e354face3eaba6 (127.30.63.2) to bd884325e7c04a4881234aab42242565 (127.30.63.3). New cstate: current_term: 3 leader_uuid: "bd884325e7c04a4881234aab42242565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:24.298811 31256 raft_consensus.cc:1275] T 01a1c64224014d3081d51a1b8b6bcacb P bd884325e7c04a4881234aab42242565 [term 3 FOLLOWER]: Refusing update from remote peer c642698d21b74372809ac4b52afb84ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:24.300092 31482 consensus_queue.cc:1048] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:24.312120 31182 raft_consensus.cc:1275] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6 [term 3 FOLLOWER]: Refusing update from remote peer c642698d21b74372809ac4b52afb84ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:24.315449 31482 consensus_queue.cc:1048] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:24.493149 31256 raft_consensus.cc:1275] T 58e537dfd4154312b2eb43471b19774d P bd884325e7c04a4881234aab42242565 [term 2 FOLLOWER]: Refusing update from remote peer c642698d21b74372809ac4b52afb84ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:24.494326 31496 consensus_queue.cc:1048] T 58e537dfd4154312b2eb43471b19774d P c642698d21b74372809ac4b52afb84ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:24.503405 31182 raft_consensus.cc:1275] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Refusing update from remote peer c642698d21b74372809ac4b52afb84ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:24.505625 31482 consensus_queue.cc:1048] T 58e537dfd4154312b2eb43471b19774d P c642698d21b74372809ac4b52afb84ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:24.535176 31106 raft_consensus.cc:1275] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [term 5 FOLLOWER]: Refusing update from remote peer bd884325e7c04a4881234aab42242565: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:24.536530 31436 consensus_queue.cc:1048] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:24.542552 31182 raft_consensus.cc:1275] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 5 FOLLOWER]: Refusing update from remote peer bd884325e7c04a4881234aab42242565: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:24.544186 31436 consensus_queue.cc:1048] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:24.552343 31256 raft_consensus.cc:1275] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [term 4 FOLLOWER]: Refusing update from remote peer c642698d21b74372809ac4b52afb84ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:24.554379 31482 consensus_queue.cc:1048] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd884325e7c04a4881234aab42242565" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 37049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:24.567005 31182 raft_consensus.cc:1275] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [term 4 FOLLOWER]: Refusing update from remote peer c642698d21b74372809ac4b52afb84ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:24.568719 31482 consensus_queue.cc:1048] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:24.692564 31106 raft_consensus.cc:1275] T d084968581fc49f5bb08a64e65c22b69 P c642698d21b74372809ac4b52afb84ac [term 3 FOLLOWER]: Refusing update from remote peer bd884325e7c04a4881234aab42242565: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:24.693960 31503 consensus_queue.cc:1048] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c642698d21b74372809ac4b52afb84ac" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 36579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:24.703986 31182 raft_consensus.cc:1275] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6 [term 3 FOLLOWER]: Refusing update from remote peer bd884325e7c04a4881234aab42242565: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:24.705302 31503 consensus_queue.cc:1048] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a308d97210c4aa2b2e354face3eaba6" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:24.719281 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:24.726943 30972 tablet_server.cc:179] TabletServer@127.30.63.1:0 shutting down...
W20260709 13:12:24.730861 31222 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:12:24.736887 31222 consensus_peers.cc:597] T f927a373038947bb917685c470b28d9d P bd884325e7c04a4881234aab42242565 -> Peer c642698d21b74372809ac4b52afb84ac (127.30.63.1:36579): Couldn't send request to peer c642698d21b74372809ac4b52afb84ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:24.760447 30972 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:24.761288 30972 tablet_replica.cc:333] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac: stopping tablet replica
I20260709 13:12:24.762130 30972 raft_consensus.cc:2243] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:24.762642 30972 raft_consensus.cc:2272] T f381d6577987460089dd2bafc44bd7f0 P c642698d21b74372809ac4b52afb84ac [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:24.765673 30972 tablet_replica.cc:333] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac: stopping tablet replica
I20260709 13:12:24.766222 30972 raft_consensus.cc:2243] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:24.766987 30972 raft_consensus.cc:2272] T fe04b62ac7494d05afaa4d1b0df2b52b P c642698d21b74372809ac4b52afb84ac [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:24.769168 30972 tablet_replica.cc:333] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac: stopping tablet replica
I20260709 13:12:24.769706 30972 raft_consensus.cc:2243] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:24.770131 30972 raft_consensus.cc:2272] T d600bdfab3484da2bdc8b47a47edfced P c642698d21b74372809ac4b52afb84ac [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:24.771709 30972 tablet_replica.cc:333] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac: stopping tablet replica
I20260709 13:12:24.772220 30972 raft_consensus.cc:2243] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:24.773021 30972 raft_consensus.cc:2272] T 01a1c64224014d3081d51a1b8b6bcacb P c642698d21b74372809ac4b52afb84ac [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:24.775015 30972 tablet_replica.cc:333] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac: stopping tablet replica
I20260709 13:12:24.775542 30972 raft_consensus.cc:2243] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:24.775971 30972 raft_consensus.cc:2272] T aa80f98d0ce4477aa88171401d262c3f P c642698d21b74372809ac4b52afb84ac [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:24.777650 30972 tablet_replica.cc:333] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac: stopping tablet replica
I20260709 13:12:24.778143 30972 raft_consensus.cc:2243] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:24.778534 30972 raft_consensus.cc:2272] T 2023200c6d3742889adb5d28fb3614d9 P c642698d21b74372809ac4b52afb84ac [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:24.780110 30972 tablet_replica.cc:333] T d084968581fc49f5bb08a64e65c22b69 P c642698d21b74372809ac4b52afb84ac: stopping tablet replica
I20260709 13:12:24.780701 30972 raft_consensus.cc:2243] T d084968581fc49f5bb08a64e65c22b69 P c642698d21b74372809ac4b52afb84ac [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:24.781098 30972 raft_consensus.cc:2272] T d084968581fc49f5bb08a64e65c22b69 P c642698d21b74372809ac4b52afb84ac [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:24.783088 30972 tablet_replica.cc:333] T 58e537dfd4154312b2eb43471b19774d P c642698d21b74372809ac4b52afb84ac: stopping tablet replica
I20260709 13:12:24.783592 30972 raft_consensus.cc:2243] T 58e537dfd4154312b2eb43471b19774d P c642698d21b74372809ac4b52afb84ac [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:24.784288 30972 raft_consensus.cc:2272] T 58e537dfd4154312b2eb43471b19774d P c642698d21b74372809ac4b52afb84ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:24.786141 30972 tablet_replica.cc:333] T f927a373038947bb917685c470b28d9d P c642698d21b74372809ac4b52afb84ac: stopping tablet replica
I20260709 13:12:24.786604 30972 raft_consensus.cc:2243] T f927a373038947bb917685c470b28d9d P c642698d21b74372809ac4b52afb84ac [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:24.787000 30972 raft_consensus.cc:2272] T f927a373038947bb917685c470b28d9d P c642698d21b74372809ac4b52afb84ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:24.887059 30972 tablet_server.cc:196] TabletServer@127.30.63.1:0 shutdown complete.
I20260709 13:12:24.907284 30972 tablet_server.cc:179] TabletServer@127.30.63.2:0 shutting down...
I20260709 13:12:24.934029 30972 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:24.934981 30972 tablet_replica.cc:333] T d600bdfab3484da2bdc8b47a47edfced P 3a308d97210c4aa2b2e354face3eaba6: stopping tablet replica
I20260709 13:12:24.935631 30972 raft_consensus.cc:2243] T d600bdfab3484da2bdc8b47a47edfced P 3a308d97210c4aa2b2e354face3eaba6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:24.936442 30972 raft_consensus.cc:2272] T d600bdfab3484da2bdc8b47a47edfced P 3a308d97210c4aa2b2e354face3eaba6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:24.938457 30972 tablet_replica.cc:333] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6: stopping tablet replica
I20260709 13:12:24.938988 30972 raft_consensus.cc:2243] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:24.939424 30972 raft_consensus.cc:2272] T d084968581fc49f5bb08a64e65c22b69 P 3a308d97210c4aa2b2e354face3eaba6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:24.942126 30972 tablet_replica.cc:333] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6: stopping tablet replica
I20260709 13:12:24.942693 30972 raft_consensus.cc:2243] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:24.943114 30972 raft_consensus.cc:2272] T 01a1c64224014d3081d51a1b8b6bcacb P 3a308d97210c4aa2b2e354face3eaba6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:24.945562 30972 tablet_replica.cc:333] T 2023200c6d3742889adb5d28fb3614d9 P 3a308d97210c4aa2b2e354face3eaba6: stopping tablet replica
I20260709 13:12:24.946087 30972 raft_consensus.cc:2243] T 2023200c6d3742889adb5d28fb3614d9 P 3a308d97210c4aa2b2e354face3eaba6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:24.946802 30972 raft_consensus.cc:2272] T 2023200c6d3742889adb5d28fb3614d9 P 3a308d97210c4aa2b2e354face3eaba6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:24.948422 30972 tablet_replica.cc:333] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6: stopping tablet replica
I20260709 13:12:24.948997 30972 raft_consensus.cc:2243] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:24.949834 30972 raft_consensus.cc:2272] T aa80f98d0ce4477aa88171401d262c3f P 3a308d97210c4aa2b2e354face3eaba6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:24.951617 30972 tablet_replica.cc:333] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6: stopping tablet replica
I20260709 13:12:24.952126 30972 raft_consensus.cc:2243] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:24.952550 30972 raft_consensus.cc:2272] T f381d6577987460089dd2bafc44bd7f0 P 3a308d97210c4aa2b2e354face3eaba6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:24.955440 30972 tablet_replica.cc:333] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6: stopping tablet replica
I20260709 13:12:24.956001 30972 raft_consensus.cc:2243] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:24.956441 30972 raft_consensus.cc:2272] T fe04b62ac7494d05afaa4d1b0df2b52b P 3a308d97210c4aa2b2e354face3eaba6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:24.959156 30972 tablet_replica.cc:333] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6: stopping tablet replica
I20260709 13:12:24.959699 30972 raft_consensus.cc:2243] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:24.960175 30972 raft_consensus.cc:2272] T f927a373038947bb917685c470b28d9d P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:24.961967 30972 tablet_replica.cc:333] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6: stopping tablet replica
I20260709 13:12:24.962383 30972 raft_consensus.cc:2243] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:24.962934 30972 raft_consensus.cc:2272] T 58e537dfd4154312b2eb43471b19774d P 3a308d97210c4aa2b2e354face3eaba6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:24.991575 30972 tablet_server.cc:196] TabletServer@127.30.63.2:0 shutdown complete.
I20260709 13:12:25.012140 30972 tablet_server.cc:179] TabletServer@127.30.63.3:0 shutting down...
I20260709 13:12:25.042704 30972 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:25.043493 30972 tablet_replica.cc:333] T f927a373038947bb917685c470b28d9d P bd884325e7c04a4881234aab42242565: stopping tablet replica
I20260709 13:12:25.044137 30972 raft_consensus.cc:2243] T f927a373038947bb917685c470b28d9d P bd884325e7c04a4881234aab42242565 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:25.045058 30972 raft_consensus.cc:2272] T f927a373038947bb917685c470b28d9d P bd884325e7c04a4881234aab42242565 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:25.046892 30972 tablet_replica.cc:333] T 58e537dfd4154312b2eb43471b19774d P bd884325e7c04a4881234aab42242565: stopping tablet replica
I20260709 13:12:25.047459 30972 raft_consensus.cc:2243] T 58e537dfd4154312b2eb43471b19774d P bd884325e7c04a4881234aab42242565 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:25.047905 30972 raft_consensus.cc:2272] T 58e537dfd4154312b2eb43471b19774d P bd884325e7c04a4881234aab42242565 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:25.050024 30972 tablet_replica.cc:333] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565: stopping tablet replica
I20260709 13:12:25.050575 30972 raft_consensus.cc:2243] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:25.051014 30972 raft_consensus.cc:2272] T aa80f98d0ce4477aa88171401d262c3f P bd884325e7c04a4881234aab42242565 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:25.052554 30972 tablet_replica.cc:333] T 01a1c64224014d3081d51a1b8b6bcacb P bd884325e7c04a4881234aab42242565: stopping tablet replica
I20260709 13:12:25.053128 30972 raft_consensus.cc:2243] T 01a1c64224014d3081d51a1b8b6bcacb P bd884325e7c04a4881234aab42242565 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:25.053555 30972 raft_consensus.cc:2272] T 01a1c64224014d3081d51a1b8b6bcacb P bd884325e7c04a4881234aab42242565 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:25.055868 30972 tablet_replica.cc:333] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565: stopping tablet replica
I20260709 13:12:25.056423 30972 raft_consensus.cc:2243] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:25.056937 30972 raft_consensus.cc:2272] T 2023200c6d3742889adb5d28fb3614d9 P bd884325e7c04a4881234aab42242565 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:25.058760 30972 tablet_replica.cc:333] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565: stopping tablet replica
I20260709 13:12:25.059331 30972 raft_consensus.cc:2243] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:25.060083 30972 raft_consensus.cc:2272] T d084968581fc49f5bb08a64e65c22b69 P bd884325e7c04a4881234aab42242565 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:25.062031 30972 tablet_replica.cc:333] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565: stopping tablet replica
I20260709 13:12:25.062521 30972 raft_consensus.cc:2243] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:25.062960 30972 raft_consensus.cc:2272] T fe04b62ac7494d05afaa4d1b0df2b52b P bd884325e7c04a4881234aab42242565 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:25.065029 30972 tablet_replica.cc:333] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565: stopping tablet replica
I20260709 13:12:25.065683 30972 raft_consensus.cc:2243] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:12:25.066421 30972 raft_consensus.cc:2272] T f381d6577987460089dd2bafc44bd7f0 P bd884325e7c04a4881234aab42242565 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:25.068327 30972 tablet_replica.cc:333] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565: stopping tablet replica
I20260709 13:12:25.068861 30972 raft_consensus.cc:2243] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:25.069267 30972 raft_consensus.cc:2272] T d600bdfab3484da2bdc8b47a47edfced P bd884325e7c04a4881234aab42242565 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:25.096974 30972 tablet_server.cc:196] TabletServer@127.30.63.3:0 shutdown complete.
I20260709 13:12:25.113550 30972 master.cc:562] Master@127.30.63.62:42305 shutting down...
I20260709 13:12:25.322940 30972 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6f30195e42bf4e5fbcdf30b52fd35012 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:25.323565 30972 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6f30195e42bf4e5fbcdf30b52fd35012 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:25.323926 30972 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6f30195e42bf4e5fbcdf30b52fd35012: stopping tablet replica
I20260709 13:12:25.344416 30972 master.cc:584] Master@127.30.63.62:42305 shutdown complete.
3a308d97210c4aa2b2e354face3eaba6  4
bd884325e7c04a4881234aab42242565  1
c642698d21b74372809ac4b52afb84ac  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (14694 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:12:25.391865 30972 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.30.63.62:36775
I20260709 13:12:25.393091 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:25.399464 31510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:25.399464 31511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:25.400857 30972 server_base.cc:1061] running on GCE node
W20260709 13:12:25.401723 31513 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:25.402544 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:25.402848 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:25.403018 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783602745403002 us; error 0 us; skew 500 ppm
I20260709 13:12:25.403581 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:25.406598 30972 webserver.cc:533] Webserver started at http://127.30.63.62:35795/ using document root <none> and password file <none>
I20260709 13:12:25.407142 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:25.407358 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:25.407653 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:25.408991 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602730526113-30972-0/minicluster-data/master-0-root/instance:
uuid: "6d94581e2e7d4917a7ea0aaecf5f66f2"
format_stamp: "Formatted at 2026-07-09 13:12:25 on dist-test-slave-c08m"
I20260709 13:12:25.413962 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:12:25.417589 31518 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:25.418524 30972 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 13:12:25.418787 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602730526113-30972-0/minicluster-data/master-0-root
uuid: "6d94581e2e7d4917a7ea0aaecf5f66f2"
format_stamp: "Formatted at 2026-07-09 13:12:25 on dist-test-slave-c08m"
I20260709 13:12:25.419057 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602730526113-30972-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602730526113-30972-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602730526113-30972-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:25.434659 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:25.435881 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:25.485488 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.62:36775
I20260709 13:12:25.485582 31569 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.62:36775 every 8 connection(s)
I20260709 13:12:25.489502 31570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:25.499655 31570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d94581e2e7d4917a7ea0aaecf5f66f2: Bootstrap starting.
I20260709 13:12:25.504889 31570 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6d94581e2e7d4917a7ea0aaecf5f66f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:25.509104 31570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d94581e2e7d4917a7ea0aaecf5f66f2: No bootstrap required, opened a new log
I20260709 13:12:25.511188 31570 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6d94581e2e7d4917a7ea0aaecf5f66f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d94581e2e7d4917a7ea0aaecf5f66f2" member_type: VOTER }
I20260709 13:12:25.511560 31570 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6d94581e2e7d4917a7ea0aaecf5f66f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:25.511835 31570 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6d94581e2e7d4917a7ea0aaecf5f66f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d94581e2e7d4917a7ea0aaecf5f66f2, State: Initialized, Role: FOLLOWER
I20260709 13:12:25.512377 31570 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6d94581e2e7d4917a7ea0aaecf5f66f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d94581e2e7d4917a7ea0aaecf5f66f2" member_type: VOTER }
I20260709 13:12:25.512907 31570 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6d94581e2e7d4917a7ea0aaecf5f66f2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:25.513106 31570 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6d94581e2e7d4917a7ea0aaecf5f66f2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:25.513404 31570 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6d94581e2e7d4917a7ea0aaecf5f66f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:25.517457 31570 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6d94581e2e7d4917a7ea0aaecf5f66f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d94581e2e7d4917a7ea0aaecf5f66f2" member_type: VOTER }
I20260709 13:12:25.518004 31570 leader_election.cc:304] T 00000000000000000000000000000000 P 6d94581e2e7d4917a7ea0aaecf5f66f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d94581e2e7d4917a7ea0aaecf5f66f2; no voters: 
I20260709 13:12:25.519217 31570 leader_election.cc:290] T 00000000000000000000000000000000 P 6d94581e2e7d4917a7ea0aaecf5f66f2 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:25.519649 31573 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6d94581e2e7d4917a7ea0aaecf5f66f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:25.521090 31573 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6d94581e2e7d4917a7ea0aaecf5f66f2 [term 1 LEADER]: Becoming Leader. State: Replica: 6d94581e2e7d4917a7ea0aaecf5f66f2, State: Running, Role: LEADER
I20260709 13:12:25.521767 31573 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6d94581e2e7d4917a7ea0aaecf5f66f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d94581e2e7d4917a7ea0aaecf5f66f2" member_type: VOTER }
I20260709 13:12:25.522225 31570 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6d94581e2e7d4917a7ea0aaecf5f66f2 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:25.527550 31575 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d94581e2e7d4917a7ea0aaecf5f66f2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6d94581e2e7d4917a7ea0aaecf5f66f2. Latest consensus state: current_term: 1 leader_uuid: "6d94581e2e7d4917a7ea0aaecf5f66f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d94581e2e7d4917a7ea0aaecf5f66f2" member_type: VOTER } }
I20260709 13:12:25.527925 31574 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d94581e2e7d4917a7ea0aaecf5f66f2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6d94581e2e7d4917a7ea0aaecf5f66f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d94581e2e7d4917a7ea0aaecf5f66f2" member_type: VOTER } }
I20260709 13:12:25.528308 31575 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d94581e2e7d4917a7ea0aaecf5f66f2 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:25.528560 31574 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d94581e2e7d4917a7ea0aaecf5f66f2 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:25.531116 31581 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:25.537277 31581 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:25.538941 30972 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:25.546276 31581 catalog_manager.cc:1383] Generated new cluster ID: a7838c13c2874db4922779ebd9e5807b
I20260709 13:12:25.546556 31581 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:25.559384 31581 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:25.560652 31581 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:25.578410 31581 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6d94581e2e7d4917a7ea0aaecf5f66f2: Generated new TSK 0
I20260709 13:12:25.579025 31581 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:25.605527 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:25.611876 31591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:25.612831 31592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:25.614619 31594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:25.615331 30972 server_base.cc:1061] running on GCE node
I20260709 13:12:25.616153 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:25.616351 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:25.616768 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783602745616742 us; error 0 us; skew 500 ppm
I20260709 13:12:25.617390 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:25.619841 30972 webserver.cc:533] Webserver started at http://127.30.63.1:46663/ using document root <none> and password file <none>
I20260709 13:12:25.620433 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:25.620668 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:25.620975 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:25.622008 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602730526113-30972-0/minicluster-data/ts-0-root/instance:
uuid: "31f01602b758422c85a11b021fddc3e6"
format_stamp: "Formatted at 2026-07-09 13:12:25 on dist-test-slave-c08m"
I20260709 13:12:25.626680 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.005s
I20260709 13:12:25.630483 31599 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:25.631520 30972 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.001s
I20260709 13:12:25.631973 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602730526113-30972-0/minicluster-data/ts-0-root
uuid: "31f01602b758422c85a11b021fddc3e6"
format_stamp: "Formatted at 2026-07-09 13:12:25 on dist-test-slave-c08m"
I20260709 13:12:25.632433 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602730526113-30972-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602730526113-30972-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602730526113-30972-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:25.645332 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:25.646675 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:25.648119 30972 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:25.650516 30972 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:25.650722 30972 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:25.651036 30972 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:25.651196 30972 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:25.695425 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.1:34605
I20260709 13:12:25.695520 31661 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.1:34605 every 8 connection(s)
I20260709 13:12:25.701325 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:25.709328 31666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:25.709750 31667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:25.715929 31669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:25.717065 30972 server_base.cc:1061] running on GCE node
I20260709 13:12:25.718289 31662 heartbeater.cc:344] Connected to a master server at 127.30.63.62:36775
I20260709 13:12:25.718660 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:12:25.718662 31662 heartbeater.cc:461] Registering TS with master...
W20260709 13:12:25.718973 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:25.719192 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783602745719172 us; error 0 us; skew 500 ppm
I20260709 13:12:25.719725 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:25.719678 31662 heartbeater.cc:507] Master 127.30.63.62:36775 requested a full tablet report, sending...
I20260709 13:12:25.722445 31535 ts_manager.cc:194] Registered new tserver with Master: 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605)
I20260709 13:12:25.723234 30972 webserver.cc:533] Webserver started at http://127.30.63.2:38609/ using document root <none> and password file <none>
I20260709 13:12:25.723960 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:25.724203 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:25.724560 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:25.724997 31535 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35608
I20260709 13:12:25.726151 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602730526113-30972-0/minicluster-data/ts-1-root/instance:
uuid: "369d39d85e794108a1f8336f5b991c25"
format_stamp: "Formatted at 2026-07-09 13:12:25 on dist-test-slave-c08m"
I20260709 13:12:25.730978 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:12:25.734814 31674 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:25.735744 30972 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:12:25.735999 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602730526113-30972-0/minicluster-data/ts-1-root
uuid: "369d39d85e794108a1f8336f5b991c25"
format_stamp: "Formatted at 2026-07-09 13:12:25 on dist-test-slave-c08m"
I20260709 13:12:25.736240 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602730526113-30972-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602730526113-30972-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602730526113-30972-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:25.750159 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:25.751331 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:25.752893 30972 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:25.755290 30972 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:25.755479 30972 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:25.755810 30972 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:25.755952 30972 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:25.796901 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.2:39631
I20260709 13:12:25.797035 31736 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.2:39631 every 8 connection(s)
I20260709 13:12:25.801556 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:25.809118 31740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:25.812695 31741 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:25.813747 30972 server_base.cc:1061] running on GCE node
I20260709 13:12:25.815495 31737 heartbeater.cc:344] Connected to a master server at 127.30.63.62:36775
W20260709 13:12:25.815647 31743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:25.815905 31737 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:25.816712 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:12:25.816766 31737 heartbeater.cc:507] Master 127.30.63.62:36775 requested a full tablet report, sending...
W20260709 13:12:25.816983 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:25.817246 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783602745817222 us; error 0 us; skew 500 ppm
I20260709 13:12:25.817888 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:25.819324 31535 ts_manager.cc:194] Registered new tserver with Master: 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631)
I20260709 13:12:25.820554 30972 webserver.cc:533] Webserver started at http://127.30.63.3:45959/ using document root <none> and password file <none>
I20260709 13:12:25.821056 31535 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35620
I20260709 13:12:25.821233 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:25.821547 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:25.821815 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:25.823276 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602730526113-30972-0/minicluster-data/ts-2-root/instance:
uuid: "c15d42e7445f4eee86f09c33d9b43fce"
format_stamp: "Formatted at 2026-07-09 13:12:25 on dist-test-slave-c08m"
I20260709 13:12:25.828083 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.007s
I20260709 13:12:25.832901 31748 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:25.833782 30972 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:12:25.834223 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602730526113-30972-0/minicluster-data/ts-2-root
uuid: "c15d42e7445f4eee86f09c33d9b43fce"
format_stamp: "Formatted at 2026-07-09 13:12:25 on dist-test-slave-c08m"
I20260709 13:12:25.834602 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602730526113-30972-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602730526113-30972-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602730526113-30972-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:25.844242 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:25.845549 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:25.847106 30972 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:25.849423 30972 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:25.849675 30972 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:25.849931 30972 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:25.850116 30972 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:25.892153 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.3:34339
I20260709 13:12:25.892277 31810 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.3:34339 every 8 connection(s)
I20260709 13:12:25.907218 31811 heartbeater.cc:344] Connected to a master server at 127.30.63.62:36775
I20260709 13:12:25.907622 31811 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:25.908424 31811 heartbeater.cc:507] Master 127.30.63.62:36775 requested a full tablet report, sending...
I20260709 13:12:25.910473 31535 ts_manager.cc:194] Registered new tserver with Master: c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3:34339)
I20260709 13:12:25.910952 30972 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015483792s
I20260709 13:12:25.911919 31535 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35622
I20260709 13:12:25.939333 31535 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35630:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:25.942305 31535 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:26.027442 31702 tablet_service.cc:1511] Processing CreateTablet for tablet 2366d5ec869a4f53adf0887c6c605f63 (DEFAULT_TABLE table=test-workload [id=5b01cab803cd4a2c8bd46a1b4cc19ec7]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:12:26.029395 31702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2366d5ec869a4f53adf0887c6c605f63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.031188 31701 tablet_service.cc:1511] Processing CreateTablet for tablet 41f91725ca2740729c7c04dab9a0d5a0 (DEFAULT_TABLE table=test-workload [id=5b01cab803cd4a2c8bd46a1b4cc19ec7]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:12:26.032804 31701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f91725ca2740729c7c04dab9a0d5a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.039842 31776 tablet_service.cc:1511] Processing CreateTablet for tablet 2366d5ec869a4f53adf0887c6c605f63 (DEFAULT_TABLE table=test-workload [id=5b01cab803cd4a2c8bd46a1b4cc19ec7]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:12:26.041356 31776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2366d5ec869a4f53adf0887c6c605f63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.044062 31699 tablet_service.cc:1511] Processing CreateTablet for tablet 6595e33a811f46c9bad6389e68a20bc9 (DEFAULT_TABLE table=test-workload [id=5b01cab803cd4a2c8bd46a1b4cc19ec7]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:12:26.045564 31699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6595e33a811f46c9bad6389e68a20bc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.045884 31700 tablet_service.cc:1511] Processing CreateTablet for tablet 11c8f2db76164c2cad66c4f44c70ba6c (DEFAULT_TABLE table=test-workload [id=5b01cab803cd4a2c8bd46a1b4cc19ec7]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:12:26.048249 31772 tablet_service.cc:1511] Processing CreateTablet for tablet d1bd1cb474eb45f7aa7547a021b47624 (DEFAULT_TABLE table=test-workload [id=5b01cab803cd4a2c8bd46a1b4cc19ec7]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:12:26.049729 31772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1bd1cb474eb45f7aa7547a021b47624. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.049616 31775 tablet_service.cc:1511] Processing CreateTablet for tablet 41f91725ca2740729c7c04dab9a0d5a0 (DEFAULT_TABLE table=test-workload [id=5b01cab803cd4a2c8bd46a1b4cc19ec7]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:12:26.051074 31775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f91725ca2740729c7c04dab9a0d5a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.053823 31774 tablet_service.cc:1511] Processing CreateTablet for tablet 11c8f2db76164c2cad66c4f44c70ba6c (DEFAULT_TABLE table=test-workload [id=5b01cab803cd4a2c8bd46a1b4cc19ec7]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:12:26.054610 31698 tablet_service.cc:1511] Processing CreateTablet for tablet d1bd1cb474eb45f7aa7547a021b47624 (DEFAULT_TABLE table=test-workload [id=5b01cab803cd4a2c8bd46a1b4cc19ec7]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:12:26.055254 31774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11c8f2db76164c2cad66c4f44c70ba6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.054988 31625 tablet_service.cc:1511] Processing CreateTablet for tablet 11c8f2db76164c2cad66c4f44c70ba6c (DEFAULT_TABLE table=test-workload [id=5b01cab803cd4a2c8bd46a1b4cc19ec7]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:12:26.056301 31625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11c8f2db76164c2cad66c4f44c70ba6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.056654 31623 tablet_service.cc:1511] Processing CreateTablet for tablet d1bd1cb474eb45f7aa7547a021b47624 (DEFAULT_TABLE table=test-workload [id=5b01cab803cd4a2c8bd46a1b4cc19ec7]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:12:26.057717 31624 tablet_service.cc:1511] Processing CreateTablet for tablet 6595e33a811f46c9bad6389e68a20bc9 (DEFAULT_TABLE table=test-workload [id=5b01cab803cd4a2c8bd46a1b4cc19ec7]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:12:26.060804 31622 tablet_service.cc:1511] Processing CreateTablet for tablet 3558f74b6e384db198bb8d74d491da4a (DEFAULT_TABLE table=test-workload [id=5b01cab803cd4a2c8bd46a1b4cc19ec7]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:12:26.053823 31627 tablet_service.cc:1511] Processing CreateTablet for tablet 2366d5ec869a4f53adf0887c6c605f63 (DEFAULT_TABLE table=test-workload [id=5b01cab803cd4a2c8bd46a1b4cc19ec7]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:12:26.062515 31697 tablet_service.cc:1511] Processing CreateTablet for tablet 3558f74b6e384db198bb8d74d491da4a (DEFAULT_TABLE table=test-workload [id=5b01cab803cd4a2c8bd46a1b4cc19ec7]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:12:26.043047 31773 tablet_service.cc:1511] Processing CreateTablet for tablet 6595e33a811f46c9bad6389e68a20bc9 (DEFAULT_TABLE table=test-workload [id=5b01cab803cd4a2c8bd46a1b4cc19ec7]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:12:26.064143 31773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6595e33a811f46c9bad6389e68a20bc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.052194 31626 tablet_service.cc:1511] Processing CreateTablet for tablet 41f91725ca2740729c7c04dab9a0d5a0 (DEFAULT_TABLE table=test-workload [id=5b01cab803cd4a2c8bd46a1b4cc19ec7]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:12:26.066219 31700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11c8f2db76164c2cad66c4f44c70ba6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.067986 31771 tablet_service.cc:1511] Processing CreateTablet for tablet 3558f74b6e384db198bb8d74d491da4a (DEFAULT_TABLE table=test-workload [id=5b01cab803cd4a2c8bd46a1b4cc19ec7]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:12:26.069654 31771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3558f74b6e384db198bb8d74d491da4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.072358 31696 tablet_service.cc:1511] Processing CreateTablet for tablet 5dd5d4a006f74f3d83acde9f4174e1ea (DEFAULT_TABLE table=test-workload [id=5b01cab803cd4a2c8bd46a1b4cc19ec7]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:12:26.073827 31621 tablet_service.cc:1511] Processing CreateTablet for tablet 5dd5d4a006f74f3d83acde9f4174e1ea (DEFAULT_TABLE table=test-workload [id=5b01cab803cd4a2c8bd46a1b4cc19ec7]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:12:26.076951 31695 tablet_service.cc:1511] Processing CreateTablet for tablet 4e960950bc9748598558089efeb71c4a (DEFAULT_TABLE table=test-workload [id=5b01cab803cd4a2c8bd46a1b4cc19ec7]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:12:26.077791 31620 tablet_service.cc:1511] Processing CreateTablet for tablet 4e960950bc9748598558089efeb71c4a (DEFAULT_TABLE table=test-workload [id=5b01cab803cd4a2c8bd46a1b4cc19ec7]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:12:26.080261 31769 tablet_service.cc:1511] Processing CreateTablet for tablet 4e960950bc9748598558089efeb71c4a (DEFAULT_TABLE table=test-workload [id=5b01cab803cd4a2c8bd46a1b4cc19ec7]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:12:26.081331 31694 tablet_service.cc:1511] Processing CreateTablet for tablet aa29c9ed2f134cd08c5b30c90a155df0 (DEFAULT_TABLE table=test-workload [id=5b01cab803cd4a2c8bd46a1b4cc19ec7]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:12:26.085881 31693 tablet_service.cc:1511] Processing CreateTablet for tablet 9e6e0240198340cdb710cc659623fe39 (DEFAULT_TABLE table=test-workload [id=5b01cab803cd4a2c8bd46a1b4cc19ec7]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:12:26.085990 31768 tablet_service.cc:1511] Processing CreateTablet for tablet aa29c9ed2f134cd08c5b30c90a155df0 (DEFAULT_TABLE table=test-workload [id=5b01cab803cd4a2c8bd46a1b4cc19ec7]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:12:26.088258 31767 tablet_service.cc:1511] Processing CreateTablet for tablet 9e6e0240198340cdb710cc659623fe39 (DEFAULT_TABLE table=test-workload [id=5b01cab803cd4a2c8bd46a1b4cc19ec7]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:12:26.089237 31618 tablet_service.cc:1511] Processing CreateTablet for tablet 9e6e0240198340cdb710cc659623fe39 (DEFAULT_TABLE table=test-workload [id=5b01cab803cd4a2c8bd46a1b4cc19ec7]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:12:26.076010 31770 tablet_service.cc:1511] Processing CreateTablet for tablet 5dd5d4a006f74f3d83acde9f4174e1ea (DEFAULT_TABLE table=test-workload [id=5b01cab803cd4a2c8bd46a1b4cc19ec7]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:12:26.084002 31619 tablet_service.cc:1511] Processing CreateTablet for tablet aa29c9ed2f134cd08c5b30c90a155df0 (DEFAULT_TABLE table=test-workload [id=5b01cab803cd4a2c8bd46a1b4cc19ec7]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:12:26.094303 31623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1bd1cb474eb45f7aa7547a021b47624. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.095052 31622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3558f74b6e384db198bb8d74d491da4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.095729 31620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e960950bc9748598558089efeb71c4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.096388 31627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2366d5ec869a4f53adf0887c6c605f63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.097539 31621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dd5d4a006f74f3d83acde9f4174e1ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.098505 31626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f91725ca2740729c7c04dab9a0d5a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.100944 31624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6595e33a811f46c9bad6389e68a20bc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.100992 31694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa29c9ed2f134cd08c5b30c90a155df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.105257 31698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1bd1cb474eb45f7aa7547a021b47624. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.106037 31697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3558f74b6e384db198bb8d74d491da4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.106776 31693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e6e0240198340cdb710cc659623fe39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.081876 31769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e960950bc9748598558089efeb71c4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.107666 31695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e960950bc9748598558089efeb71c4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.108373 31770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dd5d4a006f74f3d83acde9f4174e1ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.112928 31696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dd5d4a006f74f3d83acde9f4174e1ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.113093 31767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e6e0240198340cdb710cc659623fe39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.116395 31768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa29c9ed2f134cd08c5b30c90a155df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.105266 31618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e6e0240198340cdb710cc659623fe39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.121024 31619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa29c9ed2f134cd08c5b30c90a155df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.191087 31827 tablet_bootstrap.cc:492] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25: Bootstrap starting.
I20260709 13:12:26.213992 31828 tablet_bootstrap.cc:492] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6: Bootstrap starting.
I20260709 13:12:26.215444 31826 tablet_bootstrap.cc:492] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce: Bootstrap starting.
I20260709 13:12:26.224299 31826 tablet_bootstrap.cc:654] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.228226 31827 tablet_bootstrap.cc:654] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.247217 31827 tablet_bootstrap.cc:492] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25: No bootstrap required, opened a new log
I20260709 13:12:26.247762 31827 ts_tablet_manager.cc:1403] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25: Time spent bootstrapping tablet: real 0.057s	user 0.014s	sys 0.006s
I20260709 13:12:26.247267 31828 tablet_bootstrap.cc:654] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.250234 31826 tablet_bootstrap.cc:492] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce: No bootstrap required, opened a new log
I20260709 13:12:26.250725 31826 ts_tablet_manager.cc:1403] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.010s
I20260709 13:12:26.250931 31827 raft_consensus.cc:359] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.251803 31827 raft_consensus.cc:385] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.252223 31827 raft_consensus.cc:740] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369d39d85e794108a1f8336f5b991c25, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.253023 31827 consensus_queue.cc:260] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.253973 31826 raft_consensus.cc:359] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.254875 31826 raft_consensus.cc:385] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.255082 31737 heartbeater.cc:499] Master 127.30.63.62:36775 was elected leader, sending a full tablet report...
I20260709 13:12:26.255223 31826 raft_consensus.cc:740] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15d42e7445f4eee86f09c33d9b43fce, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.255762 31827 ts_tablet_manager.cc:1434] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:12:26.256156 31826 consensus_queue.cc:260] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.256721 31827 tablet_bootstrap.cc:492] T 2366d5ec869a4f53adf0887c6c605f63 P 369d39d85e794108a1f8336f5b991c25: Bootstrap starting.
I20260709 13:12:26.255045 31828 tablet_bootstrap.cc:492] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6: No bootstrap required, opened a new log
I20260709 13:12:26.257525 31828 ts_tablet_manager.cc:1403] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6: Time spent bootstrapping tablet: real 0.048s	user 0.006s	sys 0.008s
I20260709 13:12:26.261580 31828 raft_consensus.cc:359] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.263216 31828 raft_consensus.cc:385] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.263720 31828 raft_consensus.cc:740] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f01602b758422c85a11b021fddc3e6, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.264441 31827 tablet_bootstrap.cc:654] T 2366d5ec869a4f53adf0887c6c605f63 P 369d39d85e794108a1f8336f5b991c25: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.264734 31811 heartbeater.cc:499] Master 127.30.63.62:36775 was elected leader, sending a full tablet report...
I20260709 13:12:26.264976 31828 consensus_queue.cc:260] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.265944 31826 ts_tablet_manager.cc:1434] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.009s
I20260709 13:12:26.267252 31826 tablet_bootstrap.cc:492] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce: Bootstrap starting.
I20260709 13:12:26.278071 31826 tablet_bootstrap.cc:654] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.278625 31828 ts_tablet_manager.cc:1434] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6: Time spent starting tablet: real 0.021s	user 0.016s	sys 0.004s
I20260709 13:12:26.280131 31828 tablet_bootstrap.cc:492] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6: Bootstrap starting.
I20260709 13:12:26.278560 31662 heartbeater.cc:499] Master 127.30.63.62:36775 was elected leader, sending a full tablet report...
I20260709 13:12:26.288983 31828 tablet_bootstrap.cc:654] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.290184 31826 tablet_bootstrap.cc:492] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce: No bootstrap required, opened a new log
I20260709 13:12:26.290771 31826 ts_tablet_manager.cc:1403] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.004s
I20260709 13:12:26.294837 31826 raft_consensus.cc:359] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.296008 31826 raft_consensus.cc:385] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.296453 31826 raft_consensus.cc:740] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15d42e7445f4eee86f09c33d9b43fce, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.298010 31826 consensus_queue.cc:260] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.301512 31826 ts_tablet_manager.cc:1434] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.003s
I20260709 13:12:26.302810 31826 tablet_bootstrap.cc:492] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce: Bootstrap starting.
I20260709 13:12:26.311841 31826 tablet_bootstrap.cc:654] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.320153 31828 tablet_bootstrap.cc:492] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6: No bootstrap required, opened a new log
I20260709 13:12:26.320724 31828 ts_tablet_manager.cc:1403] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.020s
I20260709 13:12:26.320803 31827 tablet_bootstrap.cc:492] T 2366d5ec869a4f53adf0887c6c605f63 P 369d39d85e794108a1f8336f5b991c25: No bootstrap required, opened a new log
I20260709 13:12:26.321327 31827 ts_tablet_manager.cc:1403] T 2366d5ec869a4f53adf0887c6c605f63 P 369d39d85e794108a1f8336f5b991c25: Time spent bootstrapping tablet: real 0.065s	user 0.004s	sys 0.054s
I20260709 13:12:26.321648 31826 tablet_bootstrap.cc:492] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce: No bootstrap required, opened a new log
I20260709 13:12:26.322110 31826 ts_tablet_manager.cc:1403] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.001s
I20260709 13:12:26.323787 31828 raft_consensus.cc:359] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.324106 31827 raft_consensus.cc:359] T 2366d5ec869a4f53adf0887c6c605f63 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } }
I20260709 13:12:26.324672 31828 raft_consensus.cc:385] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.324878 31827 raft_consensus.cc:385] T 2366d5ec869a4f53adf0887c6c605f63 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.325028 31828 raft_consensus.cc:740] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f01602b758422c85a11b021fddc3e6, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.325323 31827 raft_consensus.cc:740] T 2366d5ec869a4f53adf0887c6c605f63 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369d39d85e794108a1f8336f5b991c25, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.324988 31826 raft_consensus.cc:359] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.325820 31826 raft_consensus.cc:385] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.326128 31826 raft_consensus.cc:740] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15d42e7445f4eee86f09c33d9b43fce, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.325975 31828 consensus_queue.cc:260] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.326206 31827 consensus_queue.cc:260] T 2366d5ec869a4f53adf0887c6c605f63 P 369d39d85e794108a1f8336f5b991c25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } }
I20260709 13:12:26.327005 31826 consensus_queue.cc:260] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.328649 31827 ts_tablet_manager.cc:1434] T 2366d5ec869a4f53adf0887c6c605f63 P 369d39d85e794108a1f8336f5b991c25: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:12:26.328873 31828 ts_tablet_manager.cc:1434] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:26.329118 31826 ts_tablet_manager.cc:1434] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:26.329617 31827 tablet_bootstrap.cc:492] T 11c8f2db76164c2cad66c4f44c70ba6c P 369d39d85e794108a1f8336f5b991c25: Bootstrap starting.
I20260709 13:12:26.329828 31828 tablet_bootstrap.cc:492] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6: Bootstrap starting.
I20260709 13:12:26.329998 31826 tablet_bootstrap.cc:492] T 2366d5ec869a4f53adf0887c6c605f63 P c15d42e7445f4eee86f09c33d9b43fce: Bootstrap starting.
I20260709 13:12:26.333578 31833 raft_consensus.cc:493] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.334138 31833 raft_consensus.cc:515] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.336652 31828 tablet_bootstrap.cc:654] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.337414 31827 tablet_bootstrap.cc:654] T 11c8f2db76164c2cad66c4f44c70ba6c P 369d39d85e794108a1f8336f5b991c25: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.337850 31826 tablet_bootstrap.cc:654] T 2366d5ec869a4f53adf0887c6c605f63 P c15d42e7445f4eee86f09c33d9b43fce: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.352540 31833 leader_election.cc:290] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605), 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631)
I20260709 13:12:26.366586 31834 raft_consensus.cc:493] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.367422 31834 raft_consensus.cc:515] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.380702 31834 leader_election.cc:290] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631), c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3:34339)
I20260709 13:12:26.404018 31712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c8f2db76164c2cad66c4f44c70ba6c" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369d39d85e794108a1f8336f5b991c25" is_pre_election: true
W20260709 13:12:26.406832 31750 leader_election.cc:343] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.484148 31832 raft_consensus.cc:493] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.485168 31832 raft_consensus.cc:515] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.493960 31832 leader_election.cc:290] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605), c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3:34339)
I20260709 13:12:26.536212 31637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c8f2db76164c2cad66c4f44c70ba6c" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f01602b758422c85a11b021fddc3e6" is_pre_election: true
I20260709 13:12:26.537343 31637 raft_consensus.cc:2468] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15d42e7445f4eee86f09c33d9b43fce in term 0.
W20260709 13:12:26.543375 31583 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:26.561123 31749 leader_election.cc:304] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6, c15d42e7445f4eee86f09c33d9b43fce; no voters: 369d39d85e794108a1f8336f5b991c25
I20260709 13:12:26.562628 31833 raft_consensus.cc:2804] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:26.563171 31833 raft_consensus.cc:493] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.563663 31833 raft_consensus.cc:3060] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.595366 31833 raft_consensus.cc:515] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.601491 31828 tablet_bootstrap.cc:492] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6: No bootstrap required, opened a new log
I20260709 13:12:26.615358 31828 ts_tablet_manager.cc:1403] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6: Time spent bootstrapping tablet: real 0.286s	user 0.098s	sys 0.168s
I20260709 13:12:26.616175 31637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c8f2db76164c2cad66c4f44c70ba6c" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f01602b758422c85a11b021fddc3e6"
I20260709 13:12:26.616549 31785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595e33a811f46c9bad6389e68a20bc9" candidate_uuid: "369d39d85e794108a1f8336f5b991c25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce" is_pre_election: true
I20260709 13:12:26.602238 31826 tablet_bootstrap.cc:492] T 2366d5ec869a4f53adf0887c6c605f63 P c15d42e7445f4eee86f09c33d9b43fce: No bootstrap required, opened a new log
I20260709 13:12:26.617767 31826 ts_tablet_manager.cc:1403] T 2366d5ec869a4f53adf0887c6c605f63 P c15d42e7445f4eee86f09c33d9b43fce: Time spent bootstrapping tablet: real 0.288s	user 0.072s	sys 0.189s
W20260709 13:12:26.618837 31678 leader_election.cc:343] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3:34339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.610731 31712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c8f2db76164c2cad66c4f44c70ba6c" candidate_uuid: "31f01602b758422c85a11b021fddc3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369d39d85e794108a1f8336f5b991c25" is_pre_election: true
I20260709 13:12:26.616936 31637 raft_consensus.cc:3060] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.605352 31832 raft_consensus.cc:493] T 2366d5ec869a4f53adf0887c6c605f63 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.621887 31832 raft_consensus.cc:515] T 2366d5ec869a4f53adf0887c6c605f63 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } }
I20260709 13:12:26.605780 31786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c8f2db76164c2cad66c4f44c70ba6c" candidate_uuid: "31f01602b758422c85a11b021fddc3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce" is_pre_election: true
I20260709 13:12:26.624783 31833 leader_election.cc:290] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 election: Requested vote from peers 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605), 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631)
I20260709 13:12:26.625221 31786 raft_consensus.cc:2393] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31f01602b758422c85a11b021fddc3e6 in current term 1: Already voted for candidate c15d42e7445f4eee86f09c33d9b43fce in this term.
I20260709 13:12:26.625373 31833 raft_consensus.cc:493] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:26.627089 31601 leader_election.cc:343] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.627274 31786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2366d5ec869a4f53adf0887c6c605f63" candidate_uuid: "369d39d85e794108a1f8336f5b991c25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce" is_pre_election: true
I20260709 13:12:26.624385 31832 leader_election.cc:290] T 2366d5ec869a4f53adf0887c6c605f63 P 369d39d85e794108a1f8336f5b991c25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3:34339), 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605)
I20260709 13:12:26.618857 31828 raft_consensus.cc:359] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
W20260709 13:12:26.629040 31678 leader_election.cc:343] T 2366d5ec869a4f53adf0887c6c605f63 P 369d39d85e794108a1f8336f5b991c25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3:34339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.627270 31712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c8f2db76164c2cad66c4f44c70ba6c" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369d39d85e794108a1f8336f5b991c25"
I20260709 13:12:26.629393 31828 raft_consensus.cc:385] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.629854 31828 raft_consensus.cc:740] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f01602b758422c85a11b021fddc3e6, State: Initialized, Role: FOLLOWER
W20260709 13:12:26.630692 31750 leader_election.cc:343] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.631567 31603 leader_election.cc:304] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6; no voters: 369d39d85e794108a1f8336f5b991c25, c15d42e7445f4eee86f09c33d9b43fce
I20260709 13:12:26.631491 31828 consensus_queue.cc:260] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.625849 31833 raft_consensus.cc:515] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.634501 31636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595e33a811f46c9bad6389e68a20bc9" candidate_uuid: "369d39d85e794108a1f8336f5b991c25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f01602b758422c85a11b021fddc3e6" is_pre_election: true
I20260709 13:12:26.635998 31635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2366d5ec869a4f53adf0887c6c605f63" candidate_uuid: "369d39d85e794108a1f8336f5b991c25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f01602b758422c85a11b021fddc3e6" is_pre_election: true
I20260709 13:12:26.637054 31712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f91725ca2740729c7c04dab9a0d5a0" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369d39d85e794108a1f8336f5b991c25" is_pre_election: true
I20260709 13:12:26.638096 31833 leader_election.cc:290] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605), 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631)
W20260709 13:12:26.638357 31675 leader_election.cc:343] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:26.638569 31750 leader_election.cc:343] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.638856 31675 leader_election.cc:304] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 369d39d85e794108a1f8336f5b991c25; no voters: 31f01602b758422c85a11b021fddc3e6, c15d42e7445f4eee86f09c33d9b43fce
I20260709 13:12:26.639216 31635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f91725ca2740729c7c04dab9a0d5a0" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f01602b758422c85a11b021fddc3e6" is_pre_election: true
I20260709 13:12:26.639947 31832 raft_consensus.cc:2749] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:26.639895 31635 raft_consensus.cc:2468] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15d42e7445f4eee86f09c33d9b43fce in term 0.
I20260709 13:12:26.642546 31749 leader_election.cc:304] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6, c15d42e7445f4eee86f09c33d9b43fce; no voters: 369d39d85e794108a1f8336f5b991c25
I20260709 13:12:26.642974 31827 tablet_bootstrap.cc:492] T 11c8f2db76164c2cad66c4f44c70ba6c P 369d39d85e794108a1f8336f5b991c25: No bootstrap required, opened a new log
I20260709 13:12:26.643656 31827 ts_tablet_manager.cc:1403] T 11c8f2db76164c2cad66c4f44c70ba6c P 369d39d85e794108a1f8336f5b991c25: Time spent bootstrapping tablet: real 0.314s	user 0.119s	sys 0.163s
I20260709 13:12:26.646688 31637 raft_consensus.cc:2468] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15d42e7445f4eee86f09c33d9b43fce in term 1.
W20260709 13:12:26.640501 31675 leader_election.cc:343] T 2366d5ec869a4f53adf0887c6c605f63 P 369d39d85e794108a1f8336f5b991c25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.647710 31826 raft_consensus.cc:359] T 2366d5ec869a4f53adf0887c6c605f63 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } }
I20260709 13:12:26.648715 31826 raft_consensus.cc:385] T 2366d5ec869a4f53adf0887c6c605f63 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.647915 31827 raft_consensus.cc:359] T 11c8f2db76164c2cad66c4f44c70ba6c P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.649804 31749 leader_election.cc:304] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6, c15d42e7445f4eee86f09c33d9b43fce; no voters: 369d39d85e794108a1f8336f5b991c25
I20260709 13:12:26.648213 31834 raft_consensus.cc:2749] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:26.648563 31675 leader_election.cc:304] T 2366d5ec869a4f53adf0887c6c605f63 P 369d39d85e794108a1f8336f5b991c25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 369d39d85e794108a1f8336f5b991c25; no voters: 31f01602b758422c85a11b021fddc3e6, c15d42e7445f4eee86f09c33d9b43fce
I20260709 13:12:26.650955 31828 ts_tablet_manager.cc:1434] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.010s
I20260709 13:12:26.651103 31849 raft_consensus.cc:2804] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:26.651608 31832 raft_consensus.cc:2749] T 2366d5ec869a4f53adf0887c6c605f63 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:26.648636 31833 raft_consensus.cc:2804] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:26.653080 31828 tablet_bootstrap.cc:492] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6: Bootstrap starting.
I20260709 13:12:26.653625 31833 raft_consensus.cc:493] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.650518 31826 raft_consensus.cc:740] T 2366d5ec869a4f53adf0887c6c605f63 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15d42e7445f4eee86f09c33d9b43fce, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.654090 31833 raft_consensus.cc:3060] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.654889 31826 consensus_queue.cc:260] T 2366d5ec869a4f53adf0887c6c605f63 P c15d42e7445f4eee86f09c33d9b43fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } }
I20260709 13:12:26.650542 31827 raft_consensus.cc:385] T 11c8f2db76164c2cad66c4f44c70ba6c P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.656569 31827 raft_consensus.cc:740] T 11c8f2db76164c2cad66c4f44c70ba6c P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369d39d85e794108a1f8336f5b991c25, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.649648 31850 raft_consensus.cc:493] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.657444 31850 raft_consensus.cc:515] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.658587 31827 consensus_queue.cc:260] T 11c8f2db76164c2cad66c4f44c70ba6c P 369d39d85e794108a1f8336f5b991c25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.660953 31827 ts_tablet_manager.cc:1434] T 11c8f2db76164c2cad66c4f44c70ba6c P 369d39d85e794108a1f8336f5b991c25: Time spent starting tablet: real 0.017s	user 0.011s	sys 0.000s
I20260709 13:12:26.661139 31828 tablet_bootstrap.cc:654] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.662003 31827 tablet_bootstrap.cc:492] T 41f91725ca2740729c7c04dab9a0d5a0 P 369d39d85e794108a1f8336f5b991c25: Bootstrap starting.
I20260709 13:12:26.669202 31849 raft_consensus.cc:697] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Becoming Leader. State: Replica: c15d42e7445f4eee86f09c33d9b43fce, State: Running, Role: LEADER
I20260709 13:12:26.670653 31849 consensus_queue.cc:237] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.683532 31828 tablet_bootstrap.cc:492] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6: No bootstrap required, opened a new log
I20260709 13:12:26.684082 31828 ts_tablet_manager.cc:1403] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6: Time spent bootstrapping tablet: real 0.031s	user 0.021s	sys 0.007s
I20260709 13:12:26.684409 31827 tablet_bootstrap.cc:654] T 41f91725ca2740729c7c04dab9a0d5a0 P 369d39d85e794108a1f8336f5b991c25: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.686659 31832 raft_consensus.cc:493] T 11c8f2db76164c2cad66c4f44c70ba6c P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.687304 31828 raft_consensus.cc:359] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.687331 31832 raft_consensus.cc:515] T 11c8f2db76164c2cad66c4f44c70ba6c P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.688555 31828 raft_consensus.cc:385] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.689234 31828 raft_consensus.cc:740] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f01602b758422c85a11b021fddc3e6, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.690758 31828 consensus_queue.cc:260] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.692270 31832 leader_election.cc:290] T 11c8f2db76164c2cad66c4f44c70ba6c P 369d39d85e794108a1f8336f5b991c25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605), c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3:34339)
I20260709 13:12:26.693337 31828 ts_tablet_manager.cc:1434] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.009s
I20260709 13:12:26.693462 31786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c8f2db76164c2cad66c4f44c70ba6c" candidate_uuid: "369d39d85e794108a1f8336f5b991c25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce" is_pre_election: true
I20260709 13:12:26.694600 31828 tablet_bootstrap.cc:492] T 2366d5ec869a4f53adf0887c6c605f63 P 31f01602b758422c85a11b021fddc3e6: Bootstrap starting.
I20260709 13:12:26.702275 31828 tablet_bootstrap.cc:654] T 2366d5ec869a4f53adf0887c6c605f63 P 31f01602b758422c85a11b021fddc3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.704051 31532 catalog_manager.cc:5697] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce reported cstate change: term changed from 0 to 1, leader changed from <none> to c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3). New cstate: current_term: 1 leader_uuid: "c15d42e7445f4eee86f09c33d9b43fce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:26.710553 31827 tablet_bootstrap.cc:492] T 41f91725ca2740729c7c04dab9a0d5a0 P 369d39d85e794108a1f8336f5b991c25: No bootstrap required, opened a new log
I20260709 13:12:26.711421 31827 ts_tablet_manager.cc:1403] T 41f91725ca2740729c7c04dab9a0d5a0 P 369d39d85e794108a1f8336f5b991c25: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.008s
I20260709 13:12:26.711524 31712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dd5d4a006f74f3d83acde9f4174e1ea" candidate_uuid: "31f01602b758422c85a11b021fddc3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369d39d85e794108a1f8336f5b991c25" is_pre_election: true
I20260709 13:12:26.713503 31637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c8f2db76164c2cad66c4f44c70ba6c" candidate_uuid: "369d39d85e794108a1f8336f5b991c25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f01602b758422c85a11b021fddc3e6" is_pre_election: true
I20260709 13:12:26.714636 31637 raft_consensus.cc:2393] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 369d39d85e794108a1f8336f5b991c25 in current term 1: Already voted for candidate c15d42e7445f4eee86f09c33d9b43fce in this term.
W20260709 13:12:26.716010 31601 leader_election.cc:343] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.716812 31827 raft_consensus.cc:359] T 41f91725ca2740729c7c04dab9a0d5a0 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.717868 31827 raft_consensus.cc:385] T 41f91725ca2740729c7c04dab9a0d5a0 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.717880 31675 leader_election.cc:304] T 11c8f2db76164c2cad66c4f44c70ba6c P 369d39d85e794108a1f8336f5b991c25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 369d39d85e794108a1f8336f5b991c25; no voters: 31f01602b758422c85a11b021fddc3e6, c15d42e7445f4eee86f09c33d9b43fce
I20260709 13:12:26.718466 31827 raft_consensus.cc:740] T 41f91725ca2740729c7c04dab9a0d5a0 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369d39d85e794108a1f8336f5b991c25, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.719554 31832 raft_consensus.cc:3060] T 11c8f2db76164c2cad66c4f44c70ba6c P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.719521 31827 consensus_queue.cc:260] T 41f91725ca2740729c7c04dab9a0d5a0 P 369d39d85e794108a1f8336f5b991c25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.729137 31850 leader_election.cc:290] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631), c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3:34339)
I20260709 13:12:26.730422 31786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dd5d4a006f74f3d83acde9f4174e1ea" candidate_uuid: "31f01602b758422c85a11b021fddc3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce" is_pre_election: true
I20260709 13:12:26.731818 31828 tablet_bootstrap.cc:492] T 2366d5ec869a4f53adf0887c6c605f63 P 31f01602b758422c85a11b021fddc3e6: No bootstrap required, opened a new log
W20260709 13:12:26.732000 31603 leader_election.cc:343] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3:34339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.732338 31828 ts_tablet_manager.cc:1403] T 2366d5ec869a4f53adf0887c6c605f63 P 31f01602b758422c85a11b021fddc3e6: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.016s
I20260709 13:12:26.732491 31603 leader_election.cc:304] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6; no voters: 369d39d85e794108a1f8336f5b991c25, c15d42e7445f4eee86f09c33d9b43fce
I20260709 13:12:26.733906 31850 raft_consensus.cc:2749] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:26.735422 31828 raft_consensus.cc:359] T 2366d5ec869a4f53adf0887c6c605f63 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } }
I20260709 13:12:26.736162 31828 raft_consensus.cc:385] T 2366d5ec869a4f53adf0887c6c605f63 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.736460 31828 raft_consensus.cc:740] T 2366d5ec869a4f53adf0887c6c605f63 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f01602b758422c85a11b021fddc3e6, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.737576 31832 raft_consensus.cc:2749] T 11c8f2db76164c2cad66c4f44c70ba6c P 369d39d85e794108a1f8336f5b991c25 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:26.737243 31828 consensus_queue.cc:260] T 2366d5ec869a4f53adf0887c6c605f63 P 31f01602b758422c85a11b021fddc3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } }
I20260709 13:12:26.738945 31826 ts_tablet_manager.cc:1434] T 2366d5ec869a4f53adf0887c6c605f63 P c15d42e7445f4eee86f09c33d9b43fce: Time spent starting tablet: real 0.121s	user 0.024s	sys 0.046s
I20260709 13:12:26.741482 31826 tablet_bootstrap.cc:492] T 6595e33a811f46c9bad6389e68a20bc9 P c15d42e7445f4eee86f09c33d9b43fce: Bootstrap starting.
I20260709 13:12:26.742764 31833 raft_consensus.cc:515] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.746129 31637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f91725ca2740729c7c04dab9a0d5a0" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f01602b758422c85a11b021fddc3e6"
I20260709 13:12:26.747001 31637 raft_consensus.cc:3060] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.751016 31826 tablet_bootstrap.cc:654] T 6595e33a811f46c9bad6389e68a20bc9 P c15d42e7445f4eee86f09c33d9b43fce: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.742969 31828 ts_tablet_manager.cc:1434] T 2366d5ec869a4f53adf0887c6c605f63 P 31f01602b758422c85a11b021fddc3e6: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:12:26.754142 31828 tablet_bootstrap.cc:492] T 9e6e0240198340cdb710cc659623fe39 P 31f01602b758422c85a11b021fddc3e6: Bootstrap starting.
I20260709 13:12:26.755853 31637 raft_consensus.cc:2468] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15d42e7445f4eee86f09c33d9b43fce in term 1.
I20260709 13:12:26.757483 31749 leader_election.cc:304] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6, c15d42e7445f4eee86f09c33d9b43fce; no voters: 
I20260709 13:12:26.758395 31853 raft_consensus.cc:2804] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:26.759219 31853 raft_consensus.cc:697] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Becoming Leader. State: Replica: c15d42e7445f4eee86f09c33d9b43fce, State: Running, Role: LEADER
I20260709 13:12:26.760382 31853 consensus_queue.cc:237] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.762244 31828 tablet_bootstrap.cc:654] T 9e6e0240198340cdb710cc659623fe39 P 31f01602b758422c85a11b021fddc3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.766808 31827 ts_tablet_manager.cc:1434] T 41f91725ca2740729c7c04dab9a0d5a0 P 369d39d85e794108a1f8336f5b991c25: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.006s
I20260709 13:12:26.768311 31827 tablet_bootstrap.cc:492] T d1bd1cb474eb45f7aa7547a021b47624 P 369d39d85e794108a1f8336f5b991c25: Bootstrap starting.
I20260709 13:12:26.773370 31833 leader_election.cc:290] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 election: Requested vote from peers 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605), 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631)
I20260709 13:12:26.774621 31712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f91725ca2740729c7c04dab9a0d5a0" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369d39d85e794108a1f8336f5b991c25"
I20260709 13:12:26.775288 31712 raft_consensus.cc:3060] T 41f91725ca2740729c7c04dab9a0d5a0 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.776542 31826 tablet_bootstrap.cc:492] T 6595e33a811f46c9bad6389e68a20bc9 P c15d42e7445f4eee86f09c33d9b43fce: No bootstrap required, opened a new log
I20260709 13:12:26.777072 31826 ts_tablet_manager.cc:1403] T 6595e33a811f46c9bad6389e68a20bc9 P c15d42e7445f4eee86f09c33d9b43fce: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.000s
I20260709 13:12:26.778896 31827 tablet_bootstrap.cc:654] T d1bd1cb474eb45f7aa7547a021b47624 P 369d39d85e794108a1f8336f5b991c25: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.780192 31826 raft_consensus.cc:359] T 6595e33a811f46c9bad6389e68a20bc9 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.780970 31826 raft_consensus.cc:385] T 6595e33a811f46c9bad6389e68a20bc9 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.781265 31826 raft_consensus.cc:740] T 6595e33a811f46c9bad6389e68a20bc9 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15d42e7445f4eee86f09c33d9b43fce, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.782106 31826 consensus_queue.cc:260] T 6595e33a811f46c9bad6389e68a20bc9 P c15d42e7445f4eee86f09c33d9b43fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.783078 31712 raft_consensus.cc:2468] T 41f91725ca2740729c7c04dab9a0d5a0 P 369d39d85e794108a1f8336f5b991c25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15d42e7445f4eee86f09c33d9b43fce in term 1.
I20260709 13:12:26.784845 31826 ts_tablet_manager.cc:1434] T 6595e33a811f46c9bad6389e68a20bc9 P c15d42e7445f4eee86f09c33d9b43fce: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:12:26.785400 31828 tablet_bootstrap.cc:492] T 9e6e0240198340cdb710cc659623fe39 P 31f01602b758422c85a11b021fddc3e6: No bootstrap required, opened a new log
I20260709 13:12:26.785755 31826 tablet_bootstrap.cc:492] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce: Bootstrap starting.
I20260709 13:12:26.786033 31828 ts_tablet_manager.cc:1403] T 9e6e0240198340cdb710cc659623fe39 P 31f01602b758422c85a11b021fddc3e6: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.007s
I20260709 13:12:26.790040 31828 raft_consensus.cc:359] T 9e6e0240198340cdb710cc659623fe39 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.790776 31826 tablet_bootstrap.cc:654] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.791309 31833 raft_consensus.cc:493] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.791141 31828 raft_consensus.cc:385] T 9e6e0240198340cdb710cc659623fe39 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.791817 31833 raft_consensus.cc:515] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.792363 31828 raft_consensus.cc:740] T 9e6e0240198340cdb710cc659623fe39 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f01602b758422c85a11b021fddc3e6, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.793391 31828 consensus_queue.cc:260] T 9e6e0240198340cdb710cc659623fe39 P 31f01602b758422c85a11b021fddc3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.794054 31833 leader_election.cc:290] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605), 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631)
I20260709 13:12:26.795960 31828 ts_tablet_manager.cc:1434] T 9e6e0240198340cdb710cc659623fe39 P 31f01602b758422c85a11b021fddc3e6: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 13:12:26.796286 31712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bd1cb474eb45f7aa7547a021b47624" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369d39d85e794108a1f8336f5b991c25" is_pre_election: true
I20260709 13:12:26.797106 31637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bd1cb474eb45f7aa7547a021b47624" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f01602b758422c85a11b021fddc3e6" is_pre_election: true
I20260709 13:12:26.797714 31637 raft_consensus.cc:2468] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15d42e7445f4eee86f09c33d9b43fce in term 0.
I20260709 13:12:26.800478 31828 tablet_bootstrap.cc:492] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6: Bootstrap starting.
I20260709 13:12:26.802517 31826 tablet_bootstrap.cc:492] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce: No bootstrap required, opened a new log
I20260709 13:12:26.802901 31827 tablet_bootstrap.cc:492] T d1bd1cb474eb45f7aa7547a021b47624 P 369d39d85e794108a1f8336f5b991c25: No bootstrap required, opened a new log
I20260709 13:12:26.803030 31826 ts_tablet_manager.cc:1403] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce: Time spent bootstrapping tablet: real 0.017s	user 0.004s	sys 0.006s
I20260709 13:12:26.803515 31827 ts_tablet_manager.cc:1403] T d1bd1cb474eb45f7aa7547a021b47624 P 369d39d85e794108a1f8336f5b991c25: Time spent bootstrapping tablet: real 0.036s	user 0.020s	sys 0.004s
I20260709 13:12:26.806468 31826 raft_consensus.cc:359] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.806699 31827 raft_consensus.cc:359] T d1bd1cb474eb45f7aa7547a021b47624 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.807226 31828 tablet_bootstrap.cc:654] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.807256 31826 raft_consensus.cc:385] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.807687 31827 raft_consensus.cc:385] T d1bd1cb474eb45f7aa7547a021b47624 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.808223 31827 raft_consensus.cc:740] T d1bd1cb474eb45f7aa7547a021b47624 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369d39d85e794108a1f8336f5b991c25, State: Initialized, Role: FOLLOWER
W20260709 13:12:26.797834 31750 leader_election.cc:343] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.807725 31826 raft_consensus.cc:740] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15d42e7445f4eee86f09c33d9b43fce, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.811122 31826 consensus_queue.cc:260] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.813596 31826 ts_tablet_manager.cc:1434] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 13:12:26.814564 31850 raft_consensus.cc:493] T 9e6e0240198340cdb710cc659623fe39 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.814035 31827 consensus_queue.cc:260] T d1bd1cb474eb45f7aa7547a021b47624 P 369d39d85e794108a1f8336f5b991c25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.813660 31749 leader_election.cc:304] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6, c15d42e7445f4eee86f09c33d9b43fce; no voters: 369d39d85e794108a1f8336f5b991c25
I20260709 13:12:26.815039 31850 raft_consensus.cc:515] T 9e6e0240198340cdb710cc659623fe39 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.815507 31833 raft_consensus.cc:2804] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:26.815889 31833 raft_consensus.cc:493] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.816215 31833 raft_consensus.cc:3060] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.817817 31827 ts_tablet_manager.cc:1434] T d1bd1cb474eb45f7aa7547a021b47624 P 369d39d85e794108a1f8336f5b991c25: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:12:26.818881 31827 tablet_bootstrap.cc:492] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25: Bootstrap starting.
I20260709 13:12:26.818717 31712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e6e0240198340cdb710cc659623fe39" candidate_uuid: "31f01602b758422c85a11b021fddc3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369d39d85e794108a1f8336f5b991c25" is_pre_election: true
I20260709 13:12:26.819187 31850 leader_election.cc:290] T 9e6e0240198340cdb710cc659623fe39 P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631), c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3:34339)
W20260709 13:12:26.821422 31601 leader_election.cc:343] T 9e6e0240198340cdb710cc659623fe39 P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.827132 31827 tablet_bootstrap.cc:654] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.831077 31833 raft_consensus.cc:515] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.834808 31786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e6e0240198340cdb710cc659623fe39" candidate_uuid: "31f01602b758422c85a11b021fddc3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce" is_pre_election: true
I20260709 13:12:26.834873 31534 catalog_manager.cc:5697] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce reported cstate change: term changed from 0 to 1, leader changed from <none> to c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3). New cstate: current_term: 1 leader_uuid: "c15d42e7445f4eee86f09c33d9b43fce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:26.837659 31603 leader_election.cc:343] T 9e6e0240198340cdb710cc659623fe39 P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3:34339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.816977 31826 tablet_bootstrap.cc:492] T 5dd5d4a006f74f3d83acde9f4174e1ea P c15d42e7445f4eee86f09c33d9b43fce: Bootstrap starting.
I20260709 13:12:26.838119 31603 leader_election.cc:304] T 9e6e0240198340cdb710cc659623fe39 P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6; no voters: 369d39d85e794108a1f8336f5b991c25, c15d42e7445f4eee86f09c33d9b43fce
I20260709 13:12:26.839233 31850 raft_consensus.cc:2749] T 9e6e0240198340cdb710cc659623fe39 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:26.841691 31637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bd1cb474eb45f7aa7547a021b47624" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f01602b758422c85a11b021fddc3e6"
I20260709 13:12:26.842298 31637 raft_consensus.cc:3060] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.845722 31826 tablet_bootstrap.cc:654] T 5dd5d4a006f74f3d83acde9f4174e1ea P c15d42e7445f4eee86f09c33d9b43fce: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.847659 31828 tablet_bootstrap.cc:492] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6: No bootstrap required, opened a new log
I20260709 13:12:26.848158 31828 ts_tablet_manager.cc:1403] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6: Time spent bootstrapping tablet: real 0.051s	user 0.020s	sys 0.010s
I20260709 13:12:26.851140 31828 raft_consensus.cc:359] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.851845 31828 raft_consensus.cc:385] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.852165 31828 raft_consensus.cc:740] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f01602b758422c85a11b021fddc3e6, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.854321 31828 consensus_queue.cc:260] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.862722 31637 raft_consensus.cc:2468] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15d42e7445f4eee86f09c33d9b43fce in term 1.
I20260709 13:12:26.864019 31749 leader_election.cc:304] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6, c15d42e7445f4eee86f09c33d9b43fce; no voters: 
I20260709 13:12:26.864951 31853 raft_consensus.cc:2804] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:26.865468 31853 raft_consensus.cc:697] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Becoming Leader. State: Replica: c15d42e7445f4eee86f09c33d9b43fce, State: Running, Role: LEADER
I20260709 13:12:26.866484 31853 consensus_queue.cc:237] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.867956 31833 leader_election.cc:290] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 election: Requested vote from peers 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605), 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631)
I20260709 13:12:26.869133 31712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bd1cb474eb45f7aa7547a021b47624" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369d39d85e794108a1f8336f5b991c25"
I20260709 13:12:26.869782 31712 raft_consensus.cc:3060] T d1bd1cb474eb45f7aa7547a021b47624 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.863996 31828 ts_tablet_manager.cc:1434] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:12:26.877736 31827 tablet_bootstrap.cc:492] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25: No bootstrap required, opened a new log
I20260709 13:12:26.878717 31827 ts_tablet_manager.cc:1403] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25: Time spent bootstrapping tablet: real 0.060s	user 0.024s	sys 0.012s
I20260709 13:12:26.878711 31712 raft_consensus.cc:2468] T d1bd1cb474eb45f7aa7547a021b47624 P 369d39d85e794108a1f8336f5b991c25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15d42e7445f4eee86f09c33d9b43fce in term 1.
I20260709 13:12:26.882160 31828 tablet_bootstrap.cc:492] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6: Bootstrap starting.
I20260709 13:12:26.883682 31827 raft_consensus.cc:359] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.885800 31827 raft_consensus.cc:385] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.886597 31827 raft_consensus.cc:740] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369d39d85e794108a1f8336f5b991c25, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.887548 31827 consensus_queue.cc:260] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.888895 31826 tablet_bootstrap.cc:492] T 5dd5d4a006f74f3d83acde9f4174e1ea P c15d42e7445f4eee86f09c33d9b43fce: No bootstrap required, opened a new log
I20260709 13:12:26.889374 31826 ts_tablet_manager.cc:1403] T 5dd5d4a006f74f3d83acde9f4174e1ea P c15d42e7445f4eee86f09c33d9b43fce: Time spent bootstrapping tablet: real 0.073s	user 0.022s	sys 0.026s
I20260709 13:12:26.889995 31827 ts_tablet_manager.cc:1434] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.005s
I20260709 13:12:26.891142 31827 tablet_bootstrap.cc:492] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25: Bootstrap starting.
I20260709 13:12:26.892401 31826 raft_consensus.cc:359] T 5dd5d4a006f74f3d83acde9f4174e1ea P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.893193 31826 raft_consensus.cc:385] T 5dd5d4a006f74f3d83acde9f4174e1ea P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.893524 31826 raft_consensus.cc:740] T 5dd5d4a006f74f3d83acde9f4174e1ea P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15d42e7445f4eee86f09c33d9b43fce, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.894326 31826 consensus_queue.cc:260] T 5dd5d4a006f74f3d83acde9f4174e1ea P c15d42e7445f4eee86f09c33d9b43fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.895339 31828 tablet_bootstrap.cc:654] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.895090 31533 catalog_manager.cc:5697] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce reported cstate change: term changed from 0 to 1, leader changed from <none> to c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3). New cstate: current_term: 1 leader_uuid: "c15d42e7445f4eee86f09c33d9b43fce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:26.896940 31826 ts_tablet_manager.cc:1434] T 5dd5d4a006f74f3d83acde9f4174e1ea P c15d42e7445f4eee86f09c33d9b43fce: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:12:26.898001 31826 tablet_bootstrap.cc:492] T 9e6e0240198340cdb710cc659623fe39 P c15d42e7445f4eee86f09c33d9b43fce: Bootstrap starting.
I20260709 13:12:26.904734 31826 tablet_bootstrap.cc:654] T 9e6e0240198340cdb710cc659623fe39 P c15d42e7445f4eee86f09c33d9b43fce: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.911475 31828 tablet_bootstrap.cc:492] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6: No bootstrap required, opened a new log
I20260709 13:12:26.912055 31828 ts_tablet_manager.cc:1403] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.004s
I20260709 13:12:26.912331 31827 tablet_bootstrap.cc:654] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.914925 31828 raft_consensus.cc:359] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.915736 31828 raft_consensus.cc:385] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.916083 31828 raft_consensus.cc:740] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f01602b758422c85a11b021fddc3e6, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.917663 31828 consensus_queue.cc:260] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.921557 31826 tablet_bootstrap.cc:492] T 9e6e0240198340cdb710cc659623fe39 P c15d42e7445f4eee86f09c33d9b43fce: No bootstrap required, opened a new log
I20260709 13:12:26.922056 31826 ts_tablet_manager.cc:1403] T 9e6e0240198340cdb710cc659623fe39 P c15d42e7445f4eee86f09c33d9b43fce: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.009s
I20260709 13:12:26.922551 31828 ts_tablet_manager.cc:1434] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:12:26.923921 31828 tablet_bootstrap.cc:492] T aa29c9ed2f134cd08c5b30c90a155df0 P 31f01602b758422c85a11b021fddc3e6: Bootstrap starting.
I20260709 13:12:26.924749 31826 raft_consensus.cc:359] T 9e6e0240198340cdb710cc659623fe39 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.925436 31826 raft_consensus.cc:385] T 9e6e0240198340cdb710cc659623fe39 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.925716 31826 raft_consensus.cc:740] T 9e6e0240198340cdb710cc659623fe39 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15d42e7445f4eee86f09c33d9b43fce, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.926491 31826 consensus_queue.cc:260] T 9e6e0240198340cdb710cc659623fe39 P c15d42e7445f4eee86f09c33d9b43fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.928503 31826 ts_tablet_manager.cc:1434] T 9e6e0240198340cdb710cc659623fe39 P c15d42e7445f4eee86f09c33d9b43fce: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:26.929414 31826 tablet_bootstrap.cc:492] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce: Bootstrap starting.
I20260709 13:12:26.932272 31827 tablet_bootstrap.cc:492] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25: No bootstrap required, opened a new log
I20260709 13:12:26.934340 31828 tablet_bootstrap.cc:654] T aa29c9ed2f134cd08c5b30c90a155df0 P 31f01602b758422c85a11b021fddc3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.935060 31826 tablet_bootstrap.cc:654] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.932806 31827 ts_tablet_manager.cc:1403] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.009s
I20260709 13:12:26.939262 31827 raft_consensus.cc:359] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.940255 31827 raft_consensus.cc:385] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.940661 31827 raft_consensus.cc:740] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369d39d85e794108a1f8336f5b991c25, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.941642 31827 consensus_queue.cc:260] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.943334 31828 tablet_bootstrap.cc:492] T aa29c9ed2f134cd08c5b30c90a155df0 P 31f01602b758422c85a11b021fddc3e6: No bootstrap required, opened a new log
I20260709 13:12:26.943831 31828 ts_tablet_manager.cc:1403] T aa29c9ed2f134cd08c5b30c90a155df0 P 31f01602b758422c85a11b021fddc3e6: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.007s
I20260709 13:12:26.944237 31827 ts_tablet_manager.cc:1434] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.001s
I20260709 13:12:26.945322 31827 tablet_bootstrap.cc:492] T aa29c9ed2f134cd08c5b30c90a155df0 P 369d39d85e794108a1f8336f5b991c25: Bootstrap starting.
I20260709 13:12:26.946261 31826 tablet_bootstrap.cc:492] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce: No bootstrap required, opened a new log
I20260709 13:12:26.946743 31826 ts_tablet_manager.cc:1403] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:12:26.946614 31828 raft_consensus.cc:359] T aa29c9ed2f134cd08c5b30c90a155df0 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.947273 31828 raft_consensus.cc:385] T aa29c9ed2f134cd08c5b30c90a155df0 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.947579 31828 raft_consensus.cc:740] T aa29c9ed2f134cd08c5b30c90a155df0 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f01602b758422c85a11b021fddc3e6, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.948232 31828 consensus_queue.cc:260] T aa29c9ed2f134cd08c5b30c90a155df0 P 31f01602b758422c85a11b021fddc3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.949816 31826 raft_consensus.cc:359] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.950546 31826 raft_consensus.cc:385] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.950899 31826 raft_consensus.cc:740] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15d42e7445f4eee86f09c33d9b43fce, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.951625 31826 consensus_queue.cc:260] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.953358 31828 ts_tablet_manager.cc:1434] T aa29c9ed2f134cd08c5b30c90a155df0 P 31f01602b758422c85a11b021fddc3e6: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:12:26.953549 31826 ts_tablet_manager.cc:1434] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:26.954286 31828 tablet_bootstrap.cc:492] T 4e960950bc9748598558089efeb71c4a P 31f01602b758422c85a11b021fddc3e6: Bootstrap starting.
I20260709 13:12:26.957967 31826 tablet_bootstrap.cc:492] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce: Bootstrap starting.
I20260709 13:12:26.960652 31828 tablet_bootstrap.cc:654] T 4e960950bc9748598558089efeb71c4a P 31f01602b758422c85a11b021fddc3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.965008 31826 tablet_bootstrap.cc:654] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.952414 31827 tablet_bootstrap.cc:654] T aa29c9ed2f134cd08c5b30c90a155df0 P 369d39d85e794108a1f8336f5b991c25: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.973269 31828 tablet_bootstrap.cc:492] T 4e960950bc9748598558089efeb71c4a P 31f01602b758422c85a11b021fddc3e6: No bootstrap required, opened a new log
I20260709 13:12:26.973599 31827 tablet_bootstrap.cc:492] T aa29c9ed2f134cd08c5b30c90a155df0 P 369d39d85e794108a1f8336f5b991c25: No bootstrap required, opened a new log
I20260709 13:12:26.973766 31828 ts_tablet_manager.cc:1403] T 4e960950bc9748598558089efeb71c4a P 31f01602b758422c85a11b021fddc3e6: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.006s
I20260709 13:12:26.973766 31826 tablet_bootstrap.cc:492] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce: No bootstrap required, opened a new log
I20260709 13:12:26.974037 31827 ts_tablet_manager.cc:1403] T aa29c9ed2f134cd08c5b30c90a155df0 P 369d39d85e794108a1f8336f5b991c25: Time spent bootstrapping tablet: real 0.029s	user 0.002s	sys 0.010s
I20260709 13:12:26.974439 31826 ts_tablet_manager.cc:1403] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 13:12:26.976900 31850 raft_consensus.cc:493] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.977104 31827 raft_consensus.cc:359] T aa29c9ed2f134cd08c5b30c90a155df0 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.977295 31826 raft_consensus.cc:359] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.977449 31850 raft_consensus.cc:515] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.977850 31827 raft_consensus.cc:385] T aa29c9ed2f134cd08c5b30c90a155df0 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.978070 31826 raft_consensus.cc:385] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.978175 31827 raft_consensus.cc:740] T aa29c9ed2f134cd08c5b30c90a155df0 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369d39d85e794108a1f8336f5b991c25, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.978571 31826 raft_consensus.cc:740] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15d42e7445f4eee86f09c33d9b43fce, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.976871 31828 raft_consensus.cc:359] T 4e960950bc9748598558089efeb71c4a P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.979408 31828 raft_consensus.cc:385] T 4e960950bc9748598558089efeb71c4a P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.979360 31827 consensus_queue.cc:260] T aa29c9ed2f134cd08c5b30c90a155df0 P 369d39d85e794108a1f8336f5b991c25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.979848 31828 raft_consensus.cc:740] T 4e960950bc9748598558089efeb71c4a P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f01602b758422c85a11b021fddc3e6, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.979682 31826 consensus_queue.cc:260] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.979728 31850 leader_election.cc:290] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631), c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3:34339)
I20260709 13:12:26.987042 31712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595e33a811f46c9bad6389e68a20bc9" candidate_uuid: "31f01602b758422c85a11b021fddc3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369d39d85e794108a1f8336f5b991c25" is_pre_election: true
I20260709 13:12:26.987742 31712 raft_consensus.cc:2468] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31f01602b758422c85a11b021fddc3e6 in term 0.
I20260709 13:12:26.987630 31828 consensus_queue.cc:260] T 4e960950bc9748598558089efeb71c4a P 31f01602b758422c85a11b021fddc3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.989332 31601 leader_election.cc:304] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6, 369d39d85e794108a1f8336f5b991c25; no voters: 
I20260709 13:12:26.990440 31834 raft_consensus.cc:2804] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:26.990833 31834 raft_consensus.cc:493] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.991195 31834 raft_consensus.cc:3060] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.991603 31828 ts_tablet_manager.cc:1434] T 4e960950bc9748598558089efeb71c4a P 31f01602b758422c85a11b021fddc3e6: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:12:26.993974 31827 ts_tablet_manager.cc:1434] T aa29c9ed2f134cd08c5b30c90a155df0 P 369d39d85e794108a1f8336f5b991c25: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 13:12:26.994728 31853 raft_consensus.cc:493] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.995210 31853 raft_consensus.cc:515] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:26.996440 31826 ts_tablet_manager.cc:1434] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:12:26.995229 31827 tablet_bootstrap.cc:492] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25: Bootstrap starting.
I20260709 13:12:26.997373 31853 leader_election.cc:290] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605), 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631)
I20260709 13:12:26.998955 31712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa29c9ed2f134cd08c5b30c90a155df0" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369d39d85e794108a1f8336f5b991c25" is_pre_election: true
I20260709 13:12:26.999619 31712 raft_consensus.cc:2468] T aa29c9ed2f134cd08c5b30c90a155df0 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15d42e7445f4eee86f09c33d9b43fce in term 0.
I20260709 13:12:27.000814 31637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa29c9ed2f134cd08c5b30c90a155df0" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f01602b758422c85a11b021fddc3e6" is_pre_election: true
I20260709 13:12:27.001466 31637 raft_consensus.cc:2468] T aa29c9ed2f134cd08c5b30c90a155df0 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15d42e7445f4eee86f09c33d9b43fce in term 0.
I20260709 13:12:27.002765 31750 leader_election.cc:304] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369d39d85e794108a1f8336f5b991c25, c15d42e7445f4eee86f09c33d9b43fce; no voters: 
I20260709 13:12:27.002774 31786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595e33a811f46c9bad6389e68a20bc9" candidate_uuid: "31f01602b758422c85a11b021fddc3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce" is_pre_election: true
I20260709 13:12:27.004182 31786 raft_consensus.cc:2468] T 6595e33a811f46c9bad6389e68a20bc9 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31f01602b758422c85a11b021fddc3e6 in term 0.
I20260709 13:12:27.005074 31827 tablet_bootstrap.cc:654] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.005421 31834 raft_consensus.cc:515] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.006088 31853 raft_consensus.cc:2804] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:27.006515 31853 raft_consensus.cc:493] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.006862 31853 raft_consensus.cc:3060] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.006923 31833 raft_consensus.cc:493] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.007534 31833 raft_consensus.cc:515] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.008505 31834 leader_election.cc:290] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 1 election: Requested vote from peers 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631), c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3:34339)
I20260709 13:12:27.009712 31712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595e33a811f46c9bad6389e68a20bc9" candidate_uuid: "31f01602b758422c85a11b021fddc3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369d39d85e794108a1f8336f5b991c25"
I20260709 13:12:27.009881 31833 leader_election.cc:290] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605), 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631)
I20260709 13:12:27.010295 31712 raft_consensus.cc:3060] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.012177 31711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3558f74b6e384db198bb8d74d491da4a" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369d39d85e794108a1f8336f5b991c25" is_pre_election: true
W20260709 13:12:27.014425 31750 leader_election.cc:343] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:27.017361 31786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595e33a811f46c9bad6389e68a20bc9" candidate_uuid: "31f01602b758422c85a11b021fddc3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
I20260709 13:12:27.018318 31786 raft_consensus.cc:3060] T 6595e33a811f46c9bad6389e68a20bc9 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.018132 31712 raft_consensus.cc:2468] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f01602b758422c85a11b021fddc3e6 in term 1.
I20260709 13:12:27.018303 31637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3558f74b6e384db198bb8d74d491da4a" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f01602b758422c85a11b021fddc3e6" is_pre_election: true
I20260709 13:12:27.020828 31637 raft_consensus.cc:2468] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15d42e7445f4eee86f09c33d9b43fce in term 0.
I20260709 13:12:27.022127 31601 leader_election.cc:304] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6, 369d39d85e794108a1f8336f5b991c25; no voters: 
I20260709 13:12:27.023005 31834 raft_consensus.cc:2804] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:27.023505 31834 raft_consensus.cc:697] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6 [term 1 LEADER]: Becoming Leader. State: Replica: 31f01602b758422c85a11b021fddc3e6, State: Running, Role: LEADER
I20260709 13:12:27.024354 31834 consensus_queue.cc:237] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.028486 31749 leader_election.cc:304] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6, c15d42e7445f4eee86f09c33d9b43fce; no voters: 369d39d85e794108a1f8336f5b991c25
I20260709 13:12:27.028890 31786 raft_consensus.cc:2468] T 6595e33a811f46c9bad6389e68a20bc9 P c15d42e7445f4eee86f09c33d9b43fce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f01602b758422c85a11b021fddc3e6 in term 1.
I20260709 13:12:27.030234 31833 raft_consensus.cc:2804] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:27.030812 31833 raft_consensus.cc:493] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.031525 31833 raft_consensus.cc:3060] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.033748 31849 raft_consensus.cc:493] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.033411 31853 raft_consensus.cc:515] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.034271 31849 raft_consensus.cc:515] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.036859 31827 tablet_bootstrap.cc:492] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25: No bootstrap required, opened a new log
I20260709 13:12:27.037412 31827 ts_tablet_manager.cc:1403] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.022s
I20260709 13:12:27.037808 31849 leader_election.cc:290] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605), 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631)
I20260709 13:12:27.038094 31853 leader_election.cc:290] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 election: Requested vote from peers 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605), 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631)
I20260709 13:12:27.039690 31637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa29c9ed2f134cd08c5b30c90a155df0" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f01602b758422c85a11b021fddc3e6"
I20260709 13:12:27.040274 31637 raft_consensus.cc:3060] T aa29c9ed2f134cd08c5b30c90a155df0 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.040103 31827 raft_consensus.cc:359] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.040424 31711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa29c9ed2f134cd08c5b30c90a155df0" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369d39d85e794108a1f8336f5b991c25"
I20260709 13:12:27.040799 31827 raft_consensus.cc:385] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.041109 31711 raft_consensus.cc:3060] T aa29c9ed2f134cd08c5b30c90a155df0 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.041211 31827 raft_consensus.cc:740] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369d39d85e794108a1f8336f5b991c25, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.040680 31833 raft_consensus.cc:515] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.042098 31827 consensus_queue.cc:260] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.040119 31712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e960950bc9748598558089efeb71c4a" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369d39d85e794108a1f8336f5b991c25" is_pre_election: true
I20260709 13:12:27.043519 31833 leader_election.cc:290] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 election: Requested vote from peers 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605), 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631)
I20260709 13:12:27.043681 31712 raft_consensus.cc:2468] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15d42e7445f4eee86f09c33d9b43fce in term 0.
I20260709 13:12:27.044265 31827 ts_tablet_manager.cc:1434] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:27.044891 31710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3558f74b6e384db198bb8d74d491da4a" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369d39d85e794108a1f8336f5b991c25"
I20260709 13:12:27.045413 31827 tablet_bootstrap.cc:492] T 9e6e0240198340cdb710cc659623fe39 P 369d39d85e794108a1f8336f5b991c25: Bootstrap starting.
I20260709 13:12:27.045425 31710 raft_consensus.cc:3060] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.051220 31827 tablet_bootstrap.cc:654] T 9e6e0240198340cdb710cc659623fe39 P 369d39d85e794108a1f8336f5b991c25: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.053138 31531 catalog_manager.cc:5697] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31f01602b758422c85a11b021fddc3e6 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "31f01602b758422c85a11b021fddc3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:27.054033 31635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e960950bc9748598558089efeb71c4a" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f01602b758422c85a11b021fddc3e6" is_pre_election: true
I20260709 13:12:27.055537 31635 raft_consensus.cc:2468] T 4e960950bc9748598558089efeb71c4a P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15d42e7445f4eee86f09c33d9b43fce in term 0.
I20260709 13:12:27.056936 31636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3558f74b6e384db198bb8d74d491da4a" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f01602b758422c85a11b021fddc3e6"
I20260709 13:12:27.057397 31750 leader_election.cc:304] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369d39d85e794108a1f8336f5b991c25, c15d42e7445f4eee86f09c33d9b43fce; no voters: 
I20260709 13:12:27.057737 31636 raft_consensus.cc:3060] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.058269 31833 raft_consensus.cc:2804] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:27.058624 31833 raft_consensus.cc:493] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.058965 31833 raft_consensus.cc:3060] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.070286 31827 tablet_bootstrap.cc:492] T 9e6e0240198340cdb710cc659623fe39 P 369d39d85e794108a1f8336f5b991c25: No bootstrap required, opened a new log
I20260709 13:12:27.070801 31827 ts_tablet_manager.cc:1403] T 9e6e0240198340cdb710cc659623fe39 P 369d39d85e794108a1f8336f5b991c25: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.009s
I20260709 13:12:27.070417 31833 raft_consensus.cc:515] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.072783 31637 raft_consensus.cc:2468] T aa29c9ed2f134cd08c5b30c90a155df0 P 31f01602b758422c85a11b021fddc3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15d42e7445f4eee86f09c33d9b43fce in term 1.
I20260709 13:12:27.072912 31833 leader_election.cc:290] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 election: Requested vote from peers 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605), 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631)
I20260709 13:12:27.054750 31711 raft_consensus.cc:2468] T aa29c9ed2f134cd08c5b30c90a155df0 P 369d39d85e794108a1f8336f5b991c25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15d42e7445f4eee86f09c33d9b43fce in term 1.
I20260709 13:12:27.073565 31712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e960950bc9748598558089efeb71c4a" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369d39d85e794108a1f8336f5b991c25"
I20260709 13:12:27.073519 31827 raft_consensus.cc:359] T 9e6e0240198340cdb710cc659623fe39 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.074187 31712 raft_consensus.cc:3060] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.074330 31749 leader_election.cc:304] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6, c15d42e7445f4eee86f09c33d9b43fce; no voters: 
I20260709 13:12:27.075450 31833 raft_consensus.cc:2804] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:27.075995 31637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e960950bc9748598558089efeb71c4a" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f01602b758422c85a11b021fddc3e6"
I20260709 13:12:27.076608 31637 raft_consensus.cc:3060] T 4e960950bc9748598558089efeb71c4a P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.076656 31833 raft_consensus.cc:697] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Becoming Leader. State: Replica: c15d42e7445f4eee86f09c33d9b43fce, State: Running, Role: LEADER
I20260709 13:12:27.076853 31636 raft_consensus.cc:2468] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15d42e7445f4eee86f09c33d9b43fce in term 1.
I20260709 13:12:27.077852 31710 raft_consensus.cc:2468] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15d42e7445f4eee86f09c33d9b43fce in term 1.
I20260709 13:12:27.077925 31749 leader_election.cc:304] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6, c15d42e7445f4eee86f09c33d9b43fce; no voters: 
I20260709 13:12:27.074208 31827 raft_consensus.cc:385] T 9e6e0240198340cdb710cc659623fe39 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.078969 31853 raft_consensus.cc:2804] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:27.079075 31827 raft_consensus.cc:740] T 9e6e0240198340cdb710cc659623fe39 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369d39d85e794108a1f8336f5b991c25, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.077948 31833 consensus_queue.cc:237] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.079541 31853 raft_consensus.cc:697] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Becoming Leader. State: Replica: c15d42e7445f4eee86f09c33d9b43fce, State: Running, Role: LEADER
I20260709 13:12:27.079993 31827 consensus_queue.cc:260] T 9e6e0240198340cdb710cc659623fe39 P 369d39d85e794108a1f8336f5b991c25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.080431 31853 consensus_queue.cc:237] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.081894 31712 raft_consensus.cc:2468] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15d42e7445f4eee86f09c33d9b43fce in term 1.
I20260709 13:12:27.082521 31827 ts_tablet_manager.cc:1434] T 9e6e0240198340cdb710cc659623fe39 P 369d39d85e794108a1f8336f5b991c25: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:12:27.083804 31750 leader_election.cc:304] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369d39d85e794108a1f8336f5b991c25, c15d42e7445f4eee86f09c33d9b43fce; no voters: 
I20260709 13:12:27.084659 31834 raft_consensus.cc:493] T 2366d5ec869a4f53adf0887c6c605f63 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.085124 31834 raft_consensus.cc:515] T 2366d5ec869a4f53adf0887c6c605f63 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } }
I20260709 13:12:27.087306 31834 leader_election.cc:290] T 2366d5ec869a4f53adf0887c6c605f63 P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3:34339), 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631)
I20260709 13:12:27.088368 31849 raft_consensus.cc:2804] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:27.089166 31849 raft_consensus.cc:697] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Becoming Leader. State: Replica: c15d42e7445f4eee86f09c33d9b43fce, State: Running, Role: LEADER
I20260709 13:12:27.090233 31637 raft_consensus.cc:2468] T 4e960950bc9748598558089efeb71c4a P 31f01602b758422c85a11b021fddc3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15d42e7445f4eee86f09c33d9b43fce in term 1.
I20260709 13:12:27.090183 31849 consensus_queue.cc:237] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.092948 31786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2366d5ec869a4f53adf0887c6c605f63" candidate_uuid: "31f01602b758422c85a11b021fddc3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce" is_pre_election: true
I20260709 13:12:27.093613 31786 raft_consensus.cc:2468] T 2366d5ec869a4f53adf0887c6c605f63 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31f01602b758422c85a11b021fddc3e6 in term 0.
I20260709 13:12:27.094781 31603 leader_election.cc:304] T 2366d5ec869a4f53adf0887c6c605f63 P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6, c15d42e7445f4eee86f09c33d9b43fce; no voters: 
I20260709 13:12:27.097463 31834 raft_consensus.cc:2804] T 2366d5ec869a4f53adf0887c6c605f63 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:27.097867 31834 raft_consensus.cc:493] T 2366d5ec869a4f53adf0887c6c605f63 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.098233 31834 raft_consensus.cc:3060] T 2366d5ec869a4f53adf0887c6c605f63 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.104375 31834 raft_consensus.cc:515] T 2366d5ec869a4f53adf0887c6c605f63 P 31f01602b758422c85a11b021fddc3e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } }
I20260709 13:12:27.105562 31712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2366d5ec869a4f53adf0887c6c605f63" candidate_uuid: "31f01602b758422c85a11b021fddc3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369d39d85e794108a1f8336f5b991c25" is_pre_election: true
I20260709 13:12:27.106194 31712 raft_consensus.cc:2468] T 2366d5ec869a4f53adf0887c6c605f63 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31f01602b758422c85a11b021fddc3e6 in term 0.
I20260709 13:12:27.108289 31834 leader_election.cc:290] T 2366d5ec869a4f53adf0887c6c605f63 P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 1 election: Requested vote from peers c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3:34339), 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631)
I20260709 13:12:27.109246 31712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2366d5ec869a4f53adf0887c6c605f63" candidate_uuid: "31f01602b758422c85a11b021fddc3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369d39d85e794108a1f8336f5b991c25"
I20260709 13:12:27.109297 31786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2366d5ec869a4f53adf0887c6c605f63" candidate_uuid: "31f01602b758422c85a11b021fddc3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
I20260709 13:12:27.109987 31786 raft_consensus.cc:3060] T 2366d5ec869a4f53adf0887c6c605f63 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.110849 31534 catalog_manager.cc:5697] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce reported cstate change: term changed from 0 to 1, leader changed from <none> to c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3). New cstate: current_term: 1 leader_uuid: "c15d42e7445f4eee86f09c33d9b43fce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:27.111797 31712 raft_consensus.cc:3060] T 2366d5ec869a4f53adf0887c6c605f63 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.115196 31786 raft_consensus.cc:2468] T 2366d5ec869a4f53adf0887c6c605f63 P c15d42e7445f4eee86f09c33d9b43fce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f01602b758422c85a11b021fddc3e6 in term 1.
I20260709 13:12:27.117203 31603 leader_election.cc:304] T 2366d5ec869a4f53adf0887c6c605f63 P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6, c15d42e7445f4eee86f09c33d9b43fce; no voters: 
I20260709 13:12:27.117988 31834 raft_consensus.cc:2804] T 2366d5ec869a4f53adf0887c6c605f63 P 31f01602b758422c85a11b021fddc3e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:27.118511 31712 raft_consensus.cc:2468] T 2366d5ec869a4f53adf0887c6c605f63 P 369d39d85e794108a1f8336f5b991c25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f01602b758422c85a11b021fddc3e6 in term 1.
I20260709 13:12:27.119122 31834 raft_consensus.cc:697] T 2366d5ec869a4f53adf0887c6c605f63 P 31f01602b758422c85a11b021fddc3e6 [term 1 LEADER]: Becoming Leader. State: Replica: 31f01602b758422c85a11b021fddc3e6, State: Running, Role: LEADER
I20260709 13:12:27.120030 31834 consensus_queue.cc:237] T 2366d5ec869a4f53adf0887c6c605f63 P 31f01602b758422c85a11b021fddc3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } }
I20260709 13:12:27.126418 31534 catalog_manager.cc:5697] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce reported cstate change: term changed from 0 to 1, leader changed from <none> to c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3). New cstate: current_term: 1 leader_uuid: "c15d42e7445f4eee86f09c33d9b43fce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:27.127969 31534 catalog_manager.cc:5697] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce reported cstate change: term changed from 0 to 1, leader changed from <none> to c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3). New cstate: current_term: 1 leader_uuid: "c15d42e7445f4eee86f09c33d9b43fce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:27.129066 31531 catalog_manager.cc:5697] T 2366d5ec869a4f53adf0887c6c605f63 P 31f01602b758422c85a11b021fddc3e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31f01602b758422c85a11b021fddc3e6 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "31f01602b758422c85a11b021fddc3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:27.143474 31833 consensus_queue.cc:1048] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:27.154666 31849 consensus_queue.cc:1048] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:27.286245 31849 consensus_queue.cc:1048] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:27.296903 31849 consensus_queue.cc:1048] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:27.303764 31859 raft_consensus.cc:493] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.304306 31859 raft_consensus.cc:515] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.306461 31859 leader_election.cc:290] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605), c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3:34339)
I20260709 13:12:27.307185 31637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dd5d4a006f74f3d83acde9f4174e1ea" candidate_uuid: "369d39d85e794108a1f8336f5b991c25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f01602b758422c85a11b021fddc3e6" is_pre_election: true
I20260709 13:12:27.307505 31786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dd5d4a006f74f3d83acde9f4174e1ea" candidate_uuid: "369d39d85e794108a1f8336f5b991c25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce" is_pre_election: true
I20260709 13:12:27.307976 31637 raft_consensus.cc:2468] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 369d39d85e794108a1f8336f5b991c25 in term 0.
I20260709 13:12:27.308161 31786 raft_consensus.cc:2468] T 5dd5d4a006f74f3d83acde9f4174e1ea P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 369d39d85e794108a1f8336f5b991c25 in term 0.
I20260709 13:12:27.309067 31675 leader_election.cc:304] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6, 369d39d85e794108a1f8336f5b991c25; no voters: 
I20260709 13:12:27.309849 31859 raft_consensus.cc:2804] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:27.310220 31859 raft_consensus.cc:493] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.310559 31859 raft_consensus.cc:3060] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.315675 31859 raft_consensus.cc:515] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.317736 31859 leader_election.cc:290] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25 [CANDIDATE]: Term 1 election: Requested vote from peers 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605), c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3:34339)
I20260709 13:12:27.318470 31637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dd5d4a006f74f3d83acde9f4174e1ea" candidate_uuid: "369d39d85e794108a1f8336f5b991c25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f01602b758422c85a11b021fddc3e6"
I20260709 13:12:27.319049 31637 raft_consensus.cc:3060] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.319218 31786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dd5d4a006f74f3d83acde9f4174e1ea" candidate_uuid: "369d39d85e794108a1f8336f5b991c25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
I20260709 13:12:27.319756 31786 raft_consensus.cc:3060] T 5dd5d4a006f74f3d83acde9f4174e1ea P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.324299 31637 raft_consensus.cc:2468] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369d39d85e794108a1f8336f5b991c25 in term 1.
I20260709 13:12:27.324544 31786 raft_consensus.cc:2468] T 5dd5d4a006f74f3d83acde9f4174e1ea P c15d42e7445f4eee86f09c33d9b43fce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369d39d85e794108a1f8336f5b991c25 in term 1.
I20260709 13:12:27.325609 31675 leader_election.cc:304] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6, 369d39d85e794108a1f8336f5b991c25; no voters: 
I20260709 13:12:27.326287 31859 raft_consensus.cc:2804] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:27.327278 31859 raft_consensus.cc:697] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25 [term 1 LEADER]: Becoming Leader. State: Replica: 369d39d85e794108a1f8336f5b991c25, State: Running, Role: LEADER
I20260709 13:12:27.328083 31859 consensus_queue.cc:237] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.335320 31531 catalog_manager.cc:5697] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25 reported cstate change: term changed from 0 to 1, leader changed from <none> to 369d39d85e794108a1f8336f5b991c25 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "369d39d85e794108a1f8336f5b991c25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:27.365268 31849 raft_consensus.cc:493] T 9e6e0240198340cdb710cc659623fe39 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.365911 31849 raft_consensus.cc:515] T 9e6e0240198340cdb710cc659623fe39 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.367875 31849 leader_election.cc:290] T 9e6e0240198340cdb710cc659623fe39 P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605), 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631)
I20260709 13:12:27.369061 31637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e6e0240198340cdb710cc659623fe39" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f01602b758422c85a11b021fddc3e6" is_pre_election: true
I20260709 13:12:27.369059 31712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e6e0240198340cdb710cc659623fe39" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369d39d85e794108a1f8336f5b991c25" is_pre_election: true
I20260709 13:12:27.369787 31637 raft_consensus.cc:2468] T 9e6e0240198340cdb710cc659623fe39 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15d42e7445f4eee86f09c33d9b43fce in term 0.
I20260709 13:12:27.370029 31712 raft_consensus.cc:2468] T 9e6e0240198340cdb710cc659623fe39 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15d42e7445f4eee86f09c33d9b43fce in term 0.
I20260709 13:12:27.370854 31749 leader_election.cc:304] T 9e6e0240198340cdb710cc659623fe39 P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6, c15d42e7445f4eee86f09c33d9b43fce; no voters: 
I20260709 13:12:27.371523 31849 raft_consensus.cc:2804] T 9e6e0240198340cdb710cc659623fe39 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:27.371831 31849 raft_consensus.cc:493] T 9e6e0240198340cdb710cc659623fe39 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.372104 31849 raft_consensus.cc:3060] T 9e6e0240198340cdb710cc659623fe39 P c15d42e7445f4eee86f09c33d9b43fce [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.377211 31849 raft_consensus.cc:515] T 9e6e0240198340cdb710cc659623fe39 P c15d42e7445f4eee86f09c33d9b43fce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.379330 31849 leader_election.cc:290] T 9e6e0240198340cdb710cc659623fe39 P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 election: Requested vote from peers 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605), 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631)
I20260709 13:12:27.380342 31637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e6e0240198340cdb710cc659623fe39" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f01602b758422c85a11b021fddc3e6"
I20260709 13:12:27.380508 31712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e6e0240198340cdb710cc659623fe39" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369d39d85e794108a1f8336f5b991c25"
I20260709 13:12:27.380990 31637 raft_consensus.cc:3060] T 9e6e0240198340cdb710cc659623fe39 P 31f01602b758422c85a11b021fddc3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.381207 31712 raft_consensus.cc:3060] T 9e6e0240198340cdb710cc659623fe39 P 369d39d85e794108a1f8336f5b991c25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.386036 31637 raft_consensus.cc:2468] T 9e6e0240198340cdb710cc659623fe39 P 31f01602b758422c85a11b021fddc3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15d42e7445f4eee86f09c33d9b43fce in term 1.
I20260709 13:12:27.386188 31712 raft_consensus.cc:2468] T 9e6e0240198340cdb710cc659623fe39 P 369d39d85e794108a1f8336f5b991c25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15d42e7445f4eee86f09c33d9b43fce in term 1.
I20260709 13:12:27.387377 31749 leader_election.cc:304] T 9e6e0240198340cdb710cc659623fe39 P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6, c15d42e7445f4eee86f09c33d9b43fce; no voters: 
I20260709 13:12:27.388263 31849 raft_consensus.cc:2804] T 9e6e0240198340cdb710cc659623fe39 P c15d42e7445f4eee86f09c33d9b43fce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:27.388841 31849 raft_consensus.cc:697] T 9e6e0240198340cdb710cc659623fe39 P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Becoming Leader. State: Replica: c15d42e7445f4eee86f09c33d9b43fce, State: Running, Role: LEADER
I20260709 13:12:27.389549 31849 consensus_queue.cc:237] T 9e6e0240198340cdb710cc659623fe39 P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.396377 31531 catalog_manager.cc:5697] T 9e6e0240198340cdb710cc659623fe39 P c15d42e7445f4eee86f09c33d9b43fce reported cstate change: term changed from 0 to 1, leader changed from <none> to c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3). New cstate: current_term: 1 leader_uuid: "c15d42e7445f4eee86f09c33d9b43fce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:27.455871 31849 consensus_queue.cc:1048] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:27.469190 31852 consensus_queue.cc:1048] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:27.485005 31849 consensus_queue.cc:1048] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:27.501763 31786 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41f91725ca2740729c7c04dab9a0d5a0"
dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
mode: GRACEFUL
new_leader_uuid: "31f01602b758422c85a11b021fddc3e6"
 from {username='slave'} at 127.0.0.1:42612
I20260709 13:12:27.502394 31786 raft_consensus.cc:606] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Received request to transfer leadership to TS 31f01602b758422c85a11b021fddc3e6
I20260709 13:12:27.502290 31853 consensus_queue.cc:1048] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:27.509307 31786 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11c8f2db76164c2cad66c4f44c70ba6c"
dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
mode: GRACEFUL
new_leader_uuid: "31f01602b758422c85a11b021fddc3e6"
 from {username='slave'} at 127.0.0.1:42612
I20260709 13:12:27.509912 31786 raft_consensus.cc:606] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Received request to transfer leadership to TS 31f01602b758422c85a11b021fddc3e6
I20260709 13:12:27.518620 31786 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1bd1cb474eb45f7aa7547a021b47624"
dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
mode: GRACEFUL
new_leader_uuid: "31f01602b758422c85a11b021fddc3e6"
 from {username='slave'} at 127.0.0.1:42612
I20260709 13:12:27.519244 31786 raft_consensus.cc:606] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Received request to transfer leadership to TS 31f01602b758422c85a11b021fddc3e6
I20260709 13:12:27.525355 31786 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3558f74b6e384db198bb8d74d491da4a"
dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
mode: GRACEFUL
new_leader_uuid: "369d39d85e794108a1f8336f5b991c25"
 from {username='slave'} at 127.0.0.1:42612
I20260709 13:12:27.525406 31853 consensus_queue.cc:1048] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:27.526077 31786 raft_consensus.cc:606] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Received request to transfer leadership to TS 369d39d85e794108a1f8336f5b991c25
I20260709 13:12:27.530256 31834 consensus_queue.cc:1048] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:27.535866 31785 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e960950bc9748598558089efeb71c4a"
dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
mode: GRACEFUL
new_leader_uuid: "369d39d85e794108a1f8336f5b991c25"
 from {username='slave'} at 127.0.0.1:42612
I20260709 13:12:27.536486 31785 raft_consensus.cc:606] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Received request to transfer leadership to TS 369d39d85e794108a1f8336f5b991c25
I20260709 13:12:27.538851 31853 consensus_queue.cc:1048] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:27.542603 31785 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa29c9ed2f134cd08c5b30c90a155df0"
dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
mode: GRACEFUL
new_leader_uuid: "369d39d85e794108a1f8336f5b991c25"
 from {username='slave'} at 127.0.0.1:42612
I20260709 13:12:27.543205 31785 raft_consensus.cc:606] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Received request to transfer leadership to TS 369d39d85e794108a1f8336f5b991c25
I20260709 13:12:27.553304 31834 consensus_queue.cc:1048] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:27.557761 31833 raft_consensus.cc:993] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce: : Instructing follower 369d39d85e794108a1f8336f5b991c25 to start an election
I20260709 13:12:27.558243 31833 raft_consensus.cc:1081] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Signalling peer 369d39d85e794108a1f8336f5b991c25 to start an election
I20260709 13:12:27.560034 31711 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3558f74b6e384db198bb8d74d491da4a"
dest_uuid: "369d39d85e794108a1f8336f5b991c25"
 from {username='slave'} at 127.0.0.1:37032
I20260709 13:12:27.560634 31711 raft_consensus.cc:493] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:27.561023 31711 raft_consensus.cc:3060] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.580935 31834 consensus_queue.cc:1048] T 2366d5ec869a4f53adf0887c6c605f63 P 31f01602b758422c85a11b021fddc3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:27.587121 31711 raft_consensus.cc:515] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.598410 31637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3558f74b6e384db198bb8d74d491da4a" candidate_uuid: "369d39d85e794108a1f8336f5b991c25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31f01602b758422c85a11b021fddc3e6"
I20260709 13:12:27.599349 31637 raft_consensus.cc:3060] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.602188 31786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3558f74b6e384db198bb8d74d491da4a" candidate_uuid: "369d39d85e794108a1f8336f5b991c25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
I20260709 13:12:27.603701 31786 raft_consensus.cc:3055] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:27.604077 31786 raft_consensus.cc:740] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c15d42e7445f4eee86f09c33d9b43fce, State: Running, Role: LEADER
I20260709 13:12:27.607290 31786 consensus_queue.cc:260] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.608553 31786 raft_consensus.cc:3060] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.609408 31834 consensus_queue.cc:1048] T 2366d5ec869a4f53adf0887c6c605f63 P 31f01602b758422c85a11b021fddc3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:27.598659 31711 leader_election.cc:290] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [CANDIDATE]: Term 2 election: Requested vote from peers 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605), c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3:34339)
I20260709 13:12:27.618211 31637 raft_consensus.cc:2468] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369d39d85e794108a1f8336f5b991c25 in term 2.
I20260709 13:12:27.620631 31852 consensus_queue.cc:1048] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:27.625449 31675 leader_election.cc:304] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6, 369d39d85e794108a1f8336f5b991c25; no voters: 
I20260709 13:12:27.626670 31859 raft_consensus.cc:2804] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:27.627120 31859 raft_consensus.cc:697] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [term 2 LEADER]: Becoming Leader. State: Replica: 369d39d85e794108a1f8336f5b991c25, State: Running, Role: LEADER
I20260709 13:12:27.627919 31859 consensus_queue.cc:237] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.638715 31786 raft_consensus.cc:2468] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369d39d85e794108a1f8336f5b991c25 in term 2.
I20260709 13:12:27.639154 31534 catalog_manager.cc:5697] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 reported cstate change: term changed from 1 to 2, leader changed from c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3) to 369d39d85e794108a1f8336f5b991c25 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "369d39d85e794108a1f8336f5b991c25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:27.648238 31853 consensus_queue.cc:1048] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:27.664321 31852 raft_consensus.cc:993] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce: : Instructing follower 369d39d85e794108a1f8336f5b991c25 to start an election
I20260709 13:12:27.664827 31853 raft_consensus.cc:1081] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Signalling peer 369d39d85e794108a1f8336f5b991c25 to start an election
I20260709 13:12:27.666445 31712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e960950bc9748598558089efeb71c4a"
dest_uuid: "369d39d85e794108a1f8336f5b991c25"
 from {username='slave'} at 127.0.0.1:37032
I20260709 13:12:27.666991 31712 raft_consensus.cc:493] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:27.667281 31712 raft_consensus.cc:3060] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.671834 31712 raft_consensus.cc:515] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.673544 31712 leader_election.cc:290] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25 [CANDIDATE]: Term 2 election: Requested vote from peers 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605), c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3:34339)
I20260709 13:12:27.674677 31637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e960950bc9748598558089efeb71c4a" candidate_uuid: "369d39d85e794108a1f8336f5b991c25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31f01602b758422c85a11b021fddc3e6"
I20260709 13:12:27.674907 31786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e960950bc9748598558089efeb71c4a" candidate_uuid: "369d39d85e794108a1f8336f5b991c25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
I20260709 13:12:27.675292 31637 raft_consensus.cc:3060] T 4e960950bc9748598558089efeb71c4a P 31f01602b758422c85a11b021fddc3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.675419 31786 raft_consensus.cc:3055] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:27.675772 31786 raft_consensus.cc:740] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c15d42e7445f4eee86f09c33d9b43fce, State: Running, Role: LEADER
I20260709 13:12:27.676647 31786 consensus_queue.cc:260] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.677981 31786 raft_consensus.cc:3060] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.682809 31637 raft_consensus.cc:2468] T 4e960950bc9748598558089efeb71c4a P 31f01602b758422c85a11b021fddc3e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369d39d85e794108a1f8336f5b991c25 in term 2.
I20260709 13:12:27.684378 31675 leader_election.cc:304] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6, 369d39d85e794108a1f8336f5b991c25; no voters: 
I20260709 13:12:27.684787 31786 raft_consensus.cc:2468] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369d39d85e794108a1f8336f5b991c25 in term 2.
I20260709 13:12:27.685357 31859 raft_consensus.cc:2804] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:27.685874 31859 raft_consensus.cc:697] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25 [term 2 LEADER]: Becoming Leader. State: Replica: 369d39d85e794108a1f8336f5b991c25, State: Running, Role: LEADER
I20260709 13:12:27.686667 31859 consensus_queue.cc:237] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.692782 31532 catalog_manager.cc:5697] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25 reported cstate change: term changed from 1 to 2, leader changed from c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3) to 369d39d85e794108a1f8336f5b991c25 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "369d39d85e794108a1f8336f5b991c25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:27.763406 31852 raft_consensus.cc:993] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce: : Instructing follower 31f01602b758422c85a11b021fddc3e6 to start an election
I20260709 13:12:27.763896 31853 raft_consensus.cc:1081] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Signalling peer 31f01602b758422c85a11b021fddc3e6 to start an election
I20260709 13:12:27.765445 31637 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11c8f2db76164c2cad66c4f44c70ba6c"
dest_uuid: "31f01602b758422c85a11b021fddc3e6"
 from {username='slave'} at 127.0.0.1:55254
I20260709 13:12:27.765941 31637 raft_consensus.cc:493] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:27.766255 31637 raft_consensus.cc:3060] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.771235 31637 raft_consensus.cc:515] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.772917 31637 leader_election.cc:290] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 2 election: Requested vote from peers 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631), c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3:34339)
I20260709 13:12:27.773834 31712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c8f2db76164c2cad66c4f44c70ba6c" candidate_uuid: "31f01602b758422c85a11b021fddc3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "369d39d85e794108a1f8336f5b991c25"
I20260709 13:12:27.773898 31786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c8f2db76164c2cad66c4f44c70ba6c" candidate_uuid: "31f01602b758422c85a11b021fddc3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
I20260709 13:12:27.774489 31712 raft_consensus.cc:3060] T 11c8f2db76164c2cad66c4f44c70ba6c P 369d39d85e794108a1f8336f5b991c25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.774628 31786 raft_consensus.cc:3055] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:27.774987 31786 raft_consensus.cc:740] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c15d42e7445f4eee86f09c33d9b43fce, State: Running, Role: LEADER
I20260709 13:12:27.775609 31786 consensus_queue.cc:260] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.776507 31786 raft_consensus.cc:3060] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.779392 31712 raft_consensus.cc:2468] T 11c8f2db76164c2cad66c4f44c70ba6c P 369d39d85e794108a1f8336f5b991c25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f01602b758422c85a11b021fddc3e6 in term 2.
I20260709 13:12:27.780536 31601 leader_election.cc:304] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6, 369d39d85e794108a1f8336f5b991c25; no voters: 
I20260709 13:12:27.781379 31906 raft_consensus.cc:2804] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:27.781818 31906 raft_consensus.cc:697] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [term 2 LEADER]: Becoming Leader. State: Replica: 31f01602b758422c85a11b021fddc3e6, State: Running, Role: LEADER
I20260709 13:12:27.781826 31786 raft_consensus.cc:2468] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f01602b758422c85a11b021fddc3e6 in term 2.
I20260709 13:12:27.782660 31906 consensus_queue.cc:237] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.789140 31532 catalog_manager.cc:5697] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 reported cstate change: term changed from 1 to 2, leader changed from c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3) to 31f01602b758422c85a11b021fddc3e6 (127.30.63.1). New cstate: current_term: 2 leader_uuid: "31f01602b758422c85a11b021fddc3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:27.820964 31859 consensus_queue.cc:1048] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:27.832284 31859 consensus_queue.cc:1048] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:27.881430 31853 consensus_queue.cc:1048] T 9e6e0240198340cdb710cc659623fe39 P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:27.893262 31853 consensus_queue.cc:1048] T 9e6e0240198340cdb710cc659623fe39 P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:27.895651 31833 raft_consensus.cc:993] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce: : Instructing follower 369d39d85e794108a1f8336f5b991c25 to start an election
I20260709 13:12:27.896016 31853 raft_consensus.cc:993] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce: : Instructing follower 31f01602b758422c85a11b021fddc3e6 to start an election
I20260709 13:12:27.896112 31833 raft_consensus.cc:1081] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Signalling peer 369d39d85e794108a1f8336f5b991c25 to start an election
I20260709 13:12:27.896557 31853 raft_consensus.cc:1081] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Signalling peer 31f01602b758422c85a11b021fddc3e6 to start an election
I20260709 13:12:27.898056 31711 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa29c9ed2f134cd08c5b30c90a155df0"
dest_uuid: "369d39d85e794108a1f8336f5b991c25"
 from {username='slave'} at 127.0.0.1:37032
I20260709 13:12:27.898617 31711 raft_consensus.cc:493] T aa29c9ed2f134cd08c5b30c90a155df0 P 369d39d85e794108a1f8336f5b991c25 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:27.899056 31711 raft_consensus.cc:3060] T aa29c9ed2f134cd08c5b30c90a155df0 P 369d39d85e794108a1f8336f5b991c25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.902613 31636 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41f91725ca2740729c7c04dab9a0d5a0"
dest_uuid: "31f01602b758422c85a11b021fddc3e6"
 from {username='slave'} at 127.0.0.1:55254
I20260709 13:12:27.903246 31636 raft_consensus.cc:493] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:27.903836 31636 raft_consensus.cc:3060] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.909803 31711 raft_consensus.cc:515] T aa29c9ed2f134cd08c5b30c90a155df0 P 369d39d85e794108a1f8336f5b991c25 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.911056 31636 raft_consensus.cc:515] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.912556 31637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa29c9ed2f134cd08c5b30c90a155df0" candidate_uuid: "369d39d85e794108a1f8336f5b991c25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31f01602b758422c85a11b021fddc3e6"
I20260709 13:12:27.913179 31637 raft_consensus.cc:3060] T aa29c9ed2f134cd08c5b30c90a155df0 P 31f01602b758422c85a11b021fddc3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.913894 31711 leader_election.cc:290] T aa29c9ed2f134cd08c5b30c90a155df0 P 369d39d85e794108a1f8336f5b991c25 [CANDIDATE]: Term 2 election: Requested vote from peers 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605), c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3:34339)
I20260709 13:12:27.914391 31785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f91725ca2740729c7c04dab9a0d5a0" candidate_uuid: "31f01602b758422c85a11b021fddc3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
I20260709 13:12:27.914966 31785 raft_consensus.cc:3055] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:27.915289 31785 raft_consensus.cc:740] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c15d42e7445f4eee86f09c33d9b43fce, State: Running, Role: LEADER
I20260709 13:12:27.915694 31636 leader_election.cc:290] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 2 election: Requested vote from peers 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631), c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3:34339)
I20260709 13:12:27.916101 31785 consensus_queue.cc:260] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.917068 31711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f91725ca2740729c7c04dab9a0d5a0" candidate_uuid: "31f01602b758422c85a11b021fddc3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "369d39d85e794108a1f8336f5b991c25"
I20260709 13:12:27.917291 31785 raft_consensus.cc:3060] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.917618 31711 raft_consensus.cc:3060] T 41f91725ca2740729c7c04dab9a0d5a0 P 369d39d85e794108a1f8336f5b991c25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.917801 31786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa29c9ed2f134cd08c5b30c90a155df0" candidate_uuid: "369d39d85e794108a1f8336f5b991c25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
I20260709 13:12:27.918393 31786 raft_consensus.cc:3055] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:27.918707 31786 raft_consensus.cc:740] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c15d42e7445f4eee86f09c33d9b43fce, State: Running, Role: LEADER
I20260709 13:12:27.919502 31786 consensus_queue.cc:260] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.920948 31786 raft_consensus.cc:3060] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.924865 31711 raft_consensus.cc:2468] T 41f91725ca2740729c7c04dab9a0d5a0 P 369d39d85e794108a1f8336f5b991c25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f01602b758422c85a11b021fddc3e6 in term 2.
I20260709 13:12:27.925093 31785 raft_consensus.cc:2468] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f01602b758422c85a11b021fddc3e6 in term 2.
I20260709 13:12:27.925225 31637 raft_consensus.cc:2468] T aa29c9ed2f134cd08c5b30c90a155df0 P 31f01602b758422c85a11b021fddc3e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369d39d85e794108a1f8336f5b991c25 in term 2.
I20260709 13:12:27.926138 31601 leader_election.cc:304] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6, 369d39d85e794108a1f8336f5b991c25; no voters: 
I20260709 13:12:27.926999 31906 raft_consensus.cc:2804] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:27.927523 31906 raft_consensus.cc:697] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [term 2 LEADER]: Becoming Leader. State: Replica: 31f01602b758422c85a11b021fddc3e6, State: Running, Role: LEADER
I20260709 13:12:27.927559 31675 leader_election.cc:304] T aa29c9ed2f134cd08c5b30c90a155df0 P 369d39d85e794108a1f8336f5b991c25 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6, 369d39d85e794108a1f8336f5b991c25; no voters: 
I20260709 13:12:27.928478 31913 raft_consensus.cc:2804] T aa29c9ed2f134cd08c5b30c90a155df0 P 369d39d85e794108a1f8336f5b991c25 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:27.928409 31906 consensus_queue.cc:237] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.929042 31913 raft_consensus.cc:697] T aa29c9ed2f134cd08c5b30c90a155df0 P 369d39d85e794108a1f8336f5b991c25 [term 2 LEADER]: Becoming Leader. State: Replica: 369d39d85e794108a1f8336f5b991c25, State: Running, Role: LEADER
I20260709 13:12:27.929914 31913 consensus_queue.cc:237] T aa29c9ed2f134cd08c5b30c90a155df0 P 369d39d85e794108a1f8336f5b991c25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.930428 31786 raft_consensus.cc:2468] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369d39d85e794108a1f8336f5b991c25 in term 2.
I20260709 13:12:27.937992 31531 catalog_manager.cc:5697] T aa29c9ed2f134cd08c5b30c90a155df0 P 369d39d85e794108a1f8336f5b991c25 reported cstate change: term changed from 1 to 2, leader changed from c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3) to 369d39d85e794108a1f8336f5b991c25 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "369d39d85e794108a1f8336f5b991c25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:27.937992 31532 catalog_manager.cc:5697] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 reported cstate change: term changed from 1 to 2, leader changed from c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3) to 31f01602b758422c85a11b021fddc3e6 (127.30.63.1). New cstate: current_term: 2 leader_uuid: "31f01602b758422c85a11b021fddc3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:27.979791 31853 raft_consensus.cc:993] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce: : Instructing follower 31f01602b758422c85a11b021fddc3e6 to start an election
I20260709 13:12:27.980322 31849 raft_consensus.cc:1081] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Signalling peer 31f01602b758422c85a11b021fddc3e6 to start an election
I20260709 13:12:27.982060 31637 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1bd1cb474eb45f7aa7547a021b47624"
dest_uuid: "31f01602b758422c85a11b021fddc3e6"
 from {username='slave'} at 127.0.0.1:55254
I20260709 13:12:27.982585 31637 raft_consensus.cc:493] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:27.982911 31637 raft_consensus.cc:3060] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.987521 31637 raft_consensus.cc:515] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.989281 31637 leader_election.cc:290] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 2 election: Requested vote from peers 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631), c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3:34339)
I20260709 13:12:27.990371 31711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bd1cb474eb45f7aa7547a021b47624" candidate_uuid: "31f01602b758422c85a11b021fddc3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "369d39d85e794108a1f8336f5b991c25"
I20260709 13:12:27.990582 31786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bd1cb474eb45f7aa7547a021b47624" candidate_uuid: "31f01602b758422c85a11b021fddc3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
I20260709 13:12:27.991007 31711 raft_consensus.cc:3060] T d1bd1cb474eb45f7aa7547a021b47624 P 369d39d85e794108a1f8336f5b991c25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.991173 31786 raft_consensus.cc:3055] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:27.991525 31786 raft_consensus.cc:740] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c15d42e7445f4eee86f09c33d9b43fce, State: Running, Role: LEADER
I20260709 13:12:27.992465 31786 consensus_queue.cc:260] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:27.993860 31786 raft_consensus.cc:3060] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.998582 31711 raft_consensus.cc:2468] T d1bd1cb474eb45f7aa7547a021b47624 P 369d39d85e794108a1f8336f5b991c25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f01602b758422c85a11b021fddc3e6 in term 2.
I20260709 13:12:27.999898 31601 leader_election.cc:304] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6, 369d39d85e794108a1f8336f5b991c25; no voters: 
I20260709 13:12:28.000571 31786 raft_consensus.cc:2468] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f01602b758422c85a11b021fddc3e6 in term 2.
I20260709 13:12:28.000713 31906 raft_consensus.cc:2804] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:28.001463 31906 raft_consensus.cc:697] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6 [term 2 LEADER]: Becoming Leader. State: Replica: 31f01602b758422c85a11b021fddc3e6, State: Running, Role: LEADER
I20260709 13:12:28.002233 31906 consensus_queue.cc:237] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:28.009128 31532 catalog_manager.cc:5697] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6 reported cstate change: term changed from 1 to 2, leader changed from c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3) to 31f01602b758422c85a11b021fddc3e6 (127.30.63.1). New cstate: current_term: 2 leader_uuid: "31f01602b758422c85a11b021fddc3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:28.110988 31786 raft_consensus.cc:1275] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [term 2 FOLLOWER]: Refusing update from remote peer 369d39d85e794108a1f8336f5b991c25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:28.112639 31913 consensus_queue.cc:1048] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:28.120886 31637 raft_consensus.cc:1275] T 4e960950bc9748598558089efeb71c4a P 31f01602b758422c85a11b021fddc3e6 [term 2 FOLLOWER]: Refusing update from remote peer 369d39d85e794108a1f8336f5b991c25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:28.122469 31859 consensus_queue.cc:1048] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:28.207357 31786 raft_consensus.cc:1275] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [term 2 FOLLOWER]: Refusing update from remote peer 369d39d85e794108a1f8336f5b991c25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:28.209347 31859 consensus_queue.cc:1048] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:28.214444 31637 raft_consensus.cc:1275] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6 [term 2 FOLLOWER]: Refusing update from remote peer 369d39d85e794108a1f8336f5b991c25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:28.215988 31913 consensus_queue.cc:1048] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:28.217909 31711 raft_consensus.cc:1275] T 11c8f2db76164c2cad66c4f44c70ba6c P 369d39d85e794108a1f8336f5b991c25 [term 2 FOLLOWER]: Refusing update from remote peer 31f01602b758422c85a11b021fddc3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:28.222240 31906 consensus_queue.cc:1048] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:28.238279 31786 raft_consensus.cc:1275] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 2 FOLLOWER]: Refusing update from remote peer 31f01602b758422c85a11b021fddc3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:28.239813 31918 consensus_queue.cc:1048] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:28.336537 31786 raft_consensus.cc:1275] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 2 FOLLOWER]: Refusing update from remote peer 31f01602b758422c85a11b021fddc3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:28.337986 31918 consensus_queue.cc:1048] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:28.344506 31711 raft_consensus.cc:1275] T 41f91725ca2740729c7c04dab9a0d5a0 P 369d39d85e794108a1f8336f5b991c25 [term 2 FOLLOWER]: Refusing update from remote peer 31f01602b758422c85a11b021fddc3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:28.346724 31918 consensus_queue.cc:1048] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:28.435876 31637 raft_consensus.cc:1275] T aa29c9ed2f134cd08c5b30c90a155df0 P 31f01602b758422c85a11b021fddc3e6 [term 2 FOLLOWER]: Refusing update from remote peer 369d39d85e794108a1f8336f5b991c25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:28.437459 31859 consensus_queue.cc:1048] T aa29c9ed2f134cd08c5b30c90a155df0 P 369d39d85e794108a1f8336f5b991c25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:28.439816 31786 raft_consensus.cc:1275] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce [term 2 FOLLOWER]: Refusing update from remote peer 369d39d85e794108a1f8336f5b991c25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:28.441175 31859 consensus_queue.cc:1048] T aa29c9ed2f134cd08c5b30c90a155df0 P 369d39d85e794108a1f8336f5b991c25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:28.482679 31785 raft_consensus.cc:1275] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [term 2 FOLLOWER]: Refusing update from remote peer 31f01602b758422c85a11b021fddc3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:28.484048 31850 consensus_queue.cc:1048] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:28.492802 31711 raft_consensus.cc:1275] T d1bd1cb474eb45f7aa7547a021b47624 P 369d39d85e794108a1f8336f5b991c25 [term 2 FOLLOWER]: Refusing update from remote peer 31f01602b758422c85a11b021fddc3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:28.494652 31906 consensus_queue.cc:1048] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:30.581501 30972 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:12:30.582233 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:30.598199 31637 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11c8f2db76164c2cad66c4f44c70ba6c"
dest_uuid: "31f01602b758422c85a11b021fddc3e6"
mode: GRACEFUL
new_leader_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
 from {username='slave'} at 127.0.0.1:57812
I20260709 13:12:30.598776 31637 raft_consensus.cc:606] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [term 2 LEADER]: Received request to transfer leadership to TS c15d42e7445f4eee86f09c33d9b43fce
I20260709 13:12:30.601356 31637 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41f91725ca2740729c7c04dab9a0d5a0"
dest_uuid: "31f01602b758422c85a11b021fddc3e6"
mode: GRACEFUL
new_leader_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
 from {username='slave'} at 127.0.0.1:57812
I20260709 13:12:30.601857 31637 raft_consensus.cc:606] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [term 2 LEADER]: Received request to transfer leadership to TS c15d42e7445f4eee86f09c33d9b43fce
I20260709 13:12:30.602965 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:30.603582 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:30.705889 31927 raft_consensus.cc:993] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6: : Instructing follower c15d42e7445f4eee86f09c33d9b43fce to start an election
I20260709 13:12:30.706611 31906 raft_consensus.cc:1081] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [term 2 LEADER]: Signalling peer c15d42e7445f4eee86f09c33d9b43fce to start an election
I20260709 13:12:30.708302 31785 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11c8f2db76164c2cad66c4f44c70ba6c"
dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
 from {username='slave'} at 127.0.0.1:42600
I20260709 13:12:30.708921 31785 raft_consensus.cc:493] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:30.709242 31785 raft_consensus.cc:3060] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:30.715351 31785 raft_consensus.cc:515] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:30.717151 31785 leader_election.cc:290] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 3 election: Requested vote from peers 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605), 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631)
I20260709 13:12:30.718025 31637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c8f2db76164c2cad66c4f44c70ba6c" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "31f01602b758422c85a11b021fddc3e6"
I20260709 13:12:30.718185 31711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c8f2db76164c2cad66c4f44c70ba6c" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "369d39d85e794108a1f8336f5b991c25"
I20260709 13:12:30.718679 31637 raft_consensus.cc:3055] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:30.718751 31711 raft_consensus.cc:3060] T 11c8f2db76164c2cad66c4f44c70ba6c P 369d39d85e794108a1f8336f5b991c25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:30.718981 31637 raft_consensus.cc:740] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 31f01602b758422c85a11b021fddc3e6, State: Running, Role: LEADER
I20260709 13:12:30.719686 31637 consensus_queue.cc:260] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:30.720561 31637 raft_consensus.cc:3060] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:30.725148 31711 raft_consensus.cc:2468] T 11c8f2db76164c2cad66c4f44c70ba6c P 369d39d85e794108a1f8336f5b991c25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15d42e7445f4eee86f09c33d9b43fce in term 3.
I20260709 13:12:30.726186 31637 raft_consensus.cc:2468] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15d42e7445f4eee86f09c33d9b43fce in term 3.
I20260709 13:12:30.726414 31750 leader_election.cc:304] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369d39d85e794108a1f8336f5b991c25, c15d42e7445f4eee86f09c33d9b43fce; no voters: 
I20260709 13:12:30.727190 31849 raft_consensus.cc:2804] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:30.728066 31849 raft_consensus.cc:697] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 3 LEADER]: Becoming Leader. State: Replica: c15d42e7445f4eee86f09c33d9b43fce, State: Running, Role: LEADER
I20260709 13:12:30.728892 31849 consensus_queue.cc:237] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:30.735931 31534 catalog_manager.cc:5697] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce reported cstate change: term changed from 2 to 3, leader changed from 31f01602b758422c85a11b021fddc3e6 (127.30.63.1) to c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3). New cstate: current_term: 3 leader_uuid: "c15d42e7445f4eee86f09c33d9b43fce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:30.879318 31927 raft_consensus.cc:993] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6: : Instructing follower c15d42e7445f4eee86f09c33d9b43fce to start an election
I20260709 13:12:30.880088 31906 raft_consensus.cc:1081] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [term 2 LEADER]: Signalling peer c15d42e7445f4eee86f09c33d9b43fce to start an election
I20260709 13:12:30.881883 31785 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41f91725ca2740729c7c04dab9a0d5a0"
dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
 from {username='slave'} at 127.0.0.1:42600
I20260709 13:12:30.882545 31785 raft_consensus.cc:493] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:30.882920 31785 raft_consensus.cc:3060] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:30.889488 31785 raft_consensus.cc:515] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:30.891813 31785 leader_election.cc:290] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 3 election: Requested vote from peers 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605), 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631)
I20260709 13:12:30.893033 31637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f91725ca2740729c7c04dab9a0d5a0" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "31f01602b758422c85a11b021fddc3e6"
I20260709 13:12:30.894030 31637 raft_consensus.cc:3055] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:30.894415 31637 raft_consensus.cc:740] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 31f01602b758422c85a11b021fddc3e6, State: Running, Role: LEADER
I20260709 13:12:30.894712 31711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f91725ca2740729c7c04dab9a0d5a0" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "369d39d85e794108a1f8336f5b991c25"
I20260709 13:12:30.895421 31711 raft_consensus.cc:3060] T 41f91725ca2740729c7c04dab9a0d5a0 P 369d39d85e794108a1f8336f5b991c25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:30.895442 31637 consensus_queue.cc:260] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:30.896903 31637 raft_consensus.cc:3060] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:30.902690 31637 raft_consensus.cc:2468] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15d42e7445f4eee86f09c33d9b43fce in term 3.
I20260709 13:12:30.902709 31711 raft_consensus.cc:2468] T 41f91725ca2740729c7c04dab9a0d5a0 P 369d39d85e794108a1f8336f5b991c25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15d42e7445f4eee86f09c33d9b43fce in term 3.
I20260709 13:12:30.904151 31750 leader_election.cc:304] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369d39d85e794108a1f8336f5b991c25, c15d42e7445f4eee86f09c33d9b43fce; no voters: 
I20260709 13:12:30.905498 31849 raft_consensus.cc:2804] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:30.906283 31849 raft_consensus.cc:697] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 3 LEADER]: Becoming Leader. State: Replica: c15d42e7445f4eee86f09c33d9b43fce, State: Running, Role: LEADER
I20260709 13:12:30.907476 31849 consensus_queue.cc:237] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:30.921171 31532 catalog_manager.cc:5697] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce reported cstate change: term changed from 2 to 3, leader changed from 31f01602b758422c85a11b021fddc3e6 (127.30.63.1) to c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3). New cstate: current_term: 3 leader_uuid: "c15d42e7445f4eee86f09c33d9b43fce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:31.155359 31711 raft_consensus.cc:1275] T 11c8f2db76164c2cad66c4f44c70ba6c P 369d39d85e794108a1f8336f5b991c25 [term 3 FOLLOWER]: Refusing update from remote peer c15d42e7445f4eee86f09c33d9b43fce: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:31.156714 31849 consensus_queue.cc:1048] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:31.167941 31637 raft_consensus.cc:1275] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [term 3 FOLLOWER]: Refusing update from remote peer c15d42e7445f4eee86f09c33d9b43fce: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:31.172106 31928 consensus_queue.cc:1048] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:31.361171 31637 raft_consensus.cc:1275] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [term 3 FOLLOWER]: Refusing update from remote peer c15d42e7445f4eee86f09c33d9b43fce: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:31.362396 31928 consensus_queue.cc:1048] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:31.371860 31711 raft_consensus.cc:1275] T 41f91725ca2740729c7c04dab9a0d5a0 P 369d39d85e794108a1f8336f5b991c25 [term 3 FOLLOWER]: Refusing update from remote peer c15d42e7445f4eee86f09c33d9b43fce: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:31.373574 31944 consensus_queue.cc:1048] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:31.604705 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:31.621237 31785 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41f91725ca2740729c7c04dab9a0d5a0"
dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
mode: GRACEFUL
new_leader_uuid: "31f01602b758422c85a11b021fddc3e6"
 from {username='slave'} at 127.0.0.1:42612
I20260709 13:12:31.621798 31785 raft_consensus.cc:606] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 3 LEADER]: Received request to transfer leadership to TS 31f01602b758422c85a11b021fddc3e6
I20260709 13:12:31.627058 31785 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11c8f2db76164c2cad66c4f44c70ba6c"
dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
mode: GRACEFUL
new_leader_uuid: "31f01602b758422c85a11b021fddc3e6"
 from {username='slave'} at 127.0.0.1:42612
I20260709 13:12:31.627617 31785 raft_consensus.cc:606] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 3 LEADER]: Received request to transfer leadership to TS 31f01602b758422c85a11b021fddc3e6
I20260709 13:12:31.653141 31711 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3558f74b6e384db198bb8d74d491da4a"
dest_uuid: "369d39d85e794108a1f8336f5b991c25"
mode: GRACEFUL
new_leader_uuid: "31f01602b758422c85a11b021fddc3e6"
 from {username='slave'} at 127.0.0.1:58168
I20260709 13:12:31.653748 31711 raft_consensus.cc:606] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [term 2 LEADER]: Received request to transfer leadership to TS 31f01602b758422c85a11b021fddc3e6
I20260709 13:12:31.658891 31711 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5dd5d4a006f74f3d83acde9f4174e1ea"
dest_uuid: "369d39d85e794108a1f8336f5b991c25"
mode: GRACEFUL
new_leader_uuid: "31f01602b758422c85a11b021fddc3e6"
 from {username='slave'} at 127.0.0.1:58168
I20260709 13:12:31.659415 31711 raft_consensus.cc:606] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25 [term 1 LEADER]: Received request to transfer leadership to TS 31f01602b758422c85a11b021fddc3e6
I20260709 13:12:31.664780 31711 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e960950bc9748598558089efeb71c4a"
dest_uuid: "369d39d85e794108a1f8336f5b991c25"
mode: GRACEFUL
new_leader_uuid: "31f01602b758422c85a11b021fddc3e6"
 from {username='slave'} at 127.0.0.1:58168
I20260709 13:12:31.665400 31711 raft_consensus.cc:606] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25 [term 2 LEADER]: Received request to transfer leadership to TS 31f01602b758422c85a11b021fddc3e6
I20260709 13:12:31.682966 31936 raft_consensus.cc:993] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25: : Instructing follower 31f01602b758422c85a11b021fddc3e6 to start an election
I20260709 13:12:31.683485 31948 raft_consensus.cc:1081] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25 [term 2 LEADER]: Signalling peer 31f01602b758422c85a11b021fddc3e6 to start an election
I20260709 13:12:31.684998 31637 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e960950bc9748598558089efeb71c4a"
dest_uuid: "31f01602b758422c85a11b021fddc3e6"
 from {username='slave'} at 127.0.0.1:55268
I20260709 13:12:31.685412 31637 raft_consensus.cc:493] T 4e960950bc9748598558089efeb71c4a P 31f01602b758422c85a11b021fddc3e6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:31.685684 31637 raft_consensus.cc:3060] T 4e960950bc9748598558089efeb71c4a P 31f01602b758422c85a11b021fddc3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:31.689774 31637 raft_consensus.cc:515] T 4e960950bc9748598558089efeb71c4a P 31f01602b758422c85a11b021fddc3e6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:31.691206 31637 leader_election.cc:290] T 4e960950bc9748598558089efeb71c4a P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 3 election: Requested vote from peers 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631), c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3:34339)
I20260709 13:12:31.692308 31711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e960950bc9748598558089efeb71c4a" candidate_uuid: "31f01602b758422c85a11b021fddc3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "369d39d85e794108a1f8336f5b991c25"
I20260709 13:12:31.692415 31785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e960950bc9748598558089efeb71c4a" candidate_uuid: "31f01602b758422c85a11b021fddc3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
I20260709 13:12:31.692875 31711 raft_consensus.cc:3055] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:31.693039 31785 raft_consensus.cc:3060] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:31.693222 31711 raft_consensus.cc:740] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 369d39d85e794108a1f8336f5b991c25, State: Running, Role: LEADER
I20260709 13:12:31.693989 31711 consensus_queue.cc:260] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:31.694902 31711 raft_consensus.cc:3060] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:31.699669 31785 raft_consensus.cc:2468] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f01602b758422c85a11b021fddc3e6 in term 3.
I20260709 13:12:31.700415 31711 raft_consensus.cc:2468] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f01602b758422c85a11b021fddc3e6 in term 3.
I20260709 13:12:31.701001 31603 leader_election.cc:304] T 4e960950bc9748598558089efeb71c4a P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6, c15d42e7445f4eee86f09c33d9b43fce; no voters: 
I20260709 13:12:31.701778 31906 raft_consensus.cc:2804] T 4e960950bc9748598558089efeb71c4a P 31f01602b758422c85a11b021fddc3e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:31.702755 31906 raft_consensus.cc:697] T 4e960950bc9748598558089efeb71c4a P 31f01602b758422c85a11b021fddc3e6 [term 3 LEADER]: Becoming Leader. State: Replica: 31f01602b758422c85a11b021fddc3e6, State: Running, Role: LEADER
I20260709 13:12:31.703627 31906 consensus_queue.cc:237] T 4e960950bc9748598558089efeb71c4a P 31f01602b758422c85a11b021fddc3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:31.710781 31534 catalog_manager.cc:5697] T 4e960950bc9748598558089efeb71c4a P 31f01602b758422c85a11b021fddc3e6 reported cstate change: term changed from 2 to 3, leader changed from 369d39d85e794108a1f8336f5b991c25 (127.30.63.2) to 31f01602b758422c85a11b021fddc3e6 (127.30.63.1). New cstate: current_term: 3 leader_uuid: "31f01602b758422c85a11b021fddc3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:31.737927 31936 raft_consensus.cc:993] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25: : Instructing follower 31f01602b758422c85a11b021fddc3e6 to start an election
I20260709 13:12:31.738412 31936 raft_consensus.cc:1081] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [term 2 LEADER]: Signalling peer 31f01602b758422c85a11b021fddc3e6 to start an election
I20260709 13:12:31.740072 31637 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3558f74b6e384db198bb8d74d491da4a"
dest_uuid: "31f01602b758422c85a11b021fddc3e6"
 from {username='slave'} at 127.0.0.1:55268
I20260709 13:12:31.740551 31637 raft_consensus.cc:493] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:31.740897 31637 raft_consensus.cc:3060] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:31.746951 31637 raft_consensus.cc:515] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:31.748396 31637 leader_election.cc:290] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 3 election: Requested vote from peers 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631), c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3:34339)
I20260709 13:12:31.749449 31711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3558f74b6e384db198bb8d74d491da4a" candidate_uuid: "31f01602b758422c85a11b021fddc3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "369d39d85e794108a1f8336f5b991c25"
I20260709 13:12:31.749569 31785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3558f74b6e384db198bb8d74d491da4a" candidate_uuid: "31f01602b758422c85a11b021fddc3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
I20260709 13:12:31.749995 31711 raft_consensus.cc:3055] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:31.750159 31785 raft_consensus.cc:3060] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:31.750294 31711 raft_consensus.cc:740] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 369d39d85e794108a1f8336f5b991c25, State: Running, Role: LEADER
I20260709 13:12:31.751101 31711 consensus_queue.cc:260] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:31.752418 31711 raft_consensus.cc:3060] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:31.757041 31849 raft_consensus.cc:993] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce: : Instructing follower 31f01602b758422c85a11b021fddc3e6 to start an election
I20260709 13:12:31.757237 31785 raft_consensus.cc:2468] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f01602b758422c85a11b021fddc3e6 in term 3.
I20260709 13:12:31.757596 31944 raft_consensus.cc:1081] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 3 LEADER]: Signalling peer 31f01602b758422c85a11b021fddc3e6 to start an election
I20260709 13:12:31.759001 31603 leader_election.cc:304] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6, c15d42e7445f4eee86f09c33d9b43fce; no voters: 
I20260709 13:12:31.759361 31637 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41f91725ca2740729c7c04dab9a0d5a0"
dest_uuid: "31f01602b758422c85a11b021fddc3e6"
 from {username='slave'} at 127.0.0.1:55254
I20260709 13:12:31.759828 31906 raft_consensus.cc:2804] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:31.759969 31637 raft_consensus.cc:493] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:31.760032 31711 raft_consensus.cc:2468] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f01602b758422c85a11b021fddc3e6 in term 3.
I20260709 13:12:31.760432 31637 raft_consensus.cc:3060] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:31.761036 31906 raft_consensus.cc:697] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6 [term 3 LEADER]: Becoming Leader. State: Replica: 31f01602b758422c85a11b021fddc3e6, State: Running, Role: LEADER
I20260709 13:12:31.762109 31906 consensus_queue.cc:237] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:31.766877 31637 raft_consensus.cc:515] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:31.768545 31637 leader_election.cc:290] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 4 election: Requested vote from peers 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631), c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3:34339)
I20260709 13:12:31.769296 31711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f91725ca2740729c7c04dab9a0d5a0" candidate_uuid: "31f01602b758422c85a11b021fddc3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "369d39d85e794108a1f8336f5b991c25"
I20260709 13:12:31.769984 31711 raft_consensus.cc:3060] T 41f91725ca2740729c7c04dab9a0d5a0 P 369d39d85e794108a1f8336f5b991c25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:31.770165 31785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f91725ca2740729c7c04dab9a0d5a0" candidate_uuid: "31f01602b758422c85a11b021fddc3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
I20260709 13:12:31.770689 31785 raft_consensus.cc:3055] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:31.771101 31785 raft_consensus.cc:740] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c15d42e7445f4eee86f09c33d9b43fce, State: Running, Role: LEADER
I20260709 13:12:31.770793 31534 catalog_manager.cc:5697] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6 reported cstate change: term changed from 2 to 3, leader changed from 369d39d85e794108a1f8336f5b991c25 (127.30.63.2) to 31f01602b758422c85a11b021fddc3e6 (127.30.63.1). New cstate: current_term: 3 leader_uuid: "31f01602b758422c85a11b021fddc3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:31.771885 31785 consensus_queue.cc:260] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:31.772882 31785 raft_consensus.cc:3060] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:31.775449 31711 raft_consensus.cc:2468] T 41f91725ca2740729c7c04dab9a0d5a0 P 369d39d85e794108a1f8336f5b991c25 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f01602b758422c85a11b021fddc3e6 in term 4.
I20260709 13:12:31.776759 31601 leader_election.cc:304] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6, 369d39d85e794108a1f8336f5b991c25; no voters: 
I20260709 13:12:31.777655 31906 raft_consensus.cc:2804] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:31.778133 31906 raft_consensus.cc:697] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [term 4 LEADER]: Becoming Leader. State: Replica: 31f01602b758422c85a11b021fddc3e6, State: Running, Role: LEADER
I20260709 13:12:31.778976 31906 consensus_queue.cc:237] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:31.779559 31785 raft_consensus.cc:2468] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f01602b758422c85a11b021fddc3e6 in term 4.
I20260709 13:12:31.785364 31534 catalog_manager.cc:5697] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 reported cstate change: term changed from 3 to 4, leader changed from c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3) to 31f01602b758422c85a11b021fddc3e6 (127.30.63.1). New cstate: current_term: 4 leader_uuid: "31f01602b758422c85a11b021fddc3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:31.827144 31948 raft_consensus.cc:993] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25: : Instructing follower 31f01602b758422c85a11b021fddc3e6 to start an election
I20260709 13:12:31.827728 31936 raft_consensus.cc:1081] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25 [term 1 LEADER]: Signalling peer 31f01602b758422c85a11b021fddc3e6 to start an election
I20260709 13:12:31.829550 31637 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5dd5d4a006f74f3d83acde9f4174e1ea"
dest_uuid: "31f01602b758422c85a11b021fddc3e6"
 from {username='slave'} at 127.0.0.1:55268
I20260709 13:12:31.830004 31637 raft_consensus.cc:493] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:31.830287 31637 raft_consensus.cc:3060] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:31.835101 31637 raft_consensus.cc:515] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:31.836540 31637 leader_election.cc:290] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 2 election: Requested vote from peers 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631), c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3:34339)
I20260709 13:12:31.837546 31711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dd5d4a006f74f3d83acde9f4174e1ea" candidate_uuid: "31f01602b758422c85a11b021fddc3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "369d39d85e794108a1f8336f5b991c25"
I20260709 13:12:31.837616 31785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dd5d4a006f74f3d83acde9f4174e1ea" candidate_uuid: "31f01602b758422c85a11b021fddc3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
I20260709 13:12:31.838231 31711 raft_consensus.cc:3055] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:31.838333 31785 raft_consensus.cc:3060] T 5dd5d4a006f74f3d83acde9f4174e1ea P c15d42e7445f4eee86f09c33d9b43fce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:31.838593 31711 raft_consensus.cc:740] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 369d39d85e794108a1f8336f5b991c25, State: Running, Role: LEADER
I20260709 13:12:31.839325 31711 consensus_queue.cc:260] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:31.840473 31711 raft_consensus.cc:3060] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:31.845510 31785 raft_consensus.cc:2468] T 5dd5d4a006f74f3d83acde9f4174e1ea P c15d42e7445f4eee86f09c33d9b43fce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f01602b758422c85a11b021fddc3e6 in term 2.
I20260709 13:12:31.846701 31603 leader_election.cc:304] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6, c15d42e7445f4eee86f09c33d9b43fce; no voters: 
I20260709 13:12:31.847065 31711 raft_consensus.cc:2468] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f01602b758422c85a11b021fddc3e6 in term 2.
I20260709 13:12:31.847651 31906 raft_consensus.cc:2804] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:31.848162 31906 raft_consensus.cc:697] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6 [term 2 LEADER]: Becoming Leader. State: Replica: 31f01602b758422c85a11b021fddc3e6, State: Running, Role: LEADER
I20260709 13:12:31.848948 31906 consensus_queue.cc:237] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:31.856138 31534 catalog_manager.cc:5697] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6 reported cstate change: term changed from 1 to 2, leader changed from 369d39d85e794108a1f8336f5b991c25 (127.30.63.2) to 31f01602b758422c85a11b021fddc3e6 (127.30.63.1). New cstate: current_term: 2 leader_uuid: "31f01602b758422c85a11b021fddc3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:32.107043 31785 raft_consensus.cc:1275] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [term 3 FOLLOWER]: Refusing update from remote peer 31f01602b758422c85a11b021fddc3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:32.108435 31949 consensus_queue.cc:1048] T 4e960950bc9748598558089efeb71c4a P 31f01602b758422c85a11b021fddc3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:32.119283 31711 raft_consensus.cc:1275] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25 [term 3 FOLLOWER]: Refusing update from remote peer 31f01602b758422c85a11b021fddc3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:32.120914 31949 consensus_queue.cc:1048] T 4e960950bc9748598558089efeb71c4a P 31f01602b758422c85a11b021fddc3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:32.146898 31849 raft_consensus.cc:993] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce: : Instructing follower 31f01602b758422c85a11b021fddc3e6 to start an election
I20260709 13:12:32.147500 31849 raft_consensus.cc:1081] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 3 LEADER]: Signalling peer 31f01602b758422c85a11b021fddc3e6 to start an election
I20260709 13:12:32.148991 31637 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11c8f2db76164c2cad66c4f44c70ba6c"
dest_uuid: "31f01602b758422c85a11b021fddc3e6"
 from {username='slave'} at 127.0.0.1:55254
I20260709 13:12:32.149475 31637 raft_consensus.cc:493] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:32.149794 31637 raft_consensus.cc:3060] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:32.154865 31637 raft_consensus.cc:515] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:32.156421 31637 leader_election.cc:290] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 4 election: Requested vote from peers 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631), c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3:34339)
I20260709 13:12:32.157200 31711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c8f2db76164c2cad66c4f44c70ba6c" candidate_uuid: "31f01602b758422c85a11b021fddc3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "369d39d85e794108a1f8336f5b991c25"
I20260709 13:12:32.157481 31785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c8f2db76164c2cad66c4f44c70ba6c" candidate_uuid: "31f01602b758422c85a11b021fddc3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
I20260709 13:12:32.157691 31711 raft_consensus.cc:3060] T 11c8f2db76164c2cad66c4f44c70ba6c P 369d39d85e794108a1f8336f5b991c25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:32.158026 31785 raft_consensus.cc:3055] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:32.158286 31785 raft_consensus.cc:740] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c15d42e7445f4eee86f09c33d9b43fce, State: Running, Role: LEADER
I20260709 13:12:32.159232 31785 consensus_queue.cc:260] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:32.160145 31785 raft_consensus.cc:3060] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:32.162370 31711 raft_consensus.cc:2468] T 11c8f2db76164c2cad66c4f44c70ba6c P 369d39d85e794108a1f8336f5b991c25 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f01602b758422c85a11b021fddc3e6 in term 4.
I20260709 13:12:32.163391 31601 leader_election.cc:304] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6, 369d39d85e794108a1f8336f5b991c25; no voters: 
I20260709 13:12:32.164016 31949 raft_consensus.cc:2804] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:32.164426 31949 raft_consensus.cc:697] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [term 4 LEADER]: Becoming Leader. State: Replica: 31f01602b758422c85a11b021fddc3e6, State: Running, Role: LEADER
I20260709 13:12:32.164532 31785 raft_consensus.cc:2468] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f01602b758422c85a11b021fddc3e6 in term 4.
I20260709 13:12:32.165233 31949 consensus_queue.cc:237] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:32.172281 31532 catalog_manager.cc:5697] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 reported cstate change: term changed from 3 to 4, leader changed from c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3) to 31f01602b758422c85a11b021fddc3e6 (127.30.63.1). New cstate: current_term: 4 leader_uuid: "31f01602b758422c85a11b021fddc3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:32.246258 31711 raft_consensus.cc:1275] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [term 3 FOLLOWER]: Refusing update from remote peer 31f01602b758422c85a11b021fddc3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:32.247550 31949 consensus_queue.cc:1048] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:32.257807 31785 raft_consensus.cc:1275] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [term 3 FOLLOWER]: Refusing update from remote peer 31f01602b758422c85a11b021fddc3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:32.259697 31962 consensus_queue.cc:1048] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:32.278120 31711 raft_consensus.cc:1275] T 41f91725ca2740729c7c04dab9a0d5a0 P 369d39d85e794108a1f8336f5b991c25 [term 4 FOLLOWER]: Refusing update from remote peer 31f01602b758422c85a11b021fddc3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:32.279220 31962 consensus_queue.cc:1048] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:32.287032 31785 raft_consensus.cc:1275] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 4 FOLLOWER]: Refusing update from remote peer 31f01602b758422c85a11b021fddc3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:32.289038 31906 consensus_queue.cc:1048] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:32.395032 31785 raft_consensus.cc:1275] T 5dd5d4a006f74f3d83acde9f4174e1ea P c15d42e7445f4eee86f09c33d9b43fce [term 2 FOLLOWER]: Refusing update from remote peer 31f01602b758422c85a11b021fddc3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:32.396320 31906 consensus_queue.cc:1048] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:32.405709 31711 raft_consensus.cc:1275] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25 [term 2 FOLLOWER]: Refusing update from remote peer 31f01602b758422c85a11b021fddc3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:32.407276 31906 consensus_queue.cc:1048] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:32.551403 31785 raft_consensus.cc:1275] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 4 FOLLOWER]: Refusing update from remote peer 31f01602b758422c85a11b021fddc3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:32.552805 31906 consensus_queue.cc:1048] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:32.563740 31711 raft_consensus.cc:1275] T 11c8f2db76164c2cad66c4f44c70ba6c P 369d39d85e794108a1f8336f5b991c25 [term 4 FOLLOWER]: Refusing update from remote peer 31f01602b758422c85a11b021fddc3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:32.565230 31949 consensus_queue.cc:1048] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:34.673727 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:34.682324 31637 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3558f74b6e384db198bb8d74d491da4a"
dest_uuid: "31f01602b758422c85a11b021fddc3e6"
mode: GRACEFUL
new_leader_uuid: "369d39d85e794108a1f8336f5b991c25"
 from {username='slave'} at 127.0.0.1:57812
I20260709 13:12:34.682814 31637 raft_consensus.cc:606] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6 [term 3 LEADER]: Received request to transfer leadership to TS 369d39d85e794108a1f8336f5b991c25
I20260709 13:12:34.685664 31637 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41f91725ca2740729c7c04dab9a0d5a0"
dest_uuid: "31f01602b758422c85a11b021fddc3e6"
mode: GRACEFUL
new_leader_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
 from {username='slave'} at 127.0.0.1:57812
I20260709 13:12:34.686146 31637 raft_consensus.cc:606] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [term 4 LEADER]: Received request to transfer leadership to TS c15d42e7445f4eee86f09c33d9b43fce
I20260709 13:12:34.688894 31637 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6595e33a811f46c9bad6389e68a20bc9"
dest_uuid: "31f01602b758422c85a11b021fddc3e6"
mode: GRACEFUL
new_leader_uuid: "369d39d85e794108a1f8336f5b991c25"
 from {username='slave'} at 127.0.0.1:57812
I20260709 13:12:34.689301 31637 raft_consensus.cc:606] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6 [term 1 LEADER]: Received request to transfer leadership to TS 369d39d85e794108a1f8336f5b991c25
I20260709 13:12:34.691876 31637 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1bd1cb474eb45f7aa7547a021b47624"
dest_uuid: "31f01602b758422c85a11b021fddc3e6"
mode: GRACEFUL
new_leader_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
 from {username='slave'} at 127.0.0.1:57812
I20260709 13:12:34.692354 31637 raft_consensus.cc:606] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6 [term 2 LEADER]: Received request to transfer leadership to TS c15d42e7445f4eee86f09c33d9b43fce
I20260709 13:12:34.693337 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:12:34.693832 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:34.777870 31906 raft_consensus.cc:993] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6: : Instructing follower 369d39d85e794108a1f8336f5b991c25 to start an election
I20260709 13:12:34.778376 31969 raft_consensus.cc:1081] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6 [term 1 LEADER]: Signalling peer 369d39d85e794108a1f8336f5b991c25 to start an election
I20260709 13:12:34.780232 31712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6595e33a811f46c9bad6389e68a20bc9"
dest_uuid: "369d39d85e794108a1f8336f5b991c25"
 from {username='slave'} at 127.0.0.1:37044
I20260709 13:12:34.780844 31712 raft_consensus.cc:493] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:34.781152 31712 raft_consensus.cc:3060] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:34.786294 31712 raft_consensus.cc:515] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:34.788138 31712 leader_election.cc:290] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25 [CANDIDATE]: Term 2 election: Requested vote from peers 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605), c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3:34339)
I20260709 13:12:34.789099 31637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595e33a811f46c9bad6389e68a20bc9" candidate_uuid: "369d39d85e794108a1f8336f5b991c25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31f01602b758422c85a11b021fddc3e6"
I20260709 13:12:34.789245 31785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595e33a811f46c9bad6389e68a20bc9" candidate_uuid: "369d39d85e794108a1f8336f5b991c25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
I20260709 13:12:34.789729 31637 raft_consensus.cc:3055] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:34.789783 31785 raft_consensus.cc:3060] T 6595e33a811f46c9bad6389e68a20bc9 P c15d42e7445f4eee86f09c33d9b43fce [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:34.789983 31637 raft_consensus.cc:740] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 31f01602b758422c85a11b021fddc3e6, State: Running, Role: LEADER
I20260709 13:12:34.790767 31637 consensus_queue.cc:260] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:34.791636 31637 raft_consensus.cc:3060] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:34.794430 31785 raft_consensus.cc:2468] T 6595e33a811f46c9bad6389e68a20bc9 P c15d42e7445f4eee86f09c33d9b43fce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369d39d85e794108a1f8336f5b991c25 in term 2.
I20260709 13:12:34.795588 31678 leader_election.cc:304] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369d39d85e794108a1f8336f5b991c25, c15d42e7445f4eee86f09c33d9b43fce; no voters: 
I20260709 13:12:34.796010 31637 raft_consensus.cc:2468] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369d39d85e794108a1f8336f5b991c25 in term 2.
I20260709 13:12:34.796669 31936 raft_consensus.cc:2804] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:34.798010 31936 raft_consensus.cc:697] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25 [term 2 LEADER]: Becoming Leader. State: Replica: 369d39d85e794108a1f8336f5b991c25, State: Running, Role: LEADER
I20260709 13:12:34.798964 31936 consensus_queue.cc:237] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:34.806833 31532 catalog_manager.cc:5697] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25 reported cstate change: term changed from 1 to 2, leader changed from 31f01602b758422c85a11b021fddc3e6 (127.30.63.1) to 369d39d85e794108a1f8336f5b991c25 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "369d39d85e794108a1f8336f5b991c25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:34.855593 31906 raft_consensus.cc:993] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6: : Instructing follower 369d39d85e794108a1f8336f5b991c25 to start an election
I20260709 13:12:34.856206 31969 raft_consensus.cc:1081] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6 [term 3 LEADER]: Signalling peer 369d39d85e794108a1f8336f5b991c25 to start an election
I20260709 13:12:34.857795 31712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3558f74b6e384db198bb8d74d491da4a"
dest_uuid: "369d39d85e794108a1f8336f5b991c25"
 from {username='slave'} at 127.0.0.1:37044
I20260709 13:12:34.858319 31712 raft_consensus.cc:493] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:34.858639 31712 raft_consensus.cc:3060] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:34.863438 31712 raft_consensus.cc:515] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:34.865134 31712 leader_election.cc:290] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [CANDIDATE]: Term 4 election: Requested vote from peers 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605), c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3:34339)
I20260709 13:12:34.866140 31637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3558f74b6e384db198bb8d74d491da4a" candidate_uuid: "369d39d85e794108a1f8336f5b991c25" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "31f01602b758422c85a11b021fddc3e6"
I20260709 13:12:34.866441 31785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3558f74b6e384db198bb8d74d491da4a" candidate_uuid: "369d39d85e794108a1f8336f5b991c25" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
I20260709 13:12:34.866739 31637 raft_consensus.cc:3055] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:34.867167 31637 raft_consensus.cc:740] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 31f01602b758422c85a11b021fddc3e6, State: Running, Role: LEADER
I20260709 13:12:34.867192 31785 raft_consensus.cc:3060] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:34.868005 31637 consensus_queue.cc:260] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:34.869150 31637 raft_consensus.cc:3060] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:34.874121 31785 raft_consensus.cc:2468] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369d39d85e794108a1f8336f5b991c25 in term 4.
I20260709 13:12:34.875298 31678 leader_election.cc:304] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369d39d85e794108a1f8336f5b991c25, c15d42e7445f4eee86f09c33d9b43fce; no voters: 
I20260709 13:12:34.875577 31637 raft_consensus.cc:2468] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369d39d85e794108a1f8336f5b991c25 in term 4.
I20260709 13:12:34.876170 31936 raft_consensus.cc:2804] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:34.876768 31936 raft_consensus.cc:697] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [term 4 LEADER]: Becoming Leader. State: Replica: 369d39d85e794108a1f8336f5b991c25, State: Running, Role: LEADER
I20260709 13:12:34.877614 31936 consensus_queue.cc:237] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:34.884507 31532 catalog_manager.cc:5697] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 reported cstate change: term changed from 3 to 4, leader changed from 31f01602b758422c85a11b021fddc3e6 (127.30.63.1) to 369d39d85e794108a1f8336f5b991c25 (127.30.63.2). New cstate: current_term: 4 leader_uuid: "369d39d85e794108a1f8336f5b991c25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:34.894513 31906 raft_consensus.cc:993] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6: : Instructing follower c15d42e7445f4eee86f09c33d9b43fce to start an election
I20260709 13:12:34.894935 31906 raft_consensus.cc:1081] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6 [term 2 LEADER]: Signalling peer c15d42e7445f4eee86f09c33d9b43fce to start an election
I20260709 13:12:34.896369 31785 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1bd1cb474eb45f7aa7547a021b47624"
dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
 from {username='slave'} at 127.0.0.1:42600
I20260709 13:12:34.896940 31785 raft_consensus.cc:493] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:34.897184 31785 raft_consensus.cc:3060] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:34.901379 31785 raft_consensus.cc:515] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:34.903097 31785 leader_election.cc:290] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 3 election: Requested vote from peers 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605), 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631)
I20260709 13:12:34.904326 31637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bd1cb474eb45f7aa7547a021b47624" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "31f01602b758422c85a11b021fddc3e6"
I20260709 13:12:34.904567 31712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bd1cb474eb45f7aa7547a021b47624" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "369d39d85e794108a1f8336f5b991c25"
I20260709 13:12:34.904968 31637 raft_consensus.cc:3055] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:34.905313 31637 raft_consensus.cc:740] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 31f01602b758422c85a11b021fddc3e6, State: Running, Role: LEADER
I20260709 13:12:34.905258 31712 raft_consensus.cc:3060] T d1bd1cb474eb45f7aa7547a021b47624 P 369d39d85e794108a1f8336f5b991c25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:34.906091 31637 consensus_queue.cc:260] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:34.906960 31637 raft_consensus.cc:3060] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:34.910869 31712 raft_consensus.cc:2468] T d1bd1cb474eb45f7aa7547a021b47624 P 369d39d85e794108a1f8336f5b991c25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15d42e7445f4eee86f09c33d9b43fce in term 3.
I20260709 13:12:34.911015 31637 raft_consensus.cc:2468] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15d42e7445f4eee86f09c33d9b43fce in term 3.
I20260709 13:12:34.912148 31749 leader_election.cc:304] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f01602b758422c85a11b021fddc3e6, c15d42e7445f4eee86f09c33d9b43fce; no voters: 
I20260709 13:12:34.912918 31849 raft_consensus.cc:2804] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:34.913991 31849 raft_consensus.cc:697] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [term 3 LEADER]: Becoming Leader. State: Replica: c15d42e7445f4eee86f09c33d9b43fce, State: Running, Role: LEADER
I20260709 13:12:34.914947 31849 consensus_queue.cc:237] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:34.922767 31532 catalog_manager.cc:5697] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce reported cstate change: term changed from 2 to 3, leader changed from 31f01602b758422c85a11b021fddc3e6 (127.30.63.1) to c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3). New cstate: current_term: 3 leader_uuid: "c15d42e7445f4eee86f09c33d9b43fce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:35.231058 31969 raft_consensus.cc:993] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6: : Instructing follower c15d42e7445f4eee86f09c33d9b43fce to start an election
I20260709 13:12:35.231565 31906 raft_consensus.cc:1081] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [term 4 LEADER]: Signalling peer c15d42e7445f4eee86f09c33d9b43fce to start an election
I20260709 13:12:35.233125 31785 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41f91725ca2740729c7c04dab9a0d5a0"
dest_uuid: "c15d42e7445f4eee86f09c33d9b43fce"
 from {username='slave'} at 127.0.0.1:42600
I20260709 13:12:35.233601 31785 raft_consensus.cc:493] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:35.233932 31785 raft_consensus.cc:3060] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:35.238236 31785 raft_consensus.cc:515] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:35.239576 31785 leader_election.cc:290] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 5 election: Requested vote from peers 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605), 369d39d85e794108a1f8336f5b991c25 (127.30.63.2:39631)
I20260709 13:12:35.240535 31637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f91725ca2740729c7c04dab9a0d5a0" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "31f01602b758422c85a11b021fddc3e6"
I20260709 13:12:35.240664 31712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f91725ca2740729c7c04dab9a0d5a0" candidate_uuid: "c15d42e7445f4eee86f09c33d9b43fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "369d39d85e794108a1f8336f5b991c25"
I20260709 13:12:35.241125 31637 raft_consensus.cc:3055] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:35.241166 31712 raft_consensus.cc:3060] T 41f91725ca2740729c7c04dab9a0d5a0 P 369d39d85e794108a1f8336f5b991c25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:35.241405 31637 raft_consensus.cc:740] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 31f01602b758422c85a11b021fddc3e6, State: Running, Role: LEADER
I20260709 13:12:35.242077 31637 consensus_queue.cc:260] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:35.242918 31637 raft_consensus.cc:3060] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:35.246711 31712 raft_consensus.cc:2468] T 41f91725ca2740729c7c04dab9a0d5a0 P 369d39d85e794108a1f8336f5b991c25 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15d42e7445f4eee86f09c33d9b43fce in term 5.
I20260709 13:12:35.247164 31637 raft_consensus.cc:2468] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15d42e7445f4eee86f09c33d9b43fce in term 5.
I20260709 13:12:35.247967 31750 leader_election.cc:304] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369d39d85e794108a1f8336f5b991c25, c15d42e7445f4eee86f09c33d9b43fce; no voters: 
I20260709 13:12:35.249040 31849 raft_consensus.cc:2804] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:35.249580 31849 raft_consensus.cc:697] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 5 LEADER]: Becoming Leader. State: Replica: c15d42e7445f4eee86f09c33d9b43fce, State: Running, Role: LEADER
I20260709 13:12:35.250394 31849 consensus_queue.cc:237] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } }
I20260709 13:12:35.258534 31532 catalog_manager.cc:5697] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce reported cstate change: term changed from 4 to 5, leader changed from 31f01602b758422c85a11b021fddc3e6 (127.30.63.1) to c15d42e7445f4eee86f09c33d9b43fce (127.30.63.3). New cstate: current_term: 5 leader_uuid: "c15d42e7445f4eee86f09c33d9b43fce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:35.306411 31785 raft_consensus.cc:1275] T 6595e33a811f46c9bad6389e68a20bc9 P c15d42e7445f4eee86f09c33d9b43fce [term 2 FOLLOWER]: Refusing update from remote peer 369d39d85e794108a1f8336f5b991c25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:35.307920 31936 consensus_queue.cc:1048] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:35.321349 31637 raft_consensus.cc:1275] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6 [term 2 FOLLOWER]: Refusing update from remote peer 369d39d85e794108a1f8336f5b991c25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:35.322901 31970 consensus_queue.cc:1048] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:35.324095 31712 raft_consensus.cc:1275] T d1bd1cb474eb45f7aa7547a021b47624 P 369d39d85e794108a1f8336f5b991c25 [term 3 FOLLOWER]: Refusing update from remote peer c15d42e7445f4eee86f09c33d9b43fce: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:35.325660 31849 consensus_queue.cc:1048] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:35.337489 31637 raft_consensus.cc:1275] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6 [term 3 FOLLOWER]: Refusing update from remote peer c15d42e7445f4eee86f09c33d9b43fce: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:35.339880 31987 consensus_queue.cc:1048] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:35.462785 31637 raft_consensus.cc:1275] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6 [term 4 FOLLOWER]: Refusing update from remote peer 369d39d85e794108a1f8336f5b991c25: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:35.464211 31970 consensus_queue.cc:1048] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f01602b758422c85a11b021fddc3e6" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:35.470775 31785 raft_consensus.cc:1275] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [term 4 FOLLOWER]: Refusing update from remote peer 369d39d85e794108a1f8336f5b991c25: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:35.472280 31981 consensus_queue.cc:1048] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15d42e7445f4eee86f09c33d9b43fce" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 34339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:35.694286 31712 raft_consensus.cc:1275] T 41f91725ca2740729c7c04dab9a0d5a0 P 369d39d85e794108a1f8336f5b991c25 [term 5 FOLLOWER]: Refusing update from remote peer c15d42e7445f4eee86f09c33d9b43fce: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:12:35.694804 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:35.696146 31988 consensus_queue.cc:1048] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "369d39d85e794108a1f8336f5b991c25" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:35.703760 30972 tablet_server.cc:179] TabletServer@127.30.63.1:0 shutting down...
W20260709 13:12:35.708019 31749 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:12:35.721539 31749 consensus_peers.cc:597] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce -> Peer 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605): Couldn't send request to peer 31f01602b758422c85a11b021fddc3e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.745771 30972 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:35.746644 30972 tablet_replica.cc:333] T 4e960950bc9748598558089efeb71c4a P 31f01602b758422c85a11b021fddc3e6: stopping tablet replica
I20260709 13:12:35.747278 30972 raft_consensus.cc:2243] T 4e960950bc9748598558089efeb71c4a P 31f01602b758422c85a11b021fddc3e6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.747993 30972 raft_consensus.cc:2272] T 4e960950bc9748598558089efeb71c4a P 31f01602b758422c85a11b021fddc3e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.749900 30972 tablet_replica.cc:333] T aa29c9ed2f134cd08c5b30c90a155df0 P 31f01602b758422c85a11b021fddc3e6: stopping tablet replica
I20260709 13:12:35.750449 30972 raft_consensus.cc:2243] T aa29c9ed2f134cd08c5b30c90a155df0 P 31f01602b758422c85a11b021fddc3e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.750867 30972 raft_consensus.cc:2272] T aa29c9ed2f134cd08c5b30c90a155df0 P 31f01602b758422c85a11b021fddc3e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.752699 30972 tablet_replica.cc:333] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6: stopping tablet replica
I20260709 13:12:35.753182 30972 raft_consensus.cc:2243] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.753583 30972 raft_consensus.cc:2272] T 3558f74b6e384db198bb8d74d491da4a P 31f01602b758422c85a11b021fddc3e6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.755831 30972 tablet_replica.cc:333] T 9e6e0240198340cdb710cc659623fe39 P 31f01602b758422c85a11b021fddc3e6: stopping tablet replica
I20260709 13:12:35.756404 30972 raft_consensus.cc:2243] T 9e6e0240198340cdb710cc659623fe39 P 31f01602b758422c85a11b021fddc3e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.756886 30972 raft_consensus.cc:2272] T 9e6e0240198340cdb710cc659623fe39 P 31f01602b758422c85a11b021fddc3e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.758903 30972 tablet_replica.cc:333] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6: stopping tablet replica
I20260709 13:12:35.759415 30972 raft_consensus.cc:2243] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.759831 30972 raft_consensus.cc:2272] T 6595e33a811f46c9bad6389e68a20bc9 P 31f01602b758422c85a11b021fddc3e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.763052 30972 tablet_replica.cc:333] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6: stopping tablet replica
I20260709 13:12:35.763797 30972 raft_consensus.cc:2243] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.764328 30972 raft_consensus.cc:2272] T d1bd1cb474eb45f7aa7547a021b47624 P 31f01602b758422c85a11b021fddc3e6 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:35.765149 31675 consensus_peers.cc:597] T aa29c9ed2f134cd08c5b30c90a155df0 P 369d39d85e794108a1f8336f5b991c25 -> Peer 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605): Couldn't send request to peer 31f01602b758422c85a11b021fddc3e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.766644 30972 tablet_replica.cc:333] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6: stopping tablet replica
I20260709 13:12:35.767194 30972 raft_consensus.cc:2243] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.767876 30972 raft_consensus.cc:2272] T 5dd5d4a006f74f3d83acde9f4174e1ea P 31f01602b758422c85a11b021fddc3e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.769649 30972 tablet_replica.cc:333] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6: stopping tablet replica
I20260709 13:12:35.770133 30972 raft_consensus.cc:2243] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.770838 30972 raft_consensus.cc:2272] T 11c8f2db76164c2cad66c4f44c70ba6c P 31f01602b758422c85a11b021fddc3e6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.773078 30972 tablet_replica.cc:333] T 2366d5ec869a4f53adf0887c6c605f63 P 31f01602b758422c85a11b021fddc3e6: stopping tablet replica
I20260709 13:12:35.773710 30972 raft_consensus.cc:2243] T 2366d5ec869a4f53adf0887c6c605f63 P 31f01602b758422c85a11b021fddc3e6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.774665 30972 raft_consensus.cc:2272] T 2366d5ec869a4f53adf0887c6c605f63 P 31f01602b758422c85a11b021fddc3e6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:35.776402 31749 consensus_peers.cc:597] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce -> Peer 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605): Couldn't send request to peer 31f01602b758422c85a11b021fddc3e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.777451 30972 tablet_replica.cc:333] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6: stopping tablet replica
I20260709 13:12:35.778053 30972 raft_consensus.cc:2243] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.778455 30972 raft_consensus.cc:2272] T 41f91725ca2740729c7c04dab9a0d5a0 P 31f01602b758422c85a11b021fddc3e6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.808094 30972 tablet_server.cc:196] TabletServer@127.30.63.1:0 shutdown complete.
I20260709 13:12:35.826823 30972 tablet_server.cc:179] TabletServer@127.30.63.2:0 shutting down...
I20260709 13:12:35.851910 30972 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:35.852545 30972 tablet_replica.cc:333] T 9e6e0240198340cdb710cc659623fe39 P 369d39d85e794108a1f8336f5b991c25: stopping tablet replica
I20260709 13:12:35.853293 30972 raft_consensus.cc:2243] T 9e6e0240198340cdb710cc659623fe39 P 369d39d85e794108a1f8336f5b991c25 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.853758 30972 raft_consensus.cc:2272] T 9e6e0240198340cdb710cc659623fe39 P 369d39d85e794108a1f8336f5b991c25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.855538 30972 tablet_replica.cc:333] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25: stopping tablet replica
I20260709 13:12:35.856042 30972 raft_consensus.cc:2243] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.856911 30972 raft_consensus.cc:2272] T 3558f74b6e384db198bb8d74d491da4a P 369d39d85e794108a1f8336f5b991c25 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.859433 30972 tablet_replica.cc:333] T aa29c9ed2f134cd08c5b30c90a155df0 P 369d39d85e794108a1f8336f5b991c25: stopping tablet replica
I20260709 13:12:35.859948 30972 raft_consensus.cc:2243] T aa29c9ed2f134cd08c5b30c90a155df0 P 369d39d85e794108a1f8336f5b991c25 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.860756 30972 raft_consensus.cc:2272] T aa29c9ed2f134cd08c5b30c90a155df0 P 369d39d85e794108a1f8336f5b991c25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.862406 30972 tablet_replica.cc:333] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25: stopping tablet replica
I20260709 13:12:35.862895 30972 raft_consensus.cc:2243] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.863306 30972 raft_consensus.cc:2272] T 4e960950bc9748598558089efeb71c4a P 369d39d85e794108a1f8336f5b991c25 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.864980 30972 tablet_replica.cc:333] T 41f91725ca2740729c7c04dab9a0d5a0 P 369d39d85e794108a1f8336f5b991c25: stopping tablet replica
I20260709 13:12:35.865483 30972 raft_consensus.cc:2243] T 41f91725ca2740729c7c04dab9a0d5a0 P 369d39d85e794108a1f8336f5b991c25 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.865901 30972 raft_consensus.cc:2272] T 41f91725ca2740729c7c04dab9a0d5a0 P 369d39d85e794108a1f8336f5b991c25 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.868860 30972 tablet_replica.cc:333] T 2366d5ec869a4f53adf0887c6c605f63 P 369d39d85e794108a1f8336f5b991c25: stopping tablet replica
I20260709 13:12:35.869637 30972 raft_consensus.cc:2243] T 2366d5ec869a4f53adf0887c6c605f63 P 369d39d85e794108a1f8336f5b991c25 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.870189 30972 raft_consensus.cc:2272] T 2366d5ec869a4f53adf0887c6c605f63 P 369d39d85e794108a1f8336f5b991c25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.872776 30972 tablet_replica.cc:333] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25: stopping tablet replica
I20260709 13:12:35.873344 30972 raft_consensus.cc:2243] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:12:35.873588 31749 consensus_peers.cc:597] T 9e6e0240198340cdb710cc659623fe39 P c15d42e7445f4eee86f09c33d9b43fce -> Peer 31f01602b758422c85a11b021fddc3e6 (127.30.63.1:34605): Couldn't send request to peer 31f01602b758422c85a11b021fddc3e6. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:34605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.874136 30972 raft_consensus.cc:2272] T 6595e33a811f46c9bad6389e68a20bc9 P 369d39d85e794108a1f8336f5b991c25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.876211 30972 tablet_replica.cc:333] T d1bd1cb474eb45f7aa7547a021b47624 P 369d39d85e794108a1f8336f5b991c25: stopping tablet replica
I20260709 13:12:35.876799 30972 raft_consensus.cc:2243] T d1bd1cb474eb45f7aa7547a021b47624 P 369d39d85e794108a1f8336f5b991c25 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.877246 30972 raft_consensus.cc:2272] T d1bd1cb474eb45f7aa7547a021b47624 P 369d39d85e794108a1f8336f5b991c25 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.879312 30972 tablet_replica.cc:333] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25: stopping tablet replica
I20260709 13:12:35.879804 30972 raft_consensus.cc:2243] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.880208 30972 raft_consensus.cc:2272] T 5dd5d4a006f74f3d83acde9f4174e1ea P 369d39d85e794108a1f8336f5b991c25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.881847 30972 tablet_replica.cc:333] T 11c8f2db76164c2cad66c4f44c70ba6c P 369d39d85e794108a1f8336f5b991c25: stopping tablet replica
I20260709 13:12:35.882293 30972 raft_consensus.cc:2243] T 11c8f2db76164c2cad66c4f44c70ba6c P 369d39d85e794108a1f8336f5b991c25 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.882706 30972 raft_consensus.cc:2272] T 11c8f2db76164c2cad66c4f44c70ba6c P 369d39d85e794108a1f8336f5b991c25 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.902633 30972 tablet_server.cc:196] TabletServer@127.30.63.2:0 shutdown complete.
I20260709 13:12:35.921623 30972 tablet_server.cc:179] TabletServer@127.30.63.3:0 shutting down...
I20260709 13:12:35.944695 30972 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:35.945500 30972 tablet_replica.cc:333] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce: stopping tablet replica
I20260709 13:12:35.946152 30972 raft_consensus.cc:2243] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.946663 30972 raft_consensus.cc:2272] T 4e960950bc9748598558089efeb71c4a P c15d42e7445f4eee86f09c33d9b43fce [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.948367 30972 tablet_replica.cc:333] T 9e6e0240198340cdb710cc659623fe39 P c15d42e7445f4eee86f09c33d9b43fce: stopping tablet replica
I20260709 13:12:35.948920 30972 raft_consensus.cc:2243] T 9e6e0240198340cdb710cc659623fe39 P c15d42e7445f4eee86f09c33d9b43fce [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.949692 30972 raft_consensus.cc:2272] T 9e6e0240198340cdb710cc659623fe39 P c15d42e7445f4eee86f09c33d9b43fce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.951450 30972 tablet_replica.cc:333] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce: stopping tablet replica
I20260709 13:12:35.951992 30972 raft_consensus.cc:2243] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.952445 30972 raft_consensus.cc:2272] T 3558f74b6e384db198bb8d74d491da4a P c15d42e7445f4eee86f09c33d9b43fce [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.954682 30972 tablet_replica.cc:333] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce: stopping tablet replica
I20260709 13:12:35.955619 30972 raft_consensus.cc:2243] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.956256 30972 raft_consensus.cc:2272] T aa29c9ed2f134cd08c5b30c90a155df0 P c15d42e7445f4eee86f09c33d9b43fce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.958190 30972 tablet_replica.cc:333] T 2366d5ec869a4f53adf0887c6c605f63 P c15d42e7445f4eee86f09c33d9b43fce: stopping tablet replica
I20260709 13:12:35.958735 30972 raft_consensus.cc:2243] T 2366d5ec869a4f53adf0887c6c605f63 P c15d42e7445f4eee86f09c33d9b43fce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.959523 30972 raft_consensus.cc:2272] T 2366d5ec869a4f53adf0887c6c605f63 P c15d42e7445f4eee86f09c33d9b43fce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.961725 30972 tablet_replica.cc:333] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce: stopping tablet replica
I20260709 13:12:35.962313 30972 raft_consensus.cc:2243] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.963176 30972 raft_consensus.cc:2272] T 41f91725ca2740729c7c04dab9a0d5a0 P c15d42e7445f4eee86f09c33d9b43fce [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.965606 30972 tablet_replica.cc:333] T 6595e33a811f46c9bad6389e68a20bc9 P c15d42e7445f4eee86f09c33d9b43fce: stopping tablet replica
I20260709 13:12:35.966231 30972 raft_consensus.cc:2243] T 6595e33a811f46c9bad6389e68a20bc9 P c15d42e7445f4eee86f09c33d9b43fce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.966838 30972 raft_consensus.cc:2272] T 6595e33a811f46c9bad6389e68a20bc9 P c15d42e7445f4eee86f09c33d9b43fce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.969372 30972 tablet_replica.cc:333] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce: stopping tablet replica
I20260709 13:12:35.969905 30972 raft_consensus.cc:2243] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.970649 30972 raft_consensus.cc:2272] T d1bd1cb474eb45f7aa7547a021b47624 P c15d42e7445f4eee86f09c33d9b43fce [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.972922 30972 tablet_replica.cc:333] T 5dd5d4a006f74f3d83acde9f4174e1ea P c15d42e7445f4eee86f09c33d9b43fce: stopping tablet replica
I20260709 13:12:35.973469 30972 raft_consensus.cc:2243] T 5dd5d4a006f74f3d83acde9f4174e1ea P c15d42e7445f4eee86f09c33d9b43fce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.973891 30972 raft_consensus.cc:2272] T 5dd5d4a006f74f3d83acde9f4174e1ea P c15d42e7445f4eee86f09c33d9b43fce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.975410 30972 tablet_replica.cc:333] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce: stopping tablet replica
I20260709 13:12:35.975853 30972 raft_consensus.cc:2243] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.976262 30972 raft_consensus.cc:2272] T 11c8f2db76164c2cad66c4f44c70ba6c P c15d42e7445f4eee86f09c33d9b43fce [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.997174 30972 tablet_server.cc:196] TabletServer@127.30.63.3:0 shutdown complete.
I20260709 13:12:36.016196 30972 master.cc:562] Master@127.30.63.62:36775 shutting down...
I20260709 13:12:36.036865 30972 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6d94581e2e7d4917a7ea0aaecf5f66f2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.037355 30972 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6d94581e2e7d4917a7ea0aaecf5f66f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.037626 30972 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6d94581e2e7d4917a7ea0aaecf5f66f2: stopping tablet replica
I20260709 13:12:36.058938 30972 master.cc:584] Master@127.30.63.62:36775 shutdown complete.
31f01602b758422c85a11b021fddc3e6  5
369d39d85e794108a1f8336f5b991c25  4
c15d42e7445f4eee86f09c33d9b43fce  1
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10710 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:12:36.103093 30972 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.30.63.62:38793
I20260709 13:12:36.104502 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:36.110383 31997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:36.110381 31998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:36.112323 32000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:36.113936 30972 server_base.cc:1061] running on GCE node
I20260709 13:12:36.116074 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:36.116271 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:36.116391 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783602756116381 us; error 0 us; skew 500 ppm
I20260709 13:12:36.117012 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:36.119462 30972 webserver.cc:533] Webserver started at http://127.30.63.62:45039/ using document root <none> and password file <none>
I20260709 13:12:36.119908 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:36.120064 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:36.120280 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:36.121414 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/master-0-root/instance:
uuid: "ffbfb630fccf464dbfd0bffd795262f7"
format_stamp: "Formatted at 2026-07-09 13:12:36 on dist-test-slave-c08m"
I20260709 13:12:36.125910 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:12:36.129431 32005 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:36.130290 30972 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:12:36.130630 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/master-0-root
uuid: "ffbfb630fccf464dbfd0bffd795262f7"
format_stamp: "Formatted at 2026-07-09 13:12:36 on dist-test-slave-c08m"
I20260709 13:12:36.130988 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:36.149861 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:36.151098 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:36.191166 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.62:38793
I20260709 13:12:36.191308 32056 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.62:38793 every 8 connection(s)
I20260709 13:12:36.195304 32057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.205420 32057 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7: Bootstrap starting.
I20260709 13:12:36.210130 32057 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.214836 32057 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7: No bootstrap required, opened a new log
I20260709 13:12:36.217069 32057 raft_consensus.cc:359] T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffbfb630fccf464dbfd0bffd795262f7" member_type: VOTER }
I20260709 13:12:36.217466 32057 raft_consensus.cc:385] T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.217746 32057 raft_consensus.cc:740] T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffbfb630fccf464dbfd0bffd795262f7, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.218343 32057 consensus_queue.cc:260] T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffbfb630fccf464dbfd0bffd795262f7" member_type: VOTER }
I20260709 13:12:36.218824 32057 raft_consensus.cc:399] T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:36.219036 32057 raft_consensus.cc:493] T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:36.219285 32057 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.223569 32057 raft_consensus.cc:515] T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffbfb630fccf464dbfd0bffd795262f7" member_type: VOTER }
I20260709 13:12:36.224189 32057 leader_election.cc:304] T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ffbfb630fccf464dbfd0bffd795262f7; no voters: 
I20260709 13:12:36.225522 32057 leader_election.cc:290] T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:36.225855 32060 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.227272 32060 raft_consensus.cc:697] T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7 [term 1 LEADER]: Becoming Leader. State: Replica: ffbfb630fccf464dbfd0bffd795262f7, State: Running, Role: LEADER
I20260709 13:12:36.227964 32060 consensus_queue.cc:237] T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffbfb630fccf464dbfd0bffd795262f7" member_type: VOTER }
I20260709 13:12:36.228713 32057 sys_catalog.cc:565] T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:36.232574 32061 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ffbfb630fccf464dbfd0bffd795262f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffbfb630fccf464dbfd0bffd795262f7" member_type: VOTER } }
I20260709 13:12:36.233045 32062 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ffbfb630fccf464dbfd0bffd795262f7. Latest consensus state: current_term: 1 leader_uuid: "ffbfb630fccf464dbfd0bffd795262f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffbfb630fccf464dbfd0bffd795262f7" member_type: VOTER } }
I20260709 13:12:36.233285 32061 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:36.233570 32062 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:36.237383 32067 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:36.245739 32067 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:36.246853 30972 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:36.255502 32067 catalog_manager.cc:1383] Generated new cluster ID: ea6de71748784119a0d204b73cb77ca0
I20260709 13:12:36.255838 32067 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:36.274838 32067 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:36.276130 32067 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:36.288406 32067 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7: Generated new TSK 0
I20260709 13:12:36.289070 32067 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:36.314154 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:36.320528 32078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:36.321820 32079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:36.323300 30972 server_base.cc:1061] running on GCE node
W20260709 13:12:36.323683 32081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:36.324715 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:36.324939 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:36.325062 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783602756325050 us; error 0 us; skew 500 ppm
I20260709 13:12:36.325546 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:36.328089 30972 webserver.cc:533] Webserver started at http://127.30.63.1:32809/ using document root <none> and password file <none>
I20260709 13:12:36.328527 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:36.328773 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:36.329002 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:36.330075 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-0-root/instance:
uuid: "fcfc3281929645969ecedbb0c0af759d"
format_stamp: "Formatted at 2026-07-09 13:12:36 on dist-test-slave-c08m"
I20260709 13:12:36.334800 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:12:36.338299 32086 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:36.339270 30972 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:12:36.339608 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-0-root
uuid: "fcfc3281929645969ecedbb0c0af759d"
format_stamp: "Formatted at 2026-07-09 13:12:36 on dist-test-slave-c08m"
I20260709 13:12:36.339943 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:36.354382 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:36.355654 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:36.357189 30972 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:36.359496 30972 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:36.359727 30972 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:36.359977 30972 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:36.360175 30972 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:36.404994 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.1:42339
I20260709 13:12:36.405093 32148 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.1:42339 every 8 connection(s)
I20260709 13:12:36.410292 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:36.418211 32153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:36.419632 32154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:36.422135 30972 server_base.cc:1061] running on GCE node
W20260709 13:12:36.423897 32156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:36.425027 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:12:36.425184 32149 heartbeater.cc:344] Connected to a master server at 127.30.63.62:38793
W20260709 13:12:36.425319 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:36.425539 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783602756425521 us; error 0 us; skew 500 ppm
I20260709 13:12:36.425597 32149 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:36.426373 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:36.426597 32149 heartbeater.cc:507] Master 127.30.63.62:38793 requested a full tablet report, sending...
I20260709 13:12:36.429495 30972 webserver.cc:533] Webserver started at http://127.30.63.2:41665/ using document root <none> and password file <none>
I20260709 13:12:36.429497 32022 ts_manager.cc:194] Registered new tserver with Master: fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339)
I20260709 13:12:36.430267 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:36.430486 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:36.430806 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:36.431813 32022 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49534
I20260709 13:12:36.431988 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-1-root/instance:
uuid: "113b5461952d47e0944d463ea4e32801"
format_stamp: "Formatted at 2026-07-09 13:12:36 on dist-test-slave-c08m"
I20260709 13:12:36.437201 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:12:36.441111 32161 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:36.442054 30972 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:12:36.442325 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-1-root
uuid: "113b5461952d47e0944d463ea4e32801"
format_stamp: "Formatted at 2026-07-09 13:12:36 on dist-test-slave-c08m"
I20260709 13:12:36.442571 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:36.480455 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:36.481767 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:36.483326 30972 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:36.485865 30972 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:36.486122 30972 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:36.486388 30972 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:36.486572 30972 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:36.530987 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.2:44517
I20260709 13:12:36.531142 32223 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.2:44517 every 8 connection(s)
I20260709 13:12:36.535969 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:36.542675 32227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:36.543576 32228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:36.553095 32224 heartbeater.cc:344] Connected to a master server at 127.30.63.62:38793
I20260709 13:12:36.553536 32224 heartbeater.cc:461] Registering TS with master...
W20260709 13:12:36.554296 32230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:36.554476 32224 heartbeater.cc:507] Master 127.30.63.62:38793 requested a full tablet report, sending...
I20260709 13:12:36.554647 30972 server_base.cc:1061] running on GCE node
I20260709 13:12:36.555856 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:36.556118 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:36.556305 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783602756556289 us; error 0 us; skew 500 ppm
I20260709 13:12:36.557031 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:36.557010 32022 ts_manager.cc:194] Registered new tserver with Master: 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:36.558986 32022 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49550
I20260709 13:12:36.560187 30972 webserver.cc:533] Webserver started at http://127.30.63.3:40351/ using document root <none> and password file <none>
I20260709 13:12:36.560951 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:36.561169 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:36.561472 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:36.562611 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-2-root/instance:
uuid: "6b3ed521ce8947db80c4b4828b355c06"
format_stamp: "Formatted at 2026-07-09 13:12:36 on dist-test-slave-c08m"
I20260709 13:12:36.567178 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:12:36.570497 32235 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:36.571380 30972 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:12:36.571625 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-2-root
uuid: "6b3ed521ce8947db80c4b4828b355c06"
format_stamp: "Formatted at 2026-07-09 13:12:36 on dist-test-slave-c08m"
I20260709 13:12:36.571918 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:36.590262 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:36.591392 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:36.592880 30972 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:36.595069 30972 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:36.595249 30972 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:36.595546 30972 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:36.595697 30972 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:36.637982 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.3:36651
I20260709 13:12:36.638180 32297 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.3:36651 every 8 connection(s)
I20260709 13:12:36.652837 32298 heartbeater.cc:344] Connected to a master server at 127.30.63.62:38793
I20260709 13:12:36.653234 32298 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:36.653924 32298 heartbeater.cc:507] Master 127.30.63.62:38793 requested a full tablet report, sending...
I20260709 13:12:36.656275 32022 ts_manager.cc:194] Registered new tserver with Master: 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:36.656510 30972 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014867352s
I20260709 13:12:36.658130 32022 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49556
I20260709 13:12:36.689867 32022 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49570:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:36.695813 32022 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:36.909569 32114 tablet_service.cc:1511] Processing CreateTablet for tablet a933d5409ea04be9bd937643b14efae4 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:36.911103 32114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a933d5409ea04be9bd937643b14efae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.911332 32111 tablet_service.cc:1511] Processing CreateTablet for tablet 314924e72a7f4efa9cbae136ba7cd259 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:36.912727 32111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 314924e72a7f4efa9cbae136ba7cd259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.915477 32112 tablet_service.cc:1511] Processing CreateTablet for tablet 10940646da924abea9f371781da8acee (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:36.916915 32112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10940646da924abea9f371781da8acee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.918609 32189 tablet_service.cc:1511] Processing CreateTablet for tablet a933d5409ea04be9bd937643b14efae4 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:36.920068 32189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a933d5409ea04be9bd937643b14efae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.919775 32188 tablet_service.cc:1511] Processing CreateTablet for tablet ddd7dfc158794e3ab7427d0b86b46c8d (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:36.921407 32188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd7dfc158794e3ab7427d0b86b46c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.921921 32113 tablet_service.cc:1511] Processing CreateTablet for tablet ddd7dfc158794e3ab7427d0b86b46c8d (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:36.923245 32113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd7dfc158794e3ab7427d0b86b46c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.926877 32187 tablet_service.cc:1511] Processing CreateTablet for tablet 10940646da924abea9f371781da8acee (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:36.927024 32186 tablet_service.cc:1511] Processing CreateTablet for tablet 314924e72a7f4efa9cbae136ba7cd259 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:36.928426 32187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10940646da924abea9f371781da8acee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.929103 32186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 314924e72a7f4efa9cbae136ba7cd259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.938426 32110 tablet_service.cc:1511] Processing CreateTablet for tablet acd9953c536c4b5fa2ebab1015a61b53 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:36.939846 32110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acd9953c536c4b5fa2ebab1015a61b53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.943038 32109 tablet_service.cc:1511] Processing CreateTablet for tablet 64767c8d367b4cc1b7e2ffbcbf73ce29 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:36.947350 32184 tablet_service.cc:1511] Processing CreateTablet for tablet 64767c8d367b4cc1b7e2ffbcbf73ce29 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:36.949733 32185 tablet_service.cc:1511] Processing CreateTablet for tablet acd9953c536c4b5fa2ebab1015a61b53 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:36.953769 32183 tablet_service.cc:1511] Processing CreateTablet for tablet 6565a440fcf14a499c191f2835d21508 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:36.956239 32182 tablet_service.cc:1511] Processing CreateTablet for tablet 6021998dccdb415f9b8203cebee0292c (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:36.959332 32181 tablet_service.cc:1511] Processing CreateTablet for tablet 11511d6fc4864afe9cef218fd4e0c0dc (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:36.961875 32184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64767c8d367b4cc1b7e2ffbcbf73ce29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.962592 32180 tablet_service.cc:1511] Processing CreateTablet for tablet d5e9c133ed6a41a3ae8f20d028374729 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:36.964010 32180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5e9c133ed6a41a3ae8f20d028374729. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.944448 32109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64767c8d367b4cc1b7e2ffbcbf73ce29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.964953 32185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acd9953c536c4b5fa2ebab1015a61b53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.968967 32182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6021998dccdb415f9b8203cebee0292c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.970801 32181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11511d6fc4864afe9cef218fd4e0c0dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.975586 32183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6565a440fcf14a499c191f2835d21508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.982892 32108 tablet_service.cc:1511] Processing CreateTablet for tablet 6565a440fcf14a499c191f2835d21508 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:36.983023 32186 tablet_service.cc:1511] Processing CreateTablet for tablet 5f28f3141aec48eb9ada8a4f63ca7e32 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:36.984514 32108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6565a440fcf14a499c191f2835d21508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.988989 32186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f28f3141aec48eb9ada8a4f63ca7e32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.990751 32107 tablet_service.cc:1511] Processing CreateTablet for tablet 6021998dccdb415f9b8203cebee0292c (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:36.992183 32107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6021998dccdb415f9b8203cebee0292c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.999282 32112 tablet_service.cc:1511] Processing CreateTablet for tablet 11511d6fc4864afe9cef218fd4e0c0dc (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:36.999755 32106 tablet_service.cc:1511] Processing CreateTablet for tablet d5e9c133ed6a41a3ae8f20d028374729 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:37.001533 32106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5e9c133ed6a41a3ae8f20d028374729. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.019073 32314 tablet_bootstrap.cc:492] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:37.021575 32187 tablet_service.cc:1511] Processing CreateTablet for tablet 95f5e8022e3d4b9e9f240b21076de4c3 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:37.025473 32105 tablet_service.cc:1511] Processing CreateTablet for tablet 95f5e8022e3d4b9e9f240b21076de4c3 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:37.026263 32187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95f5e8022e3d4b9e9f240b21076de4c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.027989 32114 tablet_service.cc:1511] Processing CreateTablet for tablet 5f28f3141aec48eb9ada8a4f63ca7e32 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:37.033520 32263 tablet_service.cc:1511] Processing CreateTablet for tablet a933d5409ea04be9bd937643b14efae4 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:37.035005 32263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a933d5409ea04be9bd937643b14efae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.042522 32313 tablet_bootstrap.cc:492] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:37.046543 32262 tablet_service.cc:1511] Processing CreateTablet for tablet ddd7dfc158794e3ab7427d0b86b46c8d (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:37.017455 32112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11511d6fc4864afe9cef218fd4e0c0dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.048529 32262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd7dfc158794e3ab7427d0b86b46c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.056841 32114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f28f3141aec48eb9ada8a4f63ca7e32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.050675 32261 tablet_service.cc:1511] Processing CreateTablet for tablet 10940646da924abea9f371781da8acee (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:37.052944 32260 tablet_service.cc:1511] Processing CreateTablet for tablet 314924e72a7f4efa9cbae136ba7cd259 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:37.058342 32261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10940646da924abea9f371781da8acee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.053709 32258 tablet_service.cc:1511] Processing CreateTablet for tablet 64767c8d367b4cc1b7e2ffbcbf73ce29 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:37.060305 32258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64767c8d367b4cc1b7e2ffbcbf73ce29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.055248 32259 tablet_service.cc:1511] Processing CreateTablet for tablet acd9953c536c4b5fa2ebab1015a61b53 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:37.081346 32259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acd9953c536c4b5fa2ebab1015a61b53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.084863 32105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95f5e8022e3d4b9e9f240b21076de4c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.086189 32257 tablet_service.cc:1511] Processing CreateTablet for tablet 6565a440fcf14a499c191f2835d21508 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:37.088975 32256 tablet_service.cc:1511] Processing CreateTablet for tablet 6021998dccdb415f9b8203cebee0292c (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:37.091431 32255 tablet_service.cc:1511] Processing CreateTablet for tablet 11511d6fc4864afe9cef218fd4e0c0dc (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:37.094297 32254 tablet_service.cc:1511] Processing CreateTablet for tablet d5e9c133ed6a41a3ae8f20d028374729 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:37.094945 32313 tablet_bootstrap.cc:654] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.105909 32180 tablet_service.cc:1511] Processing CreateTablet for tablet 0fee96a531e44b88bbae1d896f392bdd (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:37.107339 32180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fee96a531e44b88bbae1d896f392bdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.107044 32183 tablet_service.cc:1511] Processing CreateTablet for tablet 2ec7a9cf151948fdaa078aba5fb1df43 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:37.108114 32314 tablet_bootstrap.cc:654] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.108345 32183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec7a9cf151948fdaa078aba5fb1df43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.109263 32113 tablet_service.cc:1511] Processing CreateTablet for tablet 0fee96a531e44b88bbae1d896f392bdd (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:37.118719 32255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11511d6fc4864afe9cef218fd4e0c0dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.119851 32257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6565a440fcf14a499c191f2835d21508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.120898 32113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fee96a531e44b88bbae1d896f392bdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.125051 32256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6021998dccdb415f9b8203cebee0292c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.129017 32260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 314924e72a7f4efa9cbae136ba7cd259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.129799 32254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5e9c133ed6a41a3ae8f20d028374729. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.149842 32109 tablet_service.cc:1511] Processing CreateTablet for tablet 2ec7a9cf151948fdaa078aba5fb1df43 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:37.158416 32109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec7a9cf151948fdaa078aba5fb1df43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.169450 32316 tablet_bootstrap.cc:492] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:37.169749 32313 tablet_bootstrap.cc:492] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:37.170336 32313 ts_tablet_manager.cc:1403] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.128s	user 0.012s	sys 0.004s
I20260709 13:12:37.173615 32313 raft_consensus.cc:359] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:37.174480 32313 raft_consensus.cc:385] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.174840 32313 raft_consensus.cc:740] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.194594 32182 tablet_service.cc:1511] Processing CreateTablet for tablet f089b75ada024eb9bbf7e4b953063dd4 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:37.195101 32316 tablet_bootstrap.cc:654] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.215939 32256 tablet_service.cc:1511] Processing CreateTablet for tablet 95f5e8022e3d4b9e9f240b21076de4c3 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:37.217798 32256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95f5e8022e3d4b9e9f240b21076de4c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.220814 32263 tablet_service.cc:1511] Processing CreateTablet for tablet 5f28f3141aec48eb9ada8a4f63ca7e32 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:37.222714 32263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f28f3141aec48eb9ada8a4f63ca7e32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.235260 32254 tablet_service.cc:1511] Processing CreateTablet for tablet 0fee96a531e44b88bbae1d896f392bdd (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:37.236743 32254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fee96a531e44b88bbae1d896f392bdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.236538 32313 consensus_queue.cc:260] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:12:37.243265 32070 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:37.244051 32180 tablet_service.cc:1511] Processing CreateTablet for tablet dea547a3502e4ffeacd79e160d8f60e6 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:37.246472 32112 tablet_service.cc:1511] Processing CreateTablet for tablet f089b75ada024eb9bbf7e4b953063dd4 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:37.247845 32112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f089b75ada024eb9bbf7e4b953063dd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.249751 32105 tablet_service.cc:1511] Processing CreateTablet for tablet dea547a3502e4ffeacd79e160d8f60e6 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:37.251061 32105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dea547a3502e4ffeacd79e160d8f60e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.258322 32187 tablet_service.cc:1511] Processing CreateTablet for tablet 19e09eecc9b2466db338be646fedba5f (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:37.262189 32257 tablet_service.cc:1511] Processing CreateTablet for tablet 2ec7a9cf151948fdaa078aba5fb1df43 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:37.264057 32257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec7a9cf151948fdaa078aba5fb1df43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.239513 32182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f089b75ada024eb9bbf7e4b953063dd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.269490 32187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19e09eecc9b2466db338be646fedba5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.274169 32180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dea547a3502e4ffeacd79e160d8f60e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.287465 32186 tablet_service.cc:1511] Processing CreateTablet for tablet 7db983b299754e0eba1ba5726c892858 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:37.288951 32186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db983b299754e0eba1ba5726c892858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.303354 32114 tablet_service.cc:1511] Processing CreateTablet for tablet 7db983b299754e0eba1ba5726c892858 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:37.304791 32114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db983b299754e0eba1ba5726c892858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.305444 32105 tablet_service.cc:1511] Processing CreateTablet for tablet 19e09eecc9b2466db338be646fedba5f (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:37.306713 32105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19e09eecc9b2466db338be646fedba5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.313913 32262 tablet_service.cc:1511] Processing CreateTablet for tablet 7db983b299754e0eba1ba5726c892858 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:37.315302 32262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db983b299754e0eba1ba5726c892858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.276165 32254 tablet_service.cc:1511] Processing CreateTablet for tablet f089b75ada024eb9bbf7e4b953063dd4 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:37.320483 32254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f089b75ada024eb9bbf7e4b953063dd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.329164 32183 tablet_service.cc:1511] Processing CreateTablet for tablet 7beffc7d75824f0085f2b522bab2bc79 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:37.330647 32183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7beffc7d75824f0085f2b522bab2bc79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.331102 32314 tablet_bootstrap.cc:492] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:37.331583 32314 ts_tablet_manager.cc:1403] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.313s	user 0.037s	sys 0.034s
I20260709 13:12:37.332244 32313 ts_tablet_manager.cc:1434] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.162s	user 0.022s	sys 0.031s
I20260709 13:12:37.334667 32314 raft_consensus.cc:359] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:12:37.335561 32314 raft_consensus.cc:385] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.335906 32314 raft_consensus.cc:740] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.336856 32314 consensus_queue.cc:260] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:12:37.330651 32109 tablet_service.cc:1511] Processing CreateTablet for tablet 7beffc7d75824f0085f2b522bab2bc79 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:37.342770 32189 tablet_service.cc:1511] Processing CreateTablet for tablet 5708596452c34a319a19ae8a5b24b2df (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:37.343863 32224 heartbeater.cc:499] Master 127.30.63.62:38793 was elected leader, sending a full tablet report...
I20260709 13:12:37.344156 32189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5708596452c34a319a19ae8a5b24b2df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.347591 32313 tablet_bootstrap.cc:492] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:37.348982 32181 tablet_service.cc:1511] Processing CreateTablet for tablet 3868446e9dc747d9b702abc7c2888f8a (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:37.350272 32181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3868446e9dc747d9b702abc7c2888f8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.351099 32109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7beffc7d75824f0085f2b522bab2bc79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.359766 32258 tablet_service.cc:1511] Processing CreateTablet for tablet 7beffc7d75824f0085f2b522bab2bc79 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:37.361290 32258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7beffc7d75824f0085f2b522bab2bc79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.366727 32113 tablet_service.cc:1511] Processing CreateTablet for tablet 5708596452c34a319a19ae8a5b24b2df (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:37.367019 32259 tablet_service.cc:1511] Processing CreateTablet for tablet 5708596452c34a319a19ae8a5b24b2df (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:37.368095 32113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5708596452c34a319a19ae8a5b24b2df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.369751 32259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5708596452c34a319a19ae8a5b24b2df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.370124 32111 tablet_service.cc:1511] Processing CreateTablet for tablet 3868446e9dc747d9b702abc7c2888f8a (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:37.370327 32255 tablet_service.cc:1511] Processing CreateTablet for tablet 3868446e9dc747d9b702abc7c2888f8a (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:37.371361 32111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3868446e9dc747d9b702abc7c2888f8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.371546 32255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3868446e9dc747d9b702abc7c2888f8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.388846 32108 tablet_service.cc:1511] Processing CreateTablet for tablet afb482e4812e47d0a501b142e64cb73b (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:37.390266 32108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afb482e4812e47d0a501b142e64cb73b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.397135 32261 tablet_service.cc:1511] Processing CreateTablet for tablet dea547a3502e4ffeacd79e160d8f60e6 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:37.398518 32261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dea547a3502e4ffeacd79e160d8f60e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.399518 32254 tablet_service.cc:1511] Processing CreateTablet for tablet afb482e4812e47d0a501b142e64cb73b (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:37.401047 32254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afb482e4812e47d0a501b142e64cb73b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.324451 32260 tablet_service.cc:1511] Processing CreateTablet for tablet 19e09eecc9b2466db338be646fedba5f (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:37.404745 32183 tablet_service.cc:1511] Processing CreateTablet for tablet c0324508029249e0a1ff9d3eb1936981 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:37.405048 32180 tablet_service.cc:1511] Processing CreateTablet for tablet afb482e4812e47d0a501b142e64cb73b (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:37.406049 32183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0324508029249e0a1ff9d3eb1936981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.412770 32316 tablet_bootstrap.cc:492] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:37.413137 32313 tablet_bootstrap.cc:654] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.413442 32316 ts_tablet_manager.cc:1403] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.244s	user 0.014s	sys 0.037s
I20260709 13:12:37.410663 32260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19e09eecc9b2466db338be646fedba5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.425074 32182 tablet_service.cc:1511] Processing CreateTablet for tablet d002861120de41408d48712b6bd491e1 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:37.427981 32112 tablet_service.cc:1511] Processing CreateTablet for tablet c0324508029249e0a1ff9d3eb1936981 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:37.418030 32180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afb482e4812e47d0a501b142e64cb73b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.431720 32182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d002861120de41408d48712b6bd491e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.434520 32149 heartbeater.cc:499] Master 127.30.63.62:38793 was elected leader, sending a full tablet report...
I20260709 13:12:37.437036 32112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0324508029249e0a1ff9d3eb1936981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.450235 32316 raft_consensus.cc:359] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:37.451076 32316 raft_consensus.cc:385] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.451414 32316 raft_consensus.cc:740] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.452178 32316 consensus_queue.cc:260] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:37.462934 32258 tablet_service.cc:1511] Processing CreateTablet for tablet c0324508029249e0a1ff9d3eb1936981 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:37.472483 32318 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.473305 32258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0324508029249e0a1ff9d3eb1936981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.472999 32318 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:37.464710 32105 tablet_service.cc:1511] Processing CreateTablet for tablet d002861120de41408d48712b6bd491e1 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:37.475519 32318 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:37.475936 32105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d002861120de41408d48712b6bd491e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.466912 32263 tablet_service.cc:1511] Processing CreateTablet for tablet d002861120de41408d48712b6bd491e1 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:37.481678 32263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d002861120de41408d48712b6bd491e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.534891 32314 ts_tablet_manager.cc:1434] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.203s	user 0.012s	sys 0.020s
I20260709 13:12:37.535945 32314 tablet_bootstrap.cc:492] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:37.546998 32181 tablet_service.cc:1511] Processing CreateTablet for tablet 3bdc1594189c43f49251261c5d073447 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:37.548264 32314 tablet_bootstrap.cc:654] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.549889 32189 tablet_service.cc:1511] Processing CreateTablet for tablet d63bb58dbda1427191933eb8353d8d75 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:37.551309 32181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bdc1594189c43f49251261c5d073447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.553745 32108 tablet_service.cc:1511] Processing CreateTablet for tablet 3bdc1594189c43f49251261c5d073447 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:37.556286 32189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d63bb58dbda1427191933eb8353d8d75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.557464 32112 tablet_service.cc:1511] Processing CreateTablet for tablet d63bb58dbda1427191933eb8353d8d75 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:37.559103 32316 ts_tablet_manager.cc:1434] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.145s	user 0.025s	sys 0.028s
I20260709 13:12:37.561828 32298 heartbeater.cc:499] Master 127.30.63.62:38793 was elected leader, sending a full tablet report...
I20260709 13:12:37.555310 32108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bdc1594189c43f49251261c5d073447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.570711 32180 tablet_service.cc:1511] Processing CreateTablet for tablet 0aaeda9c539745d5b9b44fb7acb8b438 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:37.572118 32180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aaeda9c539745d5b9b44fb7acb8b438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.572736 32112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d63bb58dbda1427191933eb8353d8d75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.580569 32316 tablet_bootstrap.cc:492] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:37.592020 32316 tablet_bootstrap.cc:654] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.593067 32182 tablet_service.cc:1511] Processing CreateTablet for tablet 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:37.594446 32182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a6ce5ae89cb4ad08c24a3a10d6fc0c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.595530 32263 tablet_service.cc:1511] Processing CreateTablet for tablet d63bb58dbda1427191933eb8353d8d75 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:37.597136 32263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d63bb58dbda1427191933eb8353d8d75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.604091 32105 tablet_service.cc:1511] Processing CreateTablet for tablet 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:37.581982 32313 tablet_bootstrap.cc:492] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:37.557498 32254 tablet_service.cc:1511] Processing CreateTablet for tablet 3bdc1594189c43f49251261c5d073447 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:37.605896 32313 ts_tablet_manager.cc:1403] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.259s	user 0.015s	sys 0.012s
I20260709 13:12:37.616863 32254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bdc1594189c43f49251261c5d073447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.621016 32260 tablet_service.cc:1511] Processing CreateTablet for tablet 0aaeda9c539745d5b9b44fb7acb8b438 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:37.623072 32260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aaeda9c539745d5b9b44fb7acb8b438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.625231 32105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a6ce5ae89cb4ad08c24a3a10d6fc0c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.642820 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:37.646804 32113 tablet_service.cc:1511] Processing CreateTablet for tablet 0aaeda9c539745d5b9b44fb7acb8b438 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:37.648197 32113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aaeda9c539745d5b9b44fb7acb8b438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.663024 32314 tablet_bootstrap.cc:492] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:37.663800 32314 ts_tablet_manager.cc:1403] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.128s	user 0.022s	sys 0.006s
W20260709 13:12:37.664752 32165 leader_election.cc:343] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.657258 32313 raft_consensus.cc:359] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:37.665395 32313 raft_consensus.cc:385] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.665827 32313 raft_consensus.cc:740] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.675385 32111 tablet_service.cc:1511] Processing CreateTablet for tablet 28b50ebff7ac4d9cbf8fc12c43ace31e (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:37.677304 32111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28b50ebff7ac4d9cbf8fc12c43ace31e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.677172 32183 tablet_service.cc:1511] Processing CreateTablet for tablet 547f929c96244ef9a23b3eec5126aa3e (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:37.679978 32183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 547f929c96244ef9a23b3eec5126aa3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.681980 32187 tablet_service.cc:1511] Processing CreateTablet for tablet bdc0f3bc03be45ec89dc54321b977dd5 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:37.683487 32187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdc0f3bc03be45ec89dc54321b977dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.684242 32313 consensus_queue.cc:260] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:37.670702 32316 tablet_bootstrap.cc:492] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:37.693045 32316 ts_tablet_manager.cc:1403] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.113s	user 0.023s	sys 0.027s
I20260709 13:12:37.694593 32313 ts_tablet_manager.cc:1434] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.088s	user 0.008s	sys 0.000s
I20260709 13:12:37.695783 32313 tablet_bootstrap.cc:492] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:37.672333 32189 tablet_service.cc:1511] Processing CreateTablet for tablet 28b50ebff7ac4d9cbf8fc12c43ace31e (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:37.698623 32189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28b50ebff7ac4d9cbf8fc12c43ace31e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.696059 32316 raft_consensus.cc:359] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:12:37.701020 32316 raft_consensus.cc:385] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.701337 32316 raft_consensus.cc:740] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.701822 32314 raft_consensus.cc:359] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:37.702158 32316 consensus_queue.cc:260] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:12:37.702700 32314 raft_consensus.cc:385] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.703158 32314 raft_consensus.cc:740] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.704384 32316 ts_tablet_manager.cc:1434] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:12:37.704211 32314 consensus_queue.cc:260] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:37.705350 32316 tablet_bootstrap.cc:492] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:37.668251 32258 tablet_service.cc:1511] Processing CreateTablet for tablet 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:37.689500 32320 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.708338 32112 tablet_service.cc:1511] Processing CreateTablet for tablet bdc0f3bc03be45ec89dc54321b977dd5 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:37.709411 32258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a6ce5ae89cb4ad08c24a3a10d6fc0c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.708950 32320 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:12:37.709812 32112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdc0f3bc03be45ec89dc54321b977dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.714541 32320 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:37.731320 32263 tablet_service.cc:1511] Processing CreateTablet for tablet 28b50ebff7ac4d9cbf8fc12c43ace31e (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:37.737027 32314 ts_tablet_manager.cc:1434] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.072s	user 0.012s	sys 0.002s
I20260709 13:12:37.737447 32263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28b50ebff7ac4d9cbf8fc12c43ace31e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.738229 32314 tablet_bootstrap.cc:492] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:37.711755 32254 tablet_service.cc:1511] Processing CreateTablet for tablet 547f929c96244ef9a23b3eec5126aa3e (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:37.753741 32324 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.754307 32324 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:12:37.756883 32254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 547f929c96244ef9a23b3eec5126aa3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.757387 32324 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:37.758000 32261 tablet_service.cc:1511] Processing CreateTablet for tablet bdc0f3bc03be45ec89dc54321b977dd5 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:37.759752 32261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdc0f3bc03be45ec89dc54321b977dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.760991 32108 tablet_service.cc:1511] Processing CreateTablet for tablet 547f929c96244ef9a23b3eec5126aa3e (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:37.767194 32313 tablet_bootstrap.cc:654] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.792124 32108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 547f929c96244ef9a23b3eec5126aa3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.802047 32114 tablet_service.cc:1511] Processing CreateTablet for tablet 05806ba48f814549969547f21c7101c3 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:37.814621 32114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05806ba48f814549969547f21c7101c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.802421 32314 tablet_bootstrap.cc:654] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.802364 32324 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.827090 32324 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:37.803020 32318 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.807932 32316 tablet_bootstrap.cc:654] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.828850 32318 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:37.831023 32324 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:37.836201 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:37.833346 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:12:37.837615 32165 leader_election.cc:343] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.832541 32318 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:12:37.840075 32165 leader_election.cc:343] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.840536 32165 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:37.840927 32260 tablet_service.cc:1511] Processing CreateTablet for tablet 05806ba48f814549969547f21c7101c3 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:37.842527 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:37.843904 32318 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:37.845299 32260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05806ba48f814549969547f21c7101c3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:37.845223 32165 leader_election.cc:343] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.847939 32165 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:37.849100 32318 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:37.849226 32113 tablet_service.cc:1511] Processing CreateTablet for tablet afc0578da01e4736bf535c5df1439723 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:37.849848 32109 tablet_service.cc:1511] Processing CreateTablet for tablet 4124d037f0614ab8969bf0e130edd483 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:37.851464 32113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afc0578da01e4736bf535c5df1439723. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.856340 32109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4124d037f0614ab8969bf0e130edd483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.856812 32259 tablet_service.cc:1511] Processing CreateTablet for tablet afc0578da01e4736bf535c5df1439723 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:37.858273 32259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afc0578da01e4736bf535c5df1439723. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.877897 32189 tablet_service.cc:1511] Processing CreateTablet for tablet 05806ba48f814549969547f21c7101c3 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:37.878594 32181 tablet_service.cc:1511] Processing CreateTablet for tablet afc0578da01e4736bf535c5df1439723 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:37.879248 32189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05806ba48f814549969547f21c7101c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.879822 32181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afc0578da01e4736bf535c5df1439723. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.882104 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:37.882860 32187 tablet_service.cc:1511] Processing CreateTablet for tablet 4124d037f0614ab8969bf0e130edd483 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:37.885411 32187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4124d037f0614ab8969bf0e130edd483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.896788 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:37.897473 32273 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
I20260709 13:12:37.898659 32313 tablet_bootstrap.cc:492] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:37.899173 32313 ts_tablet_manager.cc:1403] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.204s	user 0.013s	sys 0.004s
W20260709 13:12:37.899295 32238 leader_election.cc:343] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.902189 32090 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:37.902319 32313 raft_consensus.cc:359] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:37.903098 32313 raft_consensus.cc:385] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.903234 32328 raft_consensus.cc:2804] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:37.903467 32313 raft_consensus.cc:740] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.903641 32328 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.903973 32328 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.904443 32313 consensus_queue.cc:260] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:37.906951 32263 tablet_service.cc:1511] Processing CreateTablet for tablet 4124d037f0614ab8969bf0e130edd483 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:37.908293 32263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4124d037f0614ab8969bf0e130edd483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.913728 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:37.893146 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:12:37.915623 32238 leader_election.cc:343] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.916349 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:37.918584 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:12:37.921896 32239 leader_election.cc:343] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.922384 32239 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:12:37.923439 32089 leader_election.cc:343] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.924316 32324 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:37.925473 32183 tablet_service.cc:1511] Processing CreateTablet for tablet 0717a2686ee346b7a5a183e36fdfd173 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:37.926787 32183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0717a2686ee346b7a5a183e36fdfd173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.927335 32316 tablet_bootstrap.cc:492] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:37.927800 32316 ts_tablet_manager.cc:1403] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.223s	user 0.006s	sys 0.022s
I20260709 13:12:37.933528 32260 tablet_service.cc:1511] Processing CreateTablet for tablet 0717a2686ee346b7a5a183e36fdfd173 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:37.931842 32316 raft_consensus.cc:359] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:37.934772 32316 raft_consensus.cc:385] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.935103 32316 raft_consensus.cc:740] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.936647 32316 consensus_queue.cc:260] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:37.936791 32180 tablet_service.cc:1511] Processing CreateTablet for tablet ee05beb4092f41ddb391480547d90df0 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:37.938130 32180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee05beb4092f41ddb391480547d90df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.941100 32318 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.941608 32318 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:37.942436 32111 tablet_service.cc:1511] Processing CreateTablet for tablet 0717a2686ee346b7a5a183e36fdfd173 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:37.943781 32318 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:37.940802 32328 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:12:37.945974 32124 raft_consensus.cc:2393] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 1: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:12:37.946152 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:37.946547 32316 ts_tablet_manager.cc:1434] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
W20260709 13:12:37.948869 32165 leader_election.cc:343] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.949679 32239 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:37.949646 32112 tablet_service.cc:1511] Processing CreateTablet for tablet ee05beb4092f41ddb391480547d90df0 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:37.950628 32324 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.950868 32313 ts_tablet_manager.cc:1434] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.051s	user 0.003s	sys 0.006s
I20260709 13:12:37.954406 32313 tablet_bootstrap.cc:492] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:37.957365 32260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0717a2686ee346b7a5a183e36fdfd173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.959970 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:37.961851 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:37.962536 32123 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 0.
I20260709 13:12:37.963348 32316 tablet_bootstrap.cc:492] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:37.964555 32165 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:12:37.965868 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:12:37.967278 32089 leader_election.cc:343] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.967934 32318 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:37.968333 32318 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.969007 32328 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:37.971599 32314 tablet_bootstrap.cc:492] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:37.972113 32314 ts_tablet_manager.cc:1403] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.234s	user 0.008s	sys 0.009s
I20260709 13:12:37.969067 32318 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.972610 32105 tablet_service.cc:1511] Processing CreateTablet for tablet 7f6867d296184651b908c8f457d74e4a (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:37.974323 32324 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:37.975546 32105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f6867d296184651b908c8f457d74e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.977028 32182 tablet_service.cc:1511] Processing CreateTablet for tablet 7f6867d296184651b908c8f457d74e4a (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:37.979318 32261 tablet_service.cc:1511] Processing CreateTablet for tablet 7f6867d296184651b908c8f457d74e4a (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:37.979295 32314 raft_consensus.cc:359] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:37.981004 32261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f6867d296184651b908c8f457d74e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.982146 32182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f6867d296184651b908c8f457d74e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.985111 32111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0717a2686ee346b7a5a183e36fdfd173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.987367 32110 tablet_service.cc:1511] Processing CreateTablet for tablet e3aaa20c2aed4029bc6031c8bf5b7c71 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:37.988730 32110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3aaa20c2aed4029bc6031c8bf5b7c71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.989709 32186 tablet_service.cc:1511] Processing CreateTablet for tablet e3aaa20c2aed4029bc6031c8bf5b7c71 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:37.990989 32186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3aaa20c2aed4029bc6031c8bf5b7c71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.980508 32314 raft_consensus.cc:385] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.992913 32314 raft_consensus.cc:740] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.993697 32314 consensus_queue.cc:260] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:37.996182 32314 ts_tablet_manager.cc:1434] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.003s
I20260709 13:12:37.997860 32316 tablet_bootstrap.cc:654] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.001263 32112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee05beb4092f41ddb391480547d90df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.005690 32254 tablet_service.cc:1511] Processing CreateTablet for tablet ee05beb4092f41ddb391480547d90df0 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:38.007074 32254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee05beb4092f41ddb391480547d90df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.016407 32273 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:12:38.018419 32090 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:12:38.019237 32328 raft_consensus.cc:2804] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.019707 32328 raft_consensus.cc:697] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:12:38.020532 32328 consensus_queue.cc:237] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:12:38.023941 32258 tablet_service.cc:1511] Processing CreateTablet for tablet e3aaa20c2aed4029bc6031c8bf5b7c71 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:38.025321 32258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3aaa20c2aed4029bc6031c8bf5b7c71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.026432 32189 tablet_service.cc:1511] Processing CreateTablet for tablet c477d57775f149408ec3429ac3fd28f4 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:38.027765 32189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c477d57775f149408ec3429ac3fd28f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.033315 32313 tablet_bootstrap.cc:654] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.992406 32318 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.041215 32314 tablet_bootstrap.cc:492] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:38.046720 32318 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:38.048574 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:38.049219 32123 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.053553 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:12:38.054920 32165 leader_election.cc:343] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.064965 32316 tablet_bootstrap.cc:492] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:38.065798 32316 ts_tablet_manager.cc:1403] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.103s	user 0.007s	sys 0.005s
I20260709 13:12:38.065536 32105 tablet_service.cc:1511] Processing CreateTablet for tablet 0265ef82085f409c9de498f37135c550 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:38.066872 32105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0265ef82085f409c9de498f37135c550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.067621 32123 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:12:38.041376 32110 tablet_service.cc:1511] Processing CreateTablet for tablet c477d57775f149408ec3429ac3fd28f4 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:38.068975 32165 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:12:38.069722 32110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c477d57775f149408ec3429ac3fd28f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.069766 32318 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.069566 32316 raft_consensus.cc:359] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.070335 32316 raft_consensus.cc:385] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.070624 32316 raft_consensus.cc:740] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.070858 32263 tablet_service.cc:1511] Processing CreateTablet for tablet c477d57775f149408ec3429ac3fd28f4 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:38.072275 32263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c477d57775f149408ec3429ac3fd28f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.071707 32316 consensus_queue.cc:260] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.080717 32324 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.081395 32324 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.084462 32324 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:38.084391 32316 ts_tablet_manager.cc:1434] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:12:38.085320 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:38.086303 32316 tablet_bootstrap.cc:492] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:38.086568 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:38.087431 32182 tablet_service.cc:1511] Processing CreateTablet for tablet 0265ef82085f409c9de498f37135c550 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260709 13:12:38.087990 32239 leader_election.cc:343] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.088750 32182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0265ef82085f409c9de498f37135c550. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:38.089093 32238 leader_election.cc:343] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.089498 32238 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:38.093186 32324 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:38.094074 32316 tablet_bootstrap.cc:654] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.103631 32181 tablet_service.cc:1511] Processing CreateTablet for tablet 980228c6820f4e3aab0ccf2eace31a25 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:38.105145 32181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 980228c6820f4e3aab0ccf2eace31a25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.108736 32186 tablet_service.cc:1511] Processing CreateTablet for tablet 0cf85dc23ac44824a3668eb1b1f3aa42 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:38.110874 32186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cf85dc23ac44824a3668eb1b1f3aa42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.115406 32261 tablet_service.cc:1511] Processing CreateTablet for tablet 0265ef82085f409c9de498f37135c550 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:38.115797 32260 tablet_service.cc:1511] Processing CreateTablet for tablet 980228c6820f4e3aab0ccf2eace31a25 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:38.117161 32314 tablet_bootstrap.cc:654] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.120833 32261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0265ef82085f409c9de498f37135c550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.118446 32112 tablet_service.cc:1511] Processing CreateTablet for tablet 980228c6820f4e3aab0ccf2eace31a25 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:38.120000 32109 tablet_service.cc:1511] Processing CreateTablet for tablet 0cf85dc23ac44824a3668eb1b1f3aa42 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:38.123281 32260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 980228c6820f4e3aab0ccf2eace31a25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.126577 32112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 980228c6820f4e3aab0ccf2eace31a25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.128211 32316 tablet_bootstrap.cc:492] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:38.128142 32259 tablet_service.cc:1511] Processing CreateTablet for tablet 0cf85dc23ac44824a3668eb1b1f3aa42 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:38.128813 32316 ts_tablet_manager.cc:1403] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.003s
I20260709 13:12:38.129586 32259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cf85dc23ac44824a3668eb1b1f3aa42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.131996 32316 raft_consensus.cc:359] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.135607 32109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cf85dc23ac44824a3668eb1b1f3aa42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.099363 32318 raft_consensus.cc:697] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:12:38.143078 32318 consensus_queue.cc:237] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.144491 32020 catalog_manager.cc:5697] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 0 to 1, leader changed from <none> to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 1 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.136134 32110 tablet_service.cc:1511] Processing CreateTablet for tablet 1f415b574b5d492a8f6bbb83d1c0b0f6 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:38.134164 32316 raft_consensus.cc:385] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.152927 32316 raft_consensus.cc:740] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.153698 32316 consensus_queue.cc:260] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.165235 32316 ts_tablet_manager.cc:1434] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 13:12:38.180290 32263 tablet_service.cc:1511] Processing CreateTablet for tablet 1f415b574b5d492a8f6bbb83d1c0b0f6 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:38.184623 32180 tablet_service.cc:1511] Processing CreateTablet for tablet 06fe55ed2a71411c95a6ffde95f58270 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:38.186009 32180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06fe55ed2a71411c95a6ffde95f58270. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.189540 32111 tablet_service.cc:1511] Processing CreateTablet for tablet 06fe55ed2a71411c95a6ffde95f58270 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:38.184661 32182 tablet_service.cc:1511] Processing CreateTablet for tablet 1f415b574b5d492a8f6bbb83d1c0b0f6 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:38.193210 32258 tablet_service.cc:1511] Processing CreateTablet for tablet 06fe55ed2a71411c95a6ffde95f58270 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:38.194068 32182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f415b574b5d492a8f6bbb83d1c0b0f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.194976 32313 tablet_bootstrap.cc:492] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:38.195514 32313 ts_tablet_manager.cc:1403] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.241s	user 0.008s	sys 0.019s
I20260709 13:12:38.197333 32316 tablet_bootstrap.cc:492] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:38.199043 32313 raft_consensus.cc:359] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.199793 32313 raft_consensus.cc:385] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.200088 32313 raft_consensus.cc:740] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.197422 32263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f415b574b5d492a8f6bbb83d1c0b0f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.203675 32314 tablet_bootstrap.cc:492] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:38.204280 32314 ts_tablet_manager.cc:1403] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.163s	user 0.012s	sys 0.009s
I20260709 13:12:38.207068 32258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06fe55ed2a71411c95a6ffde95f58270. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.210173 32112 tablet_service.cc:1511] Processing CreateTablet for tablet a08fb71ae3e84c459773fd53510d6e04 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:38.211619 32314 raft_consensus.cc:359] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.213405 32314 raft_consensus.cc:385] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.213727 32314 raft_consensus.cc:740] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.216892 32314 consensus_queue.cc:260] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.219184 32314 ts_tablet_manager.cc:1434] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:12:38.225294 32314 tablet_bootstrap.cc:492] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:38.230408 32324 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.228320 32313 consensus_queue.cc:260] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.230967 32324 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.232997 32313 ts_tablet_manager.cc:1434] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.004s
I20260709 13:12:38.233726 32324 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:38.234016 32313 tablet_bootstrap.cc:492] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:38.234969 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:38.235252 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:12:38.236459 32238 leader_election.cc:343] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.229652 32110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f415b574b5d492a8f6bbb83d1c0b0f6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:38.237650 32239 leader_election.cc:343] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.241775 32108 tablet_service.cc:1511] Processing CreateTablet for tablet 7594a5601f24445092c404115861232c (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:38.242341 32313 tablet_bootstrap.cc:654] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.242727 32111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06fe55ed2a71411c95a6ffde95f58270. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.242059 32239 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:38.244700 32108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7594a5601f24445092c404115861232c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.252903 32112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a08fb71ae3e84c459773fd53510d6e04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.254329 32022 catalog_manager.cc:5697] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 0 to 1, leader changed from <none> to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:38.267643 32070 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:38.261023 32324 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:38.274240 32259 tablet_service.cc:1511] Processing CreateTablet for tablet a08fb71ae3e84c459773fd53510d6e04 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:38.275480 32259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a08fb71ae3e84c459773fd53510d6e04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.229416 32189 tablet_service.cc:1511] Processing CreateTablet for tablet a08fb71ae3e84c459773fd53510d6e04 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:38.281924 32189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a08fb71ae3e84c459773fd53510d6e04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.283599 32186 tablet_service.cc:1511] Processing CreateTablet for tablet 7594a5601f24445092c404115861232c (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:38.286738 32186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7594a5601f24445092c404115861232c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.312507 32314 tablet_bootstrap.cc:654] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.319355 32263 tablet_service.cc:1511] Processing CreateTablet for tablet 7594a5601f24445092c404115861232c (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:38.321018 32263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7594a5601f24445092c404115861232c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.298048 32316 tablet_bootstrap.cc:654] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.343425 32108 tablet_service.cc:1511] Processing CreateTablet for tablet 33cee01befe74212ba61fb0673034f4c (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:38.344084 32314 tablet_bootstrap.cc:492] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:38.345510 32108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33cee01befe74212ba61fb0673034f4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.345655 32260 tablet_service.cc:1511] Processing CreateTablet for tablet 375545897daf43fa925e7b181b2a634b (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:38.347102 32260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 375545897daf43fa925e7b181b2a634b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.344746 32314 ts_tablet_manager.cc:1403] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.120s	user 0.021s	sys 0.000s
I20260709 13:12:38.354879 32181 tablet_service.cc:1511] Processing CreateTablet for tablet 375545897daf43fa925e7b181b2a634b (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:38.356348 32181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 375545897daf43fa925e7b181b2a634b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.356937 32180 tablet_service.cc:1511] Processing CreateTablet for tablet 33cee01befe74212ba61fb0673034f4c (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:38.358285 32180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33cee01befe74212ba61fb0673034f4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.360875 32110 tablet_service.cc:1511] Processing CreateTablet for tablet 375545897daf43fa925e7b181b2a634b (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:38.362288 32110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 375545897daf43fa925e7b181b2a634b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.363598 32328 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.364287 32328 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.369207 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:38.369879 32273 raft_consensus.cc:2468] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
I20260709 13:12:38.370826 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:38.373967 32090 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:38.372910 32328 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:12:38.374733 32089 leader_election.cc:343] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.375072 32320 raft_consensus.cc:2804] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:38.375478 32320 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.375842 32320 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.388712 32109 tablet_service.cc:1511] Processing CreateTablet for tablet 80b1d1e505fa4808b5b8fabb554df626 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:38.389425 32313 tablet_bootstrap.cc:492] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:38.390069 32313 ts_tablet_manager.cc:1403] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.156s	user 0.070s	sys 0.049s
I20260709 13:12:38.379895 32259 tablet_service.cc:1511] Processing CreateTablet for tablet 33cee01befe74212ba61fb0673034f4c (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:38.398555 32259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33cee01befe74212ba61fb0673034f4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.398280 32313 raft_consensus.cc:359] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.399056 32260 tablet_service.cc:1511] Processing CreateTablet for tablet 80b1d1e505fa4808b5b8fabb554df626 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:38.399745 32313 raft_consensus.cc:385] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.400332 32260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80b1d1e505fa4808b5b8fabb554df626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.409754 32186 tablet_service.cc:1511] Processing CreateTablet for tablet 80b1d1e505fa4808b5b8fabb554df626 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:38.410748 32112 tablet_service.cc:1511] Processing CreateTablet for tablet 0a452e0dc995431dac6d83c19fd00a32 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:38.411105 32186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80b1d1e505fa4808b5b8fabb554df626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.414459 32109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80b1d1e505fa4808b5b8fabb554df626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.416380 32180 tablet_service.cc:1511] Processing CreateTablet for tablet 0a452e0dc995431dac6d83c19fd00a32 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:38.417599 32180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a452e0dc995431dac6d83c19fd00a32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.417680 32112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a452e0dc995431dac6d83c19fd00a32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.421087 32314 raft_consensus.cc:359] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.421839 32314 raft_consensus.cc:385] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.422111 32314 raft_consensus.cc:740] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.422833 32314 consensus_queue.cc:260] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.400353 32313 raft_consensus.cc:740] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.430342 32324 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.430907 32324 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.431582 32316 tablet_bootstrap.cc:492] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:38.432071 32316 ts_tablet_manager.cc:1403] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.255s	user 0.020s	sys 0.005s
I20260709 13:12:38.425218 32314 ts_tablet_manager.cc:1434] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.071s	user 0.002s	sys 0.005s
I20260709 13:12:38.436252 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:12:38.440651 32239 leader_election.cc:343] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.441206 32263 tablet_service.cc:1511] Processing CreateTablet for tablet 0a452e0dc995431dac6d83c19fd00a32 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:38.443238 32111 tablet_service.cc:1511] Processing CreateTablet for tablet ab526b36e2374499ab98f72175e85ec3 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:38.443296 32189 tablet_service.cc:1511] Processing CreateTablet for tablet ab526b36e2374499ab98f72175e85ec3 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:38.444887 32111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab526b36e2374499ab98f72175e85ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.446554 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:12:38.448060 32238 leader_election.cc:343] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.445362 32324 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:38.448523 32238 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:38.449436 32320 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.449910 32324 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:38.451586 32316 raft_consensus.cc:359] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.454847 32316 raft_consensus.cc:385] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.444871 32189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab526b36e2374499ab98f72175e85ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.455199 32316 raft_consensus.cc:740] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.452452 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:38.455922 32313 consensus_queue.cc:260] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:12:38.457887 32089 leader_election.cc:343] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.452251 32320 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:38.458504 32261 tablet_service.cc:1511] Processing CreateTablet for tablet ab526b36e2374499ab98f72175e85ec3 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:38.456199 32316 consensus_queue.cc:260] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.462627 32316 ts_tablet_manager.cc:1434] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.030s	user 0.002s	sys 0.006s
I20260709 13:12:38.467711 32112 tablet_service.cc:1511] Processing CreateTablet for tablet f89f60951b564577beff269254a33cde (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:38.468190 32182 tablet_service.cc:1511] Processing CreateTablet for tablet f89f60951b564577beff269254a33cde (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:38.469136 32112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f89f60951b564577beff269254a33cde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.469651 32182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f89f60951b564577beff269254a33cde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.471802 32314 tablet_bootstrap.cc:492] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:38.481230 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:38.481849 32273 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.485737 32320 consensus_queue.cc:1048] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:38.486117 32316 tablet_bootstrap.cc:492] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:38.487942 32261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab526b36e2374499ab98f72175e85ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.489797 32328 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.490312 32328 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.459018 32313 ts_tablet_manager.cc:1434] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.069s	user 0.009s	sys 0.000s
I20260709 13:12:38.493085 32263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a452e0dc995431dac6d83c19fd00a32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.493589 32313 tablet_bootstrap.cc:492] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:38.493788 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:38.494424 32199 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
I20260709 13:12:38.495872 32089 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:38.498292 32316 tablet_bootstrap.cc:654] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.511603 32259 tablet_service.cc:1511] Processing CreateTablet for tablet f89f60951b564577beff269254a33cde (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:38.512954 32259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f89f60951b564577beff269254a33cde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.514353 32273 raft_consensus.cc:2468] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:12:38.519707 32090 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:12:38.516103 32313 tablet_bootstrap.cc:654] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.516830 32320 raft_consensus.cc:2804] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:38.520918 32320 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.521378 32320 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.521768 32328 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:38.522426 32328 raft_consensus.cc:2804] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.523027 32328 raft_consensus.cc:697] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:12:38.523442 32110 tablet_service.cc:1511] Processing CreateTablet for tablet 7049b5c289c247ea8dda13c92984c95d (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:38.525002 32110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7049b5c289c247ea8dda13c92984c95d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.533303 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:12:38.534700 32090 leader_election.cc:343] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.537876 32181 tablet_service.cc:1511] Processing CreateTablet for tablet 7049b5c289c247ea8dda13c92984c95d (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:38.540328 32260 tablet_service.cc:1511] Processing CreateTablet for tablet 7049b5c289c247ea8dda13c92984c95d (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:38.541957 32260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7049b5c289c247ea8dda13c92984c95d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.551380 32181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7049b5c289c247ea8dda13c92984c95d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.554816 32314 tablet_bootstrap.cc:654] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.554934 32320 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.524178 32328 consensus_queue.cc:237] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.568403 32182 tablet_service.cc:1511] Processing CreateTablet for tablet a75997deb5a741f998b671928aad3637 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:38.569744 32182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a75997deb5a741f998b671928aad3637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.574007 32112 tablet_service.cc:1511] Processing CreateTablet for tablet a75997deb5a741f998b671928aad3637 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:38.577291 32112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a75997deb5a741f998b671928aad3637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.575759 32258 tablet_service.cc:1511] Processing CreateTablet for tablet a75997deb5a741f998b671928aad3637 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:38.584692 32258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a75997deb5a741f998b671928aad3637. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:38.593000 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 97220.8us
I20260709 13:12:38.595458 32189 tablet_service.cc:1511] Processing CreateTablet for tablet cb6ba4c5418c4645a86d8c0dd19e918b (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:38.596765 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:38.597473 32198 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.597875 32189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb6ba4c5418c4645a86d8c0dd19e918b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.599836 32318 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.600330 32318 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.602505 32318 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:38.604739 32198 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
W20260709 13:12:38.605711 32089 consensus_peers.cc:597] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:38.609365 32318 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.627919 32320 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:38.625968 32089 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:38.634495 32111 tablet_service.cc:1511] Processing CreateTablet for tablet cb6ba4c5418c4645a86d8c0dd19e918b (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:38.634884 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:38.635779 32111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb6ba4c5418c4645a86d8c0dd19e918b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.635931 32316 tablet_bootstrap.cc:492] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:38.636366 32316 ts_tablet_manager.cc:1403] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.150s	user 0.024s	sys 0.020s
I20260709 13:12:38.636854 32320 raft_consensus.cc:2804] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.637208 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:38.637369 32320 raft_consensus.cc:697] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:12:38.638243 32320 consensus_queue.cc:237] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:12:38.639253 32165 leader_election.cc:343] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.629418 32318 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.641185 32318 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:38.641458 32261 tablet_service.cc:1511] Processing CreateTablet for tablet cb6ba4c5418c4645a86d8c0dd19e918b (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
W20260709 13:12:38.642377 32090 leader_election.cc:343] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.644349 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:38.648001 32112 tablet_service.cc:1511] Processing CreateTablet for tablet 002126350f9348faac039e490fafb4d7 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:38.649607 32112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002126350f9348faac039e490fafb4d7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:38.659338 32165 leader_election.cc:343] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.661022 32271 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.632045 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:38.664968 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:38.639249 32316 raft_consensus.cc:359] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.671218 32316 raft_consensus.cc:385] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.671679 32316 raft_consensus.cc:740] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.673724 32261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb6ba4c5418c4645a86d8c0dd19e918b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.672761 32316 consensus_queue.cc:260] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.674657 32022 catalog_manager.cc:5697] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 0 to 1, leader changed from <none> to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 1 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.678784 32189 tablet_service.cc:1511] Processing CreateTablet for tablet 002126350f9348faac039e490fafb4d7 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
W20260709 13:12:38.680634 32165 leader_election.cc:343] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.681140 32165 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:38.683730 32313 tablet_bootstrap.cc:492] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:38.684219 32313 ts_tablet_manager.cc:1403] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.191s	user 0.018s	sys 0.008s
I20260709 13:12:38.687103 32189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002126350f9348faac039e490fafb4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.688788 32316 ts_tablet_manager.cc:1434] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260709 13:12:38.689045 32318 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:38.689774 32318 consensus_queue.cc:1048] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:38.711433 32259 tablet_service.cc:1511] Processing CreateTablet for tablet 002126350f9348faac039e490fafb4d7 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:38.712710 32354 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.713029 32259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002126350f9348faac039e490fafb4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.713201 32354 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.715390 32354 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:38.728520 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:38.732115 32198 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
I20260709 13:12:38.719856 32123 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 0.
I20260709 13:12:38.733460 32089 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:38.734336 32354 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:38.734472 32165 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:12:38.734725 32354 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.735133 32354 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.711290 32313 raft_consensus.cc:359] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.736833 32313 raft_consensus.cc:385] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.737149 32313 raft_consensus.cc:740] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.737869 32313 consensus_queue.cc:260] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.738967 32318 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:38.739333 32318 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.739692 32318 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.740257 32313 ts_tablet_manager.cc:1434] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.001s
I20260709 13:12:38.742651 32316 tablet_bootstrap.cc:492] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:38.746671 32354 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.749666 32318 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.752367 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:38.753167 32123 raft_consensus.cc:2393] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 1: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:12:38.753883 32354 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:38.755666 32363 consensus_queue.cc:1048] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:38.756281 32316 tablet_bootstrap.cc:654] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.756122 32318 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:38.758235 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:12:38.761549 32090 leader_election.cc:343] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.762820 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:38.764020 32112 tablet_service.cc:1511] Processing CreateTablet for tablet d3a2e596cd6e4340bfea0e5a0e0609d7 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:38.764138 32020 catalog_manager.cc:5697] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 0 to 1, leader changed from <none> to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 1 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:38.765030 32090 leader_election.cc:343] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.766963 32313 tablet_bootstrap.cc:492] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:38.767500 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:38.768966 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:38.769761 32198 raft_consensus.cc:2393] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 1: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:12:38.769706 32110 tablet_service.cc:1511] Processing CreateTablet for tablet 9d001b18973b4cbf86649781d9445577 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:38.771849 32189 tablet_service.cc:1511] Processing CreateTablet for tablet d3a2e596cd6e4340bfea0e5a0e0609d7 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
W20260709 13:12:38.773584 32165 leader_election.cc:343] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.774072 32165 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:38.775069 32089 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:12:38.776249 32363 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:38.776715 32320 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:38.777295 32260 tablet_service.cc:1511] Processing CreateTablet for tablet 9d001b18973b4cbf86649781d9445577 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:38.772912 32259 tablet_service.cc:1511] Processing CreateTablet for tablet d3a2e596cd6e4340bfea0e5a0e0609d7 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:38.778502 32260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d001b18973b4cbf86649781d9445577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.779042 32259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3a2e596cd6e4340bfea0e5a0e0609d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.780249 32181 tablet_service.cc:1511] Processing CreateTablet for tablet 9d001b18973b4cbf86649781d9445577 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:38.773013 32189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3a2e596cd6e4340bfea0e5a0e0609d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.792866 32181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d001b18973b4cbf86649781d9445577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.780260 32110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d001b18973b4cbf86649781d9445577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.797420 32111 tablet_service.cc:1511] Processing CreateTablet for tablet 359bcc57ad77431cae0df4de7bf9b026 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:38.797580 32186 tablet_service.cc:1511] Processing CreateTablet for tablet 359bcc57ad77431cae0df4de7bf9b026 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:38.797928 32263 tablet_service.cc:1511] Processing CreateTablet for tablet 359bcc57ad77431cae0df4de7bf9b026 (DEFAULT_TABLE table=test-workload [id=9b9dc20f98e547b59efac9c530f28125]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:38.798761 32111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 359bcc57ad77431cae0df4de7bf9b026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.798839 32186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 359bcc57ad77431cae0df4de7bf9b026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.798943 32263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 359bcc57ad77431cae0df4de7bf9b026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.800884 32112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3a2e596cd6e4340bfea0e5a0e0609d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.821213 32324 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.821703 32324 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.823305 32313 tablet_bootstrap.cc:654] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.823712 32324 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:38.824918 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:38.826056 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:38.827078 32314 tablet_bootstrap.cc:492] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:38.831207 32198 raft_consensus.cc:2393] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 1: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:12:38.833432 32238 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:38.834559 32314 ts_tablet_manager.cc:1403] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.363s	user 0.018s	sys 0.021s
I20260709 13:12:38.837412 32314 raft_consensus.cc:359] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.838073 32314 raft_consensus.cc:385] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.839612 32318 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.840056 32318 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.838357 32314 raft_consensus.cc:740] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.847756 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:38.848344 32318 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:38.843432 32324 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.850533 32314 consensus_queue.cc:260] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:12:38.852670 32165 leader_election.cc:343] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.852857 32314 ts_tablet_manager.cc:1434] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:12:38.853909 32314 tablet_bootstrap.cc:492] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:38.853711 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:38.856568 32270 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 0.
I20260709 13:12:38.855958 32324 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:38.861110 32165 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:38.874748 32370 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:38.875280 32370 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.875689 32370 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.880349 32314 tablet_bootstrap.cc:654] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.887521 32316 tablet_bootstrap.cc:492] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:38.888032 32316 ts_tablet_manager.cc:1403] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.167s	user 0.019s	sys 0.003s
I20260709 13:12:38.890851 32316 raft_consensus.cc:359] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.891539 32316 raft_consensus.cc:385] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.891796 32316 raft_consensus.cc:740] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.892352 32316 consensus_queue.cc:260] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.894789 32313 tablet_bootstrap.cc:492] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:38.894503 32370 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.895361 32313 ts_tablet_manager.cc:1403] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.129s	user 0.008s	sys 0.015s
I20260709 13:12:38.896763 32370 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:38.898661 32320 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.899152 32320 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.899246 32313 raft_consensus.cc:359] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.900072 32313 raft_consensus.cc:385] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.900460 32313 raft_consensus.cc:740] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.901319 32320 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:38.901284 32313 consensus_queue.cc:260] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.902437 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:38.903093 32270 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.904112 32313 ts_tablet_manager.cc:1434] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:38.904632 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:38.905239 32313 tablet_bootstrap.cc:492] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:38.905282 32271 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
I20260709 13:12:38.902976 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:38.907581 32090 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:38.908504 32320 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:38.909026 32320 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.909421 32320 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.910804 32270 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
W20260709 13:12:38.912103 32165 leader_election.cc:343] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.912688 32316 ts_tablet_manager.cc:1434] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.004s
I20260709 13:12:38.913419 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:38.913498 32165 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:38.914096 32198 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
I20260709 13:12:38.916024 32370 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.916529 32370 raft_consensus.cc:697] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:12:38.917814 32314 tablet_bootstrap.cc:492] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:38.917675 32370 consensus_queue.cc:237] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.918247 32314 ts_tablet_manager.cc:1403] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.065s	user 0.011s	sys 0.000s
I20260709 13:12:38.921850 32313 tablet_bootstrap.cc:654] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.923770 32320 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.925781 32316 tablet_bootstrap.cc:492] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:38.926702 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:38.927001 32320 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:38.927353 32198 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.928067 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:38.928639 32270 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.932931 32316 tablet_bootstrap.cc:654] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.921346 32314 raft_consensus.cc:359] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.936236 32270 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:12:38.936409 32314 raft_consensus.cc:385] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.936417 32198 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:12:38.936843 32314 raft_consensus.cc:740] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.937657 32090 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:38.937726 32314 consensus_queue.cc:260] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.939208 32354 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.939658 32354 raft_consensus.cc:697] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:12:38.939711 32313 tablet_bootstrap.cc:492] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:38.940281 32313 ts_tablet_manager.cc:1403] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.006s
I20260709 13:12:38.940430 32314 ts_tablet_manager.cc:1434] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:12:38.940502 32354 consensus_queue.cc:237] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.941627 32314 tablet_bootstrap.cc:492] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:38.943004 32313 raft_consensus.cc:359] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.944454 32313 raft_consensus.cc:385] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.944803 32313 raft_consensus.cc:740] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.945787 32313 consensus_queue.cc:260] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.947134 32020 catalog_manager.cc:5697] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 0 to 1, leader changed from <none> to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.948725 32313 ts_tablet_manager.cc:1434] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:12:38.949831 32313 tablet_bootstrap.cc:492] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:38.948810 32314 tablet_bootstrap.cc:654] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.966949 32021 catalog_manager.cc:5697] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 0 to 1, leader changed from <none> to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 1 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.988978 32313 tablet_bootstrap.cc:654] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.989657 32316 tablet_bootstrap.cc:492] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:38.990095 32316 ts_tablet_manager.cc:1403] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.065s	user 0.031s	sys 0.017s
I20260709 13:12:38.990212 32314 tablet_bootstrap.cc:492] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:38.990686 32314 ts_tablet_manager.cc:1403] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.016s
I20260709 13:12:38.992256 32316 raft_consensus.cc:359] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.993022 32316 raft_consensus.cc:385] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.993258 32316 raft_consensus.cc:740] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.993250 32314 raft_consensus.cc:359] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.994124 32314 raft_consensus.cc:385] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.994243 32313 tablet_bootstrap.cc:492] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:38.993947 32316 consensus_queue.cc:260] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.994427 32314 raft_consensus.cc:740] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.994652 32313 ts_tablet_manager.cc:1403] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.017s
I20260709 13:12:38.995362 32314 consensus_queue.cc:260] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:38.996054 32316 ts_tablet_manager.cc:1434] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:12:38.997305 32316 tablet_bootstrap.cc:492] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:38.997421 32313 raft_consensus.cc:359] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:12:38.998111 32313 raft_consensus.cc:385] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.998404 32313 raft_consensus.cc:740] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.999197 32313 consensus_queue.cc:260] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:12:39.002182 32314 ts_tablet_manager.cc:1434] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:12:39.003152 32314 tablet_bootstrap.cc:492] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:39.003922 32313 ts_tablet_manager.cc:1434] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:12:39.004828 32313 tablet_bootstrap.cc:492] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:39.008394 32316 tablet_bootstrap.cc:654] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.008944 32314 tablet_bootstrap.cc:654] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.010707 32313 tablet_bootstrap.cc:654] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.015214 32314 tablet_bootstrap.cc:492] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:39.015690 32314 ts_tablet_manager.cc:1403] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.003s
I20260709 13:12:39.019062 32314 raft_consensus.cc:359] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.019757 32314 raft_consensus.cc:385] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.020051 32314 raft_consensus.cc:740] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.020740 32314 consensus_queue.cc:260] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.022748 32314 ts_tablet_manager.cc:1434] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:12:39.023854 32314 tablet_bootstrap.cc:492] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:39.025070 32324 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.025579 32324 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.027774 32324 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:39.028342 32316 tablet_bootstrap.cc:492] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:39.028570 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:39.028823 32316 ts_tablet_manager.cc:1403] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.002s
I20260709 13:12:39.029206 32123 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:39.029531 32314 tablet_bootstrap.cc:654] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.030386 32239 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:39.030985 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:39.031347 32324 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.031621 32198 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:39.031738 32324 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.031580 32316 raft_consensus.cc:359] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.032510 32324 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.034165 32313 tablet_bootstrap.cc:492] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:39.034662 32313 ts_tablet_manager.cc:1403] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.004s
I20260709 13:12:39.032401 32316 raft_consensus.cc:385] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.039351 32316 raft_consensus.cc:740] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.040441 32316 consensus_queue.cc:260] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.041999 32324 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.038393 32313 raft_consensus.cc:359] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.043061 32313 raft_consensus.cc:385] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.043491 32313 raft_consensus.cc:740] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.044484 32313 consensus_queue.cc:260] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.045609 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:39.046270 32123 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.046689 32313 ts_tablet_manager.cc:1434] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 13:12:39.047274 32314 tablet_bootstrap.cc:492] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:39.047622 32313 tablet_bootstrap.cc:492] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:39.047757 32314 ts_tablet_manager.cc:1403] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.004s
I20260709 13:12:39.050413 32314 raft_consensus.cc:359] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.051288 32314 raft_consensus.cc:385] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.051671 32314 raft_consensus.cc:740] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.052469 32314 consensus_queue.cc:260] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.058059 32316 ts_tablet_manager.cc:1434] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.001s
I20260709 13:12:39.059172 32316 tablet_bootstrap.cc:492] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:39.060655 32314 ts_tablet_manager.cc:1434] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:12:39.061745 32314 tablet_bootstrap.cc:492] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:39.064873 32123 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:39.065099 32316 tablet_bootstrap.cc:654] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.066779 32313 tablet_bootstrap.cc:654] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.067806 32314 tablet_bootstrap.cc:654] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.069715 32324 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:39.070488 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:39.071281 32198 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.074506 32239 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:39.075956 32324 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.080329 32324 raft_consensus.cc:697] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:12:39.081658 32324 consensus_queue.cc:237] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.084260 32198 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:39.092720 32316 tablet_bootstrap.cc:492] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:39.093686 32316 ts_tablet_manager.cc:1403] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.035s	user 0.022s	sys 0.007s
I20260709 13:12:39.093988 32314 tablet_bootstrap.cc:492] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:39.094533 32314 ts_tablet_manager.cc:1403] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.003s
I20260709 13:12:39.098039 32316 raft_consensus.cc:359] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.098451 32314 raft_consensus.cc:359] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.098906 32316 raft_consensus.cc:385] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.099098 32314 raft_consensus.cc:385] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.099310 32316 raft_consensus.cc:740] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.099385 32314 raft_consensus.cc:740] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.100802 32313 tablet_bootstrap.cc:492] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:39.100160 32316 consensus_queue.cc:260] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.101263 32313 ts_tablet_manager.cc:1403] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.054s	user 0.019s	sys 0.019s
I20260709 13:12:39.101011 32314 consensus_queue.cc:260] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.102947 32316 ts_tablet_manager.cc:1434] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:12:39.103421 32314 ts_tablet_manager.cc:1434] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:12:39.101468 32020 catalog_manager.cc:5697] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:39.104053 32316 tablet_bootstrap.cc:492] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:39.103993 32313 raft_consensus.cc:359] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.104785 32313 raft_consensus.cc:385] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.105074 32313 raft_consensus.cc:740] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.105806 32313 consensus_queue.cc:260] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.106882 32314 tablet_bootstrap.cc:492] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:39.107796 32313 ts_tablet_manager.cc:1434] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:39.113642 32314 tablet_bootstrap.cc:654] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.118494 32316 tablet_bootstrap.cc:654] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.125821 32370 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.126343 32198 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.128177 32313 tablet_bootstrap.cc:492] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:39.126354 32370 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.131130 32316 tablet_bootstrap.cc:492] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:39.131753 32316 ts_tablet_manager.cc:1403] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.007s
I20260709 13:12:39.131599 32370 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:39.134738 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:39.135308 32316 raft_consensus.cc:359] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.135998 32316 raft_consensus.cc:385] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.136380 32316 raft_consensus.cc:740] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.137055 32316 consensus_queue.cc:260] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.137279 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:39.138845 32316 ts_tablet_manager.cc:1434] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:12:39.139698 32316 tablet_bootstrap.cc:492] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:39.135958 32270 raft_consensus.cc:2393] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 1: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:12:39.144515 32316 tablet_bootstrap.cc:654] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.144662 32165 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:39.145620 32370 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.146555 32328 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:39.135203 32313 tablet_bootstrap.cc:654] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.181679 32370 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:39.185981 32324 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.186830 32324 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.186159 32362 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.195070 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:39.195947 32197 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:39.198199 32238 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:12:39.199148 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:39.199517 32384 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.199932 32384 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.200258 32384 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.191780 32324 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:39.197010 32362 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.204731 32362 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:39.205675 32123 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:39.206117 32328 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.206598 32328 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.208630 32328 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:39.209070 32328 consensus_queue.cc:1048] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:39.210865 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:39.211663 32271 raft_consensus.cc:2393] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 1: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:12:39.212725 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:39.219415 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:39.220176 32199 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
I20260709 13:12:39.220227 32328 consensus_queue.cc:1048] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:39.222549 32324 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.223254 32324 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.226743 32314 tablet_bootstrap.cc:492] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:39.227313 32314 ts_tablet_manager.cc:1403] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.121s	user 0.027s	sys 0.040s
I20260709 13:12:39.230335 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:39.231002 32314 raft_consensus.cc:359] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.231971 32314 raft_consensus.cc:385] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:12:39.232038 32239 leader_election.cc:343] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.232436 32314 raft_consensus.cc:740] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.226672 32324 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:39.234153 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:39.234494 32324 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.233057 32354 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:39.235262 32324 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.237685 32324 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:12:39.241295 32238 leader_election.cc:343] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.241824 32238 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:39.242918 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:39.243705 32196 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:39.222020 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:39.233376 32316 tablet_bootstrap.cc:492] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:39.244817 32316 ts_tablet_manager.cc:1403] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.105s	user 0.050s	sys 0.023s
I20260709 13:12:39.245554 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:39.247428 32089 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:39.253777 32362 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.233404 32314 consensus_queue.cc:260] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.254004 32089 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:12:39.248884 32316 raft_consensus.cc:359] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.254623 32316 raft_consensus.cc:385] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.254905 32316 raft_consensus.cc:740] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.255924 32313 tablet_bootstrap.cc:492] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:39.255656 32316 consensus_queue.cc:260] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.256021 32314 ts_tablet_manager.cc:1434] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:12:39.256369 32313 ts_tablet_manager.cc:1403] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.129s	user 0.025s	sys 0.043s
I20260709 13:12:39.257561 32314 tablet_bootstrap.cc:492] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:39.258097 32316 ts_tablet_manager.cc:1434] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:12:39.258925 32316 tablet_bootstrap.cc:492] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:39.259703 32313 raft_consensus.cc:359] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.260346 32313 raft_consensus.cc:385] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.217031 32384 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.260637 32313 raft_consensus.cc:740] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.261278 32270 raft_consensus.cc:2393] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 1: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:12:39.246946 32238 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:12:39.261544 32362 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.262246 32324 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.261189 32123 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:39.262689 32324 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.262334 32362 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.263959 32324 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.261314 32313 consensus_queue.cc:260] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.265739 32316 tablet_bootstrap.cc:654] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.268018 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:39.269380 32354 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.270603 32384 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:39.271481 32313 ts_tablet_manager.cc:1434] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:12:39.272627 32313 tablet_bootstrap.cc:492] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:39.273823 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:39.274485 32197 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.280287 32313 tablet_bootstrap.cc:654] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:39.281881 32070 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:39.283727 32314 tablet_bootstrap.cc:654] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.291442 32354 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:39.284657 32370 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.310698 32370 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.313087 32370 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:39.322255 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:39.323226 32124 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 0.
I20260709 13:12:39.251535 32395 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:39.293895 32197 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:39.288422 32362 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.301488 32314 tablet_bootstrap.cc:492] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:39.303531 32372 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.325062 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:39.345152 32123 raft_consensus.cc:2393] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 1: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:12:39.346292 32362 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:39.347575 32314 ts_tablet_manager.cc:1403] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.090s	user 0.010s	sys 0.005s
I20260709 13:12:39.349390 32372 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.351308 32314 raft_consensus.cc:359] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.352507 32372 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:39.309508 32316 tablet_bootstrap.cc:492] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:39.335036 32165 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:39.357769 32316 ts_tablet_manager.cc:1403] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.099s	user 0.022s	sys 0.020s
I20260709 13:12:39.353982 32238 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:39.359566 32384 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.360040 32384 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.362232 32384 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:39.361729 32316 raft_consensus.cc:359] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.362774 32316 raft_consensus.cc:385] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.363214 32316 raft_consensus.cc:740] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.363873 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:39.364156 32316 consensus_queue.cc:260] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.364969 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:39.365288 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:39.365628 32123 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 0.
I20260709 13:12:39.366039 32124 raft_consensus.cc:2393] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 1: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:12:39.362789 32384 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.367057 32363 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.367439 32363 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.308295 32324 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.364283 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:39.368419 32199 raft_consensus.cc:2393] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 1: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:12:39.367630 32316 ts_tablet_manager.cc:1434] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
W20260709 13:12:39.368340 32165 leader_election.cc:343] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.367775 32363 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.370265 32318 consensus_queue.cc:1048] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:39.371366 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:39.372217 32197 raft_consensus.cc:2393] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 1: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:12:39.370507 32165 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:39.355422 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:39.373068 32238 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:39.373248 32318 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.373924 32318 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.374157 32395 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.374370 32318 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.379714 32363 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.373068 32272 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 0.
I20260709 13:12:39.385591 32316 tablet_bootstrap.cc:492] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:39.386191 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:39.386834 32124 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.392292 32324 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:39.394165 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:39.352327 32314 raft_consensus.cc:385] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.399060 32362 consensus_queue.cc:1048] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:39.399266 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:39.400307 32123 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.397790 32314 raft_consensus.cc:740] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.394892 32198 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.405263 32314 consensus_queue.cc:260] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.412859 32313 tablet_bootstrap.cc:492] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:39.413416 32313 ts_tablet_manager.cc:1403] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.141s	user 0.032s	sys 0.038s
I20260709 13:12:39.414073 32395 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:39.422408 32313 raft_consensus.cc:359] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.423084 32313 raft_consensus.cc:385] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.423350 32313 raft_consensus.cc:740] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.423975 32313 consensus_queue.cc:260] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.426098 32124 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:39.415019 32363 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:39.426689 32314 ts_tablet_manager.cc:1434] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.079s	user 0.005s	sys 0.005s
I20260709 13:12:39.429155 32239 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:39.429422 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:39.430498 32123 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:12:39.432109 32313 ts_tablet_manager.cc:1434] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:12:39.433768 32314 tablet_bootstrap.cc:492] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:39.434760 32313 tablet_bootstrap.cc:492] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:39.421059 32384 raft_consensus.cc:697] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:12:39.441088 32384 consensus_queue.cc:237] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.446575 32354 consensus_queue.cc:1048] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:39.447333 32402 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.448257 32402 raft_consensus.cc:697] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:12:39.449347 32402 consensus_queue.cc:237] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.433220 32318 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.464002 32198 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:39.464283 32318 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:12:39.455241 32165 leader_election.cc:343] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.468067 32165 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:12:39.470419 32090 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:12:39.471371 32354 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:39.475648 32314 tablet_bootstrap.cc:654] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.475523 32316 tablet_bootstrap.cc:654] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.483266 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:39.486927 32271 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.476099 32318 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.493758 32328 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.494035 32318 raft_consensus.cc:697] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:12:39.494264 32328 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.494904 32318 consensus_queue.cc:237] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.480755 32363 consensus_queue.cc:1048] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:12:39.498538 32328 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:39.500061 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:39.477202 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:39.502528 32313 tablet_bootstrap.cc:654] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.504065 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:39.486037 32384 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:12:39.501065 32123 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:39.506032 32089 leader_election.cc:343] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.500356 32271 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:12:39.519222 32022 catalog_manager.cc:5697] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:39.515045 32090 leader_election.cc:343] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.526383 32090 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:12:39.527120 32316 tablet_bootstrap.cc:492] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:39.528090 32362 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:39.527832 32316 ts_tablet_manager.cc:1403] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.142s	user 0.013s	sys 0.002s
I20260709 13:12:39.543802 32316 raft_consensus.cc:359] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.544834 32316 raft_consensus.cc:385] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.545194 32316 raft_consensus.cc:740] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.549106 32314 tablet_bootstrap.cc:492] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:39.549610 32314 ts_tablet_manager.cc:1403] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.116s	user 0.019s	sys 0.001s
I20260709 13:12:39.546960 32316 consensus_queue.cc:260] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.535234 32123 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:12:39.553627 32316 ts_tablet_manager.cc:1434] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:12:39.554432 32316 tablet_bootstrap.cc:492] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:39.550994 32165 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:12:39.557427 32384 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.557794 32363 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.557946 32384 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.559262 32363 raft_consensus.cc:697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:12:39.560496 32363 consensus_queue.cc:237] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.573786 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:39.574739 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:39.568369 32384 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:12:39.575850 32238 leader_election.cc:343] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.582837 32021 catalog_manager.cc:5697] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:39.586674 32314 raft_consensus.cc:359] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.597879 32314 raft_consensus.cc:385] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.598210 32314 raft_consensus.cc:740] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
W20260709 13:12:39.588301 32239 leader_election.cc:343] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.599251 32239 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:39.589077 32384 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:39.601346 32384 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:39.604740 32314 consensus_queue.cc:260] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.607100 32314 ts_tablet_manager.cc:1434] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.000s
I20260709 13:12:39.607972 32314 tablet_bootstrap.cc:492] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:39.612222 32313 tablet_bootstrap.cc:492] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:39.612730 32313 ts_tablet_manager.cc:1403] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.178s	user 0.011s	sys 0.007s
I20260709 13:12:39.614120 32314 tablet_bootstrap.cc:654] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.615713 32313 raft_consensus.cc:359] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.596391 32316 tablet_bootstrap.cc:654] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.616415 32313 raft_consensus.cc:385] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.620070 32313 raft_consensus.cc:740] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.621109 32313 consensus_queue.cc:260] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.619912 32020 catalog_manager.cc:5697] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 0 to 1, leader changed from <none> to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:39.623869 32313 ts_tablet_manager.cc:1434] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:12:39.625089 32313 tablet_bootstrap.cc:492] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:39.627705 32402 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.628197 32402 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.633421 32402 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:39.634189 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:12:39.636793 32239 leader_election.cc:343] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.638624 32316 tablet_bootstrap.cc:492] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:39.639139 32316 ts_tablet_manager.cc:1403] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.085s	user 0.012s	sys 0.001s
I20260709 13:12:39.637951 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:12:39.641978 32238 leader_election.cc:343] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.642511 32238 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:39.643661 32402 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:39.646756 32313 tablet_bootstrap.cc:654] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.649179 32314 tablet_bootstrap.cc:492] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:39.649693 32314 ts_tablet_manager.cc:1403] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.012s
I20260709 13:12:39.653177 32314 raft_consensus.cc:359] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.654075 32314 raft_consensus.cc:385] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.654424 32314 raft_consensus.cc:740] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.655270 32314 consensus_queue.cc:260] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.646406 32316 raft_consensus.cc:359] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.656345 32316 raft_consensus.cc:385] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.656731 32316 raft_consensus.cc:740] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.657209 32020 catalog_manager.cc:5697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 0 to 1, leader changed from <none> to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:39.657693 32316 consensus_queue.cc:260] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.660014 32316 ts_tablet_manager.cc:1434] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:12:39.660917 32316 tablet_bootstrap.cc:492] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:39.661446 32313 tablet_bootstrap.cc:492] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:39.661870 32313 ts_tablet_manager.cc:1403] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.009s
I20260709 13:12:39.662781 32314 ts_tablet_manager.cc:1434] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.004s
I20260709 13:12:39.663635 32314 tablet_bootstrap.cc:492] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:39.664456 32313 raft_consensus.cc:359] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.665167 32313 raft_consensus.cc:385] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.665416 32313 raft_consensus.cc:740] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.666049 32313 consensus_queue.cc:260] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.668175 32313 ts_tablet_manager.cc:1434] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:39.669064 32313 tablet_bootstrap.cc:492] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:39.669607 32314 tablet_bootstrap.cc:654] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.674453 32320 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.674996 32320 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.677327 32320 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:39.678442 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:39.678716 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:39.679088 32273 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
I20260709 13:12:39.679436 32199 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
I20260709 13:12:39.680377 32313 tablet_bootstrap.cc:654] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.680662 32089 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:39.682158 32320 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.682509 32320 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.682832 32320 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.688922 32316 tablet_bootstrap.cc:654] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.690464 32314 tablet_bootstrap.cc:492] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:39.691083 32314 ts_tablet_manager.cc:1403] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.000s
I20260709 13:12:39.694484 32314 raft_consensus.cc:359] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.695386 32314 raft_consensus.cc:385] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.695719 32314 raft_consensus.cc:740] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.702332 32320 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.705931 32363 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.706439 32363 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.707298 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:39.707855 32199 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.707955 32313 tablet_bootstrap.cc:492] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:39.708452 32363 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:39.708727 32313 ts_tablet_manager.cc:1403] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.040s	user 0.020s	sys 0.014s
I20260709 13:12:39.710745 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:39.711381 32124 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 0.
I20260709 13:12:39.712450 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:39.713109 32273 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 0.
I20260709 13:12:39.713541 32313 raft_consensus.cc:359] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.714543 32313 raft_consensus.cc:385] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.714593 32165 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:39.715003 32199 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:12:39.715112 32313 raft_consensus.cc:740] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.716069 32363 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.716316 32320 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:39.716281 32313 consensus_queue.cc:260] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.717271 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:39.717900 32273 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.718217 32363 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.718257 32089 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:39.718714 32363 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.719219 32313 ts_tablet_manager.cc:1434] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:12:39.719240 32320 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.720716 32320 raft_consensus.cc:697] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:12:39.721541 32320 consensus_queue.cc:237] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.725179 32273 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:12:39.726008 32316 tablet_bootstrap.cc:492] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:39.726459 32316 ts_tablet_manager.cc:1403] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.066s	user 0.016s	sys 0.019s
I20260709 13:12:39.729082 32316 raft_consensus.cc:359] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.729769 32316 raft_consensus.cc:385] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.705972 32314 consensus_queue.cc:260] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.731921 32314 ts_tablet_manager.cc:1434] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.001s
I20260709 13:12:39.732810 32314 tablet_bootstrap.cc:492] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:39.733937 32363 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.734331 32020 catalog_manager.cc:5697] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 0 to 1, leader changed from <none> to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 1 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:39.736877 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:39.737367 32124 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.737524 32313 tablet_bootstrap.cc:492] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:39.741689 32314 tablet_bootstrap.cc:654] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.743227 32124 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:12:39.730094 32316 raft_consensus.cc:740] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.744706 32165 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:39.745568 32318 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.745249 32316 consensus_queue.cc:260] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.746094 32318 raft_consensus.cc:697] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:12:39.746999 32318 consensus_queue.cc:237] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.748155 32316 ts_tablet_manager.cc:1434] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:12:39.749483 32316 tablet_bootstrap.cc:492] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:39.757308 32313 tablet_bootstrap.cc:654] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.758123 32316 tablet_bootstrap.cc:654] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.760409 32363 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:39.762764 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:39.763628 32273 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.777258 32019 catalog_manager.cc:5697] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 0 to 1, leader changed from <none> to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:39.780615 32314 tablet_bootstrap.cc:492] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:39.781154 32314 ts_tablet_manager.cc:1403] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.049s	user 0.020s	sys 0.022s
I20260709 13:12:39.778342 32273 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:12:39.784722 32320 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.785193 32320 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.785434 32314 raft_consensus.cc:359] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.786185 32314 raft_consensus.cc:385] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.786511 32314 raft_consensus.cc:740] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.787339 32320 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:39.787319 32314 consensus_queue.cc:260] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.790287 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:39.790621 32402 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.791050 32402 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:12:39.791731 32090 leader_election.cc:343] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.793503 32402 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:39.795608 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:12:39.800679 32238 leader_election.cc:343] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.796468 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:39.798031 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:12:39.804858 32239 leader_election.cc:343] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:39.805012 32089 leader_election.cc:343] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.805545 32239 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:39.805712 32089 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:12:39.807299 32320 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:39.807365 32402 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:39.808818 32314 ts_tablet_manager.cc:1434] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:12:39.810276 32314 tablet_bootstrap.cc:492] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:39.819321 32314 tablet_bootstrap.cc:654] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.835906 32402 consensus_queue.cc:1048] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:39.839825 32313 tablet_bootstrap.cc:492] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:39.840446 32313 ts_tablet_manager.cc:1403] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.103s	user 0.027s	sys 0.029s
I20260709 13:12:39.843612 32313 raft_consensus.cc:359] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.844664 32313 raft_consensus.cc:385] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.845002 32313 raft_consensus.cc:740] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.845824 32313 consensus_queue.cc:260] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.848516 32313 ts_tablet_manager.cc:1434] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:39.851977 32313 tablet_bootstrap.cc:492] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:39.853603 32316 tablet_bootstrap.cc:492] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:39.854108 32316 ts_tablet_manager.cc:1403] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.105s	user 0.023s	sys 0.046s
I20260709 13:12:39.856451 32313 tablet_bootstrap.cc:654] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.856712 32316 raft_consensus.cc:359] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.857378 32316 raft_consensus.cc:385] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.857729 32316 raft_consensus.cc:740] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.858457 32316 consensus_queue.cc:260] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.860450 32316 ts_tablet_manager.cc:1434] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:12:39.861397 32316 tablet_bootstrap.cc:492] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:39.867153 32316 tablet_bootstrap.cc:654] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.867156 32314 tablet_bootstrap.cc:492] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:39.868055 32314 ts_tablet_manager.cc:1403] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.007s
I20260709 13:12:39.872205 32314 raft_consensus.cc:359] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.874388 32314 raft_consensus.cc:385] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.875101 32314 raft_consensus.cc:740] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.875790 32314 consensus_queue.cc:260] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.877709 32314 ts_tablet_manager.cc:1434] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:12:39.879168 32314 tablet_bootstrap.cc:492] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:39.883994 32313 tablet_bootstrap.cc:492] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:39.884577 32313 ts_tablet_manager.cc:1403] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.007s
I20260709 13:12:39.884958 32314 tablet_bootstrap.cc:654] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.888944 32313 raft_consensus.cc:359] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.890360 32313 raft_consensus.cc:385] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.890722 32313 raft_consensus.cc:740] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.891855 32316 tablet_bootstrap.cc:492] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:39.892117 32314 tablet_bootstrap.cc:492] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:39.892339 32316 ts_tablet_manager.cc:1403] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.015s
I20260709 13:12:39.892648 32314 ts_tablet_manager.cc:1403] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:12:39.891952 32313 consensus_queue.cc:260] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.893463 32395 consensus_queue.cc:1048] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:39.894757 32313 ts_tablet_manager.cc:1434] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:12:39.895051 32316 raft_consensus.cc:359] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.895258 32314 raft_consensus.cc:359] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.895717 32316 raft_consensus.cc:385] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.895951 32314 raft_consensus.cc:385] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.896005 32316 raft_consensus.cc:740] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.896091 32363 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.896342 32314 raft_consensus.cc:740] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.896662 32363 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.896848 32316 consensus_queue.cc:260] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.897172 32314 consensus_queue.cc:260] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.898689 32363 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:39.899035 32316 ts_tablet_manager.cc:1434] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:39.900491 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:39.900866 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:39.901168 32123 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 0.
I20260709 13:12:39.899662 32314 ts_tablet_manager.cc:1434] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:39.901957 32313 tablet_bootstrap.cc:492] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:39.902832 32165 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:39.903664 32363 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:12:39.903805 32165 leader_election.cc:343] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.904074 32363 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.904539 32363 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.906818 32316 tablet_bootstrap.cc:492] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:39.903124 32314 tablet_bootstrap.cc:492] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:39.911996 32313 tablet_bootstrap.cc:654] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.912551 32363 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.915848 32363 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:39.917318 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:39.917914 32123 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.922082 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:12:39.923501 32165 leader_election.cc:343] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.928323 32123 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:12:39.942925 32165 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:12:39.945629 32318 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.946301 32318 raft_consensus.cc:697] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:12:39.947355 32318 consensus_queue.cc:237] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.953655 32395 consensus_queue.cc:1048] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:39.966957 32362 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.967885 32362 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:39.971719 32362 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:39.981930 32316 tablet_bootstrap.cc:654] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.983033 32314 tablet_bootstrap.cc:654] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.986449 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:12:39.987890 32089 leader_election.cc:343] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.997068 32384 consensus_queue.cc:1048] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:40.005511 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:40.007370 32318 consensus_queue.cc:1048] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:40.011714 32273 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:40.016882 32090 leader_election.cc:343] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.017383 32318 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.017536 32090 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:12:40.018060 32318 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.019310 32354 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:40.022539 32395 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.023198 32395 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.042140 32318 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:40.041735 32021 catalog_manager.cc:5697] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 0 to 1, leader changed from <none> to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:40.044885 32395 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:40.045081 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:12:40.046682 32238 leader_election.cc:343] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.046790 32313 tablet_bootstrap.cc:492] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:40.047595 32313 ts_tablet_manager.cc:1403] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.152s	user 0.036s	sys 0.036s
I20260709 13:12:40.046962 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:40.051540 32313 raft_consensus.cc:359] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.052559 32313 raft_consensus.cc:385] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.053081 32313 raft_consensus.cc:740] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.054147 32313 consensus_queue.cc:260] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.058877 32313 ts_tablet_manager.cc:1434] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:12:40.060506 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:40.060415 32318 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:40.061244 32271 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 0.
I20260709 13:12:40.062031 32313 tablet_bootstrap.cc:492] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:40.069005 32313 tablet_bootstrap.cc:654] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.060673 32354 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.071941 32354 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.074910 32354 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:40.080475 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:12:40.081004 32239 leader_election.cc:343] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.081355 32270 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
I20260709 13:12:40.081522 32239 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:40.080469 32165 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:12:40.082635 32384 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:40.083614 32090 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:40.084441 32318 raft_consensus.cc:2804] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:40.085022 32318 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.085083 32363 consensus_queue.cc:1048] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:40.085628 32318 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.086874 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:40.088357 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:40.084508 32354 raft_consensus.cc:2804] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:40.096356 32354 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.096882 32370 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.095763 32318 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.097703 32370 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.099535 32199 raft_consensus.cc:2393] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 1: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:12:40.100322 32370 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:40.096925 32354 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.103266 32318 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:40.103569 32314 tablet_bootstrap.cc:492] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:40.116441 32314 ts_tablet_manager.cc:1403] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.213s	user 0.011s	sys 0.002s
I20260709 13:12:40.116683 32363 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:12:40.119117 32313 tablet_bootstrap.cc:492] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:40.120088 32313 ts_tablet_manager.cc:1403] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.060s	user 0.019s	sys 0.010s
I20260709 13:12:40.121443 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:40.122184 32270 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 0.
I20260709 13:12:40.123018 32313 raft_consensus.cc:359] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.123888 32313 raft_consensus.cc:385] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.124249 32313 raft_consensus.cc:740] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.125067 32313 consensus_queue.cc:260] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.124126 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:40.125993 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:40.126264 32122 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 0.
I20260709 13:12:40.126585 32271 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.119103 32314 raft_consensus.cc:359] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.127174 32314 raft_consensus.cc:385] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.127490 32314 raft_consensus.cc:740] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.128208 32314 consensus_queue.cc:260] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.129776 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:40.132634 32354 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.133059 32314 ts_tablet_manager.cc:1434] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:12:40.133945 32124 raft_consensus.cc:2393] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 1: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:12:40.135622 32313 ts_tablet_manager.cc:1434] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:12:40.136535 32316 tablet_bootstrap.cc:492] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:40.136559 32313 tablet_bootstrap.cc:492] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:40.137243 32314 tablet_bootstrap.cc:492] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:40.137123 32316 ts_tablet_manager.cc:1403] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.230s	user 0.047s	sys 0.038s
I20260709 13:12:40.141381 32316 raft_consensus.cc:359] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.143494 32316 raft_consensus.cc:385] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.143834 32316 raft_consensus.cc:740] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.143944 32313 tablet_bootstrap.cc:654] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.146140 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:40.148061 32354 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:40.149011 32316 consensus_queue.cc:260] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.150216 32271 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:12:40.137256 32165 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:12:40.152566 32363 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:40.152984 32363 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.153537 32363 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.153725 32165 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:12:40.156411 32370 raft_consensus.cc:2804] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:40.169508 32316 ts_tablet_manager.cc:1434] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.002s
I20260709 13:12:40.170940 32316 tablet_bootstrap.cc:492] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:40.199542 32363 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.202466 32363 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:40.218187 32313 tablet_bootstrap.cc:492] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:40.218695 32313 ts_tablet_manager.cc:1403] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.082s	user 0.006s	sys 0.011s
I20260709 13:12:40.223480 32313 raft_consensus.cc:359] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.225725 32313 raft_consensus.cc:385] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.226253 32313 raft_consensus.cc:740] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.231828 32314 tablet_bootstrap.cc:654] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.233336 32313 consensus_queue.cc:260] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.243655 32316 tablet_bootstrap.cc:654] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.245919 32448 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.253412 32448 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.249495 32314 tablet_bootstrap.cc:492] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:40.251652 32370 raft_consensus.cc:697] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:12:40.256234 32448 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:40.252938 32313 ts_tablet_manager.cc:1434] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.004s
W20260709 13:12:40.247849 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 73172.1us
I20260709 13:12:40.257877 32313 tablet_bootstrap.cc:492] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:40.255738 32370 consensus_queue.cc:237] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.262089 32314 ts_tablet_manager.cc:1403] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.127s	user 0.016s	sys 0.012s
I20260709 13:12:40.269634 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:40.277002 32123 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.271371 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:40.281252 32271 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.295161 32271 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:12:40.300312 32123 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:12:40.326330 32165 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:12:40.538749 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 212522us
I20260709 13:12:40.539616 32363 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:40.316543 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:40.313220 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:40.339501 32313 tablet_bootstrap.cc:654] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.336118 32314 raft_consensus.cc:359] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.546041 32314 raft_consensus.cc:385] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.546394 32314 raft_consensus.cc:740] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.546990 32314 consensus_queue.cc:260] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.308837 32384 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.550721 32384 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.325898 32448 consensus_queue.cc:1048] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:40.339062 32449 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.337988 32316 tablet_bootstrap.cc:492] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:40.559051 32456 consensus_queue.cc:1048] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:12:40.473465 32070 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:40.476241 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:40.559855 32318 consensus_queue.cc:1048] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:40.495827 32320 consensus_queue.cc:1048] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:40.516474 32446 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.562122 32446 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.517601 32447 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.564846 32447 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.566830 32447 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:40.521992 32354 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.536717 32019 catalog_manager.cc:5697] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 0 to 1, leader changed from <none> to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:40.567476 32354 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.540112 32363 raft_consensus.cc:697] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:12:40.548661 32314 ts_tablet_manager.cc:1434] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.229s	user 0.007s	sys 0.000s
I20260709 13:12:40.555541 32449 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.556272 32089 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:12:40.570361 32314 tablet_bootstrap.cc:492] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:40.559495 32316 ts_tablet_manager.cc:1403] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.389s	user 0.028s	sys 0.040s
I20260709 13:12:40.572052 32363 consensus_queue.cc:237] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.466578 32324 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.574347 32316 raft_consensus.cc:359] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.575145 32316 raft_consensus.cc:385] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.575515 32316 raft_consensus.cc:740] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.564409 32446 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:12:40.579039 32165 consensus_peers.cc:597] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 -> Peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Couldn't send request to peer 6b3ed521ce8947db80c4b4828b355c06. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:40.576772 32324 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.577122 32316 consensus_queue.cc:260] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.583271 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:40.577142 32362 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:40.583930 32122 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:40.588629 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:40.589115 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:40.589388 32124 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 0.
I20260709 13:12:40.586090 32270 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 0.
I20260709 13:12:40.590476 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:40.591728 32324 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:40.592803 32239 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:40.587745 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:40.593858 32272 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 0.
W20260709 13:12:40.594182 32239 leader_election.cc:343] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.588686 32354 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:40.597882 32316 ts_tablet_manager.cc:1434] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 13:12:40.599699 32316 tablet_bootstrap.cc:492] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:40.602767 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:40.603446 32124 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 0.
I20260709 13:12:40.595033 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:40.587073 32384 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:40.600250 32324 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:40.609848 32324 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.610996 32324 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.598367 32455 consensus_queue.cc:1048] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.041s
I20260709 13:12:40.630237 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:40.622838 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:40.632398 32199 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:40.620554 32449 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:12:40.622959 32238 leader_election.cc:343] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.657516 32238 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
W20260709 13:12:40.625309 32165 leader_election.cc:343] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.666030 32324 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.668025 32453 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:40.668478 32453 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.669373 32453 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.673589 32314 tablet_bootstrap.cc:654] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.678534 32316 tablet_bootstrap.cc:654] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.681119 32270 raft_consensus.cc:2393] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 1: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:12:40.686204 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:40.686868 32120 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.689232 32324 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:40.673168 32165 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:40.687701 32453 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.691066 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:40.695396 32120 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:40.697022 32449 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:40.697453 32449 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.697808 32449 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.698138 32239 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:12:40.699581 32238 leader_election.cc:343] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.700759 32324 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:40.705838 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:40.706786 32324 raft_consensus.cc:697] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:12:40.708695 32239 leader_election.cc:343] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.709105 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:40.709477 32324 consensus_queue.cc:237] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.709736 32199 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.708730 32165 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:40.713924 32363 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:40.714313 32363 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.712873 32453 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:40.714644 32363 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.723399 32313 tablet_bootstrap.cc:492] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:40.723923 32313 ts_tablet_manager.cc:1403] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.466s	user 0.023s	sys 0.000s
I20260709 13:12:40.723920 32449 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.735463 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:40.736188 32120 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 0.
I20260709 13:12:40.739787 32363 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.741794 32363 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:40.745802 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:40.751305 32449 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:40.754364 32199 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:40.755904 32238 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:40.756824 32324 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:40.757603 32324 raft_consensus.cc:697] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:12:40.758770 32324 consensus_queue.cc:237] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.765618 32316 tablet_bootstrap.cc:492] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:40.766135 32316 ts_tablet_manager.cc:1403] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.167s	user 0.018s	sys 0.000s
I20260709 13:12:40.767814 32313 raft_consensus.cc:359] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.768718 32313 raft_consensus.cc:385] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.769037 32313 raft_consensus.cc:740] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.766178 32165 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:40.769426 32316 raft_consensus.cc:359] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.769879 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:40.770155 32316 raft_consensus.cc:385] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.770426 32316 raft_consensus.cc:740] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
W20260709 13:12:40.771167 32165 leader_election.cc:343] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.771430 32316 consensus_queue.cc:260] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:12:40.772171 32165 leader_election.cc:343] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.772746 32363 raft_consensus.cc:2764] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:12:40.774446 32316 ts_tablet_manager.cc:1434] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:40.774569 32313 consensus_queue.cc:260] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.775437 32316 tablet_bootstrap.cc:492] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:40.778733 32314 tablet_bootstrap.cc:492] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:40.779452 32021 catalog_manager.cc:5697] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:40.784214 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:40.785027 32120 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.785344 32313 ts_tablet_manager.cc:1434] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.061s	user 0.005s	sys 0.003s
I20260709 13:12:40.786185 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:40.786828 32272 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.790375 32165 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:12:40.791324 32449 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:40.791729 32449 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.792114 32449 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.793241 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:40.793880 32271 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.794559 32314 ts_tablet_manager.cc:1403] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.224s	user 0.013s	sys 0.004s
I20260709 13:12:40.786384 32313 tablet_bootstrap.cc:492] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
W20260709 13:12:40.802843 32089 leader_election.cc:343] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.804232 32089 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:12:40.805351 32320 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:40.818045 32449 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.822883 32271 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:12:40.852188 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:40.853370 32121 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.857774 32449 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:40.876060 32449 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.876647 32449 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.879456 32120 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:12:40.885239 32272 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:12:40.886397 32449 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:12:40.878343 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 88075.2us
I20260709 13:12:40.896377 32314 raft_consensus.cc:359] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.897167 32314 raft_consensus.cc:385] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.897415 32314 raft_consensus.cc:740] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.897500 32165 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:40.898080 32316 tablet_bootstrap.cc:654] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.898340 32363 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:40.899135 32363 raft_consensus.cc:697] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:12:40.899957 32363 consensus_queue.cc:237] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.898164 32314 consensus_queue.cc:260] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:40.902287 32314 ts_tablet_manager.cc:1434] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.107s	user 0.003s	sys 0.005s
I20260709 13:12:40.902859 32313 tablet_bootstrap.cc:654] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.903116 32314 tablet_bootstrap.cc:492] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:40.910611 32314 tablet_bootstrap.cc:654] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.980139 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:40.982398 32120 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.992648 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:40.993888 32316 tablet_bootstrap.cc:492] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:40.993686 32123 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:12:40.997226 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:40.998023 32316 ts_tablet_manager.cc:1403] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.223s	user 0.013s	sys 0.008s
I20260709 13:12:41.000540 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:41.001713 32271 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:12:41.008277 32019 catalog_manager.cc:5697] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 0 to 1, leader changed from <none> to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:41.013646 32316 raft_consensus.cc:359] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.014557 32316 raft_consensus.cc:385] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.014899 32316 raft_consensus.cc:740] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.017689 32313 tablet_bootstrap.cc:492] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:41.018067 32165 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:12:41.018584 32313 ts_tablet_manager.cc:1403] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.232s	user 0.011s	sys 0.007s
I20260709 13:12:41.019536 32363 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:12:41.019948 32165 leader_election.cc:343] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.020248 32363 raft_consensus.cc:697] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:12:41.023880 32165 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:12:41.023655 32363 consensus_queue.cc:237] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.023667 32455 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.025782 32455 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.028955 32456 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:41.029445 32456 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:41.029822 32456 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.034618 32313 raft_consensus.cc:359] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.037705 32313 raft_consensus.cc:385] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.038200 32313 raft_consensus.cc:740] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.028389 32314 tablet_bootstrap.cc:492] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:41.021306 32316 consensus_queue.cc:260] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.038604 32120 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:12:41.043475 32314 ts_tablet_manager.cc:1403] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.141s	user 0.030s	sys 0.023s
I20260709 13:12:41.048086 32316 ts_tablet_manager.cc:1434] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.002s
I20260709 13:12:41.039135 32313 consensus_queue.cc:260] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.055249 32453 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.056216 32316 tablet_bootstrap.cc:492] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:41.055881 32453 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.058384 32453 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:41.060191 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:41.060943 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:41.062637 32239 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:41.063869 32453 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:41.065852 32121 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:12:41.067339 32022 catalog_manager.cc:5697] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:41.070075 32447 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.070776 32447 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.072275 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:41.073407 32271 raft_consensus.cc:2468] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
I20260709 13:12:41.074297 32447 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:41.074759 32090 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:41.075979 32454 raft_consensus.cc:2804] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:41.076388 32454 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:41.076781 32454 raft_consensus.cc:3060] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.080284 32313 ts_tablet_manager.cc:1434] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.004s
I20260709 13:12:41.083648 32314 raft_consensus.cc:359] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.084455 32314 raft_consensus.cc:385] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.084751 32314 raft_consensus.cc:740] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.086177 32313 tablet_bootstrap.cc:492] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:41.085619 32314 consensus_queue.cc:260] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.088400 32314 ts_tablet_manager.cc:1434] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 13:12:41.090010 32314 tablet_bootstrap.cc:492] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:41.097608 32456 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.099363 32456 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:41.086812 32455 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:41.101424 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:41.099757 32454 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.105897 32195 raft_consensus.cc:2468] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
I20260709 13:12:41.106208 32447 consensus_queue.cc:1048] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:41.107808 32165 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:12:41.108999 32447 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:41.109637 32447 raft_consensus.cc:697] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:12:41.110895 32447 consensus_queue.cc:237] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.114161 32316 tablet_bootstrap.cc:654] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.117724 32314 tablet_bootstrap.cc:654] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.122737 32022 catalog_manager.cc:5697] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 0 to 1, leader changed from <none> to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:41.127751 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:41.127774 32271 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.128333 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:41.129509 32121 raft_consensus.cc:2393] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 1: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:12:41.129698 32272 raft_consensus.cc:3060] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.130858 32454 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:41.133424 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:41.136287 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:41.136955 32270 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.131785 32022 catalog_manager.cc:5697] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 0 to 1, leader changed from <none> to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:41.147293 32313 tablet_bootstrap.cc:654] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.150683 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:41.151564 32121 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.163105 32316 tablet_bootstrap.cc:492] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:41.163669 32316 ts_tablet_manager.cc:1403] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.108s	user 0.006s	sys 0.008s
I20260709 13:12:41.166909 32270 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:12:41.166771 32316 raft_consensus.cc:359] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.167678 32316 raft_consensus.cc:385] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.167949 32316 raft_consensus.cc:740] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.178085 32456 consensus_queue.cc:1048] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:41.179107 32165 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:12:41.179944 32363 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:41.180460 32363 raft_consensus.cc:697] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:12:41.181509 32363 consensus_queue.cc:237] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.183215 32121 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:12:41.183619 32272 raft_consensus.cc:2468] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:12:41.184933 32090 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:41.185802 32454 raft_consensus.cc:2804] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:41.183244 32316 consensus_queue.cc:260] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.186162 32022 catalog_manager.cc:5697] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 0 to 1, leader changed from <none> to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:41.186494 32454 raft_consensus.cc:697] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:12:41.193993 32454 consensus_queue.cc:237] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.203326 32316 ts_tablet_manager.cc:1434] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 13:12:41.211635 32316 tablet_bootstrap.cc:492] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:41.213521 32165 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:41.216864 32370 raft_consensus.cc:3060] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.217640 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:41.219457 32314 tablet_bootstrap.cc:492] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:41.219937 32314 ts_tablet_manager.cc:1403] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.130s	user 0.009s	sys 0.011s
I20260709 13:12:41.221388 32456 consensus_queue.cc:1048] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:41.224751 32019 catalog_manager.cc:5697] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 0 to 2, leader changed from <none> to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:41.235054 32314 raft_consensus.cc:359] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.235949 32314 raft_consensus.cc:385] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.236222 32314 raft_consensus.cc:740] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.238157 32314 consensus_queue.cc:260] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.266148 32022 catalog_manager.cc:5697] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 0 to 1, leader changed from <none> to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 1 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:41.273074 32318 consensus_queue.cc:1048] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:41.274196 32370 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:41.281399 32314 ts_tablet_manager.cc:1434] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.061s	user 0.005s	sys 0.004s
I20260709 13:12:41.291575 32195 raft_consensus.cc:2468] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:12:41.314949 32313 tablet_bootstrap.cc:492] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:41.315627 32313 ts_tablet_manager.cc:1403] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.230s	user 0.017s	sys 0.038s
I20260709 13:12:41.308398 32453 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:12:41.322357 32449 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.322899 32449 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.324889 32449 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:41.332096 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:41.332873 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:41.333178 32270 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 0.
I20260709 13:12:41.333595 32122 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 0.
I20260709 13:12:41.337628 32165 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:12:41.340553 32238 consensus_peers.cc:597] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.341615 32316 tablet_bootstrap.cc:654] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.323941 32313 raft_consensus.cc:359] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.343313 32313 raft_consensus.cc:385] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.343717 32313 raft_consensus.cc:740] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.345201 32314 tablet_bootstrap.cc:492] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:41.350001 32318 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:41.361428 32318 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:41.361831 32318 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:41.369990 32488 log.cc:927] Time spent T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:12:41.373931 32124 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.381275 32318 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.383440 32318 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:41.352618 32313 consensus_queue.cc:260] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:12:41.390297 32145 debug-util.cc:398] Leaking SignalData structure 0x7b08002062c0 after lost signal to thread 30975
I20260709 13:12:41.390659 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:12:41.391523 32145 debug-util.cc:398] Leaking SignalData structure 0x7b08000e34e0 after lost signal to thread 32056
I20260709 13:12:41.395109 32453 consensus_queue.cc:1048] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:41.396576 32145 debug-util.cc:398] Leaking SignalData structure 0x7b080019f120 after lost signal to thread 32148
W20260709 13:12:41.398041 32145 debug-util.cc:398] Leaking SignalData structure 0x7b080009bd80 after lost signal to thread 32223
W20260709 13:12:41.399309 32145 debug-util.cc:398] Leaking SignalData structure 0x7b0800142e00 after lost signal to thread 32297
I20260709 13:12:41.391276 32272 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.402923 32313 ts_tablet_manager.cc:1434] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.087s	user 0.009s	sys 0.000s
I20260709 13:12:41.404008 32313 tablet_bootstrap.cc:492] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:41.415369 32318 consensus_queue.cc:1048] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:41.418048 32324 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.418588 32324 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.422070 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:41.422915 32122 raft_consensus.cc:2393] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 1: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:12:41.434437 32324 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:41.435858 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:41.437384 32272 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:12:41.437706 32238 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:41.438759 32165 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:12:41.438910 32324 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.439558 32449 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:41.440037 32449 raft_consensus.cc:697] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:12:41.448777 32449 consensus_queue.cc:237] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.442330 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:41.459523 32121 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.462519 32453 consensus_queue.cc:1048] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:41.467056 32324 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:41.489496 32314 tablet_bootstrap.cc:654] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.493884 32313 tablet_bootstrap.cc:654] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.503643 32316 tablet_bootstrap.cc:492] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:41.504240 32316 ts_tablet_manager.cc:1403] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.295s	user 0.016s	sys 0.013s
I20260709 13:12:41.482031 32121 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:12:41.524150 32370 consensus_queue.cc:1048] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:41.522287 32019 catalog_manager.cc:5697] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 0 to 1, leader changed from <none> to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:41.529039 32316 raft_consensus.cc:359] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.529886 32316 raft_consensus.cc:385] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.530187 32316 raft_consensus.cc:740] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.533464 32313 tablet_bootstrap.cc:492] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:41.533214 32316 consensus_queue.cc:260] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.534008 32313 ts_tablet_manager.cc:1403] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.130s	user 0.014s	sys 0.009s
I20260709 13:12:41.539427 32313 raft_consensus.cc:359] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.547854 32313 raft_consensus.cc:385] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.548249 32313 raft_consensus.cc:740] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.549228 32313 consensus_queue.cc:260] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.554090 32313 ts_tablet_manager.cc:1434] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.004s
I20260709 13:12:41.555634 32313 tablet_bootstrap.cc:492] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:41.555949 32447 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:41.562381 32370 consensus_queue.cc:1048] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:41.564337 32314 tablet_bootstrap.cc:492] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:41.564833 32314 ts_tablet_manager.cc:1403] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.220s	user 0.014s	sys 0.012s
I20260709 13:12:41.567836 32314 raft_consensus.cc:359] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.570271 32316 ts_tablet_manager.cc:1434] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.000s
I20260709 13:12:41.571594 32316 tablet_bootstrap.cc:492] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:41.568522 32314 raft_consensus.cc:385] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.578066 32314 raft_consensus.cc:740] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.581334 32314 consensus_queue.cc:260] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.592247 32314 ts_tablet_manager.cc:1434] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:12:41.593101 32324 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.594715 32313 tablet_bootstrap.cc:654] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.593600 32324 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.597630 32324 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:41.599282 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:41.599707 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:12:41.601145 32238 leader_election.cc:343] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:41.603013 32239 leader_election.cc:343] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.606037 32239 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:41.609222 32324 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:41.610635 32370 consensus_queue.cc:1048] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:41.612716 32455 consensus_queue.cc:1048] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:12:41.617022 32314 tablet_bootstrap.cc:492] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:41.622217 32446 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:12:41.643023 32370 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.643801 32370 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.647310 32370 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:41.680701 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:41.691066 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:41.693082 32455 consensus_queue.cc:1048] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:12:41.697279 32165 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:41.702706 32314 tablet_bootstrap.cc:654] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:41.707612 32070 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:41.708920 32449 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:41.729965 32316 tablet_bootstrap.cc:654] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.739089 32313 tablet_bootstrap.cc:492] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:41.739562 32313 ts_tablet_manager.cc:1403] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.184s	user 0.017s	sys 0.024s
I20260709 13:12:41.751292 32314 tablet_bootstrap.cc:492] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:41.752231 32270 raft_consensus.cc:1275] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:41.755167 32449 consensus_queue.cc:1048] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:41.756071 32314 ts_tablet_manager.cc:1403] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.149s	user 0.010s	sys 0.006s
I20260709 13:12:41.757912 32313 raft_consensus.cc:359] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.758863 32313 raft_consensus.cc:385] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.759543 32313 raft_consensus.cc:740] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.761641 32313 consensus_queue.cc:260] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.763787 32313 ts_tablet_manager.cc:1434] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.002s
I20260709 13:12:41.764840 32313 tablet_bootstrap.cc:492] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:41.767578 32314 raft_consensus.cc:359] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.773232 32314 raft_consensus.cc:385] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.773862 32314 raft_consensus.cc:740] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.777573 32314 consensus_queue.cc:260] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.785651 32314 ts_tablet_manager.cc:1434] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:12:41.793745 32313 tablet_bootstrap.cc:654] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.798241 32120 raft_consensus.cc:1275] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:41.798475 32314 tablet_bootstrap.cc:492] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:41.800498 32363 consensus_queue.cc:1048] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:41.812170 32314 tablet_bootstrap.cc:654] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.825613 32316 tablet_bootstrap.cc:492] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:41.826236 32316 ts_tablet_manager.cc:1403] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.255s	user 0.020s	sys 0.022s
I20260709 13:12:41.829522 32314 tablet_bootstrap.cc:492] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:41.824563 32446 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.829605 32316 raft_consensus.cc:359] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.830260 32314 ts_tablet_manager.cc:1403] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.009s
I20260709 13:12:41.830693 32316 raft_consensus.cc:385] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.830525 32446 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.831126 32316 raft_consensus.cc:740] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.832139 32316 consensus_queue.cc:260] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.833724 32446 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:41.835620 32316 ts_tablet_manager.cc:1434] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:12:41.835047 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:41.836465 32121 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 0.
I20260709 13:12:41.839686 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:41.839941 32165 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:41.840341 32270 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 0.
I20260709 13:12:41.840754 32447 raft_consensus.cc:2804] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:41.841130 32447 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:41.841471 32447 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.847287 32446 consensus_queue.cc:1048] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:12:41.853323 32316 tablet_bootstrap.cc:492] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:41.856343 32314 raft_consensus.cc:359] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.858392 32314 raft_consensus.cc:385] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.853009 32447 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.863881 32447 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:41.864933 32313 tablet_bootstrap.cc:492] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:41.865440 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:41.871924 32313 ts_tablet_manager.cc:1403] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.107s	user 0.007s	sys 0.012s
I20260709 13:12:41.865872 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:41.858749 32314 raft_consensus.cc:740] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.872923 32121 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.873040 32270 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.881178 32314 consensus_queue.cc:260] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.883453 32314 ts_tablet_manager.cc:1434] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 13:12:41.884519 32314 tablet_bootstrap.cc:492] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:41.886624 32121 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:12:41.887835 32165 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:41.888772 32313 raft_consensus.cc:359] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.890033 32447 raft_consensus.cc:2804] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:41.886848 32270 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:12:41.890614 32447 raft_consensus.cc:697] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:12:41.889513 32313 raft_consensus.cc:385] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.893451 32313 raft_consensus.cc:740] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.894644 32447 consensus_queue.cc:237] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.898082 32363 consensus_queue.cc:1048] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:41.899354 32313 consensus_queue.cc:260] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.891654 32316 tablet_bootstrap.cc:654] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.908201 32313 ts_tablet_manager.cc:1434] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:12:41.910230 32314 tablet_bootstrap.cc:654] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.920218 32313 tablet_bootstrap.cc:492] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:41.923375 32195 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.927690 32313 tablet_bootstrap.cc:654] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.930928 32314 tablet_bootstrap.cc:492] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:41.931403 32314 ts_tablet_manager.cc:1403] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.004s
I20260709 13:12:41.934324 32314 raft_consensus.cc:359] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.935042 32314 raft_consensus.cc:385] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.935331 32314 raft_consensus.cc:740] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.936019 32314 consensus_queue.cc:260] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.938136 32314 ts_tablet_manager.cc:1434] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:12:41.940629 32316 tablet_bootstrap.cc:492] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:41.941118 32316 ts_tablet_manager.cc:1403] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.088s	user 0.011s	sys 0.007s
I20260709 13:12:41.942981 32021 catalog_manager.cc:5697] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 0 to 1, leader changed from <none> to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:41.943782 32316 raft_consensus.cc:359] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.944533 32316 raft_consensus.cc:385] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.944825 32316 raft_consensus.cc:740] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.945228 32314 tablet_bootstrap.cc:492] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:41.949151 32316 consensus_queue.cc:260] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.951593 32316 ts_tablet_manager.cc:1434] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:12:41.952792 32316 tablet_bootstrap.cc:492] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:41.974825 32313 tablet_bootstrap.cc:492] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:41.975540 32313 ts_tablet_manager.cc:1403] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.006s
I20260709 13:12:41.976504 32316 tablet_bootstrap.cc:654] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.978441 32314 tablet_bootstrap.cc:654] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.978394 32313 raft_consensus.cc:359] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.981010 32313 raft_consensus.cc:385] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.981338 32313 raft_consensus.cc:740] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.982318 32316 tablet_bootstrap.cc:492] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:41.982810 32316 ts_tablet_manager.cc:1403] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.001s
I20260709 13:12:41.982082 32313 consensus_queue.cc:260] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.984822 32313 ts_tablet_manager.cc:1434] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:12:41.985900 32313 tablet_bootstrap.cc:492] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:41.986545 32316 raft_consensus.cc:359] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.987205 32316 raft_consensus.cc:385] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.987473 32316 raft_consensus.cc:740] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.988145 32316 consensus_queue.cc:260] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:41.995348 32316 ts_tablet_manager.cc:1434] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:12:41.996395 32316 tablet_bootstrap.cc:492] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:42.001578 32313 tablet_bootstrap.cc:654] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.003345 32316 tablet_bootstrap.cc:654] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.012516 32314 tablet_bootstrap.cc:492] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:42.013083 32314 ts_tablet_manager.cc:1403] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.069s	user 0.008s	sys 0.007s
I20260709 13:12:42.014699 32316 tablet_bootstrap.cc:492] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:42.015148 32316 ts_tablet_manager.cc:1403] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:12:42.016008 32314 raft_consensus.cc:359] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.016839 32314 raft_consensus.cc:385] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.017125 32314 raft_consensus.cc:740] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.017200 32316 raft_consensus.cc:359] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.017796 32316 raft_consensus.cc:385] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.018085 32316 raft_consensus.cc:740] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.017891 32314 consensus_queue.cc:260] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.020263 32314 ts_tablet_manager.cc:1434] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:12:42.018725 32316 consensus_queue.cc:260] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.022372 32313 tablet_bootstrap.cc:492] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:42.022418 32316 ts_tablet_manager.cc:1434] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:12:42.023008 32313 ts_tablet_manager.cc:1403] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.037s	user 0.005s	sys 0.008s
I20260709 13:12:42.023681 32316 tablet_bootstrap.cc:492] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:42.026396 32313 raft_consensus.cc:359] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.027148 32313 raft_consensus.cc:385] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.027444 32313 raft_consensus.cc:740] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.028335 32313 consensus_queue.cc:260] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.030556 32314 tablet_bootstrap.cc:492] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:42.033535 32313 ts_tablet_manager.cc:1434] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:12:42.033766 32316 tablet_bootstrap.cc:654] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.034642 32313 tablet_bootstrap.cc:492] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:42.041621 32313 tablet_bootstrap.cc:654] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.049729 32314 tablet_bootstrap.cc:654] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.056205 32316 tablet_bootstrap.cc:492] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:42.064754 32363 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.065346 32363 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.068420 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:42.069516 32316 ts_tablet_manager.cc:1403] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.046s	user 0.019s	sys 0.000s
I20260709 13:12:42.071482 32314 tablet_bootstrap.cc:492] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:42.072012 32314 ts_tablet_manager.cc:1403] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.003s
I20260709 13:12:42.073009 32316 raft_consensus.cc:359] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.075408 32316 raft_consensus.cc:385] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.075174 32314 raft_consensus.cc:359] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.075827 32316 raft_consensus.cc:740] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.076033 32314 raft_consensus.cc:385] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.076434 32314 raft_consensus.cc:740] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.077159 32314 consensus_queue.cc:260] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.077062 32316 consensus_queue.cc:260] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:12:42.081207 32165 leader_election.cc:343] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.081549 32316 ts_tablet_manager.cc:1434] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:12:42.082257 32313 tablet_bootstrap.cc:492] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:42.082647 32316 tablet_bootstrap.cc:492] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:42.082774 32313 ts_tablet_manager.cc:1403] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.009s
I20260709 13:12:42.085755 32362 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.086310 32362 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.079610 32314 ts_tablet_manager.cc:1434] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:12:42.088297 32314 tablet_bootstrap.cc:492] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:42.090975 32313 raft_consensus.cc:359] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.091130 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:42.091958 32195 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
I20260709 13:12:42.093113 32313 raft_consensus.cc:385] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.093509 32313 raft_consensus.cc:740] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.094173 32313 consensus_queue.cc:260] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.094913 32316 tablet_bootstrap.cc:654] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.101907 32314 tablet_bootstrap.cc:654] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.109719 32089 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:42.110173 32313 ts_tablet_manager.cc:1434] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.002s
I20260709 13:12:42.110688 32455 raft_consensus.cc:2804] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:42.111096 32455 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.111449 32455 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.111477 32316 tablet_bootstrap.cc:492] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:42.111596 32313 tablet_bootstrap.cc:492] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:42.112193 32316 ts_tablet_manager.cc:1403] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.001s
I20260709 13:12:42.115110 32316 raft_consensus.cc:359] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.115849 32316 raft_consensus.cc:385] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.116119 32316 raft_consensus.cc:740] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.116847 32316 consensus_queue.cc:260] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.117556 32447 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.118094 32447 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.119143 32316 ts_tablet_manager.cc:1434] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:42.120044 32313 tablet_bootstrap.cc:654] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.120220 32447 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:42.122774 32314 tablet_bootstrap.cc:492] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:42.123304 32314 ts_tablet_manager.cc:1403] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.000s
I20260709 13:12:42.123896 32363 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:42.126407 32314 raft_consensus.cc:359] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.127395 32314 raft_consensus.cc:385] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.127703 32314 raft_consensus.cc:740] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.128376 32314 consensus_queue.cc:260] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.120198 32316 tablet_bootstrap.cc:492] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:42.136734 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:42.137467 32272 raft_consensus.cc:2468] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 0.
I20260709 13:12:42.140067 32314 ts_tablet_manager.cc:1434] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:12:42.136237 32316 tablet_bootstrap.cc:654] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.154911 32454 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.155670 32454 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.156958 32316 tablet_bootstrap.cc:492] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:42.157491 32316 ts_tablet_manager.cc:1403] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.006s
I20260709 13:12:42.158516 32454 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:42.160313 32316 raft_consensus.cc:359] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.162647 32316 raft_consensus.cc:385] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.162969 32316 raft_consensus.cc:740] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.163676 32316 consensus_queue.cc:260] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.165838 32320 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.166157 32316 ts_tablet_manager.cc:1434] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:42.166590 32320 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.167244 32316 tablet_bootstrap.cc:492] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:42.170760 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:42.171793 32272 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 0.
I20260709 13:12:42.174510 32316 tablet_bootstrap.cc:654] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.175033 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:42.175940 32272 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
I20260709 13:12:42.177479 32090 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:42.179020 32454 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:42.179502 32454 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.179962 32454 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.186141 32314 tablet_bootstrap.cc:492] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:42.190343 32316 tablet_bootstrap.cc:492] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:42.190883 32316 ts_tablet_manager.cc:1403] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.002s
I20260709 13:12:42.186062 32362 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:42.193831 32316 raft_consensus.cc:359] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.194590 32316 raft_consensus.cc:385] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.194885 32316 raft_consensus.cc:740] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.209213 32316 consensus_queue.cc:260] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.212005 32316 ts_tablet_manager.cc:1434] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:12:42.213176 32316 tablet_bootstrap.cc:492] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:42.214504 32320 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:42.216423 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:42.217360 32120 raft_consensus.cc:2468] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 0.
I20260709 13:12:42.220515 32165 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:12:42.222945 32314 tablet_bootstrap.cc:654] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.223914 32447 raft_consensus.cc:2804] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:42.224938 32447 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.226015 32447 raft_consensus.cc:3060] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.225782 32454 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.231295 32454 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:42.224342 32165 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:42.246567 32447 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.253383 32447 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:42.243978 32449 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:42.254314 32449 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.254781 32449 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.200060 32455 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.261934 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:42.262663 32272 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
I20260709 13:12:42.271215 32313 tablet_bootstrap.cc:492] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:42.271773 32313 ts_tablet_manager.cc:1403] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.160s	user 0.072s	sys 0.056s
I20260709 13:12:42.272776 32455 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:42.273567 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:42.274861 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:42.275532 32272 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
I20260709 13:12:42.275825 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:42.276597 32269 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.276687 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:42.277717 32270 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.279177 32090 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:42.280972 32454 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:42.281327 32454 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.281672 32454 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.282372 32316 tablet_bootstrap.cc:654] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.280184 32449 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.284792 32449 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:42.286895 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:42.287541 32196 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
I20260709 13:12:42.287734 32499 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.288239 32499 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.288866 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:42.290657 32499 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:42.290511 32313 raft_consensus.cc:359] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.291676 32313 raft_consensus.cc:385] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.292047 32313 raft_consensus.cc:740] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.292763 32313 consensus_queue.cc:260] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.293721 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:42.293897 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:12:42.295010 32239 leader_election.cc:343] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.295204 32313 ts_tablet_manager.cc:1434] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:12:42.295240 32195 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
W20260709 13:12:42.295585 32238 leader_election.cc:343] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.296005 32238 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:42.296943 32499 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:42.288334 32270 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:12:42.300700 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:42.301301 32195 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.302843 32269 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:12:42.303970 32313 tablet_bootstrap.cc:492] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:42.302852 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:42.305069 32121 raft_consensus.cc:3060] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.309446 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:42.311421 32314 tablet_bootstrap.cc:492] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
W20260709 13:12:42.311318 32089 leader_election.cc:343] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.311991 32314 ts_tablet_manager.cc:1403] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.126s	user 0.012s	sys 0.012s
I20260709 13:12:42.314325 32453 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.314877 32314 raft_consensus.cc:359] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.315517 32314 raft_consensus.cc:385] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.315774 32314 raft_consensus.cc:740] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.314817 32453 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.316824 32314 consensus_queue.cc:260] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.318342 32453 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:42.318936 32314 ts_tablet_manager.cc:1434] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 13:12:42.308245 32195 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:12:42.320768 32314 tablet_bootstrap.cc:492] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:42.326443 32320 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.329104 32090 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:12:42.329360 32320 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.332785 32320 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:42.334250 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:42.332361 32454 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.323662 32121 raft_consensus.cc:2468] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
W20260709 13:12:42.338989 32165 leader_election.cc:343] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.342175 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:42.342826 32120 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:42.342778 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:42.343806 32271 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.335551 32270 raft_consensus.cc:3060] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.336184 32455 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:42.349200 32455 raft_consensus.cc:697] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:12:42.350018 32455 consensus_queue.cc:237] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.350690 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:42.351336 32195 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:42.352450 32238 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:12:42.353319 32453 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:42.353662 32453 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.353982 32453 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.360801 32499 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.361322 32499 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.367991 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:42.355613 32089 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:42.373533 32165 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:42.373654 32362 raft_consensus.cc:2804] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:42.374279 32362 raft_consensus.cc:697] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:12:42.374675 32447 raft_consensus.cc:2804] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:42.375319 32447 raft_consensus.cc:697] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:12:42.375146 32362 consensus_queue.cc:237] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.376260 32447 consensus_queue.cc:237] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.375156 32454 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:12:42.380195 32089 leader_election.cc:343] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.388942 32271 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:12:42.389637 32314 tablet_bootstrap.cc:654] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.389847 32499 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:42.390555 32270 raft_consensus.cc:2468] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:12:42.391340 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:42.391672 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:42.392488 32195 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:42.392954 32238 leader_election.cc:343] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.395536 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:42.396255 32120 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:42.391672 32165 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:42.398149 32316 tablet_bootstrap.cc:492] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:42.398674 32316 ts_tablet_manager.cc:1403] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.186s	user 0.028s	sys 0.015s
I20260709 13:12:42.400249 32456 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:42.400874 32456 raft_consensus.cc:697] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:12:42.402097 32456 consensus_queue.cc:237] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.403100 32313 tablet_bootstrap.cc:654] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.404740 32316 raft_consensus.cc:359] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.400070 32239 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:12:42.405408 32316 raft_consensus.cc:385] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.407217 32316 raft_consensus.cc:740] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.409433 32316 consensus_queue.cc:260] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.411824 32499 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:42.412380 32499 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.412865 32499 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.411531 32453 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.420560 32195 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:12:42.423888 32089 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:42.427484 32362 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:42.429683 32362 raft_consensus.cc:697] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:12:42.430534 32316 ts_tablet_manager.cc:1434] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 13:12:42.433816 32362 consensus_queue.cc:237] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.439308 32021 catalog_manager.cc:5697] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 0 to 1, leader changed from <none> to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 1 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:42.439894 32449 consensus_queue.cc:1048] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:42.446252 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:42.446703 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:42.447768 32195 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:42.427256 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 98284.7us
I20260709 13:12:42.446975 32120 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.442083 32453 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:42.447834 32021 catalog_manager.cc:5697] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 0 to 1, leader changed from <none> to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 1 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:42.454082 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:42.455057 32453 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.457618 32453 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.458192 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:42.459496 32272 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.448416 32499 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.475064 32316 tablet_bootstrap.cc:492] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:42.476199 32540 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.476622 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:42.476794 32540 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.477260 32121 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.475275 32270 raft_consensus.cc:2393] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 1: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:12:42.505519 32499 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:42.519542 32121 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:42.540810 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:42.546804 32314 tablet_bootstrap.cc:492] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:42.547304 32314 ts_tablet_manager.cc:1403] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.227s	user 0.004s	sys 0.027s
I20260709 13:12:42.542968 32453 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:42.553401 32239 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:12:42.564213 32239 leader_election.cc:343] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.564888 32453 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:42.565421 32453 raft_consensus.cc:697] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:12:42.566303 32453 consensus_queue.cc:237] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.564898 32314 raft_consensus.cc:359] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.569406 32314 raft_consensus.cc:385] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.569669 32314 raft_consensus.cc:740] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.572914 32313 tablet_bootstrap.cc:492] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
W20260709 13:12:42.561882 32544 log.cc:927] Time spent T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:12:42.572541 32314 consensus_queue.cc:260] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.573565 32313 ts_tablet_manager.cc:1403] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.270s	user 0.029s	sys 0.011s
I20260709 13:12:42.582808 32314 ts_tablet_manager.cc:1434] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.004s
I20260709 13:12:42.580176 32022 catalog_manager.cc:5697] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 0 to 1, leader changed from <none> to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:42.590062 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:42.585078 32090 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:12:42.577405 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:42.593501 32362 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:42.587546 32540 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:42.601178 32272 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:12:42.605929 32316 tablet_bootstrap.cc:654] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.588644 32022 catalog_manager.cc:5697] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 0 to 1, leader changed from <none> to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:42.609462 32314 tablet_bootstrap.cc:492] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:42.585397 32120 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:42.642414 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:42.639513 32446 consensus_queue.cc:1048] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:12:42.648976 32239 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:42.652251 32547 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:42.653560 32547 raft_consensus.cc:697] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:12:42.654407 32547 consensus_queue.cc:237] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.633726 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:42.656265 32195 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
W20260709 13:12:42.673471 32089 leader_election.cc:343] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:42.666836 32238 leader_election.cc:343] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.668056 32272 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
I20260709 13:12:42.685652 32313 raft_consensus.cc:359] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.686479 32313 raft_consensus.cc:385] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.686735 32313 raft_consensus.cc:740] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.687398 32313 consensus_queue.cc:260] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.689607 32313 ts_tablet_manager.cc:1434] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.110s	user 0.008s	sys 0.000s
I20260709 13:12:42.690665 32313 tablet_bootstrap.cc:492] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:42.697140 32313 tablet_bootstrap.cc:654] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.702600 32316 tablet_bootstrap.cc:492] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:42.703115 32316 ts_tablet_manager.cc:1403] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.240s	user 0.023s	sys 0.026s
W20260709 13:12:42.705178 32238 leader_election.cc:343] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.705735 32238 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:42.710094 32547 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:42.708921 32090 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:12:42.721907 32316 raft_consensus.cc:359] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.722663 32316 raft_consensus.cc:385] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.722973 32316 raft_consensus.cc:740] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.723768 32316 consensus_queue.cc:260] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.741312 32316 ts_tablet_manager.cc:1434] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.004s
I20260709 13:12:42.730310 32362 raft_consensus.cc:2804] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:42.743777 32362 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.744531 32362 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.748732 32313 tablet_bootstrap.cc:492] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:42.749472 32313 ts_tablet_manager.cc:1403] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.022s
I20260709 13:12:42.764889 32316 tablet_bootstrap.cc:492] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:42.799424 32313 raft_consensus.cc:359] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.807337 32313 raft_consensus.cc:385] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.808355 32313 raft_consensus.cc:740] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.807840 32316 tablet_bootstrap.cc:654] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.802893 32314 tablet_bootstrap.cc:654] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.809556 32313 consensus_queue.cc:260] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.822753 32313 ts_tablet_manager.cc:1434] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.073s	user 0.011s	sys 0.000s
I20260709 13:12:42.828438 32121 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.833550 32313 tablet_bootstrap.cc:492] T 7f6867d296184651b908c8f457d74e4a P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:42.841554 32021 catalog_manager.cc:5697] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:42.844619 32021 catalog_manager.cc:5697] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:42.832755 32362 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.853521 32362 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:42.867935 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:42.869307 32271 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.878518 32271 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:12:42.879886 32090 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:42.880019 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:42.880761 32198 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.862272 32449 consensus_queue.cc:1048] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:12:42.887804 32019 catalog_manager.cc:5697] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 0 to 1, leader changed from <none> to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 1 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:42.890609 32550 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.891114 32550 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.893182 32550 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:42.893659 32195 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.896404 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:42.900372 32314 tablet_bootstrap.cc:492] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:42.901051 32314 ts_tablet_manager.cc:1403] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.303s	user 0.016s	sys 0.015s
W20260709 13:12:42.888231 32070 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:42.889304 32362 raft_consensus.cc:2804] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:42.909888 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:42.906755 32449 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:12:42.910632 32272 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:12:42.914831 32198 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:12:42.919371 32362 raft_consensus.cc:697] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:12:42.923486 32090 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:12:42.923993 32362 consensus_queue.cc:237] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.925750 32540 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:42.926225 32316 tablet_bootstrap.cc:492] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:42.926677 32316 ts_tablet_manager.cc:1403] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.176s	user 0.026s	sys 0.004s
I20260709 13:12:42.926115 32540 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.927080 32540 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:42.926433 32455 consensus_queue.cc:1048] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:42.929268 32316 raft_consensus.cc:359] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.930051 32316 raft_consensus.cc:385] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.930346 32316 raft_consensus.cc:740] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.930182 32455 consensus_queue.cc:1048] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:42.931727 32316 consensus_queue.cc:260] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.932006 32314 raft_consensus.cc:359] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.932833 32314 raft_consensus.cc:385] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.933125 32314 raft_consensus.cc:740] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.933563 32316 ts_tablet_manager.cc:1434] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:42.933754 32314 consensus_queue.cc:260] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.933975 32550 consensus_queue.cc:1048] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:42.935349 32314 ts_tablet_manager.cc:1434] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.000s
I20260709 13:12:42.938341 32314 tablet_bootstrap.cc:492] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:42.938495 32316 tablet_bootstrap.cc:492] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:42.944450 32550 consensus_queue.cc:1048] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:42.947211 32540 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:42.968041 32121 raft_consensus.cc:1240] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:12:42.964087 32456 consensus_queue.cc:1048] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:12:42.987414 32313 tablet_bootstrap.cc:654] T 7f6867d296184651b908c8f457d74e4a P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.006327 32019 catalog_manager.cc:5697] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 0 to 1, leader changed from <none> to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 1 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:43.001848 32553 consensus_queue.cc:1059] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:12:43.027595 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:43.028806 32314 tablet_bootstrap.cc:654] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.029718 32550 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:43.030705 32553 raft_consensus.cc:3055] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:43.032963 32553 raft_consensus.cc:740] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:12:43.031065 32449 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:43.033345 32362 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:12:43.043937 32553 consensus_queue.cc:260] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.092705 32499 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.093225 32499 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.096352 32499 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:43.105832 32316 tablet_bootstrap.cc:654] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.108042 32540 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:43.108726 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:43.110251 32313 tablet_bootstrap.cc:492] T 7f6867d296184651b908c8f457d74e4a P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:43.110723 32313 ts_tablet_manager.cc:1403] T 7f6867d296184651b908c8f457d74e4a P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.278s	user 0.019s	sys 0.004s
I20260709 13:12:43.114647 32553 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:43.114825 32238 leader_election.cc:343] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.116027 32313 raft_consensus.cc:359] T 7f6867d296184651b908c8f457d74e4a P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.120574 32313 raft_consensus.cc:385] T 7f6867d296184651b908c8f457d74e4a P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.120998 32313 raft_consensus.cc:740] T 7f6867d296184651b908c8f457d74e4a P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.121779 32313 consensus_queue.cc:260] T 7f6867d296184651b908c8f457d74e4a P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.117132 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:43.127251 32272 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:43.131538 32313 ts_tablet_manager.cc:1434] T 7f6867d296184651b908c8f457d74e4a P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.021s	user 0.014s	sys 0.000s
I20260709 13:12:43.132967 32313 tablet_bootstrap.cc:492] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:43.140301 32314 tablet_bootstrap.cc:492] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:43.140864 32314 ts_tablet_manager.cc:1403] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.203s	user 0.006s	sys 0.009s
I20260709 13:12:43.157550 32314 raft_consensus.cc:359] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.158281 32314 raft_consensus.cc:385] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.158684 32314 raft_consensus.cc:740] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.159667 32314 consensus_queue.cc:260] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.170084 32314 ts_tablet_manager.cc:1434] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:12:43.171078 32314 tablet_bootstrap.cc:492] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:43.173316 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:43.174111 32120 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:43.180939 32272 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:12:43.184979 32090 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:12:43.189168 32454 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:43.189711 32454 raft_consensus.cc:697] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 2 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
W20260709 13:12:43.191375 32238 consensus_peers.cc:597] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:43.193210 32499 consensus_queue.cc:1048] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:12:43.202165 32313 tablet_bootstrap.cc:654] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.202044 32555 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.190569 32454 consensus_queue.cc:237] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.202692 32555 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.205900 32555 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:43.224272 32314 tablet_bootstrap.cc:654] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.226383 32499 consensus_queue.cc:1048] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:43.227644 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:43.228976 32239 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:12:43.251947 32453 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:43.252537 32453 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.253084 32453 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.229281 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:43.245040 32316 tablet_bootstrap.cc:492] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:43.259075 32316 ts_tablet_manager.cc:1403] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.321s	user 0.022s	sys 0.030s
I20260709 13:12:43.261194 32270 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 0.
I20260709 13:12:43.261961 32316 raft_consensus.cc:359] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.262681 32316 raft_consensus.cc:385] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.262970 32316 raft_consensus.cc:740] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.263646 32316 consensus_queue.cc:260] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.265893 32316 ts_tablet_manager.cc:1434] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:12:43.266840 32316 tablet_bootstrap.cc:492] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:43.274242 32316 tablet_bootstrap.cc:654] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.266463 32453 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.281642 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:12:43.282951 32238 leader_election.cc:343] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.283720 32165 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:12:43.286058 32447 raft_consensus.cc:2804] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:43.286487 32447 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.286844 32447 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.294305 32313 tablet_bootstrap.cc:492] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
W20260709 13:12:43.295099 32165 leader_election.cc:343] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.284286 32453 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:43.285079 32499 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.297092 32499 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.300379 32499 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:43.294822 32313 ts_tablet_manager.cc:1403] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.162s	user 0.004s	sys 0.008s
I20260709 13:12:43.302269 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:43.302961 32199 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:43.304319 32238 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:12:43.305263 32453 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:43.305685 32453 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.306147 32453 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.306191 32447 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.307346 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:43.307940 32120 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.308670 32447 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:43.310400 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:43.310982 32270 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.314201 32453 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.317718 32270 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:12:43.314855 32120 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:43.316339 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:43.320910 32165 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:12:43.322044 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:43.323808 32499 consensus_queue.cc:1048] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:43.324110 32453 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:43.325335 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:43.326130 32199 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.322338 32447 raft_consensus.cc:2804] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:43.328107 32239 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:12:43.328671 32447 raft_consensus.cc:697] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
W20260709 13:12:43.331000 32239 leader_election.cc:343] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.332026 32547 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:43.332552 32547 raft_consensus.cc:697] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:12:43.334209 32547 consensus_queue.cc:237] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.332839 32313 raft_consensus.cc:359] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.335506 32313 raft_consensus.cc:385] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.335767 32313 raft_consensus.cc:740] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.336436 32313 consensus_queue.cc:260] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.338271 32199 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:43.339295 32447 consensus_queue.cc:237] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.340355 32238 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:12:43.341848 32552 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:12:43.342275 32165 leader_election.cc:343] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.342320 32552 raft_consensus.cc:697] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:12:43.343619 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:43.344604 32314 tablet_bootstrap.cc:492] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:43.343374 32552 consensus_queue.cc:237] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.345054 32314 ts_tablet_manager.cc:1403] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.174s	user 0.010s	sys 0.004s
W20260709 13:12:43.354001 32239 leader_election.cc:343] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.338799 32313 ts_tablet_manager.cc:1434] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.000s
I20260709 13:12:43.352028 32314 raft_consensus.cc:359] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.362141 32313 tablet_bootstrap.cc:492] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:43.362319 32314 raft_consensus.cc:385] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.362679 32314 raft_consensus.cc:740] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.363389 32314 consensus_queue.cc:260] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.367100 32021 catalog_manager.cc:5697] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 1 to 2, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 2 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:43.369413 32314 ts_tablet_manager.cc:1434] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 13:12:43.370566 32314 tablet_bootstrap.cc:492] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:43.371600 32316 tablet_bootstrap.cc:492] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:43.372067 32316 ts_tablet_manager.cc:1403] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.105s	user 0.005s	sys 0.005s
I20260709 13:12:43.375296 32316 raft_consensus.cc:359] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.375988 32316 raft_consensus.cc:385] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.376264 32316 raft_consensus.cc:740] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.376916 32316 consensus_queue.cc:260] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.378031 32313 tablet_bootstrap.cc:654] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.378888 32019 catalog_manager.cc:5697] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:43.379467 32316 ts_tablet_manager.cc:1434] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:12:43.381951 32316 tablet_bootstrap.cc:492] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:43.384146 32314 tablet_bootstrap.cc:654] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.388248 32316 tablet_bootstrap.cc:654] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.393052 32022 catalog_manager.cc:5697] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 0 to 1, leader changed from <none> to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:43.401440 32316 tablet_bootstrap.cc:492] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:43.403460 32316 ts_tablet_manager.cc:1403] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.000s
I20260709 13:12:43.406268 32316 raft_consensus.cc:359] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.406944 32316 raft_consensus.cc:385] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.406644 32454 consensus_queue.cc:1048] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:43.407308 32316 raft_consensus.cc:740] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.408417 32316 consensus_queue.cc:260] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.410811 32316 ts_tablet_manager.cc:1434] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:43.411923 32316 tablet_bootstrap.cc:492] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:43.406641 32021 catalog_manager.cc:5697] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:43.419826 32316 tablet_bootstrap.cc:654] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.421640 32314 tablet_bootstrap.cc:492] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:43.422210 32314 ts_tablet_manager.cc:1403] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.004s
I20260709 13:12:43.425518 32314 raft_consensus.cc:359] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.426290 32314 raft_consensus.cc:385] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.426628 32314 raft_consensus.cc:740] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.427593 32553 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.427439 32314 consensus_queue.cc:260] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.430258 32314 ts_tablet_manager.cc:1434] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.001s
I20260709 13:12:43.433653 32314 tablet_bootstrap.cc:492] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:43.430747 32454 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.428252 32553 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.437179 32454 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.440019 32553 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:43.449373 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:43.449373 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:43.452757 32454 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:43.453246 32119 raft_consensus.cc:2393] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 1: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:12:43.462414 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:43.463565 32165 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:43.466089 32314 tablet_bootstrap.cc:654] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.464794 32553 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:43.468216 32089 leader_election.cc:343] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.471822 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:43.472640 32269 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
I20260709 13:12:43.475977 32553 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:43.480021 32090 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:12:43.481205 32454 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:43.481593 32454 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.481961 32454 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.483958 32313 tablet_bootstrap.cc:492] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:43.484627 32313 ts_tablet_manager.cc:1403] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.123s	user 0.008s	sys 0.011s
I20260709 13:12:43.485209 32540 consensus_queue.cc:1048] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:43.486164 32316 tablet_bootstrap.cc:492] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:43.486693 32316 ts_tablet_manager.cc:1403] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.075s	user 0.014s	sys 0.034s
I20260709 13:12:43.489940 32316 raft_consensus.cc:359] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.490633 32316 raft_consensus.cc:385] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.490885 32316 raft_consensus.cc:740] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.491506 32316 consensus_queue.cc:260] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.497071 32316 ts_tablet_manager.cc:1434] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:12:43.498106 32316 tablet_bootstrap.cc:492] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:43.511803 32313 raft_consensus.cc:359] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.513294 32313 raft_consensus.cc:385] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.513736 32313 raft_consensus.cc:740] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.514310 32454 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.514780 32313 consensus_queue.cc:260] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.517738 32313 ts_tablet_manager.cc:1434] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.033s	user 0.002s	sys 0.005s
I20260709 13:12:43.519816 32313 tablet_bootstrap.cc:492] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:43.524011 32316 tablet_bootstrap.cc:654] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.525628 32314 tablet_bootstrap.cc:492] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:43.526117 32314 ts_tablet_manager.cc:1403] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.093s	user 0.009s	sys 0.013s
I20260709 13:12:43.529027 32314 raft_consensus.cc:359] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.533118 32314 raft_consensus.cc:385] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.533409 32314 raft_consensus.cc:740] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.534060 32314 consensus_queue.cc:260] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.536262 32314 ts_tablet_manager.cc:1434] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:12:43.537338 32314 tablet_bootstrap.cc:492] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:43.538569 32313 tablet_bootstrap.cc:654] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.551796 32316 tablet_bootstrap.cc:492] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
W20260709 13:12:43.541548 32150 tablet.cc:2406] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:12:43.554857 32314 tablet_bootstrap.cc:654] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.554994 32316 ts_tablet_manager.cc:1403] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.000s
I20260709 13:12:43.556680 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:43.557585 32316 raft_consensus.cc:359] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.558348 32316 raft_consensus.cc:385] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.558667 32316 raft_consensus.cc:740] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
W20260709 13:12:43.558897 32089 leader_election.cc:343] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.559573 32316 consensus_queue.cc:260] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.562541 32316 ts_tablet_manager.cc:1434] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:43.563833 32316 tablet_bootstrap.cc:492] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:43.567704 32314 tablet_bootstrap.cc:492] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:43.568269 32314 ts_tablet_manager.cc:1403] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.012s
I20260709 13:12:43.584712 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:43.584518 32454 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:43.584842 32314 raft_consensus.cc:359] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.586411 32314 raft_consensus.cc:385] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.586458 32553 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.586803 32314 raft_consensus.cc:740] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.587002 32553 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.587532 32314 consensus_queue.cc:260] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.589054 32314 ts_tablet_manager.cc:1434] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 13:12:43.580976 32316 tablet_bootstrap.cc:654] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.590634 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:43.589033 32553 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:43.592531 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:43.593083 32270 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.594857 32165 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:43.595669 32555 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:43.598085 32313 tablet_bootstrap.cc:492] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:43.598520 32313 ts_tablet_manager.cc:1403] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.004s
I20260709 13:12:43.609190 32314 tablet_bootstrap.cc:492] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:43.614935 32314 tablet_bootstrap.cc:654] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.614907 32270 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:12:43.616261 32090 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:12:43.617499 32454 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:43.617995 32454 raft_consensus.cc:697] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:12:43.618947 32454 consensus_queue.cc:237] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.620965 32552 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.621491 32552 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.623687 32552 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:43.626051 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:43.627660 32314 tablet_bootstrap.cc:492] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
W20260709 13:12:43.628140 32238 leader_election.cc:343] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.628304 32314 ts_tablet_manager.cc:1403] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.002s
I20260709 13:12:43.631606 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:43.631877 32314 raft_consensus.cc:359] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.632835 32314 raft_consensus.cc:385] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.633232 32314 raft_consensus.cc:740] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.634500 32314 consensus_queue.cc:260] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:12:43.636054 32239 leader_election.cc:343] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.636312 32314 ts_tablet_manager.cc:1434] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:43.636534 32239 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:43.638640 32314 tablet_bootstrap.cc:492] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:43.639835 32552 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:43.646771 32320 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.647394 32320 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.649592 32320 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:43.650278 32314 tablet_bootstrap.cc:654] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.651961 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:43.652928 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:43.653702 32195 raft_consensus.cc:2393] T 7f6867d296184651b908c8f457d74e4a P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 1: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:12:43.653955 32313 raft_consensus.cc:359] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.654606 32313 raft_consensus.cc:385] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.654860 32313 raft_consensus.cc:740] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.655438 32313 consensus_queue.cc:260] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.658430 32313 ts_tablet_manager.cc:1434] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.060s	user 0.004s	sys 0.003s
I20260709 13:12:43.657956 32019 catalog_manager.cc:5697] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 0 to 1, leader changed from <none> to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 1 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:43.659426 32313 tablet_bootstrap.cc:492] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:43.661046 32089 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:12:43.670727 32316 tablet_bootstrap.cc:492] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:43.671227 32316 ts_tablet_manager.cc:1403] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.108s	user 0.011s	sys 0.020s
I20260709 13:12:43.671635 32550 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.674023 32316 raft_consensus.cc:359] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.674726 32316 raft_consensus.cc:385] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.674983 32316 raft_consensus.cc:740] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.675616 32316 consensus_queue.cc:260] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.677621 32313 tablet_bootstrap.cc:654] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.681952 32316 ts_tablet_manager.cc:1434] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:12:43.682233 32314 tablet_bootstrap.cc:492] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:43.684553 32314 ts_tablet_manager.cc:1403] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.001s
I20260709 13:12:43.683476 32272 raft_consensus.cc:1275] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:43.685024 32316 tablet_bootstrap.cc:492] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:43.687484 32314 raft_consensus.cc:359] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.688201 32314 raft_consensus.cc:385] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.688457 32314 raft_consensus.cc:740] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.689090 32314 consensus_queue.cc:260] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.691202 32314 ts_tablet_manager.cc:1434] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:12:43.691450 32316 tablet_bootstrap.cc:654] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.692157 32314 tablet_bootstrap.cc:492] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:43.697351 32320 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:43.699268 32313 tablet_bootstrap.cc:492] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:43.699728 32313 ts_tablet_manager.cc:1403] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.003s
I20260709 13:12:43.699837 32314 tablet_bootstrap.cc:654] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.701344 32552 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.701802 32552 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.702342 32313 raft_consensus.cc:359] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.702980 32313 raft_consensus.cc:385] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.703265 32313 raft_consensus.cc:740] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.703789 32552 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:43.704255 32552 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.703900 32313 consensus_queue.cc:260] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.705716 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:43.706390 32313 ts_tablet_manager.cc:1434] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:12:43.706301 32124 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:43.707521 32239 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:43.708308 32547 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:43.708671 32547 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.708985 32547 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.709898 32195 raft_consensus.cc:1275] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:12:43.710314 32195 pending_rounds.cc:85] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 0
I20260709 13:12:43.710610 32195 pending_rounds.cc:107] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:12:43.710942 32195 raft_consensus.cc:2889] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:43.712503 32314 tablet_bootstrap.cc:492] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:43.712555 32320 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:43.713097 32314 ts_tablet_manager.cc:1403] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.006s
I20260709 13:12:43.714002 32552 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.716931 32313 tablet_bootstrap.cc:492] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:43.718640 32552 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:43.721812 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:43.722173 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:43.722821 32196 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
W20260709 13:12:43.725253 32238 leader_election.cc:343] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.726732 32238 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:12:43.720695 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:43.730950 32124 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:43.715646 32314 raft_consensus.cc:359] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.722826 32313 tablet_bootstrap.cc:654] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.732148 32314 raft_consensus.cc:385] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.732612 32314 raft_consensus.cc:740] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.733234 32314 consensus_queue.cc:260] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.735955 32314 ts_tablet_manager.cc:1434] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:12:43.736657 32540 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.736922 32314 tablet_bootstrap.cc:492] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:43.737159 32540 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.739132 32540 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:43.740401 32453 raft_consensus.cc:2804] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:43.740833 32453 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.741168 32453 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.719373 32550 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:43.746106 32313 tablet_bootstrap.cc:492] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:43.746618 32313 ts_tablet_manager.cc:1403] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.003s
I20260709 13:12:43.743203 32547 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.757452 32314 tablet_bootstrap.cc:654] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.757406 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:43.757872 32313 raft_consensus.cc:359] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.758363 32124 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.758538 32313 raft_consensus.cc:385] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.761083 32313 raft_consensus.cc:740] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.762010 32313 consensus_queue.cc:260] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.764892 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:43.765508 32270 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
I20260709 13:12:43.766402 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:43.766644 32547 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:43.767055 32199 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
I20260709 13:12:43.771783 32313 ts_tablet_manager.cc:1434] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.003s
I20260709 13:12:43.771919 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:43.772889 32313 tablet_bootstrap.cc:492] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
W20260709 13:12:43.773468 32238 leader_election.cc:343] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.775072 32089 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:43.776415 32320 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:43.780747 32320 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.783488 32320 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.781683 32316 tablet_bootstrap.cc:492] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:43.786175 32316 ts_tablet_manager.cc:1403] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.101s	user 0.013s	sys 0.019s
I20260709 13:12:43.780033 32314 tablet_bootstrap.cc:492] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:43.780236 32313 tablet_bootstrap.cc:654] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.784452 32196 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.786985 32314 ts_tablet_manager.cc:1403] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.002s
I20260709 13:12:43.788607 32553 consensus_queue.cc:1048] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:43.792824 32453 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.795256 32316 raft_consensus.cc:359] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.795969 32316 raft_consensus.cc:385] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.796218 32316 raft_consensus.cc:740] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.796868 32316 consensus_queue.cc:260] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.799259 32316 ts_tablet_manager.cc:1434] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:12:43.800103 32316 tablet_bootstrap.cc:492] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:43.801992 32552 consensus_queue.cc:1048] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:43.805160 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:43.805727 32119 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.803642 32314 raft_consensus.cc:359] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.806985 32314 raft_consensus.cc:385] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.807336 32314 raft_consensus.cc:740] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.808781 32314 consensus_queue.cc:260] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.824316 32314 ts_tablet_manager.cc:1434] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.002s
I20260709 13:12:43.840468 32314 tablet_bootstrap.cc:492] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:43.848482 32552 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.849116 32552 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.850389 32453 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:43.851294 32552 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:43.853660 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:43.854084 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:43.854348 32195 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.839105 32553 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.862900 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:43.858938 32553 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:12:43.864782 32238 leader_election.cc:343] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:43.870574 32239 leader_election.cc:343] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.939877 32320 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.883582 32239 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:43.947947 32316 tablet_bootstrap.cc:654] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.951682 32313 tablet_bootstrap.cc:492] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:43.954632 32313 ts_tablet_manager.cc:1403] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.182s	user 0.014s	sys 0.023s
I20260709 13:12:43.956288 32547 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.966379 32124 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:43.961397 32547 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.966714 32320 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:43.969182 32547 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:43.970127 32314 tablet_bootstrap.cc:654] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.970254 32553 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:43.975818 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:43.976706 32270 raft_consensus.cc:2393] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 1: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:12:43.977624 32119 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:43.977979 32313 raft_consensus.cc:359] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.978845 32313 raft_consensus.cc:385] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.979184 32313 raft_consensus.cc:740] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.979924 32313 consensus_queue.cc:260] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:43.980859 32552 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:44.003867 32313 ts_tablet_manager.cc:1434] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 13:12:44.014698 32313 tablet_bootstrap.cc:492] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
W20260709 13:12:44.015528 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 121808us
I20260709 13:12:44.006397 32195 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:44.021045 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:44.026412 32198 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.026777 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:44.027498 32197 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:44.028932 32119 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.038292 32198 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:12:44.041658 32089 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:44.017330 32362 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.041031 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:44.043763 32362 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:44.047217 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:44.047461 32540 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:44.048529 32617 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:44.020615 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 150768us
I20260709 13:12:44.055186 32617 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:44.061098 32362 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:44.061769 32272 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.062532 32617 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:44.064709 32540 raft_consensus.cc:697] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:12:44.066195 32540 consensus_queue.cc:237] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:44.067437 32239 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:12:44.068571 32617 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:44.069129 32617 raft_consensus.cc:697] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:12:44.070034 32617 consensus_queue.cc:237] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:44.078231 32316 tablet_bootstrap.cc:492] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:44.079054 32316 ts_tablet_manager.cc:1403] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.279s	user 0.018s	sys 0.002s
I20260709 13:12:44.081406 32165 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:44.085079 32363 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.095098 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:44.103734 32123 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:44.105168 32316 raft_consensus.cc:359] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:44.105947 32316 raft_consensus.cc:385] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.106232 32316 raft_consensus.cc:740] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.080722 32238 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:12:44.112901 32363 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:44.120067 32320 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.118248 32316 consensus_queue.cc:260] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:44.120566 32320 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:44.121441 32314 tablet_bootstrap.cc:492] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:44.121907 32314 ts_tablet_manager.cc:1403] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.284s	user 0.018s	sys 0.011s
I20260709 13:12:44.122104 32316 ts_tablet_manager.cc:1434] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.003s
I20260709 13:12:44.125178 32320 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:44.117586 32615 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:44.126753 32615 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.127207 32615 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.130993 32313 tablet_bootstrap.cc:654] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.138779 32314 raft_consensus.cc:359] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:44.139364 32314 raft_consensus.cc:385] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.139684 32314 raft_consensus.cc:740] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.114014 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:44.116880 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:44.140287 32314 consensus_queue.cc:260] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:44.144001 32363 consensus_queue.cc:1048] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:44.144838 32316 tablet_bootstrap.cc:492] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:44.106544 32239 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:44.153424 32314 ts_tablet_manager.cc:1434] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:12:44.145256 32122 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:44.158023 32314 tablet_bootstrap.cc:492] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:44.152252 32617 raft_consensus.cc:2804] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:44.150595 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:44.160753 32617 raft_consensus.cc:697] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:12:44.162647 32617 consensus_queue.cc:237] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:12:44.151015 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 58935.7us
I20260709 13:12:44.174513 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:12:44.176527 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 61014us
W20260709 13:12:44.177511 32089 leader_election.cc:343] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:44.175324 32616 consensus_queue.cc:1048] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:12:44.182456 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:44.184219 32453 consensus_queue.cc:1048] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:12:44.188664 32316 tablet_bootstrap.cc:654] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.194661 32021 catalog_manager.cc:5697] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 0 to 1, leader changed from <none> to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 1 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:44.196420 32239 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:44.232424 32617 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:44.232877 32617 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.233230 32617 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.240448 32272 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:12:44.254452 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:44.261370 32616 consensus_queue.cc:1048] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:44.264139 32314 tablet_bootstrap.cc:654] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.268049 32615 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:44.298930 32615 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:12:44.299772 32238 leader_election.cc:343] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:44.301499 32090 leader_election.cc:343] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:44.301956 32090 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:12:44.302009 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:44.302874 32193 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:44.306437 32070 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:44.313390 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:44.314291 32124 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.316780 32454 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:44.303489 32090 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:12:44.327116 32019 catalog_manager.cc:5697] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.330343 32019 catalog_manager.cc:5697] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.319943 32362 consensus_queue.cc:1048] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:12:44.342037 32454 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:44.353607 32313 tablet_bootstrap.cc:492] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:44.355198 32313 ts_tablet_manager.cc:1403] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.344s	user 0.027s	sys 0.003s
I20260709 13:12:44.364375 32313 raft_consensus.cc:359] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:44.365127 32313 raft_consensus.cc:385] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.365396 32313 raft_consensus.cc:740] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.371618 32313 consensus_queue.cc:260] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:44.383735 32617 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:44.389739 32617 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:44.386032 32313 ts_tablet_manager.cc:1434] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.000s
I20260709 13:12:44.396800 32316 tablet_bootstrap.cc:492] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:44.397509 32316 ts_tablet_manager.cc:1403] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.257s	user 0.011s	sys 0.010s
I20260709 13:12:44.392692 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:44.394558 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:44.397553 32313 tablet_bootstrap.cc:492] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:44.398523 32193 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:44.387476 32362 consensus_queue.cc:1048] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:44.385396 32124 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:44.401167 32316 raft_consensus.cc:359] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:44.401916 32316 raft_consensus.cc:385] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.405053 32239 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:12:44.405943 32238 leader_election.cc:343] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:44.402300 32316 raft_consensus.cc:740] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.411003 32617 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:44.416177 32617 raft_consensus.cc:697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:12:44.411837 32316 consensus_queue.cc:260] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:44.411424 32121 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:44.422739 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 54918.9us
I20260709 13:12:44.424227 32313 tablet_bootstrap.cc:654] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.426107 32316 ts_tablet_manager.cc:1434] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.001s
I20260709 13:12:44.433566 32314 tablet_bootstrap.cc:492] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:44.434075 32314 ts_tablet_manager.cc:1403] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.276s	user 0.012s	sys 0.009s
I20260709 13:12:44.445859 32314 raft_consensus.cc:359] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:44.446579 32314 raft_consensus.cc:385] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.446871 32314 raft_consensus.cc:740] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.447494 32314 consensus_queue.cc:260] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:44.457741 32626 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.458276 32626 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:44.460989 32316 tablet_bootstrap.cc:492] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:44.442713 32617 consensus_queue.cc:237] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:44.508194 32121 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:44.511369 32626 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:12:44.572261 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 111547us
I20260709 13:12:44.579051 32314 ts_tablet_manager.cc:1434] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.145s	user 0.008s	sys 0.000s
I20260709 13:12:44.592994 32314 tablet_bootstrap.cc:492] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:44.595141 32621 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.600075 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:44.598933 32540 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.605520 32540 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:44.607450 32540 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:44.607975 32239 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:12:44.595669 32621 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:12:44.642474 32238 leader_election.cc:343] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:44.643855 32634 log.cc:927] Time spent T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.097s	user 0.007s	sys 0.020s
I20260709 13:12:44.612377 32447 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.645385 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:44.634828 32552 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:44.648873 32362 consensus_queue.cc:1048] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:44.647864 32447 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:44.661453 32447 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:44.662477 32316 tablet_bootstrap.cc:654] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.652633 32197 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
I20260709 13:12:44.668246 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:44.669066 32270 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 0.
I20260709 13:12:44.652406 32552 raft_consensus.cc:697] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:12:44.670363 32552 consensus_queue.cc:237] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:44.672374 32550 consensus_queue.cc:1048] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:44.674649 32621 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:44.675444 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:44.676143 32266 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
I20260709 13:12:44.680888 32314 tablet_bootstrap.cc:654] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.654166 32626 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 13:12:44.685920 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:44.682173 32090 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:12:44.699997 32239 leader_election.cc:343] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:44.700663 32239 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:44.700044 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:44.704949 32313 tablet_bootstrap.cc:492] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:44.705514 32626 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:44.705828 32313 ts_tablet_manager.cc:1403] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.308s	user 0.028s	sys 0.035s
I20260709 13:12:44.715266 32316 tablet_bootstrap.cc:492] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:44.719173 32316 ts_tablet_manager.cc:1403] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.266s	user 0.011s	sys 0.010s
I20260709 13:12:44.707032 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:44.711436 32320 raft_consensus.cc:2804] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:44.729697 32313 raft_consensus.cc:359] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:44.730906 32313 raft_consensus.cc:385] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.731284 32313 raft_consensus.cc:740] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.732841 32313 consensus_queue.cc:260] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:44.737797 32273 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
I20260709 13:12:44.739368 32090 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:44.748445 32165 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:12:44.751847 32019 catalog_manager.cc:5697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.753458 32313 ts_tablet_manager.cc:1434] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.001s
I20260709 13:12:44.728397 32320 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.765224 32635 raft_consensus.cc:2804] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:44.769687 32313 tablet_bootstrap.cc:492] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:44.751308 32621 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:44.766183 32320 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.765844 32635 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.785540 32194 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.778321 32621 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.782438 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:44.788789 32635 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.815536 32621 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.831060 32314 tablet_bootstrap.cc:492] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:44.831574 32314 ts_tablet_manager.cc:1403] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.239s	user 0.010s	sys 0.028s
I20260709 13:12:44.874876 32316 raft_consensus.cc:359] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:44.875741 32316 raft_consensus.cc:385] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.876086 32316 raft_consensus.cc:740] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.876781 32316 consensus_queue.cc:260] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:44.879101 32316 ts_tablet_manager.cc:1434] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.160s	user 0.011s	sys 0.027s
I20260709 13:12:44.880169 32316 tablet_bootstrap.cc:492] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:44.880470 32320 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:12:44.886847 32646 log.cc:927] Time spent T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:12:44.892285 32615 consensus_queue.cc:1048] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:44.893486 32314 raft_consensus.cc:359] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:44.894191 32314 raft_consensus.cc:385] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.894462 32314 raft_consensus.cc:740] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.895073 32314 consensus_queue.cc:260] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:44.897593 32314 ts_tablet_manager.cc:1434] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.002s
I20260709 13:12:44.902321 32022 catalog_manager.cc:5697] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.905490 32314 tablet_bootstrap.cc:492] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:44.904914 32121 raft_consensus.cc:2393] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 1: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:12:44.882895 32621 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:12:44.918852 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 166497us
W20260709 13:12:44.922971 32089 leader_election.cc:343] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:44.971349 32316 tablet_bootstrap.cc:654] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.971450 32320 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:44.952483 32621 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:44.977550 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:44.980834 32266 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.981501 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:44.978775 32547 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:44.945026 32626 consensus_queue.cc:1048] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 13:12:44.982115 32267 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.994740 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:44.991870 32635 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:44.997648 32197 raft_consensus.cc:2393] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 1: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:12:45.013283 32313 tablet_bootstrap.cc:654] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.015228 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:45.016532 32635 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:45.020484 32547 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:45.053745 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:45.056195 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:45.057188 32121 raft_consensus.cc:2393] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 1: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
W20260709 13:12:45.058923 32089 leader_election.cc:343] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:45.047000 32615 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:12:45.065255 32314 tablet_bootstrap.cc:654] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.044345 32266 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:12:45.068005 32090 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:12:45.077476 32622 raft_consensus.cc:2804] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:45.078011 32622 raft_consensus.cc:697] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:12:45.079756 32316 tablet_bootstrap.cc:492] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:45.080391 32316 ts_tablet_manager.cc:1403] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.200s	user 0.009s	sys 0.036s
I20260709 13:12:45.078838 32622 consensus_queue.cc:237] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.089461 32165 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:45.096714 32615 consensus_queue.cc:1048] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:45.096994 32555 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:45.102109 32313 tablet_bootstrap.cc:492] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:45.105237 32313 ts_tablet_manager.cc:1403] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.338s	user 0.010s	sys 0.011s
I20260709 13:12:45.106364 32316 raft_consensus.cc:359] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.106982 32316 raft_consensus.cc:385] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.107239 32316 raft_consensus.cc:740] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.107837 32316 consensus_queue.cc:260] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.113755 32313 raft_consensus.cc:359] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.114732 32313 raft_consensus.cc:385] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.115062 32313 raft_consensus.cc:740] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.121474 32313 consensus_queue.cc:260] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.122824 32316 ts_tablet_manager.cc:1434] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:12:45.128813 32314 tablet_bootstrap.cc:492] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:45.132929 32314 ts_tablet_manager.cc:1403] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.230s	user 0.015s	sys 0.013s
I20260709 13:12:45.121351 32615 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.133417 32615 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.141032 32615 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:45.142532 32313 ts_tablet_manager.cc:1434] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.002s
I20260709 13:12:45.143684 32313 tablet_bootstrap.cc:492] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:45.144098 32267 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:12:45.145771 32090 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:12:45.148532 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:45.149406 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:45.150117 32636 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:12:45.153921 32238 leader_election.cc:343] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:45.155845 32636 raft_consensus.cc:697] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:12:45.149394 32120 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:45.158720 32239 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:12:45.162906 32453 raft_consensus.cc:2804] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:45.163333 32453 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.163695 32453 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.173805 32316 tablet_bootstrap.cc:492] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
W20260709 13:12:45.175029 32238 consensus_peers.cc:597] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:45.156810 32636 consensus_queue.cc:237] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.187639 32454 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.188234 32454 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.190560 32314 raft_consensus.cc:359] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.191367 32314 raft_consensus.cc:385] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.191712 32314 raft_consensus.cc:740] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.192519 32314 consensus_queue.cc:260] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.198027 32454 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:45.201694 32314 ts_tablet_manager.cc:1434] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
I20260709 13:12:45.202765 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:45.204952 32197 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
I20260709 13:12:45.207562 32314 tablet_bootstrap.cc:492] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:45.209022 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:45.209620 32266 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
I20260709 13:12:45.204797 32453 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.210443 32316 tablet_bootstrap.cc:654] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.211854 32089 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:45.220544 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:45.215816 32550 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:45.221642 32117 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.221921 32550 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.222283 32550 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.225886 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:45.224941 32453 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:12:45.229221 32238 leader_election.cc:343] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:45.231817 32313 tablet_bootstrap.cc:654] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.243163 32019 catalog_manager.cc:5697] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 0 to 1, leader changed from <none> to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 1 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:45.246616 32550 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.249310 32550 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:45.255472 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:45.256181 32194 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.261224 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:45.261885 32266 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.262945 32117 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:45.264128 32239 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:12:45.265226 32617 raft_consensus.cc:2804] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:45.266112 32617 raft_consensus.cc:697] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:12:45.266947 32617 consensus_queue.cc:237] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.274430 32194 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:12:45.276041 32089 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:45.276988 32550 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:45.277482 32550 raft_consensus.cc:697] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:12:45.277978 32314 tablet_bootstrap.cc:654] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.277736 32022 catalog_manager.cc:5697] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 0 to 1, leader changed from <none> to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 1 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:45.278509 32550 consensus_queue.cc:237] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.288774 32266 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:12:45.297279 32314 tablet_bootstrap.cc:492] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:45.297847 32314 ts_tablet_manager.cc:1403] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.091s	user 0.011s	sys 0.004s
I20260709 13:12:45.300194 32314 raft_consensus.cc:359] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.300891 32314 raft_consensus.cc:385] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.301184 32314 raft_consensus.cc:740] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.301934 32314 consensus_queue.cc:260] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.304785 32314 ts_tablet_manager.cc:1434] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:45.306051 32314 tablet_bootstrap.cc:492] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:45.306749 32313 tablet_bootstrap.cc:492] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:45.307209 32313 ts_tablet_manager.cc:1403] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.164s	user 0.007s	sys 0.007s
I20260709 13:12:45.319895 32022 catalog_manager.cc:5697] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 0 to 1, leader changed from <none> to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 1 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:45.325263 32019 catalog_manager.cc:5697] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:45.331990 32316 tablet_bootstrap.cc:492] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:45.332508 32316 ts_tablet_manager.cc:1403] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.159s	user 0.014s	sys 0.001s
I20260709 13:12:45.333025 32313 raft_consensus.cc:359] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.333843 32313 raft_consensus.cc:385] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.334156 32313 raft_consensus.cc:740] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.334960 32313 consensus_queue.cc:260] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.335259 32316 raft_consensus.cc:359] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.335904 32316 raft_consensus.cc:385] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.336175 32316 raft_consensus.cc:740] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.336820 32316 consensus_queue.cc:260] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.341764 32313 ts_tablet_manager.cc:1434] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:12:45.342571 32314 tablet_bootstrap.cc:654] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.342918 32313 tablet_bootstrap.cc:492] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:45.354110 32316 ts_tablet_manager.cc:1434] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:12:45.355782 32316 tablet_bootstrap.cc:492] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:45.361245 32636 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.361768 32636 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.371771 32316 tablet_bootstrap.cc:654] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.386293 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:12:45.387683 32089 leader_election.cc:343] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:45.392956 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:45.390208 32636 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:12:45.394351 32090 leader_election.cc:343] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:45.394780 32090 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:12:45.395474 32636 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:45.397020 32314 tablet_bootstrap.cc:492] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:45.397485 32314 ts_tablet_manager.cc:1403] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.092s	user 0.012s	sys 0.002s
I20260709 13:12:45.400177 32314 raft_consensus.cc:359] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.400871 32314 raft_consensus.cc:385] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.401144 32314 raft_consensus.cc:740] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.403323 32313 tablet_bootstrap.cc:654] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.406389 32314 consensus_queue.cc:260] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.408566 32316 tablet_bootstrap.cc:492] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:45.409184 32316 ts_tablet_manager.cc:1403] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.000s
I20260709 13:12:45.412392 32316 raft_consensus.cc:359] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.413262 32316 raft_consensus.cc:385] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.413677 32316 raft_consensus.cc:740] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.414577 32316 consensus_queue.cc:260] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:12:45.419870 32070 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:45.425019 32314 ts_tablet_manager.cc:1434] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:12:45.426913 32314 tablet_bootstrap.cc:492] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:45.433274 32314 tablet_bootstrap.cc:654] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.440019 32313 tablet_bootstrap.cc:492] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:45.440541 32313 ts_tablet_manager.cc:1403] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.098s	user 0.013s	sys 0.007s
I20260709 13:12:45.441329 32314 tablet_bootstrap.cc:492] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:45.441931 32314 ts_tablet_manager.cc:1403] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:12:45.443369 32313 raft_consensus.cc:359] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.444111 32313 raft_consensus.cc:385] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.444514 32313 raft_consensus.cc:740] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.444808 32314 raft_consensus.cc:359] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.445576 32314 raft_consensus.cc:385] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.445411 32313 consensus_queue.cc:260] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.445886 32314 raft_consensus.cc:740] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.452836 32314 consensus_queue.cc:260] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.454504 32314 ts_tablet_manager.cc:1434] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 13:12:45.454730 32316 ts_tablet_manager.cc:1434] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 13:12:45.455632 32314 tablet_bootstrap.cc:492] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:45.462519 32313 ts_tablet_manager.cc:1434] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.002s
I20260709 13:12:45.463608 32313 tablet_bootstrap.cc:492] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:45.471351 32314 tablet_bootstrap.cc:654] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.475004 32313 tablet_bootstrap.cc:654] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.482905 32316 tablet_bootstrap.cc:492] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:45.484273 32636 consensus_queue.cc:1048] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:45.485934 32617 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.487051 32617 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.491508 32313 tablet_bootstrap.cc:492] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:45.492136 32313 ts_tablet_manager.cc:1403] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.029s	user 0.005s	sys 0.012s
I20260709 13:12:45.494943 32313 raft_consensus.cc:359] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.495709 32313 raft_consensus.cc:385] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.495993 32313 raft_consensus.cc:740] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.496227 32615 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.496749 32615 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.496815 32313 consensus_queue.cc:260] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.498950 32615 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:45.500262 32316 tablet_bootstrap.cc:654] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.500638 32313 ts_tablet_manager.cc:1434] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 13:12:45.501008 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:45.501850 32313 tablet_bootstrap.cc:492] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
W20260709 13:12:45.502617 32238 leader_election.cc:343] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:45.509152 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:45.509580 32313 tablet_bootstrap.cc:654] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.509878 32122 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:45.518229 32239 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:12:45.521916 32547 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:45.522330 32547 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.522686 32547 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.529296 32313 tablet_bootstrap.cc:492] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:45.530007 32313 ts_tablet_manager.cc:1403] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.007s
I20260709 13:12:45.535176 32636 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.535712 32636 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.535867 32313 raft_consensus.cc:359] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.537647 32313 raft_consensus.cc:385] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.538022 32313 raft_consensus.cc:740] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.538084 32636 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:45.536931 32547 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.538928 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:45.539860 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:45.540298 32197 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
I20260709 13:12:45.540443 32267 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
I20260709 13:12:45.541597 32089 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:45.538918 32313 consensus_queue.cc:260] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.543807 32313 ts_tablet_manager.cc:1434] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
I20260709 13:12:45.541664 32547 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:45.545249 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:45.546342 32313 tablet_bootstrap.cc:492] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:45.548720 32636 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:45.549273 32636 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.549728 32636 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.559777 32313 tablet_bootstrap.cc:654] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:45.567328 32238 leader_election.cc:343] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:45.568725 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:45.577101 32617 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:45.569625 32122 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.595103 32547 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.595530 32198 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.595649 32547 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.592422 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:45.598517 32197 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:45.600178 32238 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:12:45.602065 32552 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:45.602535 32552 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.602948 32552 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.621870 32645 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.622648 32645 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.673166 32550 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.674057 32550 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.684293 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:45.713748 32622 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:12:45.726101 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:45.726874 32121 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:45.729408 32314 tablet_bootstrap.cc:492] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:45.730089 32314 ts_tablet_manager.cc:1403] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.275s	user 0.040s	sys 0.067s
I20260709 13:12:45.733304 32313 tablet_bootstrap.cc:492] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:45.733872 32313 ts_tablet_manager.cc:1403] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.188s	user 0.027s	sys 0.014s
I20260709 13:12:45.750586 32313 raft_consensus.cc:359] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.751431 32313 raft_consensus.cc:385] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.751714 32313 raft_consensus.cc:740] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.752249 32314 raft_consensus.cc:359] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.753010 32314 raft_consensus.cc:385] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.753304 32314 raft_consensus.cc:740] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.753892 32314 consensus_queue.cc:260] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.752429 32313 consensus_queue.cc:260] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.754535 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:45.732839 32547 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:45.774842 32552 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.780704 32645 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:45.746662 32550 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:45.809481 32635 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.814787 32635 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.817170 32555 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.817560 32122 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:45.817663 32555 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.819195 32552 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:45.819545 32555 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:45.820895 32635 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:45.821313 32636 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.822553 32117 raft_consensus.cc:2393] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 1: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:12:45.826519 32194 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.849388 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:45.850473 32121 raft_consensus.cc:2393] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 1: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:12:45.851226 32313 ts_tablet_manager.cc:1434] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.117s	user 0.006s	sys 0.005s
I20260709 13:12:45.852428 32682 consensus_queue.cc:1048] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 13:12:45.879405 32316 tablet_bootstrap.cc:492] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:45.930536 32313 tablet_bootstrap.cc:492] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:45.980626 32314 ts_tablet_manager.cc:1434] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.250s	user 0.069s	sys 0.073s
I20260709 13:12:45.984721 32316 ts_tablet_manager.cc:1403] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.502s	user 0.105s	sys 0.159s
I20260709 13:12:45.990655 32316 raft_consensus.cc:359] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:45.992681 32316 raft_consensus.cc:385] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.993229 32316 raft_consensus.cc:740] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.994408 32316 consensus_queue.cc:260] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:12:46.006503 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 273547us
I20260709 13:12:46.010695 32239 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:46.012254 32239 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:12:46.014576 32316 ts_tablet_manager.cc:1434] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 13:12:45.983067 32636 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:45.982195 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:46.032053 32316 tablet_bootstrap.cc:492] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:46.046330 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:46.047111 32198 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:46.047391 32686 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:46.048146 32686 raft_consensus.cc:697] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:12:46.034080 32197 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:46.015575 32453 consensus_queue.cc:1048] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:12:46.074591 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:46.033813 32687 raft_consensus.cc:2804] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:46.080849 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:46.074448 32645 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.078137 32687 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:46.091240 32089 leader_election.cc:343] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:46.094282 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:46.079702 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:46.094854 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:46.095512 32651 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.103919 32119 raft_consensus.cc:2393] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 1: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:12:46.101426 32687 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:46.115998 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:46.084757 32645 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:46.124776 32198 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:46.104043 32686 consensus_queue.cc:237] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:46.128964 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:46.109037 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:46.142252 32316 tablet_bootstrap.cc:654] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:46.145475 32645 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:46.141325 32199 raft_consensus.cc:2393] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 1: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:12:46.143224 32266 raft_consensus.cc:2393] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 1: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:12:46.183624 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:46.188702 32165 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:46.190485 32313 tablet_bootstrap.cc:654] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:46.114845 32651 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:46.194587 32165 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:12:46.200394 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 49039.5us
W20260709 13:12:46.209250 32238 leader_election.cc:343] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:46.210007 32238 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:46.198858 32269 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:12:46.214952 32645 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:46.211328 32550 consensus_queue.cc:1048] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:12:46.239758 32165 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:46.242718 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:46.228364 32552 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:12:46.256803 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 55154.6us
I20260709 13:12:46.246835 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:46.271675 32555 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:46.282766 32555 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:12:46.283234 32555 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:46.239796 32684 consensus_queue.cc:1048] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 13:12:46.301522 32089 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:12:46.303404 32555 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:46.304183 32695 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:46.258636 32115 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 0.
W20260709 13:12:46.331763 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 79867.3us
I20260709 13:12:46.256474 32683 consensus_queue.cc:1048] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.041s
I20260709 13:12:46.273420 32552 raft_consensus.cc:697] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:12:46.289176 32273 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 0.
W20260709 13:12:46.355052 32701 log.cc:927] Time spent T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:12:46.372308 32313 tablet_bootstrap.cc:492] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:46.372781 32313 ts_tablet_manager.cc:1403] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.449s	user 0.020s	sys 0.009s
W20260709 13:12:46.373478 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 70202.6us
W20260709 13:12:46.369553 32702 log.cc:927] Time spent T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:12:46.370059 32651 leader_election.cc:290] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:12:46.388154 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 84966.9us
I20260709 13:12:46.363462 32687 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:12:46.448694 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 49057.2us
I20260709 13:12:46.391605 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:12:46.474864 32705 log.cc:927] Time spent T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:12:46.477450 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 78917.3us
I20260709 13:12:46.481670 32316 tablet_bootstrap.cc:492] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:46.482466 32316 ts_tablet_manager.cc:1403] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.453s	user 0.019s	sys 0.022s
I20260709 13:12:46.371517 32552 consensus_queue.cc:237] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:46.495930 32165 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:46.503906 32267 raft_consensus.cc:2393] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 1: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:12:46.518302 32687 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:12:46.524466 32070 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:46.540365 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:46.540416 32313 raft_consensus.cc:359] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:46.541327 32313 raft_consensus.cc:385] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:46.541651 32313 raft_consensus.cc:740] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:46.542237 32313 consensus_queue.cc:260] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:46.542732 32653 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:46.543143 32653 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.543462 32653 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:46.543855 32313 ts_tablet_manager.cc:1434] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.171s	user 0.004s	sys 0.000s
W20260709 13:12:46.569291 32238 leader_election.cc:343] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:46.572803 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:46.585569 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:46.586373 32121 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:46.594506 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:12:46.606830 32089 leader_election.cc:343] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:46.743849 32708 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.753809 32121 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:46.757905 32316 raft_consensus.cc:359] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:46.759016 32316 raft_consensus.cc:385] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:46.759371 32316 raft_consensus.cc:740] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:46.763250 32316 consensus_queue.cc:260] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:46.741182 32653 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:46.898592 32694 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:46.901595 32193 raft_consensus.cc:1240] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:46.906880 32712 consensus_queue.cc:1059] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:46.908209 32636 raft_consensus.cc:3055] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:46.908762 32636 raft_consensus.cc:740] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:12:46.909799 32636 consensus_queue.cc:260] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:46.744412 32708 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:46.879498 32635 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:12:46.925434 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 170100us
W20260709 13:12:46.928704 32718 log.cc:927] Time spent T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
I20260709 13:12:46.929121 32239 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:12:46.917817 32636 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:46.934860 32316 ts_tablet_manager.cc:1434] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.452s	user 0.005s	sys 0.014s
I20260709 13:12:46.932757 32635 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:46.963439 32615 raft_consensus.cc:2804] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:12:46.968417 32714 log.cc:927] Time spent T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.149s	user 0.002s	sys 0.006s
I20260709 13:12:46.983654 32615 raft_consensus.cc:697] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:12:46.984441 32615 consensus_queue.cc:237] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:46.983018 32708 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:46.993280 32653 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:12:47.013666 32726 log.cc:927] Time spent T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.050s	user 0.002s	sys 0.000s
I20260709 13:12:47.014760 32635 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:47.022418 32555 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:12:47.034655 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 84870.3us
I20260709 13:12:47.044996 32316 tablet_bootstrap.cc:492] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:47.050276 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:47.051873 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:47.052716 32269 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:47.066573 32316 tablet_bootstrap.cc:654] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:47.083573 32090 leader_election.cc:343] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:47.084254 32090 leader_election.cc:304] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:12:47.085204 32698 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:47.079154 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:47.097395 32090 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:12:47.103513 32314 tablet_bootstrap.cc:492] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:47.097838 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:47.105291 32267 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:47.107081 32313 tablet_bootstrap.cc:492] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:47.110335 32683 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:47.122853 32267 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:12:47.135512 32314 tablet_bootstrap.cc:654] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:47.142048 32238 consensus_peers.cc:597] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:47.146548 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:47.147212 32120 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:47.147959 32165 leader_election.cc:343] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:47.148871 32165 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:47.149899 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:47.151328 32690 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:47.151854 32690 raft_consensus.cc:697] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:12:47.152772 32690 consensus_queue.cc:237] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.163081 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:47.168254 32453 consensus_queue.cc:1048] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:47.172612 32723 consensus_queue.cc:1048] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:47.173766 32120 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:12:47.170732 32021 catalog_manager.cc:5697] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:47.185735 32696 consensus_queue.cc:1048] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:12:47.195266 32313 tablet_bootstrap.cc:654] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:47.202674 32165 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:47.206544 32692 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:47.208169 32165 leader_election.cc:343] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:47.208726 32316 tablet_bootstrap.cc:492] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:47.208671 32165 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:47.209215 32316 ts_tablet_manager.cc:1403] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.164s	user 0.017s	sys 0.028s
I20260709 13:12:47.212996 32653 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:47.214465 32165 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:47.221726 32690 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:47.235077 32707 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.235680 32707 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.242617 32690 raft_consensus.cc:697] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:12:47.251641 32690 consensus_queue.cc:237] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.229127 32269 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:12:47.278702 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:47.281622 32707 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:47.286218 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:47.284253 32022 catalog_manager.cc:5697] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 1 to 2, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:47.288575 32238 leader_election.cc:343] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:47.296310 32316 raft_consensus.cc:359] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.302642 32316 raft_consensus.cc:385] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:47.303071 32316 raft_consensus.cc:740] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:47.315374 32314 tablet_bootstrap.cc:492] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:47.315922 32314 ts_tablet_manager.cc:1403] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.213s	user 0.020s	sys 0.008s
I20260709 13:12:47.303925 32316 consensus_queue.cc:260] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.322333 32313 tablet_bootstrap.cc:492] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:47.322819 32313 ts_tablet_manager.cc:1403] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.216s	user 0.009s	sys 0.010s
I20260709 13:12:47.322656 32314 raft_consensus.cc:359] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.323379 32314 raft_consensus.cc:385] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:47.323659 32314 raft_consensus.cc:740] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
W20260709 13:12:47.327641 32239 leader_election.cc:343] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:47.327761 32313 raft_consensus.cc:359] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.328388 32239 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:47.328758 32313 raft_consensus.cc:385] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:47.329156 32313 raft_consensus.cc:740] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:47.330271 32700 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:47.331421 32316 ts_tablet_manager.cc:1434] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.122s	user 0.009s	sys 0.000s
I20260709 13:12:47.337092 32316 tablet_bootstrap.cc:492] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:47.337886 32313 consensus_queue.cc:260] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.339737 32313 ts_tablet_manager.cc:1434] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.002s
I20260709 13:12:47.340734 32313 tablet_bootstrap.cc:492] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:47.333909 32314 consensus_queue.cc:260] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.393767 32313 tablet_bootstrap.cc:654] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:47.394729 32700 consensus_queue.cc:1048] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:47.399945 32314 ts_tablet_manager.cc:1434] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.084s	user 0.013s	sys 0.007s
I20260709 13:12:47.403653 32314 tablet_bootstrap.cc:492] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:47.410812 32314 tablet_bootstrap.cc:654] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:47.412195 32316 tablet_bootstrap.cc:654] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:47.437306 32313 tablet_bootstrap.cc:492] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:47.437819 32313 ts_tablet_manager.cc:1403] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.097s	user 0.021s	sys 0.008s
W20260709 13:12:47.439496 32238 consensus_peers.cc:597] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:47.442673 32316 tablet_bootstrap.cc:492] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:47.443293 32316 ts_tablet_manager.cc:1403] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.111s	user 0.012s	sys 0.000s
I20260709 13:12:47.448640 32316 raft_consensus.cc:359] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.449436 32316 raft_consensus.cc:385] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:47.449759 32316 raft_consensus.cc:740] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:47.450583 32313 raft_consensus.cc:359] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.451332 32313 raft_consensus.cc:385] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:47.451118 32316 consensus_queue.cc:260] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.451643 32313 raft_consensus.cc:740] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:47.452527 32313 consensus_queue.cc:260] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.455051 32313 ts_tablet_manager.cc:1434] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:12:47.456923 32313 tablet_bootstrap.cc:492] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:47.456568 32316 ts_tablet_manager.cc:1434] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:12:47.459167 32314 tablet_bootstrap.cc:492] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:47.459671 32314 ts_tablet_manager.cc:1403] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.056s	user 0.005s	sys 0.008s
I20260709 13:12:47.461253 32316 tablet_bootstrap.cc:492] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:47.482179 32019 catalog_manager.cc:5697] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:12:47.483327 32314 raft_consensus.cc:359] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.484534 32314 raft_consensus.cc:385] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:47.484879 32314 raft_consensus.cc:740] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:47.486227 32314 consensus_queue.cc:260] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.489272 32314 ts_tablet_manager.cc:1434] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:12:47.490481 32314 tablet_bootstrap.cc:492] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:47.498803 32313 tablet_bootstrap.cc:654] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:47.507501 32316 tablet_bootstrap.cc:654] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:47.515424 32685 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.516043 32685 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.513054 32022 catalog_manager.cc:5697] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 0 to 1, leader changed from <none> to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:47.526984 32314 tablet_bootstrap.cc:654] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:47.531548 32685 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:47.534984 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:47.535455 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:12:47.538405 32090 leader_election.cc:343] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:47.541041 32089 leader_election.cc:343] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:47.541462 32089 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:12:47.542452 32683 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:47.549063 32313 tablet_bootstrap.cc:492] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:47.549540 32313 ts_tablet_manager.cc:1403] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.094s	user 0.020s	sys 0.004s
I20260709 13:12:47.579624 32313 raft_consensus.cc:359] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.581816 32313 raft_consensus.cc:385] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:47.582404 32313 raft_consensus.cc:740] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:47.578330 32707 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.583851 32707 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.586269 32707 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:47.590130 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:47.591791 32199 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:47.589773 32021 catalog_manager.cc:5697] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:47.593544 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:47.593818 32238 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:12:47.594424 32120 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:47.595862 32729 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:12:47.597179 32070 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:47.603513 32708 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.604053 32708 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.606087 32708 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:47.610432 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:47.614418 32120 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:47.613389 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:47.597493 32729 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:47.621181 32729 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:47.597388 32314 tablet_bootstrap.cc:492] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:47.621840 32314 ts_tablet_manager.cc:1403] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.132s	user 0.020s	sys 0.003s
I20260709 13:12:47.583460 32313 consensus_queue.cc:260] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.630443 32316 tablet_bootstrap.cc:492] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:47.630923 32316 ts_tablet_manager.cc:1403] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.170s	user 0.040s	sys 0.013s
I20260709 13:12:47.631207 32314 raft_consensus.cc:359] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.631901 32314 raft_consensus.cc:385] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:47.632154 32314 raft_consensus.cc:740] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:47.633677 32316 raft_consensus.cc:359] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.634321 32316 raft_consensus.cc:385] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:47.634752 32316 raft_consensus.cc:740] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:47.634755 32314 consensus_queue.cc:260] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.636449 32165 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:47.640216 32716 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:47.640648 32316 consensus_queue.cc:260] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.640972 32313 ts_tablet_manager.cc:1434] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.091s	user 0.009s	sys 0.001s
I20260709 13:12:47.642747 32313 tablet_bootstrap.cc:492] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:47.649487 32729 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.624437 32708 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:12:47.669539 32316 ts_tablet_manager.cc:1434] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 13:12:47.673787 32314 ts_tablet_manager.cc:1434] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.052s	user 0.002s	sys 0.005s
I20260709 13:12:47.675028 32316 tablet_bootstrap.cc:492] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:47.663314 32685 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.682983 32314 tablet_bootstrap.cc:492] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:47.681602 32685 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.699584 32645 consensus_queue.cc:1048] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:12:47.727746 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:47.730433 32116 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:47.720988 32717 consensus_queue.cc:1048] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:12:47.742239 32685 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:47.748448 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:47.753072 32264 raft_consensus.cc:2468] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
I20260709 13:12:47.753995 32273 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:47.755784 32090 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:47.756522 32729 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:47.757946 32116 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:47.761224 32239 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:47.763373 32622 raft_consensus.cc:2804] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:47.765610 32707 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:47.772148 32622 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:47.777024 32707 raft_consensus.cc:697] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:12:47.777314 32622 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:47.778025 32707 consensus_queue.cc:237] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.784250 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:47.784901 32196 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:47.782142 32689 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:12:47.793874 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:47.794749 32191 raft_consensus.cc:2468] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
I20260709 13:12:47.808550 32314 tablet_bootstrap.cc:654] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:47.809880 32313 tablet_bootstrap.cc:654] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:47.812371 32316 tablet_bootstrap.cc:654] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:47.848747 32191 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:47.809510 32622 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.859902 32685 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.868438 32685 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.869117 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:47.869755 32268 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:47.877547 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:47.878269 32264 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 0.
I20260709 13:12:47.875437 32622 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:47.875813 32685 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:47.884873 32090 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:47.885666 32268 raft_consensus.cc:2468] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:12:47.887411 32704 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:47.887844 32704 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:47.888164 32704 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:47.860401 32196 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:47.899631 32314 tablet_bootstrap.cc:492] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:47.900342 32314 ts_tablet_manager.cc:1403] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.226s	user 0.015s	sys 0.003s
I20260709 13:12:47.911201 32090 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:47.912330 32685 raft_consensus.cc:2804] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:47.913169 32685 raft_consensus.cc:697] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:12:47.914067 32685 consensus_queue.cc:237] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.915083 32704 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.918671 32313 tablet_bootstrap.cc:492] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:47.919261 32313 ts_tablet_manager.cc:1403] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.277s	user 0.012s	sys 0.004s
I20260709 13:12:47.925752 32313 raft_consensus.cc:359] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.926656 32313 raft_consensus.cc:385] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:47.927012 32313 raft_consensus.cc:740] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:47.927976 32313 consensus_queue.cc:260] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:47.934542 32313 ts_tablet_manager.cc:1434] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.002s
I20260709 13:12:47.936092 32313 tablet_bootstrap.cc:492] T cb6ba4c5418c4645a86d8c0dd19e918b P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:47.940490 32316 tablet_bootstrap.cc:492] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:47.941026 32316 ts_tablet_manager.cc:1403] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.266s	user 0.011s	sys 0.010s
I20260709 13:12:47.961226 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:47.968495 32196 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:47.956947 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:12:48.018666 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 62249.7us
I20260709 13:12:48.038782 32704 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:48.042568 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:12:48.050232 32089 leader_election.cc:343] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:48.054073 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:48.054829 32273 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:48.057116 32089 leader_election.cc:343] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:48.062108 32314 raft_consensus.cc:359] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.062934 32314 raft_consensus.cc:385] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.063268 32314 raft_consensus.cc:740] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.070513 32196 raft_consensus.cc:2468] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:12:48.076257 32313 tablet_bootstrap.cc:654] T cb6ba4c5418c4645a86d8c0dd19e918b P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:48.077713 32766 log.cc:927] Time spent T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:12:48.084093 32316 raft_consensus.cc:359] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.071836 32021 catalog_manager.cc:5697] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:48.085414 32316 raft_consensus.cc:385] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.086031 32316 raft_consensus.cc:740] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.086277 32314 consensus_queue.cc:260] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.088336 32316 consensus_queue.cc:260] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.097878 32314 ts_tablet_manager.cc:1434] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.197s	user 0.009s	sys 0.004s
I20260709 13:12:48.095274 32316 ts_tablet_manager.cc:1434] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.154s	user 0.012s	sys 0.000s
W20260709 13:12:48.101199 32765 log.cc:927] Time spent T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:12:48.090339 32689 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.096058 32199 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.114104 32700 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.116961 32700 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.118912 32700 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:48.134145 32699 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.134634 32699 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.140296 32019 catalog_manager.cc:5697] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 0 to 1, leader changed from <none> to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 1 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:48.145054 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:48.159085 32699 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:48.163765 32316 tablet_bootstrap.cc:492] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:48.164273 32314 tablet_bootstrap.cc:492] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:48.111969 32689 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.167373 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:12:48.168406 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 50818.4us
I20260709 13:12:48.173790 32195 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:48.188714 32689 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:48.189337 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:48.190006 32116 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 0.
I20260709 13:12:48.192821 32165 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:48.194490 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:48.194872 32690 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:48.198729 32690 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:48.199172 32690 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.199345 32269 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 0.
W20260709 13:12:48.202585 32238 leader_election.cc:343] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:48.206913 32238 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:12:48.212046   300 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:48.212530   300 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:48.213325   300 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.224278 32316 tablet_bootstrap.cc:654] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.227260 32273 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:12:48.228615 32090 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:12:48.229707 32622 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:48.230443 32622 raft_consensus.cc:697] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
W20260709 13:12:48.240715 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 71574.6us
I20260709 13:12:48.243359 32622 consensus_queue.cc:237] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.234936 32690 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.251752 32690 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:48.254104 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:48.254659 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:48.254814 32116 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.255908 32314 tablet_bootstrap.cc:654] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.269345 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:48.270236 32120 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:48.271656 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:48.276100 32116 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:12:48.285964 32165 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:48.288036 32239 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:12:48.290373 32682 raft_consensus.cc:2804] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:48.291882 32689 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:48.299896 32708 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:12:48.300521 32708 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.296981 32682 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:48.305907 32682 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.308405 32689 raft_consensus.cc:697] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:12:48.309664 32708 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:48.312039 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:48.316847 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:48.318130 32316 tablet_bootstrap.cc:492] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:48.318635 32316 ts_tablet_manager.cc:1403] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.164s	user 0.025s	sys 0.014s
I20260709 13:12:48.319072 32019 catalog_manager.cc:5697] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 0 to 1, leader changed from <none> to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 1 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:48.309363 32689 consensus_queue.cc:237] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.320959 32700 consensus_queue.cc:1048] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:48.325865 32313 tablet_bootstrap.cc:492] T cb6ba4c5418c4645a86d8c0dd19e918b P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:48.326386 32313 ts_tablet_manager.cc:1403] T cb6ba4c5418c4645a86d8c0dd19e918b P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.391s	user 0.017s	sys 0.007s
I20260709 13:12:48.329262 32313 raft_consensus.cc:359] T cb6ba4c5418c4645a86d8c0dd19e918b P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.330096 32313 raft_consensus.cc:385] T cb6ba4c5418c4645a86d8c0dd19e918b P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.330412 32313 raft_consensus.cc:740] T cb6ba4c5418c4645a86d8c0dd19e918b P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.331557 32313 consensus_queue.cc:260] T cb6ba4c5418c4645a86d8c0dd19e918b P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.333178 32165 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:48.334260 32690 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:48.336404 32313 ts_tablet_manager.cc:1434] T cb6ba4c5418c4645a86d8c0dd19e918b P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:12:48.340080 32313 tablet_bootstrap.cc:492] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:48.343444 32682 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.344445 32316 raft_consensus.cc:359] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.347539 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:48.347831 32316 raft_consensus.cc:385] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.348219 32116 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.348244 32316 raft_consensus.cc:740] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.349484 32316 consensus_queue.cc:260] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.351332 32316 ts_tablet_manager.cc:1434] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 13:12:48.269951   300 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.353260 32269 raft_consensus.cc:2393] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 1: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:12:48.354245 32313 tablet_bootstrap.cc:654] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.356575 32700 consensus_queue.cc:1048] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:48.354995 32316 tablet_bootstrap.cc:492] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:48.357734 32116 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:48.363579 32682 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:48.364017 32316 tablet_bootstrap.cc:654] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.369731   300 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:48.371237 32239 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:48.372980   300 raft_consensus.cc:2804] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:48.375124   302 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.375598   302 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.377770   302 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:48.379555 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:48.380667 32115 raft_consensus.cc:2393] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 1: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:12:48.383891   300 raft_consensus.cc:697] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:12:48.384855   300 consensus_queue.cc:237] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.388324 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:12:48.401495 32239 leader_election.cc:343] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:48.404707 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:48.406831 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:48.412082 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:48.412779 32199 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:48.413583 32019 catalog_manager.cc:5697] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 0 to 1, leader changed from <none> to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:48.422541 32313 tablet_bootstrap.cc:492] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:48.423264 32313 ts_tablet_manager.cc:1403] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.083s	user 0.020s	sys 0.016s
I20260709 13:12:48.426213 32314 tablet_bootstrap.cc:492] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:48.426079 32313 raft_consensus.cc:359] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.426684 32314 ts_tablet_manager.cc:1403] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.272s	user 0.011s	sys 0.002s
I20260709 13:12:48.426828 32313 raft_consensus.cc:385] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.427150 32313 raft_consensus.cc:740] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.429618 32316 tablet_bootstrap.cc:492] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:48.429263 32314 raft_consensus.cc:359] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.429999 32314 raft_consensus.cc:385] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.430106 32316 ts_tablet_manager.cc:1403] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.077s	user 0.015s	sys 0.016s
I20260709 13:12:48.430336 32314 raft_consensus.cc:740] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.431136 32314 consensus_queue.cc:260] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.432977 32316 raft_consensus.cc:359] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.433692 32316 raft_consensus.cc:385] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.435667 32622 consensus_queue.cc:1048] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:48.436365 32238 leader_election.cc:343] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:48.437376 32238 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:48.438236 32699 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:48.443396 32238 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:48.444977 32699 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:48.445597 32699 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:48.446069 32699 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.433363 32314 ts_tablet_manager.cc:1434] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:12:48.450325 32314 tablet_bootstrap.cc:492] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:48.428037 32313 consensus_queue.cc:260] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.433972 32316 raft_consensus.cc:740] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.457787 32316 consensus_queue.cc:260] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.463325 32316 ts_tablet_manager.cc:1434] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.003s
I20260709 13:12:48.464324 32316 tablet_bootstrap.cc:492] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:48.467392 32313 ts_tablet_manager.cc:1434] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.001s
I20260709 13:12:48.468922 32313 tablet_bootstrap.cc:492] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:48.472179 32314 tablet_bootstrap.cc:654] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.481990 32316 tablet_bootstrap.cc:654] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.472465 32699 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.496840 32316 tablet_bootstrap.cc:492] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:48.517969 32316 ts_tablet_manager.cc:1403] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.002s
I20260709 13:12:48.520829 32316 raft_consensus.cc:359] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.521557 32316 raft_consensus.cc:385] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.521850 32316 raft_consensus.cc:740] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.524621 32316 consensus_queue.cc:260] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.527542 32316 ts_tablet_manager.cc:1434] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:12:48.530520 32316 tablet_bootstrap.cc:492] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06: Bootstrap starting.
I20260709 13:12:48.539883 32699 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:48.540907 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:48.541803 32199 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.547196 32019 catalog_manager.cc:5697] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:48.550321 32313 tablet_bootstrap.cc:654] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.565490 32708 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.566046 32708 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.553691 32316 tablet_bootstrap.cc:654] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.548079 32199 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:48.567682 32238 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:12:48.567971 32708 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:48.570043 32699 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:48.570833 32699 raft_consensus.cc:697] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:12:48.572078 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:48.571851 32699 consensus_queue.cc:237] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.572961 32269 raft_consensus.cc:2393] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 1: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:12:48.568462 32711 consensus_queue.cc:1048] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:12:48.594587 32313 tablet_bootstrap.cc:492] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:48.595124 32313 ts_tablet_manager.cc:1403] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.126s	user 0.013s	sys 0.003s
I20260709 13:12:48.597901 32313 raft_consensus.cc:359] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.598666 32313 raft_consensus.cc:385] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.599092 32313 raft_consensus.cc:740] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.600358 32313 consensus_queue.cc:260] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.603528 32313 ts_tablet_manager.cc:1434] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:12:48.604115 32021 catalog_manager.cc:5697] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:48.615875 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:48.617183 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:48.617759 32120 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.630393 32120 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:48.638357 32313 tablet_bootstrap.cc:492] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:48.645516 32313 tablet_bootstrap.cc:654] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.679383 32165 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:48.680236 32690 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.690070 32313 tablet_bootstrap.cc:492] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:48.690593 32313 ts_tablet_manager.cc:1403] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.053s	user 0.017s	sys 0.009s
I20260709 13:12:48.693218 32313 raft_consensus.cc:359] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.693801 32690 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:48.715055 32313 raft_consensus.cc:385] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.695597 32316 tablet_bootstrap.cc:492] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06: No bootstrap required, opened a new log
I20260709 13:12:48.697475 32711 consensus_queue.cc:1048] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:48.715391 32313 raft_consensus.cc:740] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.715744 32316 ts_tablet_manager.cc:1403] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06: Time spent bootstrapping tablet: real 0.186s	user 0.022s	sys 0.023s
I20260709 13:12:48.716075 32313 consensus_queue.cc:260] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.701114 32314 tablet_bootstrap.cc:492] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:48.717327 32314 ts_tablet_manager.cc:1403] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.267s	user 0.033s	sys 0.083s
I20260709 13:12:48.718331 32316 raft_consensus.cc:359] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.718988 32316 raft_consensus.cc:385] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.719238 32316 raft_consensus.cc:740] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.719872 32316 consensus_queue.cc:260] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.720176 32314 raft_consensus.cc:359] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.721242 32314 raft_consensus.cc:385] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.721493 32314 raft_consensus.cc:740] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.722131 32314 consensus_queue.cc:260] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.723763 32316 ts_tablet_manager.cc:1434] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:12:48.724962 32690 consensus_queue.cc:1048] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:48.728935 32314 ts_tablet_manager.cc:1434] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:12:48.730070 32314 tablet_bootstrap.cc:492] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:48.739667 32313 ts_tablet_manager.cc:1434] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 13:12:48.743335 32313 tablet_bootstrap.cc:492] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
I20260709 13:12:48.744885 32314 tablet_bootstrap.cc:654] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.760890 32314 tablet_bootstrap.cc:492] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:48.762691 32314 ts_tablet_manager.cc:1403] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.009s
I20260709 13:12:48.765575 32314 raft_consensus.cc:359] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.766280 32314 raft_consensus.cc:385] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.766533 32314 raft_consensus.cc:740] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.768139 32314 consensus_queue.cc:260] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.790954 32314 ts_tablet_manager.cc:1434] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.000s
I20260709 13:12:48.796059 32314 tablet_bootstrap.cc:492] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d: Bootstrap starting.
I20260709 13:12:48.801838 32314 tablet_bootstrap.cc:654] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.806186 32313 tablet_bootstrap.cc:654] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.806313 32708 consensus_queue.cc:1048] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:48.848050 32700 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.849597 32700 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.850121 32194 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.851563 32700 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:48.853133 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:48.853783 32124 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:48.854786 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:48.854959 32239 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:48.855382 32195 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:48.857933   300 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:48.858436   300 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:48.858891   300 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.867851 32314 tablet_bootstrap.cc:492] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d: No bootstrap required, opened a new log
I20260709 13:12:48.868382 32314 ts_tablet_manager.cc:1403] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d: Time spent bootstrapping tablet: real 0.073s	user 0.011s	sys 0.019s
I20260709 13:12:48.867827 32313 tablet_bootstrap.cc:492] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:48.869143 32313 ts_tablet_manager.cc:1403] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.129s	user 0.026s	sys 0.032s
I20260709 13:12:48.871088 32314 raft_consensus.cc:359] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.871788 32314 raft_consensus.cc:385] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.872059 32314 raft_consensus.cc:740] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.872323 32699 consensus_queue.cc:1048] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:48.871955 32313 raft_consensus.cc:359] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.872964 32314 consensus_queue.cc:260] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.874328 32313 raft_consensus.cc:385] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.874712 32313 raft_consensus.cc:740] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.875547 32313 consensus_queue.cc:260] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.877811 32313 ts_tablet_manager.cc:1434] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 13:12:48.878891 32313 tablet_bootstrap.cc:492] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801: Bootstrap starting.
W20260709 13:12:48.883260 32070 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:48.885426 32699 consensus_queue.cc:1048] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:48.886267 32313 tablet_bootstrap.cc:654] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.886585 32700 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.887053 32700 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.892628 32314 ts_tablet_manager.cc:1434] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:12:48.894325 32700 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:48.895637 32685 consensus_queue.cc:1048] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:48.891042   300 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.897042 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:48.901952 32116 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:48.902881   300 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:48.903877 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:48.904570 32116 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.904961 32239 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:48.907557   302 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:48.907940   302 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:48.908341   302 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.910794 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:48.911435 32191 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.920413 32682 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.920960 32682 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:12:48.960638 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 53855.8us
I20260709 13:12:48.980072 32191 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:48.987864 32682 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:48.974900 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:48.993924   302 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:48.994408 32313 tablet_bootstrap.cc:492] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801: No bootstrap required, opened a new log
I20260709 13:12:48.996341 32313 ts_tablet_manager.cc:1403] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801: Time spent bootstrapping tablet: real 0.118s	user 0.041s	sys 0.026s
I20260709 13:12:49.001600 32116 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:49.011953   302 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:49.014737 32313 raft_consensus.cc:359] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:49.015457 32313 raft_consensus.cc:385] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.015748 32313 raft_consensus.cc:740] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.017504 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:49.018167 32194 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:49.020988 32239 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:49.021944   302 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:49.022636   302 raft_consensus.cc:697] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:12:49.023157 32313 consensus_queue.cc:260] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:49.023536   302 consensus_queue.cc:237] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:49.024982 32313 ts_tablet_manager.cc:1434] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 13:12:49.088857 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:49.089658 32194 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:49.117940 32238 leader_election.cc:343] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.123719 32238 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:12:49.127818 32767 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:49.128242 32767 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.128628 32767 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.130893 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:49.131712 32115 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.128621 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:49.132910 32122 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 0.
I20260709 13:12:49.138234 32767 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:49.147114 32115 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:49.168447 32699 consensus_queue.cc:1048] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:49.169771 32239 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:49.172506   300 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:49.173107   300 raft_consensus.cc:697] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:12:49.174036   300 consensus_queue.cc:237] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:49.179921 32767 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:49.179812 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:49.180778 32124 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.188301 32124 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:49.189438 32239 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:12:49.190414   334 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:49.126461 32194 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:49.191069   334 raft_consensus.cc:697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:12:49.192291   334 consensus_queue.cc:237] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:49.222373 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:49.223001 32191 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.231335 32191 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:12:49.243405   302 consensus_queue.cc:1048] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:49.267226 32021 catalog_manager.cc:5697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:49.269017 32021 catalog_manager.cc:5697] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:49.279881 32021 catalog_manager.cc:5697] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:49.598683   302 consensus_queue.cc:1048] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:49.614380   300 consensus_queue.cc:1048] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:49.679514 32767 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:49.702703   334 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:49.710213   300 consensus_queue.cc:1048] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:49.738116   300 consensus_queue.cc:1048] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:51.086169 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:51.141055   356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:51.138818   355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:51.153385 30972 server_base.cc:1061] running on GCE node
W20260709 13:12:51.153200   358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:51.155620 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:51.155900 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:51.156122 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783602771156104 us; error 0 us; skew 500 ppm
I20260709 13:12:51.156782 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:51.165480 30972 webserver.cc:533] Webserver started at http://127.30.63.4:41633/ using document root <none> and password file <none>
I20260709 13:12:51.166438 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:51.166777 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:51.167286 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:51.169932 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-3-root/instance:
uuid: "94085cf341634eb686a95983b6b7f7e6"
format_stamp: "Formatted at 2026-07-09 13:12:51 on dist-test-slave-c08m"
I20260709 13:12:51.178931 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:51.216894   364 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:51.227398 30972 fs_manager.cc:730] Time spent opening block manager: real 0.041s	user 0.001s	sys 0.004s
I20260709 13:12:51.227916 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-3-root
uuid: "94085cf341634eb686a95983b6b7f7e6"
format_stamp: "Formatted at 2026-07-09 13:12:51 on dist-test-slave-c08m"
I20260709 13:12:51.228432 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:51.324723 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:51.326601 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:51.329427 30972 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:51.334162 30972 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:51.334589 30972 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:12:51.334972 30972 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:51.335239 30972 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:51.466868 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.4:40025
I20260709 13:12:51.466974   427 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.4:40025 every 8 connection(s)
I20260709 13:12:51.487854 30972 auto_leader_rebalancer-test.cc:384] add a tserver: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:12:51.503647   428 heartbeater.cc:344] Connected to a master server at 127.30.63.62:38793
I20260709 13:12:51.504088   428 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:51.504880   428 heartbeater.cc:507] Master 127.30.63.62:38793 requested a full tablet report, sending...
I20260709 13:12:51.507256 32021 ts_manager.cc:194] Registered new tserver with Master: 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:12:51.509307 32021 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59534
I20260709 13:12:52.268993 32269 consensus_queue.cc:237] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:12:52.279394 32191 raft_consensus.cc:1275] T cb6ba4c5418c4645a86d8c0dd19e918b P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:52.281407   354 consensus_queue.cc:1048] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:52.285856 32115 raft_consensus.cc:1275] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:52.292369   300 consensus_queue.cc:1048] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:52.310259   354 raft_consensus.cc:2955] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:12:52.316222 32194 raft_consensus.cc:2955] T cb6ba4c5418c4645a86d8c0dd19e918b P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
W20260709 13:12:52.320829 32236 consensus_peers.cc:597] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cb6ba4c5418c4645a86d8c0dd19e918b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:52.331205 32122 raft_consensus.cc:2955] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:12:52.371094 32269 consensus_queue.cc:237] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:12:52.367350 32021 catalog_manager.cc:5697] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: config changed from index -1 to 2, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New cstate: current_term: 1 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:52.410058 32122 raft_consensus.cc:1275] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:52.411991   334 consensus_queue.cc:1048] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:12:52.417951 32236 consensus_peers.cc:597] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ee05beb4092f41ddb391480547d90df0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:52.419680 32195 raft_consensus.cc:1275] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:52.425168   300 raft_consensus.cc:2955] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:12:52.431061 32122 raft_consensus.cc:2955] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:12:52.438436   354 consensus_queue.cc:1048] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:52.455780 32195 raft_consensus.cc:2955] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:12:52.480661 32195 consensus_queue.cc:237] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:12:52.501341 32022 catalog_manager.cc:5697] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d reported cstate change: config changed from index -1 to 2, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New cstate: current_term: 1 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:12:52.513123   428 heartbeater.cc:499] Master 127.30.63.62:38793 was elected leader, sending a full tablet report...
I20260709 13:12:52.525233 32115 raft_consensus.cc:1275] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:52.526816   439 consensus_queue.cc:1048] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:52.530658 32264 raft_consensus.cc:1275] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:52.534886   439 consensus_queue.cc:1048] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:52.543515 32162 consensus_peers.cc:597] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4a6ce5ae89cb4ad08c24a3a10d6fc0c2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:52.544255   350 raft_consensus.cc:2955] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:12:52.545605 32115 raft_consensus.cc:2955] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:12:52.565203 32267 consensus_queue.cc:237] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:12:52.570076 32021 catalog_manager.cc:5697] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 reported cstate change: config changed from index -1 to 2, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New cstate: current_term: 1 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:52.586241 32264 raft_consensus.cc:2955] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
W20260709 13:12:52.613981 32236 consensus_peers.cc:597] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7f6867d296184651b908c8f457d74e4a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:52.623005 32122 raft_consensus.cc:1275] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:52.624435   354 consensus_queue.cc:1048] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:52.622375 32194 raft_consensus.cc:1275] T 7f6867d296184651b908c8f457d74e4a P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:52.627077   334 consensus_queue.cc:1048] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:52.639233   300 raft_consensus.cc:2955] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:12:52.648010 32122 raft_consensus.cc:2955] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:12:52.669685 32019 catalog_manager.cc:5697] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d reported cstate change: config changed from index -1 to 2, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New cstate: current_term: 1 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:12:52.697975   457 ts_tablet_manager.cc:933] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:52.711088 32194 raft_consensus.cc:2955] T 7f6867d296184651b908c8f457d74e4a P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:12:52.749220   457 tablet_copy_client.cc:323] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Beginning tablet copy session from remote peer at address 127.30.63.3:36651
I20260709 13:12:52.791783 32283 tablet_copy_service.cc:140] P 6b3ed521ce8947db80c4b4828b355c06: Received BeginTabletCopySession request for tablet cb6ba4c5418c4645a86d8c0dd19e918b from peer 94085cf341634eb686a95983b6b7f7e6 ({username='slave'} at 127.0.0.1:50584)
I20260709 13:12:52.792327 32283 tablet_copy_service.cc:161] P 6b3ed521ce8947db80c4b4828b355c06: Beginning new tablet copy session on tablet cb6ba4c5418c4645a86d8c0dd19e918b from peer 94085cf341634eb686a95983b6b7f7e6 at {username='slave'} at 127.0.0.1:50584: session id = 94085cf341634eb686a95983b6b7f7e6-cb6ba4c5418c4645a86d8c0dd19e918b
I20260709 13:12:52.801036 32283 tablet_copy_source_session.cc:215] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:52.807713   457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb6ba4c5418c4645a86d8c0dd19e918b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:52.825569   461 ts_tablet_manager.cc:933] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:52.829484   461 tablet_copy_client.cc:323] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Beginning tablet copy session from remote peer at address 127.30.63.3:36651
I20260709 13:12:52.831173 32283 tablet_copy_service.cc:140] P 6b3ed521ce8947db80c4b4828b355c06: Received BeginTabletCopySession request for tablet ee05beb4092f41ddb391480547d90df0 from peer 94085cf341634eb686a95983b6b7f7e6 ({username='slave'} at 127.0.0.1:50584)
I20260709 13:12:52.831634 32283 tablet_copy_service.cc:161] P 6b3ed521ce8947db80c4b4828b355c06: Beginning new tablet copy session on tablet ee05beb4092f41ddb391480547d90df0 from peer 94085cf341634eb686a95983b6b7f7e6 at {username='slave'} at 127.0.0.1:50584: session id = 94085cf341634eb686a95983b6b7f7e6-ee05beb4092f41ddb391480547d90df0
I20260709 13:12:52.838243   457 tablet_copy_client.cc:806] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:52.839059   457 tablet_copy_client.cc:670] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:52.848541 32283 tablet_copy_source_session.cc:215] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:52.850724   457 tablet_copy_client.cc:538] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:52.854128   461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee05beb4092f41ddb391480547d90df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:52.861040   457 tablet_bootstrap.cc:492] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6: Bootstrap starting.
I20260709 13:12:52.895401   457 tablet_bootstrap.cc:492] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:52.896648   457 tablet_bootstrap.cc:492] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6: Bootstrap complete.
I20260709 13:12:52.897431   457 ts_tablet_manager.cc:1403] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6: Time spent bootstrapping tablet: real 0.037s	user 0.020s	sys 0.011s
I20260709 13:12:52.901968   457 raft_consensus.cc:359] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:12:52.902925   457 raft_consensus.cc:740] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Initialized, Role: LEARNER
I20260709 13:12:52.903709   457 consensus_queue.cc:260] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:12:52.916118   457 ts_tablet_manager.cc:1434] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6: Time spent starting tablet: real 0.017s	user 0.012s	sys 0.001s
I20260709 13:12:52.921154 32283 tablet_copy_service.cc:342] P 6b3ed521ce8947db80c4b4828b355c06: Request end of tablet copy session 94085cf341634eb686a95983b6b7f7e6-cb6ba4c5418c4645a86d8c0dd19e918b received from {username='slave'} at 127.0.0.1:50584
I20260709 13:12:52.921790 32283 tablet_copy_service.cc:434] P 6b3ed521ce8947db80c4b4828b355c06: ending tablet copy session 94085cf341634eb686a95983b6b7f7e6-cb6ba4c5418c4645a86d8c0dd19e918b on tablet cb6ba4c5418c4645a86d8c0dd19e918b with peer 94085cf341634eb686a95983b6b7f7e6
I20260709 13:12:52.926259   465 ts_tablet_manager.cc:933] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:52.965409   465 tablet_copy_client.cc:323] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Beginning tablet copy session from remote peer at address 127.30.63.2:44517
I20260709 13:12:52.978978 32209 tablet_copy_service.cc:140] P 113b5461952d47e0944d463ea4e32801: Received BeginTabletCopySession request for tablet 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 from peer 94085cf341634eb686a95983b6b7f7e6 ({username='slave'} at 127.0.0.1:56926)
I20260709 13:12:52.979650 32209 tablet_copy_service.cc:161] P 113b5461952d47e0944d463ea4e32801: Beginning new tablet copy session on tablet 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 from peer 94085cf341634eb686a95983b6b7f7e6 at {username='slave'} at 127.0.0.1:56926: session id = 94085cf341634eb686a95983b6b7f7e6-4a6ce5ae89cb4ad08c24a3a10d6fc0c2
I20260709 13:12:52.988759 32209 tablet_copy_source_session.cc:215] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:52.993981   465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a6ce5ae89cb4ad08c24a3a10d6fc0c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:53.010834   465 tablet_copy_client.cc:806] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:53.011472   465 tablet_copy_client.cc:670] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:53.015462   465 tablet_copy_client.cc:538] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:53.026453   465 tablet_bootstrap.cc:492] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap starting.
I20260709 13:12:53.064098   465 tablet_bootstrap.cc:492] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:53.065104   465 tablet_bootstrap.cc:492] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap complete.
I20260709 13:12:53.065827   465 ts_tablet_manager.cc:1403] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6: Time spent bootstrapping tablet: real 0.040s	user 0.023s	sys 0.008s
I20260709 13:12:53.069044   465 raft_consensus.cc:359] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:12:53.069931   465 raft_consensus.cc:740] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Initialized, Role: LEARNER
I20260709 13:12:53.070652   465 consensus_queue.cc:260] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:12:53.076160   457 ts_tablet_manager.cc:933] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:53.085522   465 ts_tablet_manager.cc:1434] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 13:12:53.086334   461 tablet_copy_client.cc:806] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:53.090010   461 tablet_copy_client.cc:670] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:53.090894   457 tablet_copy_client.cc:323] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Beginning tablet copy session from remote peer at address 127.30.63.3:36651
I20260709 13:12:53.091039 32209 tablet_copy_service.cc:342] P 113b5461952d47e0944d463ea4e32801: Request end of tablet copy session 94085cf341634eb686a95983b6b7f7e6-4a6ce5ae89cb4ad08c24a3a10d6fc0c2 received from {username='slave'} at 127.0.0.1:56926
I20260709 13:12:53.091557 32209 tablet_copy_service.cc:434] P 113b5461952d47e0944d463ea4e32801: ending tablet copy session 94085cf341634eb686a95983b6b7f7e6-4a6ce5ae89cb4ad08c24a3a10d6fc0c2 on tablet 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 with peer 94085cf341634eb686a95983b6b7f7e6
I20260709 13:12:53.094267 32282 tablet_copy_service.cc:140] P 6b3ed521ce8947db80c4b4828b355c06: Received BeginTabletCopySession request for tablet 7f6867d296184651b908c8f457d74e4a from peer 94085cf341634eb686a95983b6b7f7e6 ({username='slave'} at 127.0.0.1:50584)
I20260709 13:12:53.094830 32282 tablet_copy_service.cc:161] P 6b3ed521ce8947db80c4b4828b355c06: Beginning new tablet copy session on tablet 7f6867d296184651b908c8f457d74e4a from peer 94085cf341634eb686a95983b6b7f7e6 at {username='slave'} at 127.0.0.1:50584: session id = 94085cf341634eb686a95983b6b7f7e6-7f6867d296184651b908c8f457d74e4a
I20260709 13:12:53.095219   461 tablet_copy_client.cc:538] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:53.122140   461 tablet_bootstrap.cc:492] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap starting.
I20260709 13:12:53.130879 32282 tablet_copy_source_session.cc:215] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:53.134060   457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f6867d296184651b908c8f457d74e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:53.158973   403 raft_consensus.cc:1217] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:53.210182   457 tablet_copy_client.cc:806] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:53.210857   457 tablet_copy_client.cc:670] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:53.214656   457 tablet_copy_client.cc:538] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:53.227486   457 tablet_bootstrap.cc:492] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6: Bootstrap starting.
I20260709 13:12:53.229848   461 tablet_bootstrap.cc:492] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:53.231097   461 tablet_bootstrap.cc:492] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap complete.
I20260709 13:12:53.231855   461 ts_tablet_manager.cc:1403] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6: Time spent bootstrapping tablet: real 0.110s	user 0.016s	sys 0.012s
I20260709 13:12:53.235378   461 raft_consensus.cc:359] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:12:53.236357   461 raft_consensus.cc:740] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Initialized, Role: LEARNER
I20260709 13:12:53.237145   461 consensus_queue.cc:260] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:12:53.246519   461 ts_tablet_manager.cc:1434] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:12:53.255437 32282 tablet_copy_service.cc:342] P 6b3ed521ce8947db80c4b4828b355c06: Request end of tablet copy session 94085cf341634eb686a95983b6b7f7e6-ee05beb4092f41ddb391480547d90df0 received from {username='slave'} at 127.0.0.1:50584
I20260709 13:12:53.255956 32282 tablet_copy_service.cc:434] P 6b3ed521ce8947db80c4b4828b355c06: ending tablet copy session 94085cf341634eb686a95983b6b7f7e6-ee05beb4092f41ddb391480547d90df0 on tablet ee05beb4092f41ddb391480547d90df0 with peer 94085cf341634eb686a95983b6b7f7e6
I20260709 13:12:53.265313   457 tablet_bootstrap.cc:492] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:53.266419   457 tablet_bootstrap.cc:492] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6: Bootstrap complete.
I20260709 13:12:53.267194   457 ts_tablet_manager.cc:1403] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6: Time spent bootstrapping tablet: real 0.040s	user 0.017s	sys 0.008s
I20260709 13:12:53.270511   457 raft_consensus.cc:359] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:12:53.271535   457 raft_consensus.cc:740] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Initialized, Role: LEARNER
I20260709 13:12:53.272307   457 consensus_queue.cc:260] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:12:53.281843   457 ts_tablet_manager.cc:1434] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:12:53.286453   403 raft_consensus.cc:1217] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:53.288527 32282 tablet_copy_service.cc:342] P 6b3ed521ce8947db80c4b4828b355c06: Request end of tablet copy session 94085cf341634eb686a95983b6b7f7e6-7f6867d296184651b908c8f457d74e4a received from {username='slave'} at 127.0.0.1:50584
I20260709 13:12:53.289076 32282 tablet_copy_service.cc:434] P 6b3ed521ce8947db80c4b4828b355c06: ending tablet copy session 94085cf341634eb686a95983b6b7f7e6-7f6867d296184651b908c8f457d74e4a on tablet 7f6867d296184651b908c8f457d74e4a with peer 94085cf341634eb686a95983b6b7f7e6
I20260709 13:12:53.501869   403 raft_consensus.cc:1217] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:53.545535   403 raft_consensus.cc:1217] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:53.563838   456 raft_consensus.cc:1064] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:12:53.566962   456 consensus_queue.cc:237] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:12:53.577040   403 raft_consensus.cc:1275] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 1 LEARNER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:53.579496 32116 raft_consensus.cc:1275] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:53.581677   354 consensus_queue.cc:1048] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:53.583463 32191 raft_consensus.cc:1275] T cb6ba4c5418c4645a86d8c0dd19e918b P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:53.583611   354 consensus_queue.cc:1048] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:53.585676   456 consensus_queue.cc:1048] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:53.610402   354 raft_consensus.cc:2955] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:12:53.612215 32191 raft_consensus.cc:2955] T cb6ba4c5418c4645a86d8c0dd19e918b P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:12:53.630575 32124 raft_consensus.cc:2955] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:12:53.637202   403 raft_consensus.cc:2955] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:12:53.656121 32022 catalog_manager.cc:5697] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 2 to 3, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:12:53.675616   477 log.cc:927] Time spent T cb6ba4c5418c4645a86d8c0dd19e918b P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:12:53.731365 32269 consensus_queue.cc:237] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:12:53.760706   403 raft_consensus.cc:1275] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:53.762575   354 consensus_queue.cc:1048] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:53.763058 32124 raft_consensus.cc:1275] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:53.765652   458 consensus_queue.cc:1048] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:53.770929   334 raft_consensus.cc:2955] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:12:53.788874   403 raft_consensus.cc:2955] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:12:53.792425 32116 raft_consensus.cc:2955] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:12:53.819433 32009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cb6ba4c5418c4645a86d8c0dd19e918b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:53.837520 32020 catalog_manager.cc:5697] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d reported cstate change: config changed from index 3 to 4, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New cstate: current_term: 1 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:12:53.853008 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 45644.7us
I20260709 13:12:53.856205 32181 tablet_service.cc:1558] Processing DeleteTablet for tablet cb6ba4c5418c4645a86d8c0dd19e918b with delete_type TABLET_DATA_TOMBSTONED (TS 113b5461952d47e0944d463ea4e32801 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54162
I20260709 13:12:53.865682   483 tablet_replica.cc:333] T cb6ba4c5418c4645a86d8c0dd19e918b P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:12:53.866981   483 raft_consensus.cc:2243] T cb6ba4c5418c4645a86d8c0dd19e918b P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:53.867882   483 raft_consensus.cc:2272] T cb6ba4c5418c4645a86d8c0dd19e918b P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:53.876022   483 ts_tablet_manager.cc:1916] T cb6ba4c5418c4645a86d8c0dd19e918b P 113b5461952d47e0944d463ea4e32801: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:53.884153   456 raft_consensus.cc:1064] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:12:53.886963   456 consensus_queue.cc:237] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:12:53.892737   483 ts_tablet_manager.cc:1929] T cb6ba4c5418c4645a86d8c0dd19e918b P 113b5461952d47e0944d463ea4e32801: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:53.893430   483 log.cc:1199] T cb6ba4c5418c4645a86d8c0dd19e918b P 113b5461952d47e0944d463ea4e32801: Deleting WAL directory at /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-1-root/wals/cb6ba4c5418c4645a86d8c0dd19e918b
I20260709 13:12:53.895308 32008 catalog_manager.cc:5028] TS 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): tablet cb6ba4c5418c4645a86d8c0dd19e918b (table test-workload [id=9b9dc20f98e547b59efac9c530f28125]) successfully deleted
I20260709 13:12:53.909245   402 raft_consensus.cc:1275] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 1 LEARNER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:53.911015   482 consensus_queue.cc:1048] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:53.920770 32116 raft_consensus.cc:1275] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:53.922737   456 consensus_queue.cc:1048] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:53.924394 32194 raft_consensus.cc:1275] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:53.938856   354 consensus_queue.cc:1048] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:53.940881   458 raft_consensus.cc:2955] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:12:53.941089 32116 raft_consensus.cc:2955] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:12:53.954044   402 raft_consensus.cc:2955] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:12:53.960057 32020 catalog_manager.cc:5697] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d reported cstate change: config changed from index 2 to 3, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:12:53.980376 32194 raft_consensus.cc:2955] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:12:54.017307   334 raft_consensus.cc:1064] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:12:54.021520   334 consensus_queue.cc:237] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:12:54.030579 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 59785us
I20260709 13:12:54.048852   488 raft_consensus.cc:1064] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:12:54.052562   488 consensus_queue.cc:237] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:12:54.063021   402 raft_consensus.cc:1275] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 1 LEARNER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:54.064888 32115 raft_consensus.cc:1275] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:54.066459   482 consensus_queue.cc:1048] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:54.068281   482 consensus_queue.cc:1048] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:54.070825 32195 raft_consensus.cc:1275] T 7f6867d296184651b908c8f457d74e4a P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:54.078171   482 consensus_queue.cc:1048] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:54.099357   334 raft_consensus.cc:2955] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:12:54.101305   403 raft_consensus.cc:2955] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:12:54.118412   402 raft_consensus.cc:1275] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 1 LEARNER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:54.121001 32267 raft_consensus.cc:1275] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:54.121176 32124 raft_consensus.cc:1275] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:54.122491   493 consensus_queue.cc:1048] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:54.118955 32195 raft_consensus.cc:2955] T 7f6867d296184651b908c8f457d74e4a P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:12:54.125622   473 consensus_queue.cc:1048] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:54.124303 32115 raft_consensus.cc:2955] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:12:54.126214 32020 catalog_manager.cc:5697] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: config changed from index 2 to 3, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:54.127657   473 consensus_queue.cc:1048] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:54.164424 32269 consensus_queue.cc:237] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:12:54.177570   403 raft_consensus.cc:1275] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:54.179534 32122 raft_consensus.cc:1275] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:54.191823   458 consensus_queue.cc:1048] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:54.201651   456 consensus_queue.cc:1048] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:54.212908   334 raft_consensus.cc:2955] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:12:54.219020 32120 raft_consensus.cc:2955] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:12:54.292773 32009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7f6867d296184651b908c8f457d74e4a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:54.301419   401 raft_consensus.cc:2955] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:12:54.317708   488 raft_consensus.cc:2955] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:12:54.391821 32120 raft_consensus.cc:2955] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:12:55.053889 32021 catalog_manager.cc:5697] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d reported cstate change: config changed from index 3 to 4, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New cstate: current_term: 1 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:12:55.150734 32267 raft_consensus.cc:2955] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:12:55.196317 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 121285us
W20260709 13:12:55.302561 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 118620us
I20260709 13:12:55.307403   503 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:12:55.310197   503 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:55.245811   401 raft_consensus.cc:2955] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:12:55.308800   488 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:12:55.348806   503 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:55.349114   500 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:12:55.349789   500 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:12:55.360201 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 119386us
I20260709 13:12:55.363989   500 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:55.356827   488 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:55.378010   488 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:55.374532   458 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:12:55.394486 32145 debug-util.cc:398] Leaking SignalData structure 0x7b08000d4a40 after lost signal to thread 30975
W20260709 13:12:55.401772 32145 debug-util.cc:398] Leaking SignalData structure 0x7b08001cc620 after lost signal to thread 32056
I20260709 13:12:55.405282 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:55.407019 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:55.387233   515 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:12:55.408676   458 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:55.431978   458 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:55.429587   517 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:12:55.433773 32124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 533) took 1097 ms. Trace:
I20260709 13:12:55.434080   517 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:55.434252 32124 rpcz_store.cc:276] 0709 13:12:54.336395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:55.433011 (+1096616us) service_pool.cc:224] Handling call
0709 13:12:55.433306 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:55.433471 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:55.433496 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:55.433531 (+    35us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:55.433557 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:55.433608 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:55.433716 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:55.445685   517 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:12:55.458211 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 131220us
I20260709 13:12:55.464486   509 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:12:55.422250   515 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:12:55.465209   509 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:12:55.472934 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:55.477345   470 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:12:55.478103   509 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:12:55.478015   470 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:55.465934   503 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:12:55.483481 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:55.488865   521 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:12:55.463742   500 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:12:55.491899 32145 debug-util.cc:398] Leaking SignalData structure 0x7b0800206bc0 after lost signal to thread 32148
I20260709 13:12:55.492017 32116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 540) took 1106 ms. Trace:
W20260709 13:12:55.493278 32145 debug-util.cc:398] Leaking SignalData structure 0x7b0800206be0 after lost signal to thread 32149
I20260709 13:12:55.493292 32116 rpcz_store.cc:276] 0709 13:12:54.385765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:55.491471 (+1105706us) service_pool.cc:224] Handling call
0709 13:12:55.491683 (+   212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:55.491801 (+   118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:55.491816 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:55.491843 (+    27us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:55.491860 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:55.491891 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:55.491974 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:55.494809 32089 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:12:55.495918 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:55.489461   521 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:12:55.500180   500 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:55.500994 32190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 447) took 1111 ms. Trace:
I20260709 13:12:55.501369 32190 rpcz_store.cc:276] 0709 13:12:54.389433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:55.489820 (+1100387us) service_pool.cc:224] Handling call
0709 13:12:55.497495 (+  7675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:55.500512 (+  3017us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:55.500541 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:55.500616 (+    75us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:55.500650 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:55.500716 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:55.500830 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:55.502274   500 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:55.483537   503 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:12:55.503360 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:55.505199   503 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:12:55.503535   470 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:12:55.508690 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 126892us
I20260709 13:12:55.510792 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:55.520170   525 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:12:55.525082 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:55.525175 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:55.512110 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:55.526571 32190 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 1.
I20260709 13:12:55.520767   525 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:55.529153   525 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:55.531801   515 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:55.529642   350 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:12:55.533370   350 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:12:55.535887 32145 debug-util.cc:398] Leaking SignalData structure 0x7b080010e340 after lost signal to thread 32223
I20260709 13:12:55.537041   521 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:55.539206   501 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:55.537138   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:12:55.547580   350 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:55.557559   514 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:12:55.558092   514 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:55.563661 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:55.567247   514 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:55.569199 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:55.546034   401 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:12:55.574014 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:55.576280 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:55.577862 32022 catalog_manager.cc:5697] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 reported cstate change: config changed from index 2 to 3, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:55.588487 32145 debug-util.cc:398] Leaking SignalData structure 0x7b0800319e60 after lost signal to thread 32297
W20260709 13:12:55.588866 32145 debug-util.cc:398] Leaking SignalData structure 0x7b0800319e20 after lost signal to thread 32298
W20260709 13:12:55.589913 32145 debug-util.cc:398] Leaking SignalData structure 0x7b080016e680 after lost signal to thread 428
I20260709 13:12:55.590128 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:55.593923 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:55.595674 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:12:55.613060 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 118335us
I20260709 13:12:55.616756 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:55.617100 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:55.617381 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:55.630442 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:55.632382   514 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:12:55.633188   514 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:12:55.634001 32089 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:12:55.635319   502 raft_consensus.cc:2749] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:55.635602 32089 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:12:55.636433   527 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:55.637051 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:55.637719   514 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:12:55.638010 32119 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:12:55.638463 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:55.639587   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:12:55.641788 32089 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:12:55.643803 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:55.697366   527 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:55.649111 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:12:55.697499 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 55794.5us
I20260709 13:12:55.649919 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:55.654516 32020 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59534 (request call id 19) took 1318 ms. Trace:
I20260709 13:12:55.654922 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:55.698280 32089 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:12:55.699142   527 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:55.699249 32239 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:55.699780 32020 rpcz_store.cc:276] 0709 13:12:54.336435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:54.336622 (+   187us) service_pool.cc:224] Handling call
0709 13:12:55.654357 (+1317735us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":715973,"reported_tablets":1}
I20260709 13:12:55.662624 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:55.668735 32165 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:55.671259   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:12:55.673050 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:55.701893 32165 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:12:55.702345   519 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:55.702912   513 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:55.703109 32165 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:55.700380 32239 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:55.704123   513 raft_consensus.cc:2804] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:55.704207   350 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:55.704568   513 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:12:55.704982   513 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:55.685316 32181 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f6867d296184651b908c8f457d74e4a with delete_type TABLET_DATA_TOMBSTONED (TS 113b5461952d47e0944d463ea4e32801 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54162
I20260709 13:12:55.705494   519 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:55.693588 32192 consensus_queue.cc:237] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:12:55.683359 32021 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49534 (request call id 148) took 1394 ms. Trace:
I20260709 13:12:55.654542 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:55.704902 32239 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:55.694240 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:55.711046 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:55.711957 32239 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:55.712157 32165 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:55.713649   493 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:55.714762   519 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:55.715377   493 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:55.717672   519 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:55.710016 32021 rpcz_store.cc:276] 0709 13:12:54.289205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:54.289341 (+   136us) service_pool.cc:224] Handling call
0709 13:12:55.682168 (+1392827us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b68000b0960. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4daa0ca 00007fb5a4da8808 00007fb5a4da6e40 00007fb5a4eaec3e 00007fb5a336f2a4 00007fb5a336f232 00007fb5a336f161 00007fb5a336f0dc 00007fb5a336e392 00007fb59d32c48c
0709 13:12:55.683301 (+  1133us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:55.189447 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:55.206482 (+ 17035us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:55.206534 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:12:55.206562 (+    28us) tablet.cc:662] Decoding operations
0709 13:12:55.206980 (+   418us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:55.207063 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:55.207106 (+    43us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:12:55.207345 (+   239us) tablet.cc:701] Row locks acquired
0709 13:12:55.207393 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:12:55.207693 (+   300us) write_op.cc:270] Start()
0709 13:12:55.207834 (+   141us) write_op.cc:276] Timestamp: P: 1783602775207632 usec, L: 0
0709 13:12:55.207868 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:12:55.218568 (+ 10700us) log.cc:844] Serialized 529 byte log entry
0709 13:12:55.571701 (+353133us) op_driver.cc:464] REPLICATION: finished
0709 13:12:55.641711 (+ 70010us) write_op.cc:301] APPLY: starting
0709 13:12:55.641789 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:55.641885 (+    96us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:55.642019 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:55.642244 (+   225us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:55.642387 (+   143us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:12:55.642445 (+    58us) write_op.cc:312] APPLY: finished
0709 13:12:55.642648 (+   203us) log.cc:844] Serialized 22 byte log entry
0709 13:12:55.642800 (+   152us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:55.642867 (+    67us) write_op.cc:454] Released schema lock
0709 13:12:55.642914 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:55.643234 (+   320us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:55.643266 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":753360,"reported_tablets":1,"spinlock_wait_cycles":50566016,"child_traces":[["op",{"apply.queue_time_us":69746,"apply.run_cpu_time_us":1528,"apply.run_wall_time_us":1528,"num_ops":1,"prepare.queue_time_us":122775,"prepare.run_cpu_time_us":3513,"prepare.run_wall_time_us":51713,"replication_time_us":363698,"thread_start_us":69414,"threads_started":1}]]}
I20260709 13:12:55.721022   513 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:12:55.740854   369 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:55.741652   513 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:12:55.742677   526 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:55.749593   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:12:55.770947 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:12:55.773608 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:55.775010 32266 consensus_queue.cc:237] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:12:55.802511 32165 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:55.803426   514 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:55.804755   403 raft_consensus.cc:1275] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:55.806308   514 consensus_queue.cc:1048] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:55.809478   535 tablet_replica.cc:333] T 7f6867d296184651b908c8f457d74e4a P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:12:55.814402   508 raft_consensus.cc:2955] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:12:55.815727   403 raft_consensus.cc:1275] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:55.817497   535 raft_consensus.cc:2243] T 7f6867d296184651b908c8f457d74e4a P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.817193   401 raft_consensus.cc:2955] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:12:55.818451   535 raft_consensus.cc:2272] T 7f6867d296184651b908c8f457d74e4a P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.818120   482 consensus_queue.cc:1048] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:55.821508 32192 raft_consensus.cc:1240] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:55.823414   482 consensus_queue.cc:1059] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:55.830133   519 raft_consensus.cc:3055] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:55.830605   519 raft_consensus.cc:740] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:12:55.831557   519 consensus_queue.cc:260] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:12:55.832631 32121 raft_consensus.cc:1275] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:55.854777 32021 catalog_manager.cc:5697] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 3 to 4, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New cstate: current_term: 1 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:12:55.852332   535 ts_tablet_manager.cc:1916] T 7f6867d296184651b908c8f457d74e4a P 113b5461952d47e0944d463ea4e32801: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:55.859815 32008 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:55.866073   488 consensus_queue.cc:1048] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:55.867934 32259 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 with delete_type TABLET_DATA_TOMBSTONED (TS 6b3ed521ce8947db80c4b4828b355c06 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36066
I20260709 13:12:55.870373   519 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:55.876320 32121 raft_consensus.cc:2955] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:12:55.894126   539 tablet_replica.cc:333] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:12:55.895570   539 raft_consensus.cc:2243] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.895872   535 ts_tablet_manager.cc:1929] T 7f6867d296184651b908c8f457d74e4a P 113b5461952d47e0944d463ea4e32801: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:55.896333   539 raft_consensus.cc:2272] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.896396   535 log.cc:1199] T 7f6867d296184651b908c8f457d74e4a P 113b5461952d47e0944d463ea4e32801: Deleting WAL directory at /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-1-root/wals/7f6867d296184651b908c8f457d74e4a
I20260709 13:12:55.905531   539 ts_tablet_manager.cc:1916] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 6b3ed521ce8947db80c4b4828b355c06: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:55.906715 32008 catalog_manager.cc:5028] TS 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): tablet 7f6867d296184651b908c8f457d74e4a (table test-workload [id=9b9dc20f98e547b59efac9c530f28125]) successfully deleted
I20260709 13:12:55.926143   539 ts_tablet_manager.cc:1929] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 6b3ed521ce8947db80c4b4828b355c06: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:55.926594   539 log.cc:1199] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 6b3ed521ce8947db80c4b4828b355c06: Deleting WAL directory at /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-2-root/wals/4a6ce5ae89cb4ad08c24a3a10d6fc0c2
I20260709 13:12:55.928403 32009 catalog_manager.cc:5028] TS 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): tablet 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 (table test-workload [id=9b9dc20f98e547b59efac9c530f28125]) successfully deleted
I20260709 13:12:55.961247   514 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:12:55.961889   514 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:55.964273   514 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:55.967090 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:55.968477 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:12:55.970311 32165 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:12:55.972828   514 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:57.025359   525 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.026444   525 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:12:57.028390   525 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:12:57.029676 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:57.029680   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:12:57.033480 32238 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:12:57.034221   525 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:57.323943   540 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:12:57.324604   540 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:12:57.326762   540 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:57.328006 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:57.328333 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:57.328996 32270 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 2.
I20260709 13:12:57.329103 32196 raft_consensus.cc:2393] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 2: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:12:57.330121   369 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:12:57.331218   540 raft_consensus.cc:2804] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:57.331640   540 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:12:57.332050   540 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:57.339324   540 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:12:57.341125   540 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:57.342099 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:12:57.342216 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:12:57.342846 32196 raft_consensus.cc:2393] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 2: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:12:57.349658 32270 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 2.
I20260709 13:12:57.350960   369 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:12:57.352303   540 raft_consensus.cc:2804] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:57.366511   540 raft_consensus.cc:697] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 2 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:12:57.367689   540 consensus_queue.cc:237] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:12:57.376745 32021 catalog_manager.cc:5697] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 1 to 2, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4), now has a pending config: VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2), VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3), VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 2 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:12:57.857250 32270 raft_consensus.cc:1275] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:57.864272   540 consensus_queue.cc:1048] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:57.882694 32266 raft_consensus.cc:2955] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:12:57.886601   549 raft_consensus.cc:2955] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 2 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:12:57.891274   499 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:12:57.891856   499 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:12:57.895150 32266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36066 (request call id 61) took 2123 ms. Trace:
I20260709 13:12:57.895651 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:12:57.896369 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:12:57.897111 32196 raft_consensus.cc:2393] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 2: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:12:57.895625 32266 rpcz_store.cc:276] 0709 13:12:55.771831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:55.772731 (+   900us) service_pool.cc:224] Handling call
0709 13:12:55.789556 (+ 16825us) log.cc:844] Serialized 487 byte log entry
0709 13:12:57.895062 (+2105506us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":721,"raft.run_cpu_time_us":1229,"raft.run_wall_time_us":1338,"thread_start_us":22866,"threads_started":1,"wal-append.queue_time_us":21489,"wal-append.run_cpu_time_us":1463,"wal-append.run_wall_time_us":1001493}
I20260709 13:12:57.899673 32089 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:12:57.900413   547 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:57.900867 32009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ee05beb4092f41ddb391480547d90df0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:57.907699   547 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:57.909735   499 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:12:57.910652   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:12:57.919968 32196 raft_consensus.cc:1275] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:57.922734   540 consensus_queue.cc:1048] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:57.926687 32020 catalog_manager.cc:5697] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 3 to 4, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted, no longer has a pending config: VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2), VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3), VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 2 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:57.941431 32196 raft_consensus.cc:2955] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:12:57.992166 32110 tablet_service.cc:1558] Processing DeleteTablet for tablet ee05beb4092f41ddb391480547d90df0 with delete_type TABLET_DATA_TOMBSTONED (TS fcfc3281929645969ecedbb0c0af759d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56870
I20260709 13:12:58.005169   557 tablet_replica.cc:333] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:12:58.006368   557 raft_consensus.cc:2243] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:58.010147   557 raft_consensus.cc:2272] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:58.013137   557 ts_tablet_manager.cc:1916] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:58.026552   557 ts_tablet_manager.cc:1929] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:58.026886   557 log.cc:1199] T ee05beb4092f41ddb391480547d90df0 P fcfc3281929645969ecedbb0c0af759d: Deleting WAL directory at /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-0-root/wals/ee05beb4092f41ddb391480547d90df0
I20260709 13:12:58.028275 32009 catalog_manager.cc:5028] TS fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): tablet ee05beb4092f41ddb391480547d90df0 (table test-workload [id=9b9dc20f98e547b59efac9c530f28125]) successfully deleted
I20260709 13:12:59.550688   568 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:12:59.551617   568 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:12:59.623468   570 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:12:59.624269   570 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:12:59.626996   570 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:59.627614   570 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:12:59.628170   570 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:12:59.906311   570 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:12:59.926033   568 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:12:59.936928 32163 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.500s	user 0.006s	sys 0.030s
W20260709 13:12:59.937534 32163 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.501s	user 0.006s	sys 0.030s
I20260709 13:12:59.959363   571 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:12:59.959952   571 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:59.961315   574 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:12:59.962311   572 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:12:59.962141   571 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:59.963280   561 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:12:59.963649   572 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:12:59.963958   561 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:59.962152   574 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:59.971418   514 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:12:59.971966   514 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:59.969565   561 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:59.982664   574 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:59.983186   573 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:12:59.985723   574 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:12:59.984751   572 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:59.986284   574 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:59.986466   573 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:12:59.988605   514 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:59.989015   574 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:12:59.989445 32237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.759s	user 0.000s	sys 0.017s
W20260709 13:12:59.990367 32237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.765s	user 0.000s	sys 0.019s
I20260709 13:12:59.978639   571 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:12:59.992251   573 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:12:59.991992   571 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:12:59.996886   571 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:13:00.001190 32162 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.773s	user 0.008s	sys 0.026s
W20260709 13:13:00.001675 32162 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.774s	user 0.008s	sys 0.026s
I20260709 13:13:00.010282   561 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:00.009761   514 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:00.011623   561 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:00.021082   561 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:00.045288   514 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:00.047927   514 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:00.063752   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:00.171561   572 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:00.173152   572 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:00.172362   571 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:00.174968   571 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:00.177568   571 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:00.178157   571 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:00.178723   571 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:00.174206   514 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:00.182502   514 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:00.184857   514 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:00.214583   561 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:00.215487   579 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:00.215581   561 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:00.216357   579 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:00.219025   561 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:00.219538   579 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:00.011340   574 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:00.234439   574 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:00.235718   573 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:00.220289   579 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:00.246018   579 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:00.236264   573 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:00.355350   573 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:00.414975   578 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:00.415573   578 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:00.417754   578 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:00.565442   571 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:00.565821   572 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:00.566099   571 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:00.566589   571 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:00.567418   588 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:00.567986   588 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:00.221131   561 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:00.418272   578 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:00.565531   579 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:00.642966   582 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:00.682900   585 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:00.684799   571 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:00.643347   578 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:00.948171   578 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:00.846416 32162 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.036s	sys 0.061s
W20260709 13:13:00.975958 32162 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.036s	sys 0.061s
I20260709 13:13:00.944401   582 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:00.985342   582 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:00.962450   585 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:00.615257   561 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:00.643896   576 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:00.982146   571 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:00.652648   580 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:00.991681   580 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:00.994812   580 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:00.990526   571 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.000484   571 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.003756   585 leader_election.cc:290] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.004803   576 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:13:01.007701   576 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.012045   587 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:01.225698   587 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.012732   581 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:01.229080   581 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.232020   581 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.014415   580 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:01.233119   580 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.235823   580 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.236667   587 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.021682   561 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.025036   578 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:01.238090   578 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.240696   578 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:01.276636 32294 debug-util.cc:398] Leaking SignalData structure 0x7b08001e2300 after lost signal to thread 30975
I20260709 13:13:01.299058   582 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:01.300089   582 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.303186   582 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.303927   582 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:01.304565   582 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.131554   591 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:13:01.135604 32237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.031s	sys 0.045s
I20260709 13:13:01.137449   584 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:01.029978   586 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:13:01.305601 32090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.000s	sys 0.011s
I20260709 13:13:01.123229   588 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.324654   587 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:01.325258   580 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:01.345999   580 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.348239   580 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.325898   581 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:01.348918   581 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.349289   574 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.343816   599 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:01.344094   584 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.350955   581 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.326962   578 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:01.332998 32192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 639) took 1330 ms. Trace:
I20260709 13:13:01.351701   578 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.351749 32192 rpcz_store.cc:276] 0709 13:13:00.002998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.331970 (+1328972us) service_pool.cc:224] Handling call
0709 13:13:01.332363 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:01.332597 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:01.332629 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:01.332680 (+    51us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:01.332711 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.332778 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:01.332931 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:01.353018   584 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.350854   599 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.353861   578 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.334733 32191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 642) took 1325 ms. Trace:
W20260709 13:13:01.334898 32165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.995s	user 0.017s	sys 0.028s
W20260709 13:13:01.355257 32165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.015s	user 0.018s	sys 0.028s
W20260709 13:13:01.337435 32087 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.009s	sys 0.002s
W20260709 13:13:01.355976 32087 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.009s	sys 0.002s
I20260709 13:13:01.337594   593 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:01.338388   592 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:01.338642   594 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:01.338879   576 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:01.339814 32195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 644) took 1329 ms. Trace:
I20260709 13:13:01.339176   595 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:01.340201   596 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:13:01.340803 32237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.031s	sys 0.045s
W20260709 13:13:01.341430 32090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.000s	sys 0.012s
I20260709 13:13:01.345029   586 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.374660 32191 rpcz_store.cc:276] 0709 13:13:00.009488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.333892 (+1324404us) service_pool.cc:224] Handling call
0709 13:13:01.334232 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:01.334402 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:01.334429 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:01.334469 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:01.334506 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.334553 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:01.334672 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:01.409792   582 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.383402   593 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.442634   582 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:01.442426   576 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.443272   582 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.389248   602 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:01.445201   602 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.410552 32199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 641) took 1402 ms. Trace:
I20260709 13:13:01.446346   594 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.447211 32199 rpcz_store.cc:276] 0709 13:13:00.008286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.409609 (+1401323us) service_pool.cc:224] Handling call
0709 13:13:01.409932 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:01.410148 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:01.410186 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:01.410240 (+    54us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:01.410281 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.410349 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:01.410481 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:01.449126   602 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.382974   584 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:01.391548   600 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:01.451267   584 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.451614   600 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.451619 32194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 643) took 1441 ms. Trace:
I20260709 13:13:01.453058 32194 rpcz_store.cc:276] 0709 13:13:00.009756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.450774 (+1441018us) service_pool.cc:224] Handling call
0709 13:13:01.451100 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:01.451271 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:01.451298 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:01.451345 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:01.451391 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.451447 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:01.451560 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:01.453845   600 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.376397   581 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:01.383687   592 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.459335   600 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:01.460013   600 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.461179 32197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 652) took 1399 ms. Trace:
I20260709 13:13:01.418339   601 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:01.355469   591 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.341180   585 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:01.456259   586 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.390285   599 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.376255   578 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:01.376721   588 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:01.444689 32195 rpcz_store.cc:276] 0709 13:13:00.010040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.243961 (+233921us) service_pool.cc:224] Handling call
0709 13:13:00.244297 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:00.287616 (+ 43319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:00.287660 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:00.287717 (+    57us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:00.287759 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.339055 (+1051296us) spinlock_profiling.cc:243] Waited 43 ms on lock 0x7b5400210cd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:01.339113 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:01.339267 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98923776}
I20260709 13:13:01.458542   582 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.462011   600 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.355175   598 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:01.488631   600 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:01.488258   588 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.488839   598 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.489198   600 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.490029   594 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.490682   588 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.471385   603 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:01.491215   588 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:01.463622   602 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:01.491094   596 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.496883   588 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.459349   581 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.491124   600 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.461127   592 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.481611   593 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.496975   578 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.491124   598 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.483749   584 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.499584   585 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.461611 32197 rpcz_store.cc:276] 0709 13:13:00.061598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.062379 (+   781us) service_pool.cc:224] Handling call
0709 13:13:00.062717 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:00.236167 (+173450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:00.236200 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:00.236240 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:00.236278 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.460915 (+1224637us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54003a4b54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:01.460965 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:01.461109 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":398468992}
I20260709 13:13:01.365209   587 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:01.511791   591 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.499414   602 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.575776   561 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:01.577214   561 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.578533   602 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.491542   603 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.497189   601 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.499368   595 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.511550   596 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:01.465714 32164 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.029s	user 0.000s	sys 0.030s
I20260709 13:13:01.553081   586 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:01.617038   586 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.621394   561 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.620483   598 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:01.622706   598 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.555840   581 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.556123   573 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:01.558111   571 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:01.558967   574 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:01.559123   594 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:01.561079   590 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:01.562937   514 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:01.572029   565 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:01.572343   576 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.573024   582 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:01.559053   513 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:01.559130   578 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.579128   587 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:01.584796   606 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:01.631479   609 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:01.631711   582 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.632078   590 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.584987   591 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:01.584095   584 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:01.631711   594 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.634698   574 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.588997   605 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:01.589124   575 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:01.589661   585 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.586431   588 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.631385   514 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.588500   602 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:01.639360   573 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.640024   611 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:01.639860   602 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.593307   592 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:01.594481   593 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:01.634874   565 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.587704   599 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:01.642158   513 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.632476   609 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.651638   599 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.613649   607 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:13:01.615986   369 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.30.63.1:42339 timed out after 1.680s (SENT) [suppressed 3 similar messages]
W20260709 13:13:01.615732 32294 debug-util.cc:398] Leaking SignalData structure 0x7b08001d8900 after lost signal to thread 32056
I20260709 13:13:01.658126   604 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:13:01.631322 32164 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.193s	user 0.000s	sys 0.040s
I20260709 13:13:01.632283   606 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.634934   584 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.640780   611 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.597081   603 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.641176   514 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.653650   578 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:01.654639   582 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.654460   593 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:01.655242   599 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.650218   576 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:01.637908   591 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.652736   573 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.657116   592 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.625386   586 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.634267   561 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:01.656160   574 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.677167   593 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:13:01.671784 32294 debug-util.cc:398] Leaking SignalData structure 0x7b080032e900 after lost signal to thread 32148
I20260709 13:13:01.666275   598 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.684728   513 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.684963   609 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.670610   588 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:01.672343   582 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:01.685505   610 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:01.685247   578 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.668923 32021 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59534 (request call id 26) took 1653 ms. Trace:
I20260709 13:13:01.639858   575 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:01.637936   571 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.692618   591 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:01.694638 32294 debug-util.cc:398] Leaking SignalData structure 0x7b080032ee20 after lost signal to thread 32223
I20260709 13:13:01.673197   587 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:01.695286   576 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.653247   600 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:13:01.689525   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 66760.6us
I20260709 13:13:01.701110   588 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.714653   595 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.716396   588 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.717406 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.703089   584 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.705119   592 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.679805   585 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:01.707978 32021 rpcz_store.cc:276] 0709 13:13:00.014940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.015088 (+   148us) service_pool.cc:224] Handling call
0709 13:13:01.668623 (+1653535us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:13:01.711222   582 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.637862   605 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.705652   607 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.721025   587 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.721194   585 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.713078   571 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.722280 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:01.722633   513 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:01.723102 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:01.723987 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:01.735098   582 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.737161   612 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:01.732919   601 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.735617   585 leader_election.cc:290] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.659276   604 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.724642 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:01.728315 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:01.728538 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:01.729313   606 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.730392   590 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.730932   576 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.731091   594 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.732882 32124 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:13:01.711249   610 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:01.735072   571 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:01.738147   612 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.746522   571 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:01.712391 32294 debug-util.cc:398] Leaking SignalData structure 0x7b080024cbc0 after lost signal to thread 32297
W20260709 13:13:01.749607 32294 debug-util.cc:398] Leaking SignalData structure 0x7b08000ab160 after lost signal to thread 32298
W20260709 13:13:01.751722 32294 debug-util.cc:398] Leaking SignalData structure 0x7b0800234740 after lost signal to thread 427
I20260709 13:13:01.724740   574 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:01.736956 32123 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:13:01.739339 32120 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:13:01.740440 32121 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:13:01.728366   578 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.737214   587 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.720451   561 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.753369   574 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.752184   602 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.734925   575 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:01.737797   513 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.727001   580 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:01.753834   565 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.755146   600 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.768494   580 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.764489   571 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.771001   580 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.764557   574 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.775758 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.776613 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.777524 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.778337 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.776679 32199 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:13:01.779129 32192 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:13:01.780388   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:01.782795 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.783356 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:01.784163 32115 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 1.
I20260709 13:13:01.784534 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.785724   610 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:01.793429 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.794332 32197 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:01.795053 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.796686 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.797531   513 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.799309 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.799563 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.800678 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.800956 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.801983 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:01.802604 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.803223 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.803994 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.807617   611 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.808495 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.808853 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.809209   600 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.809546 32197 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:13:01.810290 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.811724 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.811954 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.813840 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.814049 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.814198 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.815150 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.815896 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.816226 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.816485 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.807323   605 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.816663 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.800804   607 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.817615 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:01.820425   561 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:01.822034 32118 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 1.
I20260709 13:13:01.823411   600 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:01.824295   600 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:01.841120 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:01.845710   612 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.846432 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.847338 32198 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:01.849118 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:01.852654 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:01.854930 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.856187 32264 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:01.856664 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:01.857229 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.857570 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:01.860744   604 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.862140   369 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:01.862322 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:01.865234 32118 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:13:01.871042 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:01.871423 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:01.872005 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:01.872756 32120 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:13:01.872886 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:01.873901 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.878388 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:01.878770 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:01.879638 32124 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:13:01.880405 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:01.881224 32267 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:01.885335 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:01.885766 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.888522 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:01.889050 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.889938 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.889490 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:01.891234 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:01.891736 32270 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:01.892022 32266 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:01.894682 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:01.894879 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.895649 32190 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:01.896209 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:01.896466   600 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:01.896906 32267 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:01.897068 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:01.899376 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:01.900810 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:01.901449 32124 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:13:01.897960 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:01.902345 32269 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:01.951999 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:01.940953   613 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:01.973179 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:01.984153 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.973464 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:01.974757 32238 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:01.975538 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:01.984973 32269 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:01.982192 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.986321 32197 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:01.986848 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:01.987500 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.975709 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:01.989218 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.989554 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:01.989935 32195 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:01.990499 32122 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:13:01.904026 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.905912 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:01.905535 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:01.977468 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.953073 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:01.982118 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:01.991159 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.999071 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.999620 32120 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:13:01.999776 32121 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:13:01.988272 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:01.905893 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:01.983655 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.985436 32124 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:13:02.000449 32191 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:02.000381 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:02.006757 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:02.007743 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:02.008491 32191 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:02.009477 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.953958 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.007756 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.001531 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:02.000514 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:02.012154 32123 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:13:02.010787 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:02.012739 32193 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:02.001870 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.989971 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:01.905700 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.014010 32192 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:01.984404   613 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.017784 32198 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:01.908295 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.018695 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:01.906600 32273 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:02.018954 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.019372 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.019613 32267 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:02.019683 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.019390 32265 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:02.020864 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.016167 32268 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:02.021510 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.021678 32270 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:02.020805 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.022116 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.023940 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.024544 32267 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:01.954702 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:02.023133 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 48576.5us
I20260709 13:13:02.022199 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.028295   618 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.028965   618 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:01.988265 32197 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:02.029418   618 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.036047   613 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.037847 32238 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:02.038722   610 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.039124   610 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:02.039490   610 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.028302   616 raft_consensus.cc:2804] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.040983   616 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:02.041379   616 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.042934 32089 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:02.045507   607 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.045466 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.046116   607 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:02.046533   607 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.053018   616 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:13:02.056062 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.058350 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.058656 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.059862 32238 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:02.060691   610 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.061209   612 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.061719   612 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:02.062661   612 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.063084 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.064668 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.066684 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.067514 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.070300 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.070593 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.067873 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.068686 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.068742 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.073763   607 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.075014 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.079317   612 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:02.080348   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 65850.4us
I20260709 13:13:02.084314   610 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:02.081300 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.085534   616 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:02.085665 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.086621   612 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:02.076414   607 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.089120 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:02.090193 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:02.086195   368 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.090441 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:02.090817 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:02.091148 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:02.093019   619 raft_consensus.cc:2749] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.093729 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:02.095090 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.095309 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:02.095815 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:02.096498 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:02.095090 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:02.097268 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:02.099690 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.101428 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:02.103660 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:02.103847 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:02.105206 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:02.099067 32089 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:02.110275 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:02.110678 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.111537 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.110275 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.112778 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:02.113806 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.113953 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.117110 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.117566 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.118245 32265 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:02.114625 32267 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:02.120220 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.127655 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.130931 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:02.131435   581 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.131807   581 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:02.132171   581 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.132736 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:02.134768 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:02.136305 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.138931 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.140931 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.143962 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.141095   581 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.121104   618 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:02.144920 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.144038 32089 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:02.147405 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.147573   580 raft_consensus.cc:2804] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.148638   580 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:02.148766 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.149065   580 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.145481 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:02.150406   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 53173.6us
I20260709 13:13:02.153638   369 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.155543   619 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.155450 32089 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:02.156771 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.157229   618 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.157956   607 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.158453 32238 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:02.158416   607 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:02.158473 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.159243   607 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.159296   580 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.161859   580 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.163772 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:02.164103 32089 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:02.165693 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.166172   578 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.166738   578 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:02.172009 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.171609 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.172502   578 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.173036 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.173264 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.169358 32089 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:02.174587   612 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:02.176007 32089 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:02.150296   581 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.166147 32197 consensus_queue.cc:237] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:13:02.178894 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.180214 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.176806   580 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.178375 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.183019 32089 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:02.182461   581 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.187183 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.182173   580 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:02.189257   580 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.189522 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.189666 32089 leader_election.cc:304] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:02.184237   594 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.178658   607 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.190532 32089 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:02.185294 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.191516   587 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.190862   594 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:02.192185 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.192756   590 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.192777 32089 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:02.192848 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.193544 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.194054 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.194715 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.195338 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:02.190673 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.199364   587 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:02.238742 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:02.187220   581 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:02.241796 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.243323 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.201143 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.244781 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.244913 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.200249   594 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.246016   578 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.242744   581 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:02.240103 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 47394.2us
I20260709 13:13:02.201117   590 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:02.251017   578 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.253561   590 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.238237 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:02.239928   587 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:02.244953 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.241700   575 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:13:02.267540 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.269618   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:02.270533 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:02.271157 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.272823 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:02.272231   581 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.273487 32196 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.273975 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:02.274618 32193 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.272858 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:02.276973   581 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.278949   607 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.280263   369 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.281215   620 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.282829   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:02.283290   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:02.265192   575 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:02.294641   575 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.295130   580 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.308928 32196 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:02.323081   590 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.325997   590 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.327966 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.339636 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.340202 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.340858 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.341073 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.340521 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.342209 32193 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:02.351310   580 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.359066 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.360402   594 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.361414   587 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.363430   587 leader_election.cc:290] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.364006   594 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.367091 32165 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:02.368352   613 raft_consensus.cc:2804] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.368173   575 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.369339 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.370103 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.370668 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.370609 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.371654   575 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.368855   613 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:02.372520   613 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.372768 32239 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.373996 32165 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:02.374752   591 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.380225 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.380748 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.381103 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.385753   617 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.386297   617 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:02.386787   617 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:02.390446 32162 consensus_peers.cc:597] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f089b75ada024eb9bbf7e4b953063dd4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:02.393371 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:02.396807   561 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.397377   561 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:02.397842   561 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.398309 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.399282 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.400000 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:02.400329 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.402069 32165 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:02.403074 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.403932 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.406159 32239 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.406980 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.408196 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.408317   625 raft_consensus.cc:2804] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.409631 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:02.411226 32239 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.413355   605 raft_consensus.cc:2749] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.414144   617 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.414606 32239 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.415443   605 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.416302   617 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.416567 32239 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.412258   591 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:02.409032   625 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:02.416628 32090 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:02.418226   591 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.418236   624 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.418851   624 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:02.419312   624 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.419595   625 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.419843 32239 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.411599   613 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.418864 32090 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:02.424922 32087 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:02.433399   613 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.436987   575 raft_consensus.cc:2749] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.437314   561 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.439409   561 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.440941   587 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.442557 32090 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:02.444075   575 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.444567 32090 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:02.445650   575 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.446063 32090 leader_election.cc:304] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:02.447659   621 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.448210   621 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:13:02.448518 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 43695.2us
I20260709 13:13:02.448817 32090 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:02.449776   622 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.450129 32196 raft_consensus.cc:1240] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.448938   621 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.451642 32090 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:02.453565 32196 raft_consensus.cc:1240] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.453428 32165 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:02.457103   561 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.456307 32090 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:02.457132   580 raft_consensus.cc:2804] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.458498   561 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:02.458645   580 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:02.458365   624 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.459075   561 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.459187   580 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.456984   612 consensus_queue.cc:1059] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:13:02.461576   624 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.462095   612 raft_consensus.cc:3055] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:02.462667   612 raft_consensus.cc:740] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:02.463611   612 consensus_queue.cc:260] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.457800 32165 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:02.465941   606 consensus_queue.cc:1059] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:02.467659   610 raft_consensus.cc:3055] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:02.467612   580 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.468163   610 raft_consensus.cc:740] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:02.470094   580 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.469729   610 consensus_queue.cc:260] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.454229   591 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.472020 32165 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:02.472168   626 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.474817   610 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.475746   626 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:02.476423   626 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.465785   612 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.473311 32090 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
W20260709 13:13:02.475275 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 55522.5us
I20260709 13:13:02.478655   622 raft_consensus.cc:2804] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.478570   617 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.475092   624 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:02.479388   622 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:02.479653   617 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:02.479579 32090 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:02.479903   622 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.480253   617 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.480798   590 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:02.481187 32239 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.481400 32090 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:02.481662   590 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:02.479840   624 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:02.482136   590 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:02.482210   624 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:02.477411   561 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.487288   561 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.490398 32090 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:02.491395   594 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.491722   587 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.491819   594 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:02.492295   594 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.492347 32193 raft_consensus.cc:1240] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.494243   591 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.496901 32239 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.500685   605 consensus_queue.cc:1059] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:02.506986   590 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.509202   591 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.513957 32193 raft_consensus.cc:1240] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.496227   621 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.516384   401 raft_consensus.cc:1240] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 2 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.517019 32239 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.517459   594 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.518769   605 raft_consensus.cc:3055] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:02.519115   605 raft_consensus.cc:740] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:02.510722   622 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.519872   605 consensus_queue.cc:260] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.510859   617 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.511970 32090 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:02.521751   605 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.522102   606 consensus_queue.cc:1059] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:02.523645 32090 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:02.521999 32165 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:02.525055 32239 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.537222 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.539129 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.543325 32090 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:02.538023 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.551334   587 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.552676 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.552874 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.553562 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.553915 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.554100 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.554878 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.555167 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.555262   625 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.552812   587 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:02.556151   587 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.556288 32196 raft_consensus.cc:1240] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.557412   625 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.558956   622 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.526018 32197 raft_consensus.cc:1240] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.524617   580 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.563560   587 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.524713   606 raft_consensus.cc:3055] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:02.564946   590 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.565095   606 raft_consensus.cc:740] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:02.566279   606 consensus_queue.cc:260] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:02.567797   606 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.523582   610 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:02.569200   625 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.571115   625 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:02.571509   625 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.572922   624 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.575119   624 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.575881   591 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:02.576048 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 51902.7us
I20260709 13:13:02.576900 32239 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.578063 32090 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:02.569644 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 47752.3us
I20260709 13:13:02.569985 32269 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:02.525223   616 consensus_queue.cc:1059] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:13:02.576694   604 consensus_queue.cc:1059] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:02.579154   594 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.580173   622 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.580571   622 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:02.580958   622 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.584419 32165 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:02.585423   561 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.585513 32165 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:02.585865   561 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:02.578778   626 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.586277   561 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.589308   622 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.590703   616 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.591262   627 raft_consensus.cc:3055] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:02.591655   627 raft_consensus.cc:740] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:02.527233   621 leader_election.cc:290] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.591854   626 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.592484   627 consensus_queue.cc:260] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.592720   594 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.586244 32090 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:02.594050   627 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.590939 32239 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.595255 32090 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:02.599745 32090 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:02.594024 32165 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:02.602841 32090 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:02.603893 32090 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:02.604787   613 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.605350   613 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:02.606120   613 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.608173   616 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.594620   604 raft_consensus.cc:3055] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:02.609476   604 raft_consensus.cc:740] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:02.610562   604 consensus_queue.cc:260] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.612183   604 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.594033   561 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.614102 32239 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.614295   575 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.623417   575 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:02.623864   575 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.529387   617 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.595414   594 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.620929   587 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.594373   626 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.628129 32239 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.607779   621 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.626891   594 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:02.631204   626 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:02.631407   594 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.631675   626 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.633618   622 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.634198   606 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.635044 32090 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:02.635739 32239 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.629134 32165 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:02.628638   610 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.636863 32165 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:02.629653   616 consensus_queue.cc:1059] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:02.635126   621 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:02.607635   580 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.639220 32090 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:02.639572   625 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.630957   578 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.642586   616 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.652810   561 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.643406   617 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.643417   628 raft_consensus.cc:3055] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:02.643659 32239 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.639070   622 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.647375   587 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.648084 32090 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:02.653514   628 raft_consensus.cc:740] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:02.650116   594 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.646982   621 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.652375   578 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:02.654904   580 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.655556   578 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.654961   628 consensus_queue.cc:260] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.655933 32090 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:02.656410   628 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.645678   613 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.657205 32239 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.657543 32090 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:02.660341 32115 raft_consensus.cc:1240] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.663028 32239 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.663504 32089 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:02.665259 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.665428 32123 raft_consensus.cc:1240] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.665664 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:02.665892   624 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.665370 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.666363   610 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.667105 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:02.667483 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:02.663058 32269 raft_consensus.cc:1275] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:02.653875   617 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:02.671025 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:02.669852 32239 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.668928 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.667502 32090 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:02.653520   561 raft_consensus.cc:2764] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:13:02.677680 32239 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.678680 32239 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.679494 32239 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.680255 32239 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.661092   607 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.662588   580 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.668815   616 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.716430 32121 raft_consensus.cc:1240] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.716215 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.719696 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.682191   590 raft_consensus.cc:2804] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:02.721235 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.676757   617 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.673467   610 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.671061 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.724023 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.724110 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.719099 32123 raft_consensus.cc:1240] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 1. Current term is 2. Ops: []
W20260709 13:13:02.725158 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 60649.5us
I20260709 13:13:02.722987 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.681557   605 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:02.732111 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.664817   575 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.718384   607 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:02.727895 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.736567 32089 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:02.681702   606 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.713538   591 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:02.716284 32197 raft_consensus.cc:1240] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
W20260709 13:13:02.739460 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 59243.1us
I20260709 13:13:02.681814   612 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.709712   580 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:02.748530   580 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.738024   590 raft_consensus.cc:697] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 2 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:02.740753 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.758280   590 consensus_queue.cc:237] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.761869   613 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.744225 32239 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.746718 32089 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:02.742835   607 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.757084   594 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.757141   632 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.777948 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:02.780305 32266 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:13:02.782325 32270 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:13:02.783428 32267 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:13:02.741128   627 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.787554 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:13:02.787925 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 43809.1us
I20260709 13:13:02.788570 32118 raft_consensus.cc:1240] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.788700   591 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.742349 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.789085 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.790091 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.783485   581 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:02.795374   607 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.799012   625 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.803825 32239 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.808030 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:02.814267   580 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.814498 32270 raft_consensus.cc:1240] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.818208 32196 raft_consensus.cc:1240] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.818090 32239 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.818619 32193 raft_consensus.cc:1240] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.819458 32239 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.820541 32239 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.821892 32239 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.823619   591 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.823066 32239 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.824659   633 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.825037   607 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:02.825325 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.826512   580 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.825759 32239 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.828037 32239 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.780407   626 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.829234 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.828836   604 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.830382   575 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.826797   627 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.831624   578 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.844640 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.834753   591 consensus_queue.cc:1059] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:13:02.845898   637 raft_consensus.cc:3055] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:02.846279 32270 raft_consensus.cc:1240] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.846297   637 raft_consensus.cc:740] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:02.847420 32271 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:13:02.847420   637 consensus_queue.cc:260] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.848670 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.849301 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.849701 32239 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.818655   606 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.819919   581 raft_consensus.cc:697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 2 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:02.856415   578 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.857249 32115 raft_consensus.cc:1240] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.856750   581 consensus_queue.cc:237] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.858707   626 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.862401 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:02.851871 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.852300 32196 raft_consensus.cc:1240] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.822525   628 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:02.868192 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.833423   633 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:02.874567 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.876837   604 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.877115   632 consensus_queue.cc:1059] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:02.878580   632 raft_consensus.cc:3055] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:02.879218   632 raft_consensus.cc:740] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:02.879653 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:02.879932   621 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.869179 32239 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.864796   637 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.854606 32268 raft_consensus.cc:1240] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.880901   606 consensus_queue.cc:1059] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:13:02.880312   632 consensus_queue.cc:260] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.888360   610 raft_consensus.cc:3055] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:13:02.891273 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 89129.1us
I20260709 13:13:02.892767 32239 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.891158   610 raft_consensus.cc:740] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:02.873592   636 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.889948   616 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:02.906914 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.909350 32120 raft_consensus.cc:1240] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.910005   621 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.911489   610 consensus_queue.cc:260] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.909404 32122 raft_consensus.cc:1240] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.916975 32116 raft_consensus.cc:1240] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.917395 32118 raft_consensus.cc:1240] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.908017   628 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.919445   610 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.893203   617 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.921801   622 consensus_queue.cc:1059] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:02.922068   575 consensus_queue.cc:1059] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:02.922457   617 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:02.922874   622 raft_consensus.cc:3055] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:02.923322   622 raft_consensus.cc:740] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:02.923697   587 raft_consensus.cc:3055] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:02.924103   587 raft_consensus.cc:740] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:02.924160   622 consensus_queue.cc:260] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.928249 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:13:02.929582 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.927928   587 consensus_queue.cc:260] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:13:02.930723   587 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.899755   605 consensus_queue.cc:1059] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:13:02.933215   605 raft_consensus.cc:3055] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:02.929593   622 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.936993   642 ts_tablet_manager.cc:933] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:02.933966   632 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.935065   605 raft_consensus.cc:740] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:02.943238 32165 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.943008   605 consensus_queue.cc:260] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.944020   625 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.944231   605 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.945904 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:02.947908 32119 raft_consensus.cc:1240] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.948233 32116 raft_consensus.cc:1240] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
W20260709 13:13:02.948688 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.949211 32165 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:02.951053   616 consensus_queue.cc:1059] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:02.960489   625 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.957170 32117 raft_consensus.cc:1240] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 2 LEADER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.965044 32193 raft_consensus.cc:1240] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.966841   604 consensus_queue.cc:1059] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:02.968327   633 raft_consensus.cc:3055] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:02.968750   633 raft_consensus.cc:740] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:02.969609   633 consensus_queue.cc:260] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.970681   633 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.973709 32193 raft_consensus.cc:1240] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.975590 32021 catalog_manager.cc:5697] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 1 to 2, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 2 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:02.980995   604 consensus_queue.cc:1059] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:02.982172   604 raft_consensus.cc:3055] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:02.982543   604 raft_consensus.cc:740] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:02.983582   604 consensus_queue.cc:260] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:02.989599 32193 raft_consensus.cc:1240] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.990808   636 raft_consensus.cc:3055] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:02.992668   604 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.994017   636 raft_consensus.cc:740] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:02.994055   606 consensus_queue.cc:1059] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:03.000728   591 consensus_queue.cc:1059] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:03.002017   591 raft_consensus.cc:3055] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:03.002496   591 raft_consensus.cc:740] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:03.003476   591 consensus_queue.cc:260] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:03.003654   637 consensus_queue.cc:1059] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:13:03.012378 32193 raft_consensus.cc:1240] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:03.013087   636 consensus_queue.cc:260] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:03.014056   627 consensus_queue.cc:1059] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:03.014709   636 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.015288   627 raft_consensus.cc:3055] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:03.015754   627 raft_consensus.cc:740] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:13:03.016871 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 69601.9us
I20260709 13:13:03.017210   591 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.017712 32165 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:03.021060   625 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.021395 32116 raft_consensus.cc:1240] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:03.021914 32117 raft_consensus.cc:1240] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:03.021395 32118 raft_consensus.cc:1240] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:03.022439 32165 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:03.023562   625 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:03.032505 32165 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:03.034106   612 raft_consensus.cc:3055] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:03.034519   612 raft_consensus.cc:740] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:03.016880   627 consensus_queue.cc:260] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:03.035403   612 consensus_queue.cc:260] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:03.042009 32165 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:03.043079   625 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.037797   561 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.035841   633 consensus_queue.cc:1059] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:13:03.044938 32165 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:03.045506   604 raft_consensus.cc:3055] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:03.046475 32165 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:03.046327   625 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.037302   610 consensus_queue.cc:1059] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:13:03.048513   612 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.048488   610 raft_consensus.cc:3055] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:03.048760   642 tablet_copy_client.cc:323] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Beginning tablet copy session from remote peer at address 127.30.63.2:44517
I20260709 13:13:03.046027   604 raft_consensus.cc:740] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:03.051108   641 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.049431   627 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.052547   604 consensus_queue.cc:260] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:03.053655 32209 tablet_copy_service.cc:140] P 113b5461952d47e0944d463ea4e32801: Received BeginTabletCopySession request for tablet f089b75ada024eb9bbf7e4b953063dd4 from peer 94085cf341634eb686a95983b6b7f7e6 ({username='slave'} at 127.0.0.1:56926)
I20260709 13:13:03.054095   604 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.054283 32209 tablet_copy_service.cc:161] P 113b5461952d47e0944d463ea4e32801: Beginning new tablet copy session on tablet f089b75ada024eb9bbf7e4b953063dd4 from peer 94085cf341634eb686a95983b6b7f7e6 at {username='slave'} at 127.0.0.1:56926: session id = 94085cf341634eb686a95983b6b7f7e6-f089b75ada024eb9bbf7e4b953063dd4
W20260709 13:13:03.050128   605 consensus_queue.cc:1175] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fcfc3281929645969ecedbb0c0af759d" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:13:03.063242   632 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:03.063896   632 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:03.064419 32209 tablet_copy_source_session.cc:215] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:03.066574   632 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:03.066939 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:03.070170 32165 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:03.072686   642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f089b75ada024eb9bbf7e4b953063dd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:03.050628   610 raft_consensus.cc:740] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:03.081252   625 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:03.082224 32165 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:03.081249   610 consensus_queue.cc:260] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:03.083137   641 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.083438   610 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.085692 32165 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:03.086572   617 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.087965 32165 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:03.088835   617 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.089330 32165 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:03.090165   617 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.090651 32165 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:03.091476   617 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.091956 32165 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:03.092780   617 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.094040 32165 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:03.094837   617 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.098270   642 tablet_copy_client.cc:806] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:03.099062   642 tablet_copy_client.cc:670] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:03.099045 32165 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:03.099766   632 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:03.100397   617 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.100517   632 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:03.101866 32165 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:03.102674   625 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.103569   625 consensus_queue.cc:1048] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:03.103919 32165 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:03.104202   632 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:03.104425 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:03.104864   617 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:03.105481   617 raft_consensus.cc:697] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:03.105398 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:03.106446   617 consensus_queue.cc:237] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:03.106815 32165 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:03.106992   561 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:03.107723   625 raft_consensus.cc:2804] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:03.108213   625 raft_consensus.cc:697] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:03.107740   561 raft_consensus.cc:697] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:03.109478 32165 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:03.109730   642 tablet_copy_client.cc:538] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:03.109597   561 consensus_queue.cc:237] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:03.110320   641 raft_consensus.cc:2804] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:03.111788   641 raft_consensus.cc:697] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:03.112682   641 consensus_queue.cc:237] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:03.114384 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:03.116021 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:03.121557 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:03.122215   625 consensus_queue.cc:237] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:03.124924 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:03.125451 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:03.127586 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:03.130075 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:03.151152 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:03.149519 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:03.154680 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:03.154985 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:03.156569 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:03.156865 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:03.157948 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:13:03.158694 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.159116 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:03.161062 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:03.162238 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:03.163376 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:03.164774 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:03.165627 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:03.166818 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:03.167641 32122 raft_consensus.cc:1240] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:03.168903 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:03.170013 32122 raft_consensus.cc:1240] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:03.170342 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:03.170025 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:03.173586 32122 raft_consensus.cc:1240] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:03.176204 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:03.179035 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:03.179817 32122 raft_consensus.cc:1240] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:03.181967 32122 raft_consensus.cc:1240] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:03.183526   642 tablet_bootstrap.cc:492] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap starting.
I20260709 13:13:03.183976 32122 raft_consensus.cc:1240] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:03.186355 32273 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:13:03.188604 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:03.191587 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:03.192381 32122 raft_consensus.cc:1240] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:03.194422 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:03.196363 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:03.197139 32121 raft_consensus.cc:1240] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:03.198544 32273 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:13:03.204804 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:03.206837 32089 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:03.209794   622 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.208257 32089 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:03.214625   561 consensus_queue.cc:1059] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:03.215997   561 raft_consensus.cc:3055] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:03.216394   561 raft_consensus.cc:740] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:03.219100 32022 catalog_manager.cc:5697] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 1 to 2, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:03.221542 32267 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:13:03.222389 32121 raft_consensus.cc:1240] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:03.223160   587 raft_consensus.cc:2749] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.225837 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:03.217608   561 consensus_queue.cc:260] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:13:03.225888 32089 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:03.229096   561 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.230818 32265 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:13:03.231120   641 consensus_queue.cc:1059] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:03.231513   581 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.232349   625 raft_consensus.cc:3055] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:03.232769   625 raft_consensus.cc:740] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:03.233661   625 consensus_queue.cc:260] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:03.236773   625 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.236382 32089 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:03.242522   581 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.244313 32089 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:03.256881   581 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.259864 32265 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:03.260103 32089 leader_election.cc:304] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:03.261787   581 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:03.246726 32165 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:03.291463 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 44831.8us
I20260709 13:13:03.293697   625 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.294464   587 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.296660 32089 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:03.298055   641 consensus_queue.cc:1059] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:03.298883   625 consensus_queue.cc:1059] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:03.299897 32165 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:03.302009   617 raft_consensus.cc:3055] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:03.302115   641 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.304090 32165 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:03.305441 32165 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:03.302933   617 raft_consensus.cc:740] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:03.303351   613 raft_consensus.cc:3055] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:03.307440   587 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.307780   613 raft_consensus.cc:740] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:03.308195   617 consensus_queue.cc:260] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:03.308743   613 consensus_queue.cc:260] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:03.300088 32022 catalog_manager.cc:5697] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 1 to 2, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:03.309753 32089 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:03.309787   617 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.307423   641 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.312271   613 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.312034 32022 catalog_manager.cc:5697] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 1 to 2, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:03.314687 32021 catalog_manager.cc:5697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 1 to 2, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 2 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:03.310227   625 consensus_queue.cc:1059] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:13:03.318665   641 raft_consensus.cc:3055] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:03.318734   625 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.319151   641 raft_consensus.cc:740] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:03.315267 32022 catalog_manager.cc:5697] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 1 to 2, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:03.320024   641 consensus_queue.cc:260] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:03.321369   641 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.320529   581 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.323825 32089 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:03.327651 32089 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:03.330374 32089 leader_election.cc:304] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:03.331403 32089 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:03.332226 32089 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:03.329088   622 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.333115   621 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.333752   625 consensus_queue.cc:1059] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:13:03.333806 32089 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:03.333133   638 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.332973   640 consensus_queue.cc:1059] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:13:03.352449 32089 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:03.333194   590 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:03.335994   629 consensus_queue.cc:1059] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:13:03.351482   632 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.334241   626 consensus_queue.cc:1059] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:13:03.338351   631 consensus_queue.cc:1059] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:13:03.332680   561 consensus_queue.cc:1059] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:13:03.335428   634 consensus_queue.cc:1059] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:13:03.355861 32089 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:03.333280   580 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.357218   622 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:03.334841   635 consensus_queue.cc:1059] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:13:03.372219   581 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.366602 32089 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:03.334972   630 consensus_queue.cc:1059] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:13:03.378300 32089 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:03.386359 32089 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:03.378718   638 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.389441   575 raft_consensus.cc:2749] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.391640   622 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.406987   640 raft_consensus.cc:3055] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:03.415978   640 raft_consensus.cc:740] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:03.418883   626 raft_consensus.cc:3055] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:03.419281   626 raft_consensus.cc:740] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:03.418388   640 consensus_queue.cc:260] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:03.420507   640 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.424854   660 raft_consensus.cc:3055] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:03.425341   660 raft_consensus.cc:740] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:03.426533 32269 raft_consensus.cc:1275] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:03.429232   642 tablet_bootstrap.cc:492] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:13:03.428936   632 consensus_queue.cc:1048] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:03.426179   660 consensus_queue.cc:260] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:03.430361   660 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.405562   625 raft_consensus.cc:3055] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:03.438335   617 raft_consensus.cc:3055] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:03.438796   617 raft_consensus.cc:740] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:03.441592   642 tablet_bootstrap.cc:492] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap complete.
I20260709 13:13:03.420192   626 consensus_queue.cc:260] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:03.437024   625 raft_consensus.cc:740] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:03.472571   626 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.473251   642 ts_tablet_manager.cc:1403] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6: Time spent bootstrapping tablet: real 0.290s	user 0.021s	sys 0.010s
W20260709 13:13:03.488925 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:03.497120 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 159520us
I20260709 13:13:03.501750   641 raft_consensus.cc:3055] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:03.502321   641 raft_consensus.cc:740] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:03.503433   641 consensus_queue.cc:260] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:03.505591   629 raft_consensus.cc:3055] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:03.506340   629 raft_consensus.cc:740] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:03.507490   629 consensus_queue.cc:260] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:03.508914   641 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:03.512157 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.531008 32165 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:03.533069 32196 raft_consensus.cc:1275] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:03.541541 32089 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:03.546744 32165 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:03.550851 32089 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:03.554078 32195 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:03.555703 32089 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:03.559332 32089 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:03.562824 32089 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:03.558830   580 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.561853   635 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:03.532439   561 consensus_queue.cc:1059] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:13:03.566730   622 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.496958   625 consensus_queue.cc:260] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:03.563371   590 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.563174   621 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.555114   587 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.571841   642 raft_consensus.cc:359] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 1 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:03.554092   661 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:03.499913   617 consensus_queue.cc:260] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:03.569417   659 raft_consensus.cc:3055] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:03.667150   561 raft_consensus.cc:3055] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:03.667616   661 raft_consensus.cc:697] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:03.668509   629 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.667626   561 raft_consensus.cc:740] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:03.669719   561 consensus_queue.cc:260] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:03.670826   561 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.662072   635 raft_consensus.cc:697] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
W20260709 13:13:03.667266 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.672808   661 consensus_queue.cc:237] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:03.672868   635 consensus_queue.cc:237] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:03.672883   634 raft_consensus.cc:3055] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:03.677397   634 raft_consensus.cc:740] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:03.678234   634 consensus_queue.cc:260] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:03.679481   634 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:03.680088 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 112025us
I20260709 13:13:03.662755   659 raft_consensus.cc:740] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:03.684291   659 consensus_queue.cc:260] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:03.685367   659 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.690898   625 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.691313   642 raft_consensus.cc:740] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Initialized, Role: LEARNER
I20260709 13:13:03.692088   642 consensus_queue.cc:260] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:13:03.697347 32165 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:03.698149   626 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:03.698470 32165 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:03.698721   626 raft_consensus.cc:697] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:03.699805   626 consensus_queue.cc:237] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:03.702708   629 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:03.703290   629 raft_consensus.cc:697] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:03.704174   629 consensus_queue.cc:237] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:03.728575 32122 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.733471 32121 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:03.742599 32122 raft_consensus.cc:1275] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:03.746016 32265 raft_consensus.cc:1275] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:03.749264 32265 raft_consensus.cc:1275] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:03.752175 32265 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:03.758966   617 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.768450   578 consensus_queue.cc:1048] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:03.768740   561 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:03.770838   561 consensus_queue.cc:1048] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:03.777890   578 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:03.795382   642 ts_tablet_manager.cc:1434] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6: Time spent starting tablet: real 0.322s	user 0.031s	sys 0.049s
I20260709 13:13:03.804909 32209 tablet_copy_service.cc:342] P 113b5461952d47e0944d463ea4e32801: Request end of tablet copy session 94085cf341634eb686a95983b6b7f7e6-f089b75ada024eb9bbf7e4b953063dd4 received from {username='slave'} at 127.0.0.1:56926
I20260709 13:13:03.805603 32209 tablet_copy_service.cc:434] P 113b5461952d47e0944d463ea4e32801: ending tablet copy session 94085cf341634eb686a95983b6b7f7e6-f089b75ada024eb9bbf7e4b953063dd4 on tablet f089b75ada024eb9bbf7e4b953063dd4 with peer 94085cf341634eb686a95983b6b7f7e6
W20260709 13:13:03.805716 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 230988us
I20260709 13:13:03.810552 32265 raft_consensus.cc:1275] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:03.814581 32121 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.818116 32022 catalog_manager.cc:5697] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 1 to 2, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:03.823470 32121 raft_consensus.cc:1275] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:03.822536 32022 catalog_manager.cc:5697] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 1 to 2, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:03.828840 32121 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.835664   661 consensus_queue.cc:1048] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:03.842825 32121 raft_consensus.cc:1275] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:03.845207   629 consensus_queue.cc:1048] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:03.846032   635 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:03.846171   626 consensus_queue.cc:1048] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:03.846670   629 consensus_queue.cc:1048] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:03.851509   629 consensus_queue.cc:1048] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:13:03.926019   636 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.948926   636 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:03.997104   636 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:04.007880 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:04.008797 32117 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:13:04.009958   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:04.010650   401 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:04.013295 32239 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:04.016767   610 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:04.017427   610 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:04.017784   610 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.027304   610 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:04.051523 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:04.052001   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:13:04.052181 32121 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.052629   401 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.055858   610 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:04.063697 32021 catalog_manager.cc:5697] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 1 to 2, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:04.070637 32268 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:04.072973 32021 catalog_manager.cc:5697] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 1 to 2, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:04.063637 32121 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:04.081385   581 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:04.082134 32239 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:04.082022   581 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.084146   636 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:04.084771   636 raft_consensus.cc:697] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:04.085798   636 consensus_queue.cc:237] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:04.086649   581 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:04.067006   401 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:04.090963 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:04.091770 32268 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:04.093226 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:04.094066 32193 raft_consensus.cc:2393] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 2: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:04.094033 32090 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:04.094961   624 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:04.095337   624 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:04.095703   624 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:04.095794   641 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:04.113029   624 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.114689 32121 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:04.120393   578 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.120882   659 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:04.121003   578 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.123538   578 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:04.116300   624 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:04.116498 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:04.124364 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:04.116421 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:04.125496 32193 raft_consensus.cc:2393] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 2: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:04.126157 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:04.126782 32272 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:04.127013 32268 raft_consensus.cc:1275] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:04.144235 32269 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:04.151578 32090 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:04.153106   624 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:04.154052   624 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:04.154443   624 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.155885   641 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:04.156635 32090 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:04.156437   641 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.163524   641 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:04.158442   659 consensus_queue.cc:1048] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:04.163794   624 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.152806 32022 catalog_manager.cc:5697] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:04.165863   581 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:04.166369   581 raft_consensus.cc:697] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 2 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:04.167173   581 consensus_queue.cc:237] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.172528 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:04.173491 32117 raft_consensus.cc:2393] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 2: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:04.176980 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:04.177696 32269 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:13:04.186024 32121 raft_consensus.cc:1275] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:04.186278 32165 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:04.186311 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:04.187575   659 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:04.187974   659 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:04.188094   624 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:04.188400   659 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:04.189389 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:04.189940 32269 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.197278   668 consensus_queue.cc:1048] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:04.198606 32269 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:04.198437 32022 catalog_manager.cc:5697] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 1 to 2, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 2 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:04.205706   659 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.207504 32090 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:04.211647   581 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:04.212248   581 raft_consensus.cc:697] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 3 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:04.213166   581 consensus_queue.cc:237] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.226632 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:04.229286 32117 raft_consensus.cc:2393] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 2: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:04.223171 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:04.232561   659 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:04.240688 32269 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:13:04.246628 32165 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:04.248775   641 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:04.249428   641 raft_consensus.cc:697] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:04.249706 32268 raft_consensus.cc:1275] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:04.253886 32117 raft_consensus.cc:1275] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:04.256028 32021 catalog_manager.cc:5697] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:04.253772   641 consensus_queue.cc:237] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.259433   668 consensus_queue.cc:1048] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:04.264384   664 consensus_queue.cc:1048] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:04.272547 32121 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:04.283329 32121 raft_consensus.cc:1275] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:04.289710   641 consensus_queue.cc:1048] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:13:04.295915   636 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.296453   636 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.300679   610 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.301304   610 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.302211 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:04.302347 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:04.302911 32121 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:04.303347 32191 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:04.303589   610 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:04.304394 32239 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:04.305213 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:04.299201   636 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:04.305996   636 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:04.306360   636 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:04.306704   636 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.313578 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:04.314263 32121 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:04.316393 32239 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:04.318755   610 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:04.318711   636 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.319447   610 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:04.319964   610 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.321400   636 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:04.323158 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:04.325353 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:04.325976 32121 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.324388 32191 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.332965 32022 catalog_manager.cc:5697] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 1 to 2, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:04.336686 32191 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:04.338228 32238 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:04.339120   678 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.339689   678 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.340787   664 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:04.341739   664 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.342125   678 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:04.343986   664 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:04.348256 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:04.349224 32117 raft_consensus.cc:2393] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 2: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:04.350742   624 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.351316   624 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.353773   624 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:04.362463 32268 raft_consensus.cc:1275] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:04.342736   678 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:04.365006 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:04.365708   678 raft_consensus.cc:697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:04.365758 32193 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:04.370196 32238 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:04.372296   678 consensus_queue.cc:237] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.374567 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:04.375394 32268 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:04.376904 32090 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:04.378032   581 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:04.378535   581 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:04.378957   581 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.351065 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:04.397476   706 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:04.398075   706 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.404106   624 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.404826   624 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:13:04.405586   705 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:04.408058   624 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:04.409030 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:04.409822 32272 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:04.413368 32121 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:04.413683 32090 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:04.425379   624 raft_consensus.cc:2804] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:04.426537   624 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:04.426978   624 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.427234 32022 catalog_manager.cc:5697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:04.431932   664 consensus_queue.cc:1048] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:04.418864   610 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.419358 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:04.433633 32269 raft_consensus.cc:2368] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3.
I20260709 13:13:04.406042   705 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:04.421692 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:04.435254 32118 raft_consensus.cc:2393] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 2: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:04.422789 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:04.436444 32191 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:04.437646 32238 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:04.439654   678 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:04.439785 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:04.440131   678 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:04.440404 32118 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.440536   678 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:04.437705   705 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.447883 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:04.449743 32193 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.424058   706 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:04.452018   610 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:04.454053 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 87787.9us
I20260709 13:13:04.456132 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:04.456804 32196 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:04.456946 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:04.459091 32193 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:04.460201 32238 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:04.461306 32165 leader_election.cc:400] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3.
I20260709 13:13:04.462525 32165 leader_election.cc:403] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:04.461928   610 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:04.463599   610 raft_consensus.cc:697] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:04.463477 32118 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:04.464666   610 consensus_queue.cc:237] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.465451   664 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3.
I20260709 13:13:04.503938   705 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.505900   578 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:04.509325   578 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.511474   578 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:04.513258 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:04.493422   581 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.515949   581 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:04.517474 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:04.518069 32272 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.518725   678 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.519162 32269 raft_consensus.cc:2368] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 2. Current term is 3.
I20260709 13:13:04.521287 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:04.521895 32118 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.522212   624 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:13:04.524258   624 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:04.524772 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:04.524963 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:04.521476 32090 leader_election.cc:400] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 2. Current term is 3.
I20260709 13:13:04.525679 32193 raft_consensus.cc:2393] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 2: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:04.525898 32090 leader_election.cc:403] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:04.527726 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:04.528339 32268 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.530081 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:04.530288   678 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:04.530825 32121 raft_consensus.cc:2393] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 2: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:04.534866 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:04.535405 32195 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.536382 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:04.536942 32198 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.537683 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:04.540436 32272 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:04.541900 32090 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:04.541087   705 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:04.549101 32195 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:04.544101   624 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:04.555269 32089 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:04.555236 32022 catalog_manager.cc:5697] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:04.557098   624 raft_consensus.cc:697] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 3 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:04.561425   401 raft_consensus.cc:1275] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:13:04.556393   709 raft_consensus.cc:2804] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:04.565783 32272 raft_consensus.cc:1275] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:04.564759   705 consensus_queue.cc:1048] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:13:04.567329   587 consensus_queue.cc:1048] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:04.564750   709 raft_consensus.cc:697] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 3 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:04.568810   709 consensus_queue.cc:237] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:13:04.569922 32198 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:04.571090 32238 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:04.575814   705 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:04.578511   705 raft_consensus.cc:697] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:04.579509   705 consensus_queue.cc:237] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.590543 32121 raft_consensus.cc:1275] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:13:04.593779   705 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:04.594524   704 consensus_queue.cc:1048] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:04.561362   624 consensus_queue.cc:237] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.594386   705 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.636853 32022 catalog_manager.cc:5697] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:04.621388   636 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:04.657501   636 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.659605   636 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:04.614262 32268 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:04.661633 32268 raft_consensus.cc:1275] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:04.662860 32118 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:04.663146 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:04.663491   578 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 2. Current term is 3.
I20260709 13:13:04.628424   664 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:04.663865 32198 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:04.664053   664 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.666194   664 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:04.666708   664 consensus_queue.cc:1048] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:04.667882 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:04.668076 32238 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:04.625161   641 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:04.668557 32272 raft_consensus.cc:2368] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3.
I20260709 13:13:04.668871   636 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:04.668768   641 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.669384   636 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:04.669812   636 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:04.670321 32165 leader_election.cc:400] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3.
I20260709 13:13:04.670617 32165 leader_election.cc:403] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:04.670991   641 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:04.671500   668 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.672089   705 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:04.672875 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:04.673856 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:04.674605 32198 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:04.675079 32268 raft_consensus.cc:2368] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3.
I20260709 13:13:04.676033 32238 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:04.676682 32165 leader_election.cc:400] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3.
I20260709 13:13:04.676990 32165 leader_election.cc:403] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:04.676954   610 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:04.677556   610 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:04.677760   629 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.678010   610 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:04.679626   636 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.683353 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:04.689359 32198 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:04.692157 32238 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:04.693763 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:04.698407 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:04.685138   629 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3.
I20260709 13:13:04.699204 32121 raft_consensus.cc:2393] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 2: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:04.693053   636 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:04.691442   704 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.718098   704 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.721019   704 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:04.721218   724 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:04.721572   704 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:04.721777   724 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.722062   704 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.723953   704 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:04.701529 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:04.706228   706 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:04.695490 32193 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:04.708276 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:04.695230   705 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:04.701550   678 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:04.726518 32116 raft_consensus.cc:2393] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 2: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:04.726858   678 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.723973   724 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:04.729779   678 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:04.715163   668 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3.
I20260709 13:13:04.717025 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:04.725291   706 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.739709 32122 raft_consensus.cc:2393] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 2: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:04.740973   706 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:04.751053 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:04.724328   610 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.752079 32116 raft_consensus.cc:2393] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 2: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:04.753221 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:04.753820   704 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:04.754251 32122 raft_consensus.cc:2393] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 2: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:04.750929 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:04.754598   704 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:13:04.755636 32118 raft_consensus.cc:2393] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 2: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:04.756074   610 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:04.757651   704 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:04.761489 32193 raft_consensus.cc:1275] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:04.764226   705 raft_consensus.cc:697] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:04.765254   705 consensus_queue.cc:237] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.768884 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:04.768721   678 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:04.769670 32192 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:04.769860   678 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.770392 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:04.770630 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:04.771080 32190 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:04.772022   678 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:04.772468 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:04.773167 32195 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:13:04.769064   636 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:04.774116 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:04.774868 32193 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:04.768730 32238 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:04.775990   678 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:04.776410 32238 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:04.777163   706 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:04.777530 32238 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:04.777709   706 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:04.777952 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:04.776691   678 raft_consensus.cc:697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:04.778273   704 raft_consensus.cc:2804] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:04.778635 32193 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:04.769800 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:04.779356 32238 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:04.779644 32191 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:04.780102   610 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:04.780473   610 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:04.780841   610 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.781467   641 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.778148   706 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:04.781967   641 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.784191   641 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:04.778734   704 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:04.784772   704 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:04.779090   678 consensus_queue.cc:237] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.785332 32238 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:04.786567 32238 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:04.788223 32196 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:04.777102 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:04.789196 32198 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:04.789577   725 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:04.789990   725 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:04.767693 32022 catalog_manager.cc:5697] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:04.790442   725 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:04.790916   724 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:04.791508 32238 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:04.797161   705 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:04.797962   705 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:04.798728   705 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:04.774153   636 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.809213 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:04.809131 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:04.810220 32124 raft_consensus.cc:2393] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 2: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:04.810287 32117 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:04.812654 32123 raft_consensus.cc:1275] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:04.813597 32196 raft_consensus.cc:1275] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:04.812232 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:04.815853 32118 raft_consensus.cc:2393] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 2: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:04.818183 32238 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:04.819036 32238 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:04.820255 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:04.829083 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:04.831147   704 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:13:04.831509 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:04.831736   641 consensus_queue.cc:1048] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:04.794272   724 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:04.832285 32121 raft_consensus.cc:2393] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 2: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:04.810657   705 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.836019 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:04.843258 32120 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
I20260709 13:13:04.837167 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:04.844739 32116 raft_consensus.cc:2393] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 2: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:04.842342 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:04.847317 32122 raft_consensus.cc:2393] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 2: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:04.830377 32196 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:04.808629   636 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:04.833168   723 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:04.841373   724 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:04.869323   727 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:04.870996 32165 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:04.869606   704 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:04.850003   629 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.849644   726 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:04.882882   723 raft_consensus.cc:697] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:04.889088   659 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:04.835659   610 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.893183   726 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:04.913883   721 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.912703   659 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:04.920506   723 consensus_queue.cc:237] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.926330   725 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.928884   705 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:04.898000   717 consensus_queue.cc:1048] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:13:04.923174   659 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:04.886579   706 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.896806   629 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.949443 32115 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:04.954532 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:04.955564 32121 raft_consensus.cc:2393] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 2: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
W20260709 13:13:04.954574 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 58551us
I20260709 13:13:04.922026   726 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:04.958182   731 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:04.899173   727 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.963402 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:04.965937 32238 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:04.967381 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:04.979235 32196 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:04.950289   705 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.987237 32191 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:04.980165 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:04.930140   721 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:04.984280   737 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:04.983841   705 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:05.038918 32123 raft_consensus.cc:2393] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 2: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:05.029722   678 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:05.028630   737 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:05.022571   717 consensus_queue.cc:1048] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:13:05.051612   636 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:05.036950   734 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.058151   734 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:05.050880   737 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:05.071966   721 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:05.083958   725 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:05.056540   636 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:05.089373   734 leader_election.cc:290] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:05.074779   610 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:05.050945   678 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:05.099931   659 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:05.101275   678 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:05.085893   629 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:05.112078 32272 raft_consensus.cc:1275] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:05.115204 32269 raft_consensus.cc:1275] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:05.118062 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:05.122836 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:05.123737 32272 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:05.123298 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:05.126196 32121 raft_consensus.cc:2393] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 2: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
W20260709 13:13:05.128418 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 111712us
I20260709 13:13:05.131461 32115 raft_consensus.cc:1275] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:05.133638 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:05.133975 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:05.134418 32115 raft_consensus.cc:2393] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 3: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:05.134588 32121 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:13:05.134264 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:05.135582 32272 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:13:05.135856   659 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:05.143344 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:05.110752   578 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.120208   721 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.146405 32120 raft_consensus.cc:2393] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 2: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:05.119423   727 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:05.143177   718 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.147161   705 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:05.148272 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:05.151245   578 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:05.169948   736 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.151710   721 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:05.186757 32123 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:05.172001   724 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:05.212987 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:05.215849 32120 raft_consensus.cc:2393] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 3: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:05.195290   587 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.169749   718 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:05.189363   705 consensus_queue.cc:1048] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
W20260709 13:13:05.221572 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 79619.9us
I20260709 13:13:05.228740 32090 leader_election.cc:304] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:05.216440   742 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.188900   733 consensus_queue.cc:1048] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
W20260709 13:13:05.235468 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 93558.1us
I20260709 13:13:05.236301 32165 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:05.227665   636 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:05.201275   736 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:05.224033   587 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:05.235692   738 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:05.355751 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:05.360841 32120 raft_consensus.cc:2393] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 2: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
W20260709 13:13:05.362361 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 116548us
I20260709 13:13:05.297649   732 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:05.364699 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:05.365443 32272 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:13:05.304679 32268 raft_consensus.cc:1275] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:05.256490   716 consensus_queue.cc:1048] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.101s
I20260709 13:13:05.367094   732 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.385114   732 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:05.385258   735 log.cc:927] Time spent T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:13:05.241063   742 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:05.389755 32272 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:05.412375   578 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:05.414011   587 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:05.424678   746 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:05.424897 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 455462us
I20260709 13:13:05.425135   724 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:05.425280   746 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:05.305704   738 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:05.427922   746 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:05.433579 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:05.434077 32196 raft_consensus.cc:1275] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:05.435117 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:05.435771 32192 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:05.436503   726 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:05.437011 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:05.438067 32190 raft_consensus.cc:2368] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4.
I20260709 13:13:05.438416 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:05.439168 32196 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:05.439306   726 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:05.439486 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:05.440124 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:05.440132 32197 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:05.445691 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:05.450932 32121 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:05.441854   721 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:05.430738   718 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:05.453405 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:05.454088 32196 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:05.434255   742 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:05.380278   736 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:05.456425 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:05.457195 32191 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:13:05.458379 32196 raft_consensus.cc:1275] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:05.428185   738 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:05.461062 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:05.462126 32196 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:05.455785   732 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:05.390884   749 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:05.463053 32195 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:05.465045   749 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.459295   737 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:05.465492   749 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:05.466185 32269 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:05.468154   732 leader_election.cc:290] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:05.470257   737 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:05.473685 32165 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:05.473922   749 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:05.474469   742 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:05.474550 32123 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:05.475306   742 raft_consensus.cc:697] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 4 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:05.476166   742 consensus_queue.cc:237] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:05.481062 32194 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:05.485054 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:05.485678 32272 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:13:05.489315 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:05.490124 32272 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:13:05.497799 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:05.498468 32272 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:13:05.476353   749 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:05.501792 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 201618us
I20260709 13:13:05.480472 32191 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:05.507187 32272 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
I20260709 13:13:05.510416 32165 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:05.514120 32089 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:05.513047 32165 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:05.515812 32238 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:05.517622 32238 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:05.513830   755 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:05.519412   755 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.519757   755 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:05.520143   704 raft_consensus.cc:2804] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:05.502200   706 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:05.523867 32238 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:05.520713   704 raft_consensus.cc:697] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:05.538918 32165 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:05.543336 32239 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:05.544219 32239 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:05.522471   734 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:05.554668 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:05.559410 32195 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:05.555737 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:05.560658 32194 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:05.555970 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:05.561832 32198 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:05.557001 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:05.558283 32238 leader_election.cc:400] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4.
I20260709 13:13:05.563045 32238 leader_election.cc:403] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:05.563134 32191 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:05.558625 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:05.564041 32238 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:05.565761 32238 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:05.530925   641 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:05.531868   737 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:05.567395 32238 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:05.539287   725 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:05.573980 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:05.575987 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:05.575294 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:05.579725 32121 raft_consensus.cc:1275] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:05.576223 32115 raft_consensus.cc:2393] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 2: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:05.584715 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:05.588300 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:05.589208 32196 raft_consensus.cc:1275] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:05.590286 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:05.591085 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:05.592525 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:05.591106 32267 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:05.531428   738 consensus_queue.cc:1048] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:13:05.559146   734 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.595353 32198 raft_consensus.cc:1275] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:05.562779   727 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:05.595721 32194 raft_consensus.cc:1275] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:05.597455 32195 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:05.558969   746 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:05.562392   610 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:05.540132   744 consensus_queue.cc:1048] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:13:05.570130   641 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.610064 32196 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:05.615417 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:05.616499 32120 raft_consensus.cc:2393] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 2: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:05.617446 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:05.618388 32122 raft_consensus.cc:2393] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 2: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:05.570525   636 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:05.571149   725 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:05.587848   706 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:05.568701   730 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4.
I20260709 13:13:05.578276 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:05.578774   737 raft_consensus.cc:697] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:13:05.672737 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 53343.5us
I20260709 13:13:05.604199   734 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:05.612377   727 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.611902   743 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:05.683014 32122 raft_consensus.cc:1275] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:05.622435   641 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:05.663244   754 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.664529   725 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:05.626976   636 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:05.662761 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:05.624890 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:05.666163   610 raft_consensus.cc:697] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:05.682492   706 raft_consensus.cc:697] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:05.674103   746 raft_consensus.cc:697] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 3 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:05.681865 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:05.711999   636 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:05.718781   764 consensus_queue.cc:1048] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:13:05.677714   704 consensus_queue.cc:237] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:13:05.737592   755 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:05.740024 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:05.685039 32190 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:05.720767   737 consensus_queue.cc:237] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:05.769482   755 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:05.711078 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:05.770711 32122 raft_consensus.cc:2393] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 3: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:05.688115   727 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:05.716233 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:05.715013   743 raft_consensus.cc:697] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:05.729586   741 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:05.780967   741 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:05.757804 32117 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:05.760004   746 consensus_queue.cc:237] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:05.760265   706 consensus_queue.cc:237] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:05.741600   610 consensus_queue.cc:237] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:05.710877   754 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:05.765455 32199 raft_consensus.cc:2393] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 3: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:05.774595 32120 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
I20260709 13:13:05.765841   733 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.769659   724 consensus_queue.cc:1048] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:13:05.815760 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 194883us
I20260709 13:13:05.781422   743 consensus_queue.cc:237] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:05.794121   726 consensus_queue.cc:1048] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:13:05.827595 32090 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:05.834901 32190 raft_consensus.cc:1275] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:05.834678   705 consensus_queue.cc:1048] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:05.835305 32238 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:05.839892 32192 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:05.847596 32238 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:05.813859   733 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:05.860759 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 259685us
I20260709 13:13:05.841463   723 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:13:05.862416 32238 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:05.848254   587 raft_consensus.cc:2804] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:05.865209 32089 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:05.843068   738 consensus_queue.cc:1048] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:13:05.865124   581 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.868036   724 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:05.897908 32089 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:05.866576   587 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.866315   764 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.905576 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:05.906633   771 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:05.917603 32191 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:05.911397 32089 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:05.924886 32238 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:05.852363   727 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:05.933179   769 consensus_queue.cc:1048] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:13:05.910933   587 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:05.940220 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 140439us
I20260709 13:13:05.961153 32195 raft_consensus.cc:1275] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:05.924669   723 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:05.910557   581 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:05.945541   726 raft_consensus.cc:2804] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:05.941228   724 raft_consensus.cc:697] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:05.940726   771 raft_consensus.cc:697] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:13:05.985656 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 105475us
I20260709 13:13:05.939981   641 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:05.980676   717 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:05.923354   764 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:05.983155   723 raft_consensus.cc:697] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:06.015775   773 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:06.016310   772 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:06.068984   772 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:06.069505   772 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:05.981705   726 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:06.072857   726 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:06.000846   754 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:05.999529   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 105078us
I20260709 13:13:06.097164   773 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:06.067818 32117 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
I20260709 13:13:06.139688   733 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:06.111454   773 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:06.166453   629 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.173477   629 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:13:06.178421   629 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:06.181095 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:06.181996 32191 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:06.137369   724 consensus_queue.cc:237] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:06.174345   727 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:06.204068 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 217127us
I20260709 13:13:06.230790 32191 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:06.136968   771 consensus_queue.cc:237] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:06.167687   723 consensus_queue.cc:237] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:06.236256 32238 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:13:06.244849   779 log.cc:927] Time spent T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:13:06.240876 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:06.224855   581 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:06.254463 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:06.264863 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:06.265565 32191 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:06.245798   705 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:13:06.256829   734 consensus_meta.cc:287] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.566s	user 0.004s	sys 0.007s
I20260709 13:13:06.258854   769 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:06.260596 32119 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:06.278371   734 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:06.281998 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:06.221133   725 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:06.257064   641 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:06.263343 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:06.267637   659 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:06.292192   659 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:06.295555   659 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:06.307533 32197 raft_consensus.cc:2410] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:06.308198 32270 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:06.284204   764 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:06.314644 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:06.315692 32197 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:06.317714 32197 raft_consensus.cc:1275] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:06.299038   769 raft_consensus.cc:697] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:06.307862 32118 raft_consensus.cc:2368] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3.
I20260709 13:13:06.278096   705 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:06.324285 32117 raft_consensus.cc:2393] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 3: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:06.336169 32270 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:06.337337   775 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:13:06.340327 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 73956.7us
W20260709 13:13:06.344988 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 72550.2us
I20260709 13:13:06.333407   581 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:06.346074 32089 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:06.341956   734 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:06.336349   772 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:06.346315   743 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:13:06.358467   778 log.cc:927] Time spent T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.104s	user 0.001s	sys 0.001s
W20260709 13:13:06.374644   785 log.cc:927] Time spent T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:13:06.374774   610 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:06.375438   610 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:06.378784 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:06.379467 32122 raft_consensus.cc:1275] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:13:06.380030 32119 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:06.383735 32116 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:06.382045 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:06.390589 32122 raft_consensus.cc:2368] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3.
I20260709 13:13:06.384965   610 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:06.348925   581 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:06.396510 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:06.369264 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:06.367506   743 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:06.403228   581 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:06.407015   581 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:06.338424   769 consensus_queue.cc:237] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:06.380239   792 consensus_queue.cc:1048] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.099s
I20260709 13:13:06.347530   775 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:06.424520 32116 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:06.425786   775 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:06.410625   636 consensus_meta.cc:287] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.649s	user 0.011s	sys 0.001s
I20260709 13:13:06.407716   725 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:06.409574   705 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:06.433671   783 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:06.434135   783 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:06.415508 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:06.437925 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 88604.4us
I20260709 13:13:06.434489   783 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:06.427901   581 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:06.431697   636 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:06.440961   743 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:06.463766   802 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.422180   587 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:06.464342   772 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:06.459956   733 consensus_queue.cc:1048] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:13:06.468111   802 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:06.498404   794 log.cc:927] Time spent T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:13:06.464571   726 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:06.507079   401 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 1 LEARNER]: Advancing to term 2
W20260709 13:13:06.496544   797 log.cc:927] Time spent T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260709 13:13:06.546481 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 164772us
W20260709 13:13:06.549474 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 161223us
I20260709 13:13:06.567325   783 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:06.577105   587 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:06.598891   766 log.cc:927] Time spent T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.659s	user 0.005s	sys 0.005s
I20260709 13:13:06.599010   401 raft_consensus.cc:1275] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 2 LEARNER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:13:06.606065 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:06.609947 32116 raft_consensus.cc:1275] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:06.592443   581 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:06.613973   759 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.617216 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:06.652429   793 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.653179   793 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:06.655913   793 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:06.661300 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 47788.2us
I20260709 13:13:06.592178   773 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:06.665827   636 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:06.642688   742 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:13:06.684953 32199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 741) took 1114 ms. Trace:
I20260709 13:13:06.685549 32199 rpcz_store.cc:276] 0709 13:13:05.558308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.558427 (+   119us) service_pool.cc:224] Handling call
0709 13:13:06.672877 (+1114450us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b54000b2554. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:06.673047 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":462891904}
I20260709 13:13:06.704437 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:06.678158   783 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:06.702068   717 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:06.707259   802 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:06.705521   726 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:06.657495   759 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:06.747488   717 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:06.769961 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 97413.9us
W20260709 13:13:06.767961   804 log.cc:927] Time spent T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
W20260709 13:13:06.776410   805 log.cc:927] Time spent T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:13:06.778119   726 consensus_queue.cc:1048] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:06.786903   773 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:06.775420 32193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 722) took 1753 ms. Trace:
I20260709 13:13:06.791551 32193 rpcz_store.cc:276] 0709 13:13:05.016435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.016560 (+   125us) service_pool.cc:224] Handling call
0709 13:13:05.016890 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:05.462768 (+445878us) spinlock_profiling.cc:243] Waited 9.58 ms on lock 0x7b1800373a20. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59eb994bc 00007fb59bee748b 00007fb5a4d41ab9 00007fb59bf0369b 00007fb59bf0193f 00007fb59bf01455 00007fb59efe9060 00007fb59efe9bfb 00007fb59eff464b
0709 13:13:05.462926 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:05.462960 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:05.463466 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 13:13:05.674118 (+210652us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:05.717733 (+ 43615us) log.cc:844] Serialized 14 byte log entry
0709 13:13:05.718043 (+   310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.718144 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:06.163929 (+445785us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b1800373a20. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bf04522 00007fb59bf067c1 00007fb59bf06779 00007fb59bf06709 00007fb59bf066d1 00007fb59bf059cd 000000000038f354 000000000038f199 00007fb59bee783a
0709 13:13:06.483533 (+319604us) spinlock_profiling.cc:243] Waited 8.19 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:13:06.761648 (+278115us) raft_consensus.cc:1685] finished
0709 13:13:06.761686 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:06.770066 (+  8380us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":35323,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":36,"raft.queue_time_us":95770,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":4104,"spinlock_wait_cycles":51782912,"thread_start_us":254884,"threads_started":2,"wal-append.queue_time_us":368300}
W20260709 13:13:06.798723 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 93713.2us
I20260709 13:13:06.800426   745 consensus_queue.cc:1048] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:06.802277 32239 leader_election.cc:400] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3.
I20260709 13:13:06.802901 32239 leader_election.cc:403] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:13:06.803699   723 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3.
I20260709 13:13:06.806170 32239 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:06.796948 32123 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
W20260709 13:13:06.808238 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 334875us
I20260709 13:13:06.809626 32123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56884 (request call id 803) took 1127 ms. Trace:
I20260709 13:13:06.810091 32123 rpcz_store.cc:276] 0709 13:13:05.680801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.680976 (+   175us) service_pool.cc:224] Handling call
0709 13:13:06.704171 (+1023195us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b5800005198. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59beccb71 00007fb59becca22 00007fb5a4de5c09 00007fb5a3f3fee0 00007fb5a40090ab 00007fb5a4009131 00007fb5a3fb70a0 00007fb5a3fb6984 00007fb59d5316d4 00007fb59d531662
0709 13:13:06.807805 (+103634us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2311424}
I20260709 13:13:06.823153 32089 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:06.827068 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:06.829440 32199 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:06.831223 32089 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:06.831554 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:06.832653 32193 raft_consensus.cc:2368] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3.
I20260709 13:13:06.831612 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:06.827114 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:06.833837 32271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36084 (request call id 749) took 1249 ms. Trace:
I20260709 13:13:06.834236 32271 rpcz_store.cc:276] 0709 13:13:05.584329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.584459 (+   130us) service_pool.cc:224] Handling call
0709 13:13:06.833615 (+1249156us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b5400068e54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:06.833743 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":815187712}
I20260709 13:13:06.809119   723 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:06.852088   732 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:06.826647   717 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:06.812750   636 consensus_queue.cc:1048] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:13:06.963029 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:06.969540 32124 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:06.835022   773 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:06.989545 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:13:06.944451   746 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.017s	sys 0.015s
W20260709 13:13:06.995357 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 183684us
I20260709 13:13:06.998474 32198 raft_consensus.cc:1275] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:06.970115   705 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:13:06.938524   816 log.cc:927] Time spent T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:13:06.976262   732 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:06.958842   757 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:06.957827   629 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:13:06.996869   746 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.021s	sys 0.015s
I20260709 13:13:06.992834   773 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:06.852351   759 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:06.971004   664 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:07.014019   753 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.017940   664 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:07.015040   812 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.008831   771 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:07.023656 32196 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:07.001832   678 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:07.018088   753 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:07.079469 32124 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:07.305783 32124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56884 (request call id 823) took 1065 ms. Trace:
I20260709 13:13:07.006356   732 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:07.160387 32238 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:07.310423 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 150139us
W20260709 13:13:07.129170   798 log.cc:927] Time spent T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.701s	user 0.000s	sys 0.003s
I20260709 13:13:07.306362 32124 rpcz_store.cc:276] 0709 13:13:06.240751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.252708 (+ 11957us) service_pool.cc:224] Handling call
0709 13:13:06.962799 (+710091us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b5800005198. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59beccb71 00007fb59becca22 00007fb5a4de5c09 00007fb5a3f3fee0 00007fb5a40090ab 00007fb5a4009131 00007fb5a3fb70a0 00007fb5a3fb6984 00007fb59d5316d4 00007fb59d531662
0709 13:13:07.305689 (+342890us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3498880}
I20260709 13:13:07.318054   808 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:07.312423 32238 leader_election.cc:400] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3.
I20260709 13:13:07.320969 32238 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:07.079552   759 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:07.016618   773 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:07.015743 32190 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:13:07.145085   821 log.cc:927] Time spent T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:13:07.218647   790 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:07.314625 32115 raft_consensus.cc:1240] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:07.006119   705 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:07.150952   825 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:07.025815   706 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:07.128868   814 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:07.026232   757 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:07.329691   822 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:07.141523   636 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:07.024860   771 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:07.020763   629 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:07.318910   808 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:07.118577   812 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:13:07.320381   678 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:07.338908 32115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 814) took 1731 ms. Trace:
I20260709 13:13:07.337169   664 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:07.367260 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 44527.6us
I20260709 13:13:07.368021 32238 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:07.328969   759 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:07.376569 32195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 792) took 1374 ms. Trace:
I20260709 13:13:07.380872 32115 rpcz_store.cc:276] 0709 13:13:05.603350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.603520 (+   170us) service_pool.cc:224] Handling call
0709 13:13:07.314065 (+1710545us) spinlock_profiling.cc:243] Waited 8.33 ms on lock 0x7b5800005198. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59beccb71 00007fb59becca22 00007fb5a4de5c09 00007fb5a3f3fee0 00007fb5a40090ab 00007fb5a4009131 00007fb5a3fcafc0 00007fb5a3fb5929 00007fb5a3fb53d2 00007fb59d52cbd4
0709 13:13:07.314367 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:07.332913 (+ 18546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:07.333123 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19152768}
I20260709 13:13:07.377151 32195 rpcz_store.cc:276] 0709 13:13:06.002507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.002707 (+   200us) service_pool.cc:224] Handling call
0709 13:13:06.003201 (+   494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:06.003674 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:06.003719 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:06.009438 (+  5719us) log.cc:844] Serialized 26 byte log entry
0709 13:13:06.298717 (+289279us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:06.298760 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:06.298846 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:07.015109 (+716263us) spinlock_profiling.cc:243] Waited 4.83 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:13:07.371780 (+356671us) raft_consensus.cc:1685] finished
0709 13:13:07.371810 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:07.376479 (+  4669us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18073,"raft.queue_time_us":15915,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":18950,"spinlock_wait_cycles":11112192,"thread_start_us":219676,"threads_started":1,"wal-append.queue_time_us":330198}
I20260709 13:13:07.353600   814 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:07.343401   706 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:07.351994   825 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:07.353336   790 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:07.379647 32265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 741) took 1799 ms. Trace:
I20260709 13:13:07.366245   636 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:07.352340   822 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:07.391114   831 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:07.394645   820 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:07.394693   835 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:13:07.416267   828 log.cc:927] Time spent T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:13:07.417474   825 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:07.407998   831 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:07.410827   815 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:07.414636   709 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:07.440214   838 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:07.440645   636 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:07.417488   705 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:07.420120   831 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:07.432222   736 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:07.434217   753 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:07.442618   825 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:13:07.440645   790 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:07.406354   834 consensus_queue.cc:1048] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:13:07.398949 32265 rpcz_store.cc:276] 0709 13:13:05.572629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.575670 (+  3041us) service_pool.cc:224] Handling call
0709 13:13:07.316075 (+1740405us) spinlock_profiling.cc:243] Waited 7.14 ms on lock 0x7b5800187898. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59beccb71 00007fb59becca22 00007fb5a4de5c09 00007fb5a3f3fee0 00007fb5a40090ab 00007fb5a4009131 00007fb5a3fcafc0 00007fb5a3fb5929 00007fb5a3fb53d2 00007fb59d52cbd4
0709 13:13:07.329039 (+ 12964us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:07.336463 (+  7424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:07.340062 (+  3599us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:07.349324 (+  9262us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:07.351323 (+  1999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:07.355439 (+  4116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:07.372083 (+ 16644us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16416000}
I20260709 13:13:07.438261   709 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:07.452576   664 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:07.442260   838 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:07.545035   629 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:07.531236   736 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:07.617630   771 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:07.463760   757 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:07.453086   815 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:07.411273   820 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:07.643405   812 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:07.948167   745 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:07.962502 32268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36084 (request call id 743) took 2389 ms. Trace:
I20260709 13:13:07.790287   736 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:07.641412   629 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:07.825146 32272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 748) took 2236 ms. Trace:
I20260709 13:13:07.884840   764 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:07.965662   771 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:07.668316   664 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:07.623610   759 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:07.912400   739 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.642591   750 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:07.891670   753 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:13:07.892453   732 consensus_meta.cc:287] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.565s	user 0.012s	sys 0.000s
I20260709 13:13:07.973699   629 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:07.865123   800 log.cc:927] Time spent T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 1.444s	user 0.010s	sys 0.012s
I20260709 13:13:08.033003   737 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:13:08.033429 32118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56890 (request call id 815) took 2420 ms (client timeout 2270 ms). Trace:
I20260709 13:13:07.809167   709 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:07.897365   659 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.964901 32268 rpcz_store.cc:276] 0709 13:13:05.573352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.578552 (+  5200us) service_pool.cc:224] Handling call
0709 13:13:07.913120 (+2334568us) spinlock_profiling.cc:243] Waited 780 ms on lock 0x7b54000f1754. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:07.953774 (+ 40654us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1793880448}
I20260709 13:13:08.010803   636 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:08.011030   771 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:07.813824   706 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:08.013723   741 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:07.968087   764 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:07.865243   773 consensus_meta.cc:287] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.003s
I20260709 13:13:07.911430   717 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:08.033664   737 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.033838   810 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:07.642674   839 raft_consensus.cc:2804] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:07.964418   745 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:07.966194   678 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:07.967160 32272 rpcz_store.cc:276] 0709 13:13:05.584003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.584670 (+   667us) service_pool.cc:224] Handling call
0709 13:13:05.585121 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:05.792237 (+207116us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:05.792282 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:07.041040 (+1248758us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b2c00139618. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59d8eaa11 00007fb59d8fa372 00007fb59f02ca01 00007fb59eff143a 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2
0709 13:13:07.041421 (+   381us) log.cc:844] Serialized 26 byte log entry
0709 13:13:07.332891 (+291470us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:07.332932 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:07.332999 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:07.806899 (+473900us) raft_consensus.cc:1685] finished
0709 13:13:07.806920 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:07.820223 (+ 13303us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11167,"raft.queue_time_us":25440,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":60143,"spinlock_wait_cycles":35737472,"thread_start_us":477932,"threads_started":2,"wal-append.queue_time_us":315634}
W20260709 13:13:08.053138 32238 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.008s	sys 0.030s
I20260709 13:13:07.821357   838 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:08.026504   739 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:08.059744 32164 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.012s	sys 0.019s
W20260709 13:13:08.035025   796 log.cc:927] Time spent T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 1.610s	user 0.006s	sys 0.011s
W20260709 13:13:08.033931 32118 rpcz_store.cc:269] 0709 13:13:05.612862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.619325 (+  6463us) service_pool.cc:224] Handling call
0709 13:13:08.033177 (+2413852us) spinlock_profiling.cc:243] Waited 548 ms on lock 0x7b54002c8dd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:08.033326 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1261044608}
W20260709 13:13:08.103032 32238 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.009s	sys 0.030s
W20260709 13:13:08.105651 32164 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.013s	sys 0.020s
W20260709 13:13:08.105964 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 693284us
I20260709 13:13:08.107968 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:07.907496   814 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:08.093318   706 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:08.034590   732 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:08.112519 32163 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.022s	sys 0.014s
I20260709 13:13:08.064998   636 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.093490   709 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:13:08.120642 32163 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.023s	sys 0.014s
W20260709 13:13:08.117969 32162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 246778us
W20260709 13:13:08.114646   769 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.694s	user 0.014s	sys 0.041s
I20260709 13:13:08.057371   659 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.103252 32192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 789) took 2188 ms. Trace:
I20260709 13:13:08.034350   753 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.095674   773 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.046175   831 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:08.148197 32239 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.30.63.1:42339 timed out after 2.270s (SENT) [suppressed 2 similar messages]
I20260709 13:13:08.115720   838 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:08.117080   839 raft_consensus.cc:697] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:08.152390 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:08.159358 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:13:08.142077   769 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.721s	user 0.014s	sys 0.042s
I20260709 13:13:08.164259 32191 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:08.134614   716 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:08.150345 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:08.134958   736 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:08.134895   845 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:08.140198   755 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:08.141217   774 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:08.143347   759 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.066061   750 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.209323 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:08.144323   842 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:08.192730 32196 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:13:08.213881 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:08.143589   678 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:08.215641   678 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.217424   840 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.104277   810 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.218200   840 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.187651 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:08.143090   814 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:08.149729   741 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:08.195905   853 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:08.196480 32194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 793) took 2130 ms. Trace:
I20260709 13:13:08.196697 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:08.199002 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:08.199993 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:08.148453   668 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:08.145197   756 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:08.200659   734 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:08.148006   718 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:08.207238 32273 raft_consensus.cc:1240] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:08.119876   706 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.144197   709 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.195268 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:08.203969   815 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:08.237003   852 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:08.238684 32194 rpcz_store.cc:276] 0709 13:13:06.065930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.066056 (+   126us) service_pool.cc:224] Handling call
0709 13:13:06.066380 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:06.088423 (+ 22043us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:06.088451 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:06.091149 (+  2698us) log.cc:844] Serialized 26 byte log entry
0709 13:13:06.338578 (+247429us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:06.338624 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:06.338694 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:08.033525 (+1694831us) spinlock_profiling.cc:243] Waited 8.29 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:13:08.186921 (+153396us) raft_consensus.cc:1685] finished
0709 13:13:08.186941 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:08.196420 (+  9479us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21683,"raft.queue_time_us":49982,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":9321,"spinlock_wait_cycles":19065728,"thread_start_us":247043,"threads_started":1,"wal-append.queue_time_us":331995}
I20260709 13:13:08.263706 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:08.201416   704 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:08.219444   725 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:08.211995   774 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.163815   838 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.203135   736 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.270864 32194 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:08.208302   755 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.213131   759 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.245565   717 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:08.243726   664 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:08.249954   820 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:08.284039   750 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:08.255970   776 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.242486   814 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.266649   769 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:08.266883   629 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:08.248916   741 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.219530   851 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.276857   771 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:08.252203   734 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.192721   716 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.300349   846 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.259959   849 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.253829   718 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.256603   853 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.292662 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:08.277976   725 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.208956   845 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.235482   842 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.272866   704 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:08.304564   809 log.cc:927] Time spent T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 1.455s	user 0.005s	sys 0.013s
W20260709 13:13:08.304667   368 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.061s	sys 0.132s
I20260709 13:13:08.249322   668 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.299436   732 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:08.290751   717 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.304328   776 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.292402   852 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:08.366561 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 218383us
I20260709 13:13:08.312481   737 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:08.317140   788 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:08.302553   769 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:08.402915   843 log.cc:927] Time spent T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.224s	user 0.001s	sys 0.001s
W20260709 13:13:08.354671   368 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.061s	sys 0.133s
I20260709 13:13:08.290762   839 consensus_queue.cc:237] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.251372   756 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.367483   659 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:08.370093   773 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:08.423442 32238 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:08.429256 32238 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:08.408613   840 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:08.416560   737 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:08.414986   636 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:08.143848 32192 rpcz_store.cc:276] 0709 13:13:05.910778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.919133 (+  8355us) service_pool.cc:224] Handling call
0709 13:13:05.961548 (+ 42415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:05.992306 (+ 30758us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:06.000927 (+  8621us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:06.016555 (+ 15628us) log.cc:844] Serialized 26 byte log entry
0709 13:13:06.338964 (+322409us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:06.342053 (+  3089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:06.344712 (+  2659us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:07.864321 (+1519609us) spinlock_profiling.cc:243] Waited 8.62 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:13:08.055105 (+190784us) raft_consensus.cc:1685] finished
0709 13:13:08.055128 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:08.097356 (+ 42228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1028,"raft.queue_time_us":8372,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":15435,"spinlock_wait_cycles":19826560,"thread_start_us":311102,"threads_started":1,"wal-append.queue_time_us":404456}
I20260709 13:13:08.421156   771 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:08.455825   736 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:08.427846   678 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:08.431509 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:08.425566   739 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:08.433658   706 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:08.449218   840 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:08.428495   855 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:08.417253   788 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:08.476740 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:08.437409   737 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.459272   636 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:08.457892   668 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:08.485291 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:08.325141   851 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.467321   709 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:08.486179 32198 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:13:08.492518   718 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:08.493968 32121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 813) took 2890 ms. Trace:
I20260709 13:13:08.478279   838 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:08.473021   840 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:08.513569 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:08.535074 32198 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:08.537811   853 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:08.539383   776 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:08.461998   771 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:13:08.539474 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:08.359865   849 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:08.529506   860 log.cc:927] Time spent T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:13:08.529450   725 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:08.360054   846 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.528622   704 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:08.545907   840 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:08.547565   847 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:08.549535   717 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:08.554452   842 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:08.542815   771 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:08.494560 32121 rpcz_store.cc:276] 0709 13:13:05.597084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.597190 (+   106us) service_pool.cc:224] Handling call
0709 13:13:07.400750 (+1803560us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b5800005198. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59beccb71 00007fb59becca22 00007fb5a4de5c09 00007fb5a3f3fee0 00007fb5a40090ab 00007fb5a4009131 00007fb5a3fcafc0 00007fb5a3fb5929 00007fb5a3fb53d2 00007fb59d52cbd4
0709 13:13:07.400946 (+   196us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:07.401295 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:07.401322 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:07.406245 (+  4923us) log.cc:844] Serialized 26 byte log entry
0709 13:13:07.806972 (+400727us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:07.807033 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:07.807133 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:08.482450 (+675317us) raft_consensus.cc:1685] finished
0709 13:13:08.482477 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:08.487277 (+  4800us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1875,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":2394,"spinlock_wait_cycles":8357760,"thread_start_us":164490,"threads_started":1,"wal-append.queue_time_us":693002}
I20260709 13:13:08.560230   852 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:08.561911 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:08.483104   759 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:08.529670   786 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:08.513902   730 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:08.493176   810 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:08.569344 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:08.573329 32120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 820) took 2699 ms. Trace:
I20260709 13:13:08.604350 32198 raft_consensus.cc:2468] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:13:08.573949   737 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:08.530640 32193 raft_consensus.cc:1275] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:08.490134   755 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:08.492810   741 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:08.534448   716 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:08.608774   861 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:08.609709   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:08.482919 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:08.613583 32115 raft_consensus.cc:1240] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:08.614559 32124 raft_consensus.cc:1240] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:08.612519 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:08.678540 32121 raft_consensus.cc:2368] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4.
I20260709 13:13:08.615602 32123 raft_consensus.cc:1275] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:08.486174   636 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:13:08.623505 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 194321us
I20260709 13:13:08.680974 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:08.628971 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:08.681953 32123 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:08.594023   717 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.604166 32120 rpcz_store.cc:276] 0709 13:13:05.873613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.873784 (+   171us) service_pool.cc:224] Handling call
0709 13:13:05.874159 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:05.896749 (+ 22590us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:05.896795 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:08.015867 (+2119072us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b2c000278a8. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59d8eaa11 00007fb59d8fa372 00007fb59f02ca01 00007fb59eff143a 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2
0709 13:13:08.016548 (+   681us) log.cc:844] Serialized 26 byte log entry
0709 13:13:08.199713 (+183165us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:08.199750 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:08.199826 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:08.573021 (+373195us) raft_consensus.cc:1685] finished
0709 13:13:08.573040 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:08.573255 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22086,"raft.queue_time_us":24692,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":18941,"spinlock_wait_cycles":3894656,"thread_start_us":182681,"threads_started":1,"wal-append.queue_time_us":265058}
I20260709 13:13:08.624383   736 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:08.679159   845 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:08.720537 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:08.720657   736 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.685300   861 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:08.621366   718 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:08.621279   820 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:08.683883 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:08.687028 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:08.689512 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:08.725317 32198 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:13:08.725839 32121 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:08.726562 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:08.727192 32198 raft_consensus.cc:2468] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:13:08.727413 32116 raft_consensus.cc:1240] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:13:08.682184   636 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:08.676415 32193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 803) took 1830 ms. Trace:
W20260709 13:13:08.728714 32164 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.004s	sys 0.020s
W20260709 13:13:08.729516 32164 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.004s	sys 0.020s
I20260709 13:13:08.669818 32268 raft_consensus.cc:2410] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:08.744829 32238 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:08.745951 32238 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:08.746975 32238 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:08.749408   846 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:08.627257   786 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:08.747591   820 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:08.769968   771 consensus_queue.cc:1059] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:13:08.791482 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:08.766475   717 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.792306   771 consensus_queue.cc:1048] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:08.792896   820 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:08.774950 32239 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:08.795300 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:08.760421   725 raft_consensus.cc:2804] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:08.760574   704 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:08.794639 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:08.751109 32119 raft_consensus.cc:1240] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:08.798674   857 raft_consensus.cc:3055] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:08.490559   855 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.729488   718 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:08.803763   717 leader_election.cc:290] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:08.792932 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:08.805589 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:08.801069   725 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:08.814623   725 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:08.611749   847 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:08.808115 32239 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:08.815078 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:08.815685 32121 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:08.620647   730 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:08.765937   705 raft_consensus.cc:2804] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:08.813083 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:08.806696   704 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:08.805264   759 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:08.808212 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:08.817670   402 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:08.819177 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:08.831359 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:08.817687   727 consensus_queue.cc:1059] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:13:08.824981 32124 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:08.815869   857 raft_consensus.cc:740] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:08.810053   724 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:08.722733   741 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:08.776971   610 consensus_queue.cc:1059] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:13:09.010984 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:09.012663   847 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:09.011889   741 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:09.017716 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:08.914882 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.018677 32122 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:09.010746 32116 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:08.831559 32238 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:09.019328 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:08.743659 32193 rpcz_store.cc:276] 0709 13:13:06.839903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.850425 (+ 10522us) service_pool.cc:224] Handling call
0709 13:13:08.476297 (+1625872us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b5800004298. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59beccb71 00007fb59becca22 00007fb5a4de5c09 00007fb5a3f3fee0 00007fb5a40090ab 00007fb5a4009131 00007fb5a3fcafc0 00007fb5a3fb5929 00007fb5a3fb53d2 00007fb59d52cbd4
0709 13:13:08.476564 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:08.624279 (+147715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:08.669820 (+ 45541us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53532544}
I20260709 13:13:09.020072 32268 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:09.022270   578 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.022985   578 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:09.007934   861 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:09.024538   851 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:08.820048   853 raft_consensus.cc:2804] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:13:09.130221 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 119606us
I20260709 13:13:08.827451   704 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:08.821560   705 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:13:09.141722 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 310255us
I20260709 13:13:08.831591   764 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:08.844063 32192 raft_consensus.cc:1275] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:13:09.034860   724 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.952534   736 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:08.928009   740 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.888185   759 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:09.531702 32190 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.032s	sys 0.038s
I20260709 13:13:09.518898 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:13:09.528848 32194 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.250s	user 0.023s	sys 0.105s
I20260709 13:13:09.562712 32266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36084 (request call id 783) took 1336 ms. Trace:
W20260709 13:13:09.562973 32194 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.284s	user 0.024s	sys 0.105s
I20260709 13:13:09.563180 32266 rpcz_store.cc:276] 0709 13:13:08.226812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.272327 (+ 45515us) service_pool.cc:224] Handling call
0709 13:13:09.132397 (+860070us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b5800187898. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59beccb71 00007fb59becca22 00007fb5a4de5c09 00007fb5a3f3fee0 00007fb5a40090ab 00007fb5a4009131 00007fb5a3fb70a0 00007fb5a3fb6984 00007fb59d5316d4 00007fb59d531662
0709 13:13:09.562647 (+430250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8527616}
I20260709 13:13:09.432224   845 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:09.564713 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:09.565093   845 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:09.565610 32264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36084 (request call id 781) took 1352 ms. Trace:
I20260709 13:13:09.566001 32264 rpcz_store.cc:276] 0709 13:13:08.225729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.564374 (+1338645us) service_pool.cc:224] Handling call
0709 13:13:09.565550 (+  1176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:09.566932 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:09.567173   845 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:09.567623   745 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:09.479822   725 consensus_meta.cc:287] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.665s	user 0.007s	sys 0.000s
I20260709 13:13:09.500344   731 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:13:09.352239   840 consensus_meta.cc:287] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.777s	user 0.004s	sys 0.004s
I20260709 13:13:09.568610   725 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:09.569015   731 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:09.569150   840 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:09.571183   840 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:09.358359   808 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:09.572397 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.573099 32120 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:08.836205   849 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:09.574263 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:09.448071   857 consensus_queue.cc:260] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:09.574975 32120 raft_consensus.cc:2368] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4.
I20260709 13:13:09.574896 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:09.575534   857 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:09.575755 32192 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:13:09.576040 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:09.525396 32236 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.349s	user 0.049s	sys 0.102s
W20260709 13:13:09.577270 32236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.401s	user 0.050s	sys 0.103s
I20260709 13:13:09.028479   730 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:09.497465   578 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:09.574919 32267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 773) took 1367 ms. Trace:
W20260709 13:13:09.308645 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 173683us
I20260709 13:13:09.580520   730 raft_consensus.cc:1027] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: attempt to promote peer 94085cf341634eb686a95983b6b7f7e6: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:13:09.579619 32267 rpcz_store.cc:276] 0709 13:13:08.207155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.210208 (+  3053us) service_pool.cc:224] Handling call
0709 13:13:08.276421 (+ 66213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:08.404861 (+128440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:08.404889 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:08.404927 (+    38us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:08.404957 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.574711 (+1169754us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54002b84d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:09.574749 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.574864 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":294918016}
I20260709 13:13:09.581529   831 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:09.582186 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.577961 32019 catalog_manager.cc:5697] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 1 to 2, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3), now has a pending config: VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1), VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2), VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3), NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 2 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } } pending_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:13:09.583207   724 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:09.580752 32020 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49550 (request call id 162) took 3012 ms. Trace:
I20260709 13:13:09.584039 32020 rpcz_store.cc:276] 0709 13:13:06.568735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.569032 (+   297us) service_pool.cc:224] Handling call
0709 13:13:09.580481 (+3011449us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:13:09.584656 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.582472 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:09.571209   731 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:09.354790 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:09.588642 32268 raft_consensus.cc:2393] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 3: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:09.589203 32268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36080 (request call id 803) took 1138 ms. Trace:
W20260709 13:13:09.589380   850 log.cc:927] Time spent T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 1.231s	user 0.010s	sys 0.010s
I20260709 13:13:09.589695 32268 rpcz_store.cc:276] 0709 13:13:08.450963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.299808 (+848845us) service_pool.cc:224] Handling call
0709 13:13:09.589146 (+289338us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:09.353067 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:09.590956 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:09.591229 32193 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:13:09.591668 32268 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:08.927672   855 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:09.592437 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:09.466763   741 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:09.589298 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:09.593616 32267 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:09.585949 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.594087 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.596659   740 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:09.597668 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.604383 32270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 768) took 1407 ms. Trace:
I20260709 13:13:09.606904 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:09.607661 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.057312   718 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:09.595295 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.659394   734 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:09.659732 32119 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
W20260709 13:13:09.562140 32190 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.033s	sys 0.038s
I20260709 13:13:09.660844 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:09.661549 32271 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
W20260709 13:13:09.662112 32271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36084 (request call id 782) took 1436 ms (client timeout 1508 ms). Trace:
W20260709 13:13:09.662536 32271 rpcz_store.cc:269] 0709 13:13:08.226317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.239281 (+ 12964us) service_pool.cc:224] Handling call
0709 13:13:09.660697 (+1421416us) spinlock_profiling.cc:243] Waited 8.33 ms on lock 0x7b5800187898. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59beccb71 00007fb59becca22 00007fb5a4de5c09 00007fb5a3f3fee0 00007fb5a40090ab 00007fb5a4009131 00007fb5a3fb70a0 00007fb5a3fb6984 00007fb59d5316d4 00007fb59d531662
0709 13:13:09.662054 (+  1357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19170176}
I20260709 13:13:09.663456 32190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 808) took 1524 ms. Trace:
I20260709 13:13:09.664625   781 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:09.664955 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.665264   781 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:09.666261 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.131065   853 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:09.597107 32197 raft_consensus.cc:1275] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:09.567629 32264 raft_consensus.cc:2393] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 3: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:09.592935 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:09.153704   792 consensus_queue.cc:1059] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.446s
I20260709 13:13:09.668013   769 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:09.663861 32190 rpcz_store.cc:276] 0709 13:13:08.139358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.140670 (+  1312us) service_pool.cc:224] Handling call
0709 13:13:08.212653 (+ 71983us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:08.358026 (+145373us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:08.718873 (+360847us) log.cc:844] Serialized 14 byte log entry
0709 13:13:09.660921 (+942048us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:09.660975 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:09.661025 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.663234 (+  2209us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54001dfbd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:09.663277 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.663403 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1161126,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":3493,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":239276928,"thread_start_us":1206779,"threads_started":2,"wal-append.queue_time_us":820340}
I20260709 13:13:09.673538 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:09.674069 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:09.674424 32271 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:09.669021 32264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36080 (request call id 793) took 1302 ms. Trace:
I20260709 13:13:09.668543   853 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:09.517251 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:09.677531 32273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36084 (request call id 784) took 1447 ms. Trace:
I20260709 13:13:09.677934 32273 rpcz_store.cc:276] 0709 13:13:08.230550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.275795 (+ 45245us) service_pool.cc:224] Handling call
0709 13:13:09.131905 (+856110us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b5800187898. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59beccb71 00007fb59becca22 00007fb5a4de5c09 00007fb5a3f3fee0 00007fb5a40090ab 00007fb5a4009131 00007fb5a3fb70a0 00007fb5a3fb6984 00007fb59d5316d4 00007fb59d531662
0709 13:13:09.677468 (+545563us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4831616}
I20260709 13:13:09.679090 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:09.600715   705 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:09.499029   810 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:09.670405   842 raft_consensus.cc:3055] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:09.681064   842 raft_consensus.cc:740] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:09.680927   810 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:09.681959   842 consensus_queue.cc:260] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:09.669690 32197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 805) took 2789 ms. Trace:
W20260709 13:13:09.550165 32090 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.007s	sys 0.015s
W20260709 13:13:09.683928 32090 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.999s	user 0.007s	sys 0.015s
I20260709 13:13:09.668025 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:09.684408 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 1.03819e+06us
I20260709 13:13:09.685384 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.686725 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.686455   704 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:09.687922 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:09.601933 32198 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.012s	sys 0.010s
I20260709 13:13:09.675537 32264 rpcz_store.cc:276] 0709 13:13:08.366562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.566680 (+1200118us) service_pool.cc:224] Handling call
0709 13:13:09.668960 (+102280us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:09.688812 32198 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.013s	sys 0.010s
I20260709 13:13:09.689371   704 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:09.604352 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:09.669307 32268 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:09.690456 32199 raft_consensus.cc:2368] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4.
W20260709 13:13:09.690891 32199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54182 (request call id 802) took 2851 ms (client timeout 1543 ms). Trace:
I20260709 13:13:09.691056 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:09.691246 32199 rpcz_store.cc:269] 0709 13:13:06.839524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.840415 (+   891us) service_pool.cc:224] Handling call
0709 13:13:09.604200 (+2763785us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b5800004298. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59beccb71 00007fb59becca22 00007fb5a4de5c09 00007fb5a3f3fee0 00007fb5a40090ab 00007fb5a4009131 00007fb5a3fb70a0 00007fb5a3fb6984 00007fb59d5316d4 00007fb59d531662
0709 13:13:09.690830 (+ 86630us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9075072}
I20260709 13:13:09.683633 32197 rpcz_store.cc:276] 0709 13:13:06.880509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.880735 (+   226us) service_pool.cc:224] Handling call
0709 13:13:09.596617 (+2715882us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b5800004298. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59beccb71 00007fb59becca22 00007fb5a4de5c09 00007fb5a3f3fee0 00007fb5a40090ab 00007fb5a4009131 00007fb5a3fcafc0 00007fb5a3fb5929 00007fb5a3fb53d2 00007fb59d52cbd4
0709 13:13:09.596810 (+   193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.669434 (+ 72624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.669632 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43370752}
I20260709 13:13:09.692608 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:09.694466 32199 raft_consensus.cc:1275] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:13:09.475688   636 consensus_meta.cc:287] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.713s	user 0.000s	sys 0.008s
I20260709 13:13:09.695791   636 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:09.563444 32238 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:09.583361 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:09.697944 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 134587us
I20260709 13:13:09.592429   838 raft_consensus.cc:3055] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:09.608271 32118 raft_consensus.cc:2368] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3.
I20260709 13:13:09.606994 32270 rpcz_store.cc:276] 0709 13:13:08.197488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.197630 (+   142us) service_pool.cc:224] Handling call
0709 13:13:08.198000 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:08.293700 (+ 95700us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:08.293744 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:08.293798 (+    54us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:08.293842 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.604128 (+1310286us) spinlock_profiling.cc:243] Waited 95.4 ms on lock 0x7b54000e2254. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:09.604179 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.604323 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":219487616}
I20260709 13:13:09.702792 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:09.703423 32270 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:09.612870 32087 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:09.648195 32120 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:13:09.702836 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.613586   786 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:09.610401 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.609663 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.609331 32196 raft_consensus.cc:1275] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:09.706693 32123 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:13:09.707283 32123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56890 (request call id 862) took 1032 ms. Trace:
I20260709 13:13:09.707672 32123 rpcz_store.cc:276] 0709 13:13:08.674773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.609416 (+934643us) service_pool.cc:224] Handling call
0709 13:13:09.707216 (+ 97800us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:09.599457   740 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:09.711181 32116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56890 (request call id 852) took 1039 ms. Trace:
I20260709 13:13:09.649459 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:09.649792   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:09.674818 32190 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:09.716355   610 consensus_queue.cc:1048] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:09.683394   810 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:09.711704 32116 rpcz_store.cc:276] 0709 13:13:08.671724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.020211 (+348487us) service_pool.cc:224] Handling call
0709 13:13:09.610263 (+590052us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5800005198. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59beccb71 00007fb59becca22 00007fb5a4de5c09 00007fb5a3f3fee0 00007fb5a40090ab 00007fb5a4009131 00007fb5a3fb70a0 00007fb5a3fb6984 00007fb59d5316d4 00007fb59d531662
0709 13:13:09.711098 (+100835us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":233778560}
I20260709 13:13:09.722090 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.723317 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.391141   851 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:09.651024 32117 raft_consensus.cc:1275] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:09.584188 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:13:09.651739 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 69132.6us
I20260709 13:13:09.648942 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.608930 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:09.593784 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:09.572045   725 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:09.658509 32267 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:09.750558 32267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36080 (request call id 801) took 1314 ms. Trace:
I20260709 13:13:09.751142 32267 rpcz_store.cc:276] 0709 13:13:08.436723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.589022 (+1152299us) service_pool.cc:224] Handling call
0709 13:13:09.750470 (+161448us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:09.675678 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:09.681887   724 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:09.689464 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:09.710289   704 raft_consensus.cc:2804] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:09.752539 32271 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:09.752902 32264 raft_consensus.cc:2410] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:09.603534   759 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:09.705331 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 92592.9us
W20260709 13:13:09.608147 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 101113us
W20260709 13:13:09.609073 32191 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 755) took 3341 ms (client timeout 2691 ms). Trace:
I20260709 13:13:09.708936 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.648942 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:09.757236 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.710026 32090 leader_election.cc:304] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:09.711021 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:09.712862 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:09.696481 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.724355 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:09.713001 32165 connection.cc:256] RPC call timeout handler was delayed by -2.2104672969999228s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
I20260709 13:13:09.744666 32195 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:09.746206 32115 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:09.768184 32270 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:13:09.770229 32115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56890 (request call id 842) took 1139 ms. Trace:
I20260709 13:13:09.705210   838 raft_consensus.cc:740] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:09.753631 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:09.770876 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:09.769464 32121 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:13:09.667968   781 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:09.713630   718 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:09.761709 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:09.743997   851 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:09.767653 32120 raft_consensus.cc:2368] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3.
I20260709 13:13:09.744576   706 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:09.780413 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.736752 32118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56890 (request call id 833) took 1115 ms. Trace:
I20260709 13:13:09.771529 32270 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:13:09.770571 32115 rpcz_store.cc:276] 0709 13:13:08.630666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.642981 (+1012315us) service_pool.cc:224] Handling call
0709 13:13:09.770175 (+127194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:09.768307 32264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36080 (request call id 807) took 1294 ms. Trace:
I20260709 13:13:09.789875 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:09.756525   769 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:13:09.766808 32191 rpcz_store.cc:269] 0709 13:13:06.267497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.267616 (+   119us) service_pool.cc:224] Handling call
0709 13:13:08.107765 (+1840149us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b5800004298. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59beccb71 00007fb59becca22 00007fb5a4de5c09 00007fb5a3f3fee0 00007fb5a40090ab 00007fb5a4009131 00007fb5a3fb70a0 00007fb5a3fb6984 00007fb59d5316d4 00007fb59d531662
0709 13:13:09.608873 (+1501108us) spinlock_profiling.cc:243] Waited 55.3 ms on lock 0x7b54002a6554. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:09.608993 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135488128}
W20260709 13:13:09.773546 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 63619.1us
I20260709 13:13:09.774804 32272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36084 (request call id 785) took 1544 ms. Trace:
I20260709 13:13:09.776042 32269 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:09.811316 32272 rpcz_store.cc:276] 0709 13:13:08.230955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.648673 (+1417718us) service_pool.cc:224] Handling call
0709 13:13:09.774713 (+126040us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:09.811956 32269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36084 (request call id 779) took 1600 ms (client timeout 1588 ms). Trace:
I20260709 13:13:09.777088 32266 raft_consensus.cc:2393] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 4: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:09.812358 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:09.812338 32269 rpcz_store.cc:269] 0709 13:13:08.211234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.241347 (+ 30113us) service_pool.cc:224] Handling call
0709 13:13:09.761494 (+1520147us) spinlock_profiling.cc:243] Waited 7.82 ms on lock 0x7b5800187898. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59beccb71 00007fb59becca22 00007fb5a4de5c09 00007fb5a3f3fee0 00007fb5a40090ab 00007fb5a4009131 00007fb5a3fb70a0 00007fb5a3fb6984 00007fb59d5316d4 00007fb59d531662
0709 13:13:09.811898 (+ 50404us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17990912}
I20260709 13:13:09.767010 32123 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
I20260709 13:13:09.777015 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.748543   810 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.766531 32116 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:09.779978   753 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:09.778007 32117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 838) took 1160 ms. Trace:
I20260709 13:13:09.785892 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:09.748973   610 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:09.788408 32120 raft_consensus.cc:2393] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 3: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:09.753530   734 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.789405 32264 rpcz_store.cc:276] 0709 13:13:08.474015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.689240 (+1215225us) service_pool.cc:224] Handling call
0709 13:13:09.768236 (+ 78996us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:09.776226 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:09.756385   704 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:09.811445 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.812706 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:09.813930 32121 raft_consensus.cc:2410] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:09.813638 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:09.814155 32165 connection.cc:256] RPC call timeout handler was delayed by -1.2872463490000428s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1748s for a response
I20260709 13:13:09.814738 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.779944 32198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 829) took 1056 ms. Trace:
I20260709 13:13:09.770742 32192 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:13:09.817487 32090 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:09.768885 32193 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:09.791204   706 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:09.780413   578 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:09.776753   718 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:09.779613 32119 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:09.964886 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.783953   851 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:09.959506 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:09.970000 32269 raft_consensus.cc:2393] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 2: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
W20260709 13:13:09.815388   878 log.cc:927] Time spent T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
W20260709 13:13:09.963480 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 146063us
I20260709 13:13:09.813063   781 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:09.973188   788 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:09.973831 32194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 818) took 1711 ms. Trace:
I20260709 13:13:09.814914   845 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.945577 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.975857 32120 raft_consensus.cc:2393] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 3: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:09.955355 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.976392 32123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 849) took 1305 ms. Trace:
I20260709 13:13:09.976456 32116 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
I20260709 13:13:09.976970 32121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 850) took 1305 ms. Trace:
I20260709 13:13:09.976936 32123 rpcz_store.cc:276] 0709 13:13:08.671041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.975662 (+1304621us) service_pool.cc:224] Handling call
0709 13:13:09.975931 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.976091 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:09.976131 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:09.976179 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:09.976207 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.976257 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.976344 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:09.977455 32121 rpcz_store.cc:276] 0709 13:13:08.671257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.976216 (+1304959us) service_pool.cc:224] Handling call
0709 13:13:09.976478 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.976650 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:09.976679 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:09.976716 (+    37us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:09.976756 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.976815 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.976905 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:09.975565 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.979038 32121 raft_consensus.cc:1240] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: []
W20260709 13:13:09.809634   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 114827us
I20260709 13:13:09.973050   781 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:09.823859 32271 raft_consensus.cc:2393] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 2: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:09.974265 32194 rpcz_store.cc:276] 0709 13:13:08.262714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.277977 (+ 15263us) service_pool.cc:224] Handling call
0709 13:13:08.278323 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:09.563680 (+1285357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:09.563724 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:09.564336 (+   612us) log.cc:844] Serialized 26 byte log entry
0709 13:13:09.654083 (+ 89747us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:09.654396 (+   313us) log.cc:844] Serialized 14 byte log entry
0709 13:13:09.654611 (+   215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.654724 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:09.973617 (+318893us) raft_consensus.cc:1685] finished
0709 13:13:09.973642 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.973768 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":854,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":23178,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":7396,"thread_start_us":1374227,"threads_started":2,"wal-append.queue_time_us":89691}
I20260709 13:13:09.791046   757 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:09.984715   757 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:09.985040 32197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 838) took 1173 ms. Trace:
I20260709 13:13:09.987797 32239 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:09.986291 32197 rpcz_store.cc:276] 0709 13:13:08.811647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.693969 (+882322us) service_pool.cc:224] Handling call
0709 13:13:09.694332 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:09.694592 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:09.694619 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:09.695133 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:13:09.935017 (+239884us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:09.935056 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.935130 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:09.984409 (+ 49279us) raft_consensus.cc:1685] finished
0709 13:13:09.984476 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.984891 (+   415us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":239312,"threads_started":1,"wal-append.queue_time_us":287464}
I20260709 13:13:09.969364 32193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54182 (request call id 831) took 1227 ms. Trace:
I20260709 13:13:09.988845   837 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:09.989310   837 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:09.989379   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:09.989877   837 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:09.989782   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:09.990159   402 raft_consensus.cc:2468] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:09.990521   401 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
W20260709 13:13:09.962296 32165 connection.cc:256] RPC call timeout handler was delayed by -1.045709640000041s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1896s for a response
I20260709 13:13:09.975596 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:09.992882 32267 raft_consensus.cc:2468] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:13:09.823335 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:09.979110 32122 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:13:09.817938   759 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:09.811399   862 raft_consensus.cc:3055] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:09.967221 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:09.821271 32117 rpcz_store.cc:276] 0709 13:13:08.614107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.620679 (+  6572us) service_pool.cc:224] Handling call
0709 13:13:09.650424 (+1029745us) spinlock_profiling.cc:243] Waited 6.98 ms on lock 0x7b5800005198. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59beccb71 00007fb59becca22 00007fb5a4de5c09 00007fb5a3f3fee0 00007fb5a40090ab 00007fb5a4009131 00007fb5a3fcafc0 00007fb5a3fb5929 00007fb5a3fb53d2 00007fb59d52cbd4
0709 13:13:09.650662 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.744500 (+ 93838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.774015 (+ 29515us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16061184}
I20260709 13:13:09.989007 32193 rpcz_store.cc:276] 0709 13:13:08.737919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.593512 (+855593us) service_pool.cc:224] Handling call
0709 13:13:09.965124 (+371612us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:09.999507   636 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:09.999862   723 consensus_queue.cc:1059] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:10.001037   723 raft_consensus.cc:3055] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:10.001475   723 raft_consensus.cc:740] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:10.002722   723 consensus_queue.cc:260] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:09.938748   838 consensus_queue.cc:260] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:10.005661   838 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:09.967885 32198 rpcz_store.cc:276] 0709 13:13:08.723488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.727827 (+  4339us) service_pool.cc:224] Handling call
0709 13:13:08.728078 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:08.728290 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:09.689321 (+961031us) log.cc:844] Serialized 14 byte log entry
0709 13:13:09.779234 (+ 89913us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:09.779287 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:09.779330 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.779410 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.779822 (+   412us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1158,"prepare.queue_time_us":802640,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":31412,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":4932,"thread_start_us":1016851,"threads_started":2}
I20260709 13:13:09.982324   578 raft_consensus.cc:697] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 3 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:09.982877 32121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 853) took 1310 ms. Trace:
I20260709 13:13:09.979192 32123 raft_consensus.cc:1275] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:10.004055   705 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:09.988067   845 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:10.023272 32238 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:09.993652 32165 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:09.993752 32122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56890 (request call id 854) took 1321 ms. Trace:
I20260709 13:13:09.965278 32192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54182 (request call id 833) took 1212 ms. Trace:
I20260709 13:13:10.025668 32238 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:09.993817 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:10.026593 32271 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:13:09.821830   810 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:09.997524 32239 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:09.998481   724 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:10.029281 32239 leader_election.cc:400] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4.
I20260709 13:13:10.025871 32090 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:10.007433 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:09.964326   704 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:09.970084   624 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:10.014408 32123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 855) took 1341 ms. Trace:
I20260709 13:13:10.014060 32121 rpcz_store.cc:276] 0709 13:13:08.672041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.978555 (+1306514us) service_pool.cc:224] Handling call
0709 13:13:09.978891 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.982240 (+  3349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.982803 (+   563us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34816}
I20260709 13:13:10.034600 32123 rpcz_store.cc:276] 0709 13:13:08.672666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.978577 (+1305911us) service_pool.cc:224] Handling call
0709 13:13:09.978881 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:10.014134 (+ 35253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.014336 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40576}
I20260709 13:13:10.036338 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:10.035089 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.908514   822 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:10.027424   723 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.016649   578 consensus_queue.cc:237] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:10.017467   781 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:10.018309 32124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56890 (request call id 846) took 1386 ms (client timeout 1500 ms). Trace:
I20260709 13:13:10.018672   788 consensus_queue.cc:1059] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:09.937060   610 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:10.006208   706 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:10.045080 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:10.021534 32273 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:10.024070 32122 rpcz_store.cc:276] 0709 13:13:08.672324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.019405 (+347081us) service_pool.cc:224] Handling call
0709 13:13:09.975426 (+956021us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b5800005198. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59beccb71 00007fb59becca22 00007fb5a4de5c09 00007fb5a3f3fee0 00007fb5a40090ab 00007fb5a4009131 00007fb5a3fb70a0 00007fb5a3fb6984 00007fb59d5316d4 00007fb59d531662
0709 13:13:09.993697 (+ 18271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4031232}
I20260709 13:13:09.980410 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:10.038990   790 raft_consensus.cc:2804] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:09.789140 32118 rpcz_store.cc:276] 0709 13:13:08.612495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.620797 (+  8302us) service_pool.cc:224] Handling call
0709 13:13:09.606739 (+985942us) spinlock_profiling.cc:243] Waited 8.98 ms on lock 0x7b5800005198. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59beccb71 00007fb59becca22 00007fb5a4de5c09 00007fb5a3f3fee0 00007fb5a40090ab 00007fb5a4009131 00007fb5a3fb70a0 00007fb5a3fb6984 00007fb59d5316d4 00007fb59d531662
0709 13:13:09.727985 (+121246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20661632}
I20260709 13:13:09.994300 32272 raft_consensus.cc:2393] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 3: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:09.995467 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:10.027518 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:09.987222   757 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:09.999904 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:09.998266   759 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:10.033382 32239 leader_election.cc:403] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:13:09.998916   862 raft_consensus.cc:740] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:10.053807 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:10.054358 32122 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:10.055603 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:10.056278 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:10.038236 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:10.038365 32238 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:10.024871   768 consensus_queue.cc:1048] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:13:10.040000 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:09.966027   718 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.040309 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:10.058437 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:10.042765 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:10.028648   750 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:10.043206 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:10.040824 32090 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:10.029613   636 raft_consensus.cc:2804] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:13:10.044421 32124 rpcz_store.cc:269] 0709 13:13:08.631937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.686700 (+ 54763us) service_pool.cc:224] Handling call
0709 13:13:10.018136 (+1331436us) spinlock_profiling.cc:243] Waited 99.6 ms on lock 0x7b5400206554. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:10.018243 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229134080}
I20260709 13:13:10.033913   857 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:09.815522   769 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:10.046396 32269 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
W20260709 13:13:10.085784 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 45081.6us
I20260709 13:13:10.087566 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:09.987793 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:10.034749   792 raft_consensus.cc:2804] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:10.048015 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:10.039012 32265 raft_consensus.cc:1240] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:10.026290 32192 rpcz_store.cc:276] 0709 13:13:08.752476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.608640 (+856164us) service_pool.cc:224] Handling call
0709 13:13:09.963631 (+354991us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:10.039774   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:10.028313   853 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:10.098678 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:10.099483 32192 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.099869 32268 raft_consensus.cc:2393] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 3: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:10.100539   853 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:10.100627   845 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:09.965325   734 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:10.101917   610 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:10.090739 32197 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:13:10.103858 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:10.057367 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:10.104444 32197 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.105604 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:10.057626 32238 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:10.059098 32198 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.059046 32194 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:13:10.041510 32165 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:10.048003   790 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:10.059672 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:10.060982 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:10.050870 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:10.064067   862 consensus_queue.cc:260] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:10.040882   807 consensus_queue.cc:1048] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:13:10.055326   724 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4.
I20260709 13:13:10.059757   706 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:10.069877 32117 raft_consensus.cc:2393] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 3: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:10.084682   774 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:10.061393 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:10.075227 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:10.082199   810 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:10.083359 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:10.089313 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:10.132298 32269 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:13:10.087641 32090 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:10.073722   750 raft_consensus.cc:697] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 4 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:10.098580 32119 raft_consensus.cc:2393] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 3: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:10.127400 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:10.082763   636 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:10.138600 32192 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:10.126853   814 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:10.128412   610 raft_consensus.cc:2804] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:10.139925 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:10.139950   610 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:10.140785   862 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.141094   610 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:10.141371 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:10.142141 32192 raft_consensus.cc:2468] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:13:10.143205 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:13:10.121726 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 64160.5us
I20260709 13:13:10.089937   764 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:10.085482   857 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:13:10.123466 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 82039.2us
I20260709 13:13:10.122758   790 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.091059   792 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:10.102900   734 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:10.125311   759 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:10.126036 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:10.130625 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:10.159772 32194 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:10.136330 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 48707.2us
I20260709 13:13:10.137053 32124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 856) took 1464 ms. Trace:
I20260709 13:13:10.145040 32119 raft_consensus.cc:1275] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:10.160539 32124 rpcz_store.cc:276] 0709 13:13:08.672974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.136094 (+1463120us) service_pool.cc:224] Handling call
0709 13:13:10.136519 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:10.136731 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:10.136780 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:10.136828 (+    48us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:10.136856 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.136908 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:10.137001 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:10.137950   774 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:10.138813   636 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.119753 32191 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.143360   704 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:10.138769   889 log.cc:927] Time spent T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:13:10.143980 32118 raft_consensus.cc:2368] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3.
I20260709 13:13:10.119773 32195 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:10.144871 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:10.145730 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:10.174499 32122 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:13:10.127952   845 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:10.138610 32117 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:10.126935   705 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:10.126617   706 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:10.156039 32165 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:10.193317 32238 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:10.157661 32198 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:10.134611 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:10.161319 32090 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:10.195006 32123 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:10.195262   734 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:10.195894 32090 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:13:10.199150 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.161804 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:10.165095 32124 raft_consensus.cc:1240] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:10.157546   857 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.195945   734 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:10.212862   734 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.161921   792 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.149505   764 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:10.214421   764 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.163076   774 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:10.203339 32124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 865) took 1461 ms. Trace:
I20260709 13:13:10.146868   837 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:10.238519   757 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:10.238847   837 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:10.225732   842 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.239151   757 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:10.193104 32119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 857) took 1519 ms. Trace:
I20260709 13:13:10.239427   832 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:13:10.241153 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 85221.3us
I20260709 13:13:10.241557 32238 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:10.229565 32124 rpcz_store.cc:276] 0709 13:13:08.741565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.164750 (+1423185us) service_pool.cc:224] Handling call
0709 13:13:10.164977 (+   227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:10.202974 (+ 37997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.203264 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:10.243570 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 47740.4us
I20260709 13:13:10.244752 32165 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:10.245375 32090 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:10.246236   624 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:10.247911   624 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:10.248294   624 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.249109 32124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 832) took 1095 ms. Trace:
I20260709 13:13:10.249490 32124 rpcz_store.cc:276] 0709 13:13:09.153644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.248322 (+1094678us) service_pool.cc:224] Handling call
0709 13:13:10.248652 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:10.248812 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:10.248839 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:10.248881 (+    42us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:10.248909 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.248959 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:10.249057 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:10.240453   774 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.244318   832 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:10.250960   636 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:10.251559   832 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:10.196390   706 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:10.254629 32264 raft_consensus.cc:2393] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 2: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:10.256052   788 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:10.255542 32238 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:10.259493 32238 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:10.260191 32238 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:10.253868 32090 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:10.262194 32194 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:10.255360 32165 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:10.252912   822 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:10.265895   705 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:10.292724   705 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:10.293171   705 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.293519   772 raft_consensus.cc:3055] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:10.293890   772 raft_consensus.cc:740] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:10.294661   772 consensus_queue.cc:260] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:10.295593   772 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.296382   636 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:10.299118 32196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 814) took 2097 ms. Trace:
I20260709 13:13:10.300297 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:10.253750   769 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:10.266400   876 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:10.256480   788 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:13:10.332548 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 77259.1us
I20260709 13:13:10.257354   830 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:10.288329   791 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:10.299497 32196 rpcz_store.cc:276] 0709 13:13:08.201925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.214936 (+ 13011us) service_pool.cc:224] Handling call
0709 13:13:09.608994 (+1394058us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.706642 (+ 97648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.298944 (+592302us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54002a6550. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff08ad 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:10.299064 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3205394816}
I20260709 13:13:10.199076   750 consensus_queue.cc:237] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:10.350554 32165 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:10.329382   725 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:13:10.383448 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.391456 32165 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:13:10.410998 32266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36084 (request call id 799) took 1683 ms (client timeout 1622 ms). Trace:
W20260709 13:13:10.411574 32266 rpcz_store.cc:269] 0709 13:13:08.727179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.564484 (+837305us) service_pool.cc:224] Handling call
0709 13:13:10.410747 (+846263us) spinlock_profiling.cc:243] Waited 60.9 ms on lock 0x7b540014ad54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:10.410912 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139987200}
I20260709 13:13:10.413168 32266 raft_consensus.cc:1240] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:10.413923 32266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 776) took 2204 ms. Trace:
I20260709 13:13:10.413995 32196 raft_consensus.cc:1275] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:10.414369 32266 rpcz_store.cc:276] 0709 13:13:08.209638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.412609 (+2202971us) service_pool.cc:224] Handling call
0709 13:13:10.412957 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:10.413627 (+   670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.413858 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:10.416836 32022 catalog_manager.cc:5697] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 1 to 2, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 2 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:10.420862 32268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36084 (request call id 802) took 1659 ms (client timeout 2187 ms). Trace:
W20260709 13:13:10.421422 32268 rpcz_store.cc:269] 0709 13:13:08.761007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.690796 (+929789us) service_pool.cc:224] Handling call
0709 13:13:10.420542 (+729746us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b5400305a54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:10.420778 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":938174208}
W20260709 13:13:10.423811 32273 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36084 (request call id 792) took 1800 ms (client timeout 2179 ms). Trace:
W20260709 13:13:10.424316 32273 rpcz_store.cc:269] 0709 13:13:08.623811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.678852 (+1055041us) service_pool.cc:224] Handling call
0709 13:13:10.423610 (+744758us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b5400427cd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:10.423743 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":746154240}
I20260709 13:13:10.342782   814 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:10.440351   822 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:10.442962   822 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:10.443455   822 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:10.453425 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 398303us
I20260709 13:13:10.240131 32119 rpcz_store.cc:276] 0709 13:13:08.673254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.138911 (+1465657us) service_pool.cc:224] Handling call
0709 13:13:10.139264 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:10.163162 (+ 23898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.185485 (+ 22323us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:10.453938 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 193780us
I20260709 13:13:10.419040 32022 catalog_manager.cc:5697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 1 to 2, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 2 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:10.456037 32238 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:10.459262 32238 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:10.459364 32239 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:10.348985   788 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.466287 32238 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:10.343307   876 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:10.467032 32239 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:10.376699   791 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:10.394642   725 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:10.473920 32239 leader_election.cc:400] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3.
I20260709 13:13:10.474721 32239 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:10.483299 32191 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:10.457023 32022 catalog_manager.cc:5697] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 1 to 2, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 2 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:10.484294 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:10.484951 32191 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.440886   814 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:13:10.489195 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 97809.6us
I20260709 13:13:10.490191 32239 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:10.490423 32165 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:10.454356   756 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:10.469619   830 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:10.479054   636 raft_consensus.cc:2804] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:10.479518   791 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.481667   876 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.486681   837 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:10.479257   841 raft_consensus.cc:2804] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:10.503626   740 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:10.486392   724 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:10.502008   814 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.481168   725 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.504118   801 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:10.513507   771 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:10.518432   636 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:10.532899   740 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:10.520977   781 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:10.594302 32191 raft_consensus.cc:2468] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:10.529559   837 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:10.597069 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:10.599339 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:10.599941 32191 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:13:10.532483   841 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:10.601459 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:10.602080 32191 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
W20260709 13:13:10.603003 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 112887us
I20260709 13:13:10.603894 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:10.560789   724 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:10.604437 32191 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.565212   801 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:10.566814   771 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:10.595356   636 raft_consensus.cc:3060] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.590675   704 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:10.598296   740 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.600929   837 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.597888   781 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:13:10.619289 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 128920us
I20260709 13:13:10.621349 32239 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:10.604875   841 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.621990 32165 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:10.622555 32191 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:10.610059   801 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:10.607122   724 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:10.630321 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.631245 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:10.634128 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:10.614482   771 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.612041 32118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 873) took 1861 ms. Trace:
W20260709 13:13:10.655313 32197 consensus_meta.cc:287] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.550s	user 0.013s	sys 0.016s
W20260709 13:13:10.632989   838 consensus_meta.cc:287] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.627s	user 0.014s	sys 0.025s
I20260709 13:13:10.624995   781 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:10.658165 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:10.658288 32197 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:10.660846 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:10.628160   742 raft_consensus.cc:2804] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:13:10.664848   723 consensus_meta.cc:287] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.621s	user 0.008s	sys 0.003s
I20260709 13:13:10.674645 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:10.678429 32191 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.677429 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:10.674711   759 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:10.620476   811 consensus_queue.cc:1059] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:13:10.644060   757 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:10.688220 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.689204 32271 raft_consensus.cc:2410] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:10.646944   810 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:10.694921 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:10.704638 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:10.705535 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:10.675926   742 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:10.707661   742 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.631834   904 consensus_queue.cc:1048] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 13:13:10.698539 32019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59534 (request call id 35) took 2136 ms. Trace:
I20260709 13:13:10.629361   704 consensus_queue.cc:1048] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
W20260709 13:13:10.718062 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.697300 32191 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
W20260709 13:13:10.688439   610 consensus_meta.cc:287] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.547s	user 0.017s	sys 0.014s
I20260709 13:13:10.713791 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:10.720299 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:13:10.705160   790 consensus_meta.cc:287] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.543s	user 0.027s	sys 0.047s
I20260709 13:13:10.725581 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:10.729362 32115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 848) took 2058 ms. Trace:
W20260709 13:13:10.709710   903 log.cc:927] Time spent T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:13:10.729835 32115 rpcz_store.cc:276] 0709 13:13:08.670761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.980254 (+1309493us) service_pool.cc:224] Handling call
0709 13:13:09.983821 (+  3567us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:10.040665 (+ 56844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:10.040704 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:10.051361 (+ 10657us) log.cc:844] Serialized 518 byte log entry
0709 13:13:10.086948 (+ 35587us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:10.086985 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.722376 (+635391us) spinlock_profiling.cc:243] Waited 55.3 ms on lock 0x7b54000325d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:10.722426 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:10.722470 (+    44us) raft_consensus.cc:1685] finished
0709 13:13:10.722484 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:10.729281 (+  6797us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2832,"raft.queue_time_us":1131,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":5091,"spinlock_wait_cycles":127310976,"thread_start_us":20847,"threads_started":1,"wal-append.queue_time_us":154332}
I20260709 13:13:10.751137 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:10.752763 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:10.702664   810 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:10.680787   814 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:10.758771 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:10.758736 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:10.754889 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:10.760944 32197 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.709431   811 raft_consensus.cc:3055] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:10.754151 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:10.687762   624 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:10.770085 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:10.700472   774 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:10.773649 32190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 841) took 1943 ms. Trace:
I20260709 13:13:10.774158   774 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:10.748127 32265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 766) took 2552 ms. Trace:
I20260709 13:13:10.777572 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:10.764492   810 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.781046 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:13:10.782644   897 log.cc:927] Time spent T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:13:10.766570   830 raft_consensus.cc:697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:10.782361 32191 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.765431   811 raft_consensus.cc:740] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:10.813053   830 consensus_queue.cc:237] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:10.774118   624 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:10.749002   610 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:13:10.749759   790 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:10.823103 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:10.826766 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:10.779301 32265 rpcz_store.cc:276] 0709 13:13:08.195480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.200560 (+  5080us) service_pool.cc:224] Handling call
0709 13:13:09.521826 (+1321266us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b5800187898. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59beccb71 00007fb59becceee 0000000000375939 00007fb5a3f401e0 00007fb5a40090c4 00007fb5a4009131 00007fb5a3fcafc0 00007fb5a3fb5929 00007fb5a3fb53d2 00007fb59d52cbd4
0709 13:13:09.522052 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:10.107074 (+585022us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.747798 (+640724us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b5400068954. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:10.748045 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1210566400}
I20260709 13:13:10.644450 32118 rpcz_store.cc:276] 0709 13:13:08.748456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.185051 (+1436595us) service_pool.cc:224] Handling call
0709 13:13:10.253218 (+ 68167us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:10.288920 (+ 35702us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:10.291672 (+  2752us) log.cc:844] Serialized 14 byte log entry
0709 13:13:10.567130 (+275458us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:10.575428 (+  8298us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:10.595415 (+ 19987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.601163 (+  5748us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:10.609522 (+  8359us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9346,"prepare.queue_time_us":182,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":5878,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":20529,"spinlock_wait_cycles":17555968,"thread_start_us":239715,"threads_started":1,"wal-append.queue_time_us":303519}
I20260709 13:13:10.828096 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:10.828502 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:10.829326 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:10.829833 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:10.713866 32019 rpcz_store.cc:276] 0709 13:13:08.562338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.562567 (+   229us) service_pool.cc:224] Handling call
0709 13:13:10.698452 (+2135885us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:09.590796 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:09.591387 (+   591us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:09.591430 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:13:09.591448 (+    18us) tablet.cc:662] Decoding operations
0709 13:13:09.591808 (+   360us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:09.591882 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:09.591908 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:13:09.592106 (+   198us) tablet.cc:701] Row locks acquired
0709 13:13:09.592128 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:13:09.600768 (+  8640us) write_op.cc:270] Start()
0709 13:13:09.600905 (+   137us) write_op.cc:276] Timestamp: P: 1783602789600715 usec, L: 0
0709 13:13:09.600925 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:13:09.601581 (+   656us) log.cc:844] Serialized 777 byte log entry
0709 13:13:10.055138 (+453557us) op_driver.cc:464] REPLICATION: finished
0709 13:13:10.345059 (+289921us) write_op.cc:301] APPLY: starting
0709 13:13:10.345159 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:10.345284 (+   125us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:10.345425 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:10.345705 (+   280us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:10.345910 (+   205us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:13:10.345979 (+    69us) write_op.cc:312] APPLY: finished
0709 13:13:10.444677 (+ 98698us) log.cc:844] Serialized 22 byte log entry
0709 13:13:10.472962 (+ 28285us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:10.486789 (+ 13827us) write_op.cc:454] Released schema lock
0709 13:13:10.489539 (+  2750us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:10.589597 (+100058us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:10.596132 (+  6535us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":284890,"apply.run_cpu_time_us":13251,"apply.run_wall_time_us":216703,"num_ops":1,"prepare.queue_time_us":4322,"prepare.run_cpu_time_us":3647,"prepare.run_wall_time_us":64042,"raft.queue_time_us":363522,"raft.run_cpu_time_us":56882,"raft.run_wall_time_us":124826,"replication_time_us":445756,"spinlock_wait_cycles":3968,"thread_start_us":300078,"threads_started":4,"wal-append.queue_time_us":49257}]]}
I20260709 13:13:10.830371 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:10.830523 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:10.830914 32194 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.830976 32198 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.832211 32271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36084 (request call id 797) took 2153 ms. Trace:
I20260709 13:13:10.832645 32271 rpcz_store.cc:276] 0709 13:13:08.678750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.027267 (+1348517us) service_pool.cc:224] Handling call
0709 13:13:10.832013 (+804746us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b54001865d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:10.832150 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1470405504}
W20260709 13:13:10.833854   851 consensus_meta.cc:287] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.843s	user 0.027s	sys 0.040s
I20260709 13:13:10.833781 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:10.824182 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:10.826511 32272 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:10.839977 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:10.841889 32272 raft_consensus.cc:2410] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:10.834933 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:10.842583 32271 raft_consensus.cc:2393] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 3: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:10.842365 32198 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:10.843817 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:10.844211 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:10.844367 32198 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.876713 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:10.877725   811 consensus_queue.cc:260] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:10.882790   832 consensus_meta.cc:287] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.631s	user 0.010s	sys 0.012s
W20260709 13:13:10.884209   734 consensus_meta.cc:287] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.671s	user 0.023s	sys 0.026s
I20260709 13:13:10.828531 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:10.836951   905 log.cc:927] Time spent T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:13:10.838812 32192 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.901531 32191 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:10.902664 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:13:10.903132 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.903980 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:10.904886   610 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:10.896461   832 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:10.906476 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:10.907218 32191 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:10.908072 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:10.908656 32191 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:10.909004   772 consensus_meta.cc:287] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.613s	user 0.018s	sys 0.012s
I20260709 13:13:10.910079   790 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:10.912253   706 consensus_meta.cc:287] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.656s	user 0.005s	sys 0.024s
I20260709 13:13:10.894579 32197 raft_consensus.cc:2468] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:10.895876 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:10.830933 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:10.914924 32191 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:10.916038 32191 raft_consensus.cc:1240] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:10.915326   369 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:10.908946   811 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.884372   725 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:10.915336 32265 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:10.834297   851 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:10.921995   706 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:10.927613 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:10.928814   725 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:10.774102 32190 rpcz_store.cc:276] 0709 13:13:08.830437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.715799 (+885362us) service_pool.cc:224] Handling call
0709 13:13:09.716132 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.716347 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:09.716702 (+   355us) log.cc:844] Serialized 14 byte log entry
0709 13:13:10.638973 (+922271us) spinlock_profiling.cc:243] Waited 7.19 ms on lock 0x7b18001b6280. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bee6e07 00007fb5a4d41ab9 00007fb59bf0369b 00007fb59bf0193f 00007fb59bf03c02 00007fb59eb8b20b 00007fb59eb90d23 00007fb59eb9123a 00007fb59effba2a
0709 13:13:10.773090 (+134117us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:10.773153 (+    63us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:10.773210 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.773426 (+   216us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:10.773590 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":202,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":93,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":84,"spinlock_wait_cycles":16544000,"thread_start_us":133531,"threads_started":1,"wal-append.queue_time_us":1056071}
I20260709 13:13:10.908337   832 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:10.926842   772 consensus_queue.cc:1059] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:10.928926 32195 raft_consensus.cc:1240] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:10.929386 32268 raft_consensus.cc:1240] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:10.930227 32090 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:10.924265 32198 raft_consensus.cc:2410] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:10.936437   753 raft_consensus.cc:3055] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:10.922583 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:10.937578 32272 raft_consensus.cc:2393] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 4: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:10.932257 32194 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:10.932878 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:10.938711 32194 raft_consensus.cc:1240] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:10.913506 32118 raft_consensus.cc:2468] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 1.
I20260709 13:13:10.945680 32197 raft_consensus.cc:1240] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:13:10.962311 32269 raft_consensus.cc:1240] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:10.961856 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:10.963958 32265 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.947417 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:10.963835 32238 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:10.965857   764 consensus_meta.cc:287] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.723s	user 0.023s	sys 0.004s
I20260709 13:13:10.898967   734 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:10.959568 32090 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:10.925484   786 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:10.930071   790 consensus_queue.cc:1059] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:13:10.928833   706 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:10.984395   636 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:10.986063   718 consensus_meta.cc:287] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.925s	user 0.004s	sys 0.014s
I20260709 13:13:10.986495   718 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:13:10.932344   578 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.858s	user 0.015s	sys 0.010s
W20260709 13:13:10.987840   578 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.015s	sys 0.010s
I20260709 13:13:10.968092   740 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:10.976298 32238 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:10.989271   841 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:10.990114   740 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:10.990437 32271 raft_consensus.cc:2393] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 2: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:10.990744 32115 raft_consensus.cc:2393] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 2: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
W20260709 13:13:10.973451   705 consensus_meta.cc:287] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.680s	user 0.006s	sys 0.031s
W20260709 13:13:10.981392   857 consensus_meta.cc:287] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.769s	user 0.038s	sys 0.033s
I20260709 13:13:10.980907   764 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:10.982957   709 raft_consensus.cc:3055] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:10.942241   753 raft_consensus.cc:740] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:10.985033 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:10.985450   801 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:10.976848   832 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:10.990449 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:10.980840   772 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:10.978049 32118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 838) took 1676 ms. Trace:
I20260709 13:13:10.940356   898 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:11.032392   898 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:11.033298   898 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.033915   801 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:10.991430 32238 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:13:10.963439   792 consensus_meta.cc:287] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.750s	user 0.012s	sys 0.026s
I20260709 13:13:10.946211 32193 raft_consensus.cc:1240] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:11.002045 32120 raft_consensus.cc:1240] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:10.998304   837 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:11.002928 32192 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:11.004339   841 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:11.000604   709 raft_consensus.cc:740] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:11.007627 32264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36080 (request call id 814) took 1337 ms. Trace:
I20260709 13:13:11.042853 32264 rpcz_store.cc:276] 0709 13:13:09.670717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.975342 (+304625us) service_pool.cc:224] Handling call
0709 13:13:11.007435 (+1032093us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b54000e2254. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:11.007568 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":600458112}
I20260709 13:13:11.009064 32265 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:11.009676   718 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:11.010166   771 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:10.997855   862 consensus_queue.cc:1048] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:13:11.012811   734 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:11.014953 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.015749 32269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 775) took 2806 ms. Trace:
I20260709 13:13:11.055498 32269 rpcz_store.cc:276] 0709 13:13:08.209364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.237588 (+2028224us) service_pool.cc:224] Handling call
0709 13:13:10.237936 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:10.969151 (+731215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.015514 (+ 46363us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b5400295c54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:11.015689 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1665375488}
W20260709 13:13:11.016127 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.021247   807 raft_consensus.cc:1027] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: attempt to promote peer 94085cf341634eb686a95983b6b7f7e6: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:13:11.036651 32124 raft_consensus.cc:1240] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3. Ops: []
W20260709 13:13:11.038136 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 46880us
I20260709 13:13:10.997267   706 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:11.037513   792 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:11.045373 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:13:11.046593   842 consensus_meta.cc:287] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.807s	user 0.019s	sys 0.005s
I20260709 13:13:11.047334   837 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:11.050525 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:11.010934   876 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:11.028270 32118 rpcz_store.cc:276] 0709 13:13:09.301194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.976954 (+1675760us) service_pool.cc:224] Handling call
0709 13:13:10.977391 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:10.977600 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:10.977633 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:10.977685 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:10.977721 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.977865 (+   144us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:10.977986 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:10.968232   788 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:11.029369   772 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:10.997066   725 consensus_queue.cc:1048] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:13:11.053104 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:11.029644   814 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:11.040542 32117 consensus_meta.cc:287] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.812s	user 0.008s	sys 0.012s
I20260709 13:13:11.000880   857 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:11.058568 32238 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:10.999969   705 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:11.062592   636 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:11.063310   771 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:11.064185 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:11.064137   709 consensus_queue.cc:260] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:11.037848   832 raft_consensus.cc:697] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:11.042577   704 raft_consensus.cc:2804] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:11.102658 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:11.102855   705 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:11.103204   704 raft_consensus.cc:697] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:13:11.101792 32267 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36080 (request call id 816) took 1430 ms (client timeout 1762 ms). Trace:
I20260709 13:13:11.096556 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:11.034062   753 consensus_queue.cc:260] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:11.107246   704 consensus_queue.cc:237] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:11.108253   753 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.108441   857 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:11.065657   791 consensus_meta.cc:287] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.533s	user 0.004s	sys 0.011s
I20260709 13:13:11.055035 32190 raft_consensus.cc:2393] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 2: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:11.073436 32270 raft_consensus.cc:2410] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:11.077378 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:11.112409 32271 raft_consensus.cc:2393] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 3: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:11.072152 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:11.113322 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:11.085757 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:11.087756   792 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:11.079079   724 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:11.079794   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 111834us
I20260709 13:13:11.089268   764 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:11.090433 32264 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.093521 32238 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:11.072250   706 raft_consensus.cc:697] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:11.121912 32116 raft_consensus.cc:1240] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
W20260709 13:13:11.091392 32089 leader_election.cc:336] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.508s (SENT)
I20260709 13:13:11.094542 32087 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:11.091888 32117 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:11.102120 32273 raft_consensus.cc:1240] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 1. Current term is 2. Ops: []
W20260709 13:13:11.104460 32267 rpcz_store.cc:269] 0709 13:13:09.671373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.937840 (+266467us) service_pool.cc:224] Handling call
0709 13:13:11.101600 (+1163760us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b5400305f54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:11.101733 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52635520}
I20260709 13:13:11.066701 32090 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:11.106463 32268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 778) took 2895 ms. Trace:
W20260709 13:13:11.133585 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 66993.6us
I20260709 13:13:11.107175 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:11.137825 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:11.138540 32267 raft_consensus.cc:2393] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 3: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
W20260709 13:13:11.085805   822 consensus_meta.cc:287] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.642s	user 0.012s	sys 0.000s
I20260709 13:13:11.105417 32196 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:11.078959 32266 raft_consensus.cc:1240] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:11.086516 32118 raft_consensus.cc:1240] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:11.114316 32124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 833) took 1814 ms. Trace:
I20260709 13:13:11.140710 32124 rpcz_store.cc:276] 0709 13:13:09.299779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.250420 (+950641us) service_pool.cc:224] Handling call
0709 13:13:10.250700 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.057758 (+807058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.114074 (+ 56316us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b5400032854. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:11.114260 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1806870400}
I20260709 13:13:11.081239   772 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.142096   876 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:11.085871 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:11.073668   734 consensus_queue.cc:1059] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:13:11.104763   862 raft_consensus.cc:2804] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:11.121115 32238 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:11.148190 32238 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:11.149111 32271 raft_consensus.cc:2410] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:11.149250 32238 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:11.122423 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:11.124980 32117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56890 (request call id 896) took 1071 ms. Trace:
I20260709 13:13:11.121192 32265 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:11.125125 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:11.126616 32121 raft_consensus.cc:1240] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:11.128751   636 raft_consensus.cc:1027] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: attempt to promote peer 94085cf341634eb686a95983b6b7f7e6: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:13:11.116230   791 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:11.126096   764 raft_consensus.cc:2804] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:11.130798   724 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:11.151027   369 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:11.144021   822 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:11.160264   786 raft_consensus.cc:2804] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:11.160681   786 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:11.160907 32198 raft_consensus.cc:1240] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:11.156672   862 raft_consensus.cc:697] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:11.131572   771 raft_consensus.cc:2804] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:11.132512 32270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36080 (request call id 829) took 1428 ms. Trace:
I20260709 13:13:11.126883   706 consensus_queue.cc:237] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:11.125305 32115 raft_consensus.cc:1240] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:11.152463   792 raft_consensus.cc:2804] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:11.164239 32270 rpcz_store.cc:276] 0709 13:13:09.703626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.007173 (+303547us) service_pool.cc:224] Handling call
0709 13:13:11.132332 (+1125159us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54000f1254. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:11.132460 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2389168384}
I20260709 13:13:11.133458 32268 rpcz_store.cc:276] 0709 13:13:08.210944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.422542 (+2211598us) service_pool.cc:224] Handling call
0709 13:13:10.423005 (+   463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:10.935100 (+512095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.106304 (+171204us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b540014d054. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:11.106421 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1164185344}
I20260709 13:13:11.139631 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:13:11.167353 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.164929 32115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 841) took 1718 ms. Trace:
I20260709 13:13:11.168296 32120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 835) took 1868 ms. Trace:
I20260709 13:13:11.145993 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:11.130713   742 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:11.102874   832 consensus_queue.cc:237] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:11.111277   781 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:11.152174 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:11.129300 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:11.153267   788 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:11.150017 32269 raft_consensus.cc:2376] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3. Re-sending same reply.
I20260709 13:13:11.156710 32123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 878) took 2004 ms. Trace:
I20260709 13:13:11.119271   810 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:11.157222 32238 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:11.161327   786 raft_consensus.cc:3060] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.125401 32087 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:11.187021 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:11.187252 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:13:11.187520 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 62197.6us
I20260709 13:13:11.188709 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:11.188944 32239 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:11.136435 32264 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:11.144460 32124 raft_consensus.cc:1240] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:11.168609 32115 rpcz_store.cc:276] 0709 13:13:09.446225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.121977 (+1675752us) service_pool.cc:224] Handling call
0709 13:13:11.125132 (+  3155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.164559 (+ 39427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.164859 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:11.168704 32120 rpcz_store.cc:276] 0709 13:13:09.300390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.298029 (+997639us) service_pool.cc:224] Handling call
0709 13:13:10.298300 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.037920 (+739620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.168019 (+130099us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b5400205154. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:11.168237 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1618062208}
I20260709 13:13:11.140872   709 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.170853 32267 raft_consensus.cc:2393] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 3: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:11.171752 32116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 851) took 2500 ms. Trace:
I20260709 13:13:11.172169 32273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 786) took 2940 ms. Trace:
I20260709 13:13:11.193974 32273 rpcz_store.cc:276] 0709 13:13:08.235785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.425304 (+2189519us) service_pool.cc:224] Handling call
0709 13:13:11.101948 (+676644us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.133571 (+ 31623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.171967 (+ 38396us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b5400305f50. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff08ad 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:11.172101 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1555372416}
I20260709 13:13:11.162210   764 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:13:11.175277 32089 leader_election.cc:336] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.588s (SENT)
I20260709 13:13:11.185082   822 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:11.175490 32123 rpcz_store.cc:276] 0709 13:13:09.152768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.196003 (+1043235us) service_pool.cc:224] Handling call
0709 13:13:11.050589 (+854586us) spinlock_profiling.cc:243] Waited 46.6 ms on lock 0x7b5800005198. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59beccb71 00007fb59becca22 00007fb5a4de5c09 00007fb5a3f3fee0 00007fb5a40090ab 00007fb5a4009131 00007fb5a3fcafc0 00007fb5a3fb5929 00007fb5a3fb53d2 00007fb59d52cbd4
0709 13:13:11.050795 (+   206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.050991 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:11.148939 (+ 97948us) log.cc:844] Serialized 14 byte log entry
0709 13:13:11.156338 (+  7399us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:11.156393 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:11.156474 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.156538 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:11.156667 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1591,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":107189120,"thread_start_us":104686,"threads_started":2}
I20260709 13:13:11.156459   811 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:11.185998 32266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 777) took 2975 ms. Trace:
I20260709 13:13:11.209679 32272 raft_consensus.cc:2393] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 2: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:11.191313 32238 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:11.209555 32266 rpcz_store.cc:276] 0709 13:13:08.210666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.415416 (+2204750us) service_pool.cc:224] Handling call
0709 13:13:10.477986 (+ 62570us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.139368 (+661382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.185734 (+ 46366us) spinlock_profiling.cc:243] Waited 601 ms on lock 0x7b54002fc6d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:11.185936 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1381672320}
W20260709 13:13:11.191658 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.157658 32118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 839) took 1854 ms. Trace:
I20260709 13:13:11.193900 32116 rpcz_store.cc:276] 0709 13:13:08.671469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.977488 (+1306019us) service_pool.cc:224] Handling call
0709 13:13:10.828284 (+850796us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b5800005198. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59beccb71 00007fb59becca22 00007fb5a4de5c09 00007fb5a3f3fee0 00007fb5a40090ab 00007fb5a4009131 00007fb5a3fcafc0 00007fb5a3fb5929 00007fb5a3fb53d2 00007fb59d52cbd4
0709 13:13:11.121750 (+293466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.122332 (+   582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.171477 (+ 49145us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b54002c97d0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff08ad 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:11.171679 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":677337728}
I20260709 13:13:11.193877 32124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 842) took 1747 ms. Trace:
I20260709 13:13:11.212314 32124 rpcz_store.cc:276] 0709 13:13:09.446516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.141754 (+1695238us) service_pool.cc:224] Handling call
0709 13:13:11.144191 (+  2437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.193526 (+ 49335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.193801 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:11.152297   876 raft_consensus.cc:2804] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:11.197355 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:11.215071 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:11.215960 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:11.195070   830 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:11.217332 32116 raft_consensus.cc:1240] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:11.154745   898 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:11.199056 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:11.220907 32267 raft_consensus.cc:2393] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 2: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:11.195025   705 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:11.167958   718 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:11.151257 32117 rpcz_store.cc:276] 0709 13:13:10.054003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.127107 (+ 73104us) service_pool.cc:224] Handling call
0709 13:13:11.124923 (+997816us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:11.175901 32121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 836) took 1875 ms. Trace:
I20260709 13:13:11.197573 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:11.246913 32196 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:11.246620 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:11.204999 32239 leader_election.cc:400] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3.
I20260709 13:13:11.164044   771 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:11.206476 32191 raft_consensus.cc:1240] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:11.246397 32121 rpcz_store.cc:276] 0709 13:13:09.300668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.327835 (+1027167us) service_pool.cc:224] Handling call
0709 13:13:11.126301 (+798466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:11.154357 (+ 28056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.175655 (+ 21298us) spinlock_profiling.cc:243] Waited 798 ms on lock 0x7b54002c88d0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff08ad 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:11.175828 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1835264384}
I20260709 13:13:11.206410 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:11.207259 32270 raft_consensus.cc:1240] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:11.200809   724 raft_consensus.cc:2955] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:13:11.219609   830 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:11.216301 32199 raft_consensus.cc:2376] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3. Re-sending same reply.
I20260709 13:13:11.217971 32116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 843) took 1771 ms. Trace:
I20260709 13:13:11.256992 32267 raft_consensus.cc:1240] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:11.257369 32116 rpcz_store.cc:276] 0709 13:13:09.446810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.212381 (+1765571us) service_pool.cc:224] Handling call
0709 13:13:11.217159 (+  4778us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.217751 (+   592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.217921 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:11.257835 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:11.218101 32238 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:11.258350 32267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 802) took 2814 ms. Trace:
I20260709 13:13:11.258807 32267 rpcz_store.cc:276] 0709 13:13:08.443879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.244400 (+2800521us) service_pool.cc:224] Handling call
0709 13:13:11.256801 (+ 12401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.257887 (+  1086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.258275 (+   388us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:11.186463   792 raft_consensus.cc:697] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:11.195013   734 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:11.222424 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:11.205900   764 raft_consensus.cc:3060] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.247973 32115 raft_consensus.cc:2393] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 2: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
W20260709 13:13:11.248114 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 47527.1us
I20260709 13:13:11.273241 32239 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:11.252570 32270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 797) took 2840 ms. Trace:
I20260709 13:13:11.250795 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:11.198727 32273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 792) took 2832 ms. Trace:
I20260709 13:13:11.254134 32121 raft_consensus.cc:1240] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:11.274258 32270 rpcz_store.cc:276] 0709 13:13:08.411881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.206686 (+2794805us) service_pool.cc:224] Handling call
0709 13:13:11.207001 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.252325 (+ 45324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.252514 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:11.218921   876 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:11.243948   837 raft_consensus.cc:2804] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:11.219993   811 raft_consensus.cc:697] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:11.212146 32118 rpcz_store.cc:276] 0709 13:13:09.301482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.086004 (+1784522us) service_pool.cc:224] Handling call
0709 13:13:11.086315 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.145327 (+ 59012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.156161 (+ 10834us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:11.244506   705 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:11.270437 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:11.252031   771 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.252329 32119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 837) took 1951 ms. Trace:
I20260709 13:13:11.295495 32199 raft_consensus.cc:2393] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 3: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:11.252247   718 raft_consensus.cc:697] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 3 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:11.261076   704 raft_consensus.cc:2804] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:11.275084 32273 rpcz_store.cc:276] 0709 13:13:08.366310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.197979 (+2831669us) service_pool.cc:224] Handling call
0709 13:13:11.198256 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.198430 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:11.198455 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:11.198497 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:11.198524 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.198577 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:11.198674 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:11.306715 32115 raft_consensus.cc:1240] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:13:11.279057 32267 raft_consensus.cc:1240] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:11.307543 32267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 804) took 2852 ms. Trace:
I20260709 13:13:11.277269   876 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.280553   792 consensus_queue.cc:237] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:11.283010   781 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:11.284698   636 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.276837   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:13:11.260411   830 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:11.262177 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:11.286062 32265 raft_consensus.cc:1240] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:11.252106   862 consensus_queue.cc:237] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:11.297434 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.299685 32272 raft_consensus.cc:1240] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:11.271641   734 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:11.301234 32268 raft_consensus.cc:1240] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:11.302696 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:11.305148 32121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 863) took 1321 ms. Trace:
I20260709 13:13:11.318588 32121 rpcz_store.cc:276] 0709 13:13:09.983927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.249560 (+1265633us) service_pool.cc:224] Handling call
0709 13:13:11.250014 (+   454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.275239 (+ 25225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.304986 (+ 29747us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b54003f43d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:11.305102 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7056256}
I20260709 13:13:11.319558 32269 raft_consensus.cc:1240] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:11.319686 32272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 806) took 2857 ms. Trace:
I20260709 13:13:11.319777 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:11.320137 32272 rpcz_store.cc:276] 0709 13:13:08.462425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.299032 (+2836607us) service_pool.cc:224] Handling call
0709 13:13:11.299447 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.319451 (+ 20004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.319632 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:11.306860 32123 raft_consensus.cc:1240] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:11.295816   705 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.307607 32273 raft_consensus.cc:1240] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:11.278329 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:11.307873 32267 rpcz_store.cc:276] 0709 13:13:08.454897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.259754 (+2804857us) service_pool.cc:224] Handling call
0709 13:13:11.278940 (+ 19186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.307315 (+ 28375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.307488 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:11.278923 32270 raft_consensus.cc:1240] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:11.308665 32271 raft_consensus.cc:1240] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:11.308766 32115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 892) took 1296 ms. Trace:
I20260709 13:13:11.306488   851 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:11.310388 32264 raft_consensus.cc:1240] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:11.313372 32198 raft_consensus.cc:2376] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3. Re-sending same reply.
I20260709 13:13:11.296453 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:13:11.297366 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.315272 32122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 875) took 2180 ms. Trace:
I20260709 13:13:11.300190   815 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:11.307269   801 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.306702   610 consensus_queue.cc:1059] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:13:11.321096 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:11.456126 32197 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.430240 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:11.321172 32123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 893) took 1308 ms. Trace:
I20260709 13:13:11.457652 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:11.457692 32123 rpcz_store.cc:276] 0709 13:13:10.012998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.303837 (+1290839us) service_pool.cc:224] Handling call
0709 13:13:11.304095 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.320956 (+ 16861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.321123 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:11.458472 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:11.458693 32122 rpcz_store.cc:276] 0709 13:13:09.138398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.005977 (+1867579us) service_pool.cc:224] Handling call
0709 13:13:11.006578 (+   601us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:11.007010 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:11.007041 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:11.007565 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:13:11.057040 (+ 49475us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:11.314671 (+257631us) log.cc:844] Serialized 14 byte log entry
0709 13:13:11.314971 (+   300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.315056 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:11.315096 (+    40us) raft_consensus.cc:1685] finished
0709 13:13:11.315106 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:11.315219 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":192425,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":223,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":3962,"thread_start_us":291998,"threads_started":2,"wal-append.queue_time_us":98354}
I20260709 13:13:11.459998 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:11.371373 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:11.395886 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:11.461393 32196 raft_consensus.cc:2410] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:11.321228 32272 raft_consensus.cc:1240] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:11.462664 32264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 796) took 3055 ms. Trace:
I20260709 13:13:11.462252 32124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 881) took 1967 ms. Trace:
I20260709 13:13:11.343904 32116 raft_consensus.cc:1240] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:13:11.462759 32272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 794) took 2822 ms. Trace:
I20260709 13:13:11.379935 32269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 795) took 2975 ms. Trace:
I20260709 13:13:11.464406 32272 rpcz_store.cc:276] 0709 13:13:08.640011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.320796 (+2680785us) service_pool.cc:224] Handling call
0709 13:13:11.321054 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.462545 (+141491us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.462713 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:11.466416 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:11.463160 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:11.463307 32271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 791) took 2840 ms. Trace:
I20260709 13:13:11.464673 32269 rpcz_store.cc:276] 0709 13:13:08.404879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.308138 (+2903259us) service_pool.cc:224] Handling call
0709 13:13:11.319398 (+ 11260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.320040 (+   642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.379852 (+ 59812us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:11.306941   769 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.463277 32264 rpcz_store.cc:276] 0709 13:13:08.407554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.309145 (+2901591us) service_pool.cc:224] Handling call
0709 13:13:11.310222 (+  1077us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.462450 (+152228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.462612 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:11.314033   837 raft_consensus.cc:697] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:11.467490 32270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 805) took 3007 ms. Trace:
I20260709 13:13:11.463485 32115 rpcz_store.cc:276] 0709 13:13:10.012788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.277176 (+1264388us) service_pool.cc:224] Handling call
0709 13:13:11.304240 (+ 27064us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:11.308492 (+  4252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.308705 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:11.468389 32271 rpcz_store.cc:276] 0709 13:13:08.623011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.301639 (+2678628us) service_pool.cc:224] Handling call
0709 13:13:11.301905 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.463092 (+161187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.463257 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:11.470171 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:11.480465 32270 rpcz_store.cc:276] 0709 13:13:08.460295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.275418 (+2815123us) service_pool.cc:224] Handling call
0709 13:13:11.278662 (+  3244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.467231 (+188569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.467434 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:11.466763 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:11.472048 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:11.472285 32089 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:11.298374 32119 rpcz_store.cc:276] 0709 13:13:09.300935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.483561 (+1182626us) service_pool.cc:224] Handling call
0709 13:13:10.528732 (+ 45171us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:10.601160 (+ 72428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:10.602904 (+  1744us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:10.657218 (+ 54314us) log.cc:844] Serialized 26 byte log entry
0709 13:13:10.914886 (+257668us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:10.923482 (+  8596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.923935 (+   453us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:11.188065 (+264130us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b54000f6ca0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59ef66dbe 00007fb59ef71930 00007fb59ef718d8 00007fb59ef71858 00007fb59ef71813 00007fb59ef70a9c 00007fb5a4e5c626 00007fb5a4e56dd8 00007fb59efad7cb 00007fb59efb02c0
0709 13:13:11.217656 (+ 29591us) raft_consensus.cc:1685] finished
0709 13:13:11.217690 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:11.249314 (+ 31624us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":267402,"raft.queue_time_us":29783,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":10215,"spinlock_wait_cycles":31779584,"thread_start_us":203472,"threads_started":1,"wal-append.queue_time_us":208947}
I20260709 13:13:11.463640 32124 rpcz_store.cc:276] 0709 13:13:09.495414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.213453 (+1718039us) service_pool.cc:224] Handling call
0709 13:13:11.213852 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.214092 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:11.304494 (+ 90402us) log.cc:844] Serialized 14 byte log entry
0709 13:13:11.461841 (+157347us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:11.461909 (+    68us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:11.461964 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.462047 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:11.462185 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":59128,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":68,"raft.queue_time_us":426,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":4087,"thread_start_us":207177,"threads_started":2}
W20260709 13:13:11.378680   915 log.cc:927] Time spent T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:13:11.475518 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:11.477809 32090 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:11.478111 32116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 883) took 1467 ms. Trace:
I20260709 13:13:11.312517   807 consensus_queue.cc:1048] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.158s
I20260709 13:13:11.402916 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:11.428424   810 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:11.467568   898 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:11.379791   921 log.cc:927] Time spent T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:13:11.321143   734 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:11.488461 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:11.316239   853 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.492045 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:11.496929   756 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:11.381699   791 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:11.397104 32265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 794) took 3026 ms. Trace:
I20260709 13:13:11.422447 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:13:11.380282   919 log.cc:927] Time spent T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:13:11.498871 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:11.497684 32116 rpcz_store.cc:276] 0709 13:13:10.010707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.258246 (+1247539us) service_pool.cc:224] Handling call
0709 13:13:11.343330 (+ 85084us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b5800005198. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59beccb71 00007fb59becca22 00007fb5a4de5c09 00007fb5a3f3fee0 00007fb5a40090ab 00007fb5a4009131 00007fb5a3fcafc0 00007fb5a3fb5929 00007fb5a3fb53d2 00007fb59d52cbd4
0709 13:13:11.343597 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:11.477763 (+134166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.478029 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23530240}
I20260709 13:13:11.499148 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:11.536448 32198 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.502985 32197 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
W20260709 13:13:11.440210   918 log.cc:927] Time spent T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:13:11.504868 32267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 808) took 1836 ms. Trace:
I20260709 13:13:11.539444 32267 rpcz_store.cc:276] 0709 13:13:09.668848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.473145 (+1804297us) service_pool.cc:224] Handling call
0709 13:13:11.504212 (+ 31067us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.504431 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:11.504455 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:11.504492 (+    37us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:11.504521 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.504570 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:11.504795 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:11.506616 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:11.467679   815 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:11.483808   837 consensus_queue.cc:237] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:11.315359   636 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:11.486043 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:11.527467   898 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:11.515290 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:11.553156 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:11.554253 32198 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:11.516000 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:11.522678 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:11.555162 32269 raft_consensus.cc:2393] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 3: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:11.555264 32194 raft_consensus.cc:2393] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 2: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:11.555308 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:13:11.555647 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 77963.7us
I20260709 13:13:11.556066 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:11.556227 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:11.380947   578 raft_consensus.cc:3055] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:11.556481 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:11.527129 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:11.556830 32090 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:11.527302 32124 raft_consensus.cc:2393] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 3: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:11.557379 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:11.485137   841 consensus_queue.cc:1059] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:13:11.471695   801 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:11.559846 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:11.563954 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:11.563956 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:11.565091 32267 raft_consensus.cc:2393] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 2: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:11.485116   769 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:11.427713   718 consensus_queue.cc:237] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:11.427539   811 consensus_queue.cc:237] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:11.538564 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:11.515616   704 raft_consensus.cc:697] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:11.509033   790 consensus_queue.cc:1059] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
W20260709 13:13:11.549206 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 48188.5us
I20260709 13:13:11.560482 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:11.583348 32194 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:11.559870 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:11.534730   756 consensus_queue.cc:1059] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:13:11.513286   369 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:11.566509 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:11.565847 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:11.532631 32265 rpcz_store.cc:276] 0709 13:13:08.368975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.206840 (+2837865us) service_pool.cc:224] Handling call
0709 13:13:11.262130 (+ 55290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.317505 (+ 55375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.395759 (+ 78254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:11.575124 32269 raft_consensus.cc:2410] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:13:11.609760 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.576879 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:11.610319 32199 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.530141   772 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:11.549383 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:11.572171 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:11.623245 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:11.624321 32272 raft_consensus.cc:2393] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 3: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:11.626530 32268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 800) took 3193 ms. Trace:
I20260709 13:13:11.627053 32268 rpcz_store.cc:276] 0709 13:13:08.432899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.212408 (+2779509us) service_pool.cc:224] Handling call
0709 13:13:11.301005 (+ 88597us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.317856 (+ 16851us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.626251 (+308395us) spinlock_profiling.cc:243] Waited 49.7 ms on lock 0x7b54002b8ed0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff08ad 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:11.626450 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114293504}
I20260709 13:13:11.556871   578 raft_consensus.cc:740] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:11.558398   898 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:11.547165   815 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.596840 32198 raft_consensus.cc:2376] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3. Re-sending same reply.
I20260709 13:13:11.571959 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:11.529031   853 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:11.585662   791 raft_consensus.cc:2804] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:11.634495 32195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 773) took 1005 ms. Trace:
I20260709 13:13:11.635468 32238 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:13:11.638409 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 134900us
W20260709 13:13:11.658784 32165 connection.cc:256] RPC call timeout handler was delayed by -1.0288965469999312s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1513s for a response
I20260709 13:13:11.659134 32238 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:11.659464 32165 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:11.639655 32196 raft_consensus.cc:1240] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:11.660352 32196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 777) took 1030 ms. Trace:
I20260709 13:13:11.660676 32196 rpcz_store.cc:276] 0709 13:13:10.629989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.639166 (+1009177us) service_pool.cc:224] Handling call
0709 13:13:11.639448 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.660096 (+ 20648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.660293 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:11.642434 32198 raft_consensus.cc:1240] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:11.662016 32198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 778) took 1031 ms. Trace:
I20260709 13:13:11.662240 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:11.662338 32198 rpcz_store.cc:276] 0709 13:13:10.630272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.641815 (+1011543us) service_pool.cc:224] Handling call
0709 13:13:11.642191 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.661642 (+ 19451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.661962 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:11.663002 32271 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.663656 32198 raft_consensus.cc:1240] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:11.664247 32198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 784) took 1031 ms. Trace:
I20260709 13:13:11.664525 32198 rpcz_store.cc:276] 0709 13:13:10.632825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.663244 (+1030419us) service_pool.cc:224] Handling call
0709 13:13:11.663503 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.664034 (+   531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.664200 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:11.644066 32191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 763) took 1018 ms. Trace:
I20260709 13:13:11.665320 32191 rpcz_store.cc:276] 0709 13:13:10.625593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.938234 (+312641us) service_pool.cc:224] Handling call
0709 13:13:10.938524 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.249157 (+310633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.643740 (+394583us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b5400211bd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:11.643985 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":615825280}
W20260709 13:13:11.652293 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.653939 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:11.666982 32264 raft_consensus.cc:2393] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 2: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:11.667098 32198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 877) took 1032 ms. Trace:
I20260709 13:13:11.656621 32195 rpcz_store.cc:276] 0709 13:13:10.628776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.939428 (+310652us) service_pool.cc:224] Handling call
0709 13:13:10.971543 (+ 32115us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:10.971898 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:10.971932 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:11.104528 (+132596us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b2c0005bf68. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59d8eaa11 00007fb59d8fa372 00007fb59f02ca01 00007fb59eff143a 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2
0709 13:13:11.105239 (+   711us) log.cc:844] Serialized 26 byte log entry
0709 13:13:11.146401 (+ 41162us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:11.146453 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.146542 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:11.617580 (+471038us) raft_consensus.cc:1685] finished
0709 13:13:11.617608 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:11.634391 (+ 16783us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13949,"raft.queue_time_us":129,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":3625,"spinlock_wait_cycles":4397952,"thread_start_us":14910,"threads_started":1,"wal-append.queue_time_us":128170}
I20260709 13:13:11.665912 32196 raft_consensus.cc:1240] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:11.668292 32196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 782) took 1036 ms. Trace:
I20260709 13:13:11.668512 32191 raft_consensus.cc:1240] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:11.668624 32196 rpcz_store.cc:276] 0709 13:13:10.631482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.661422 (+1029940us) service_pool.cc:224] Handling call
0709 13:13:11.665719 (+  4297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.668084 (+  2365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.668244 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:11.670517 32196 raft_consensus.cc:1240] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:11.667420 32198 rpcz_store.cc:276] 0709 13:13:10.634656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.666347 (+1031691us) service_pool.cc:224] Handling call
0709 13:13:11.666590 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.666819 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:11.666843 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:11.666883 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:11.666911 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.666960 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:11.667053 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:11.628312   742 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:11.633636 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:11.637454   898 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:11.677482 32191 raft_consensus.cc:1240] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:11.677904 32273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 793) took 3039 ms. Trace:
I20260709 13:13:11.678267 32273 rpcz_store.cc:276] 0709 13:13:08.638904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.307146 (+2668242us) service_pool.cc:224] Handling call
0709 13:13:11.307424 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.462866 (+155442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.673885 (+211019us) spinlock_profiling.cc:243] Waited 4.69 ms on lock 0x7b540031a220. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59ef68dc0 00007fb59eff4a02 00007fb59eff0dd6 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2
0709 13:13:11.677845 (+  3960us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10786688}
I20260709 13:13:11.678941 32191 raft_consensus.cc:1240] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:11.679320 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:11.680891 32198 raft_consensus.cc:1240] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:11.682541 32196 raft_consensus.cc:1240] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:11.674906   807 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:11.687920 32271 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
I20260709 13:13:11.687856 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:11.694100 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:11.696955 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:11.697692 32273 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
I20260709 13:13:11.698590 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:11.699115 32273 raft_consensus.cc:2393] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 4: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:11.675357   926 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:11.707863   926 raft_consensus.cc:697] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:11.676807   791 raft_consensus.cc:697] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 3 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:11.687639   704 consensus_queue.cc:237] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:13:11.709702   791 consensus_queue.cc:237] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:11.711344   853 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:11.713052   924 log.cc:927] Time spent T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:13:11.695528   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:13:11.704893   578 consensus_queue.cc:260] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:11.725004   578 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.729388   926 consensus_queue.cc:237] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:11.731076   636 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:11.732240   769 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:11.706914   753 consensus_meta.cc:287] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.598s	user 0.011s	sys 0.000s
I20260709 13:13:11.716426   771 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:11.748374   771 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:11.700687   807 raft_consensus.cc:697] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:11.758551   807 consensus_queue.cc:237] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:11.764955   935 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:11.795784 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 184462us
I20260709 13:13:11.576969 32090 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:11.798504 32089 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:11.799803 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 222729us
W20260709 13:13:11.815243 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.629037 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:11.826866 32120 raft_consensus.cc:2468] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:11.837910 32190 raft_consensus.cc:2376] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3. Re-sending same reply.
I20260709 13:13:11.638471 32192 raft_consensus.cc:2376] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3. Re-sending same reply.
I20260709 13:13:11.847394 32195 raft_consensus.cc:1240] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:11.856680 32196 raft_consensus.cc:1240] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:13:11.700141 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:11.760099   876 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:11.966926 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 168731us
W20260709 13:13:11.970538 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 161029us
W20260709 13:13:11.742631   709 consensus_meta.cc:287] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.546s	user 0.009s	sys 0.002s
W20260709 13:13:11.974762   786 consensus_meta.cc:287] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6: Time spent flushing consensus metadata: real 0.767s	user 0.008s	sys 0.003s
I20260709 13:13:11.975651   786 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:11.978039   772 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:11.979605   837 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.979907   786 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:11.700726 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:11.980728   837 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:11.980756   742 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:11.988173   801 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:11.988467 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:11.989063   402 raft_consensus.cc:1240] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 2 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:11.975688   709 consensus_queue.cc:1059] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:11.975675   753 consensus_queue.cc:1059] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
W20260709 13:13:12.001813   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 502657us
I20260709 13:13:12.002298   709 raft_consensus.cc:3055] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:12.002923   709 raft_consensus.cc:740] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:12.003015   753 raft_consensus.cc:3055] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:12.003602   753 raft_consensus.cc:740] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:12.004070 32273 raft_consensus.cc:2393] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 2: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:11.996371 32267 raft_consensus.cc:2393] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 2: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:12.006212 32273 raft_consensus.cc:1240] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:12.007102 32273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50584 (request call id 33) took 2265 ms. Trace:
I20260709 13:13:12.007539 32273 rpcz_store.cc:276] 0709 13:13:09.741464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.005114 (+2263650us) service_pool.cc:224] Handling call
0709 13:13:12.005764 (+   650us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:12.006751 (+   987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.006991 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:12.008193 32271 raft_consensus.cc:1240] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:11.984186   837 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:11.956036   930 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:11.987027   934 consensus_queue.cc:1059] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:13:11.959626   933 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:12.012995   930 raft_consensus.cc:697] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 3 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:12.008985 32271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 810) took 2339 ms. Trace:
I20260709 13:13:12.015225 32271 rpcz_store.cc:276] 0709 13:13:09.669503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.983134 (+2313631us) service_pool.cc:224] Handling call
0709 13:13:11.989363 (+  6229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:12.008719 (+ 19356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.008909 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:12.019124 32265 raft_consensus.cc:2393] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 2: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:12.018810   930 consensus_queue.cc:237] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:12.008641   764 consensus_meta.cc:287] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.723s	user 0.013s	sys 0.003s
I20260709 13:13:12.013903   933 raft_consensus.cc:3055] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:13:11.996240   830 consensus_meta.cc:287] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.655s	user 0.006s	sys 0.004s
I20260709 13:13:12.031960   933 raft_consensus.cc:740] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:12.034128   830 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:12.034610   898 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:12.034960   933 consensus_queue.cc:260] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:12.037848   876 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:12.012996   753 consensus_queue.cc:260] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:12.059074   753 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.060555   898 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:12.066573 32273 raft_consensus.cc:1240] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:12.068698   788 raft_consensus.cc:3055] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:12.062282 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:12.073627   929 raft_consensus.cc:3055] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:12.122740   929 raft_consensus.cc:740] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:12.124312 32268 raft_consensus.cc:1240] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:12.124735 32089 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:12.124526   929 consensus_queue.cc:260] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:12.126024   790 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:12.041585   830 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:12.060210 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:12.093297 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:12.118057 32267 raft_consensus.cc:1240] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4. Ops: []
W20260709 13:13:12.077284   939 log.cc:927] Time spent T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.311s	user 0.005s	sys 0.017s
I20260709 13:13:12.064214 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:12.036440   933 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.136524   401 raft_consensus.cc:2955] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 2 LEARNER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:13:12.140391 32270 raft_consensus.cc:1240] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:12.141240 32270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 823) took 1491 ms. Trace:
I20260709 13:13:12.141963   725 raft_consensus.cc:3055] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:12.142509   725 raft_consensus.cc:740] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:12.143925   725 consensus_queue.cc:260] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:12.149564 32197 raft_consensus.cc:1275] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:12.149350 32021 catalog_manager.cc:5697] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:12.151185 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:13:12.152004   734 consensus_meta.cc:287] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.620s	user 0.011s	sys 0.006s
I20260709 13:13:12.152096 32194 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:12.149354   725 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.011615   709 consensus_queue.cc:260] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:12.156567 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 307622us
W20260709 13:13:12.157560   937 log.cc:927] Time spent T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.391s	user 0.006s	sys 0.015s
I20260709 13:13:12.115908   815 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:12.089617   786 consensus_queue.cc:1059] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:13:12.101680   791 consensus_queue.cc:1059] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 13:13:12.118903   788 raft_consensus.cc:740] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:12.125124 32268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 821) took 1475 ms. Trace:
I20260709 13:13:12.079890 32199 raft_consensus.cc:2410] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:12.125389 32271 raft_consensus.cc:1240] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:12.165386 32271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 816) took 1517 ms. Trace:
I20260709 13:13:12.132216 32267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 819) took 1483 ms. Trace:
I20260709 13:13:12.126801 32089 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:12.166055 32267 rpcz_store.cc:276] 0709 13:13:10.648804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.078894 (+1430090us) service_pool.cc:224] Handling call
0709 13:13:12.079502 (+   608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:12.131928 (+ 52426us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.132154 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:12.168215 32267 raft_consensus.cc:1240] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:12.170099 32267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 824) took 1519 ms. Trace:
I20260709 13:13:12.126538   790 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:12.170830   790 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:12.172776 32267 rpcz_store.cc:276] 0709 13:13:10.650288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.167309 (+1517021us) service_pool.cc:224] Handling call
0709 13:13:12.167913 (+   604us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:12.169716 (+  1803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.169984 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:12.141631 32270 rpcz_store.cc:276] 0709 13:13:10.650002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.139415 (+1489413us) service_pool.cc:224] Handling call
0709 13:13:12.139901 (+   486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:12.140924 (+  1023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.141170 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:12.175009 32267 raft_consensus.cc:1240] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:12.175038 32270 raft_consensus.cc:1240] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:12.175956 32267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 826) took 1276 ms. Trace:
I20260709 13:13:12.176069 32270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 831) took 1181 ms. Trace:
I20260709 13:13:12.176630 32270 rpcz_store.cc:276] 0709 13:13:10.994385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.174192 (+1179807us) service_pool.cc:224] Handling call
0709 13:13:12.174761 (+   569us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:12.175738 (+   977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.176000 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38272}
I20260709 13:13:12.178952 32270 raft_consensus.cc:1240] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:12.179767 32270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 832) took 1184 ms. Trace:
I20260709 13:13:12.160099 32165 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:12.181547   742 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:12.176539 32267 rpcz_store.cc:276] 0709 13:13:10.899340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.174043 (+1274703us) service_pool.cc:224] Handling call
0709 13:13:12.174721 (+   678us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:12.175597 (+   876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.175879 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30464}
I20260709 13:13:12.128072 32273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 818) took 1471 ms. Trace:
I20260709 13:13:12.186003 32273 rpcz_store.cc:276] 0709 13:13:10.648464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.065329 (+1416865us) service_pool.cc:224] Handling call
0709 13:13:12.065993 (+   664us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:12.119671 (+ 53678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.119973 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:12.135461 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.168814 32271 rpcz_store.cc:276] 0709 13:13:10.647840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.030060 (+1382220us) service_pool.cc:224] Handling call
0709 13:13:12.125107 (+ 95047us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:12.165033 (+ 39926us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.165278 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:12.137177 32264 raft_consensus.cc:1240] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:12.079941   764 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:12.126510   929 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.163669 32268 rpcz_store.cc:276] 0709 13:13:10.649429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.123206 (+1473777us) service_pool.cc:224] Handling call
0709 13:13:12.123751 (+   545us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:12.124852 (+  1101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.125070 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:12.198751 32196 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:12.199002   788 consensus_queue.cc:260] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:13:12.199883   815 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:12.194540 32264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 822) took 1544 ms. Trace:
I20260709 13:13:12.201256 32264 rpcz_store.cc:276] 0709 13:13:10.649728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.136461 (+1486733us) service_pool.cc:224] Handling call
0709 13:13:12.136899 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:12.194060 (+ 57161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.194461 (+   401us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:12.201901 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 83684.1us
I20260709 13:13:12.200377   788 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:12.204713   791 raft_consensus.cc:3055] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:12.205231   791 raft_consensus.cc:740] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:12.152539   734 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:12.206663   791 consensus_queue.cc:260] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:12.208200   791 raft_consensus.cc:3060] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.209290   742 consensus_queue.cc:1059] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:12.211241   734 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:13:12.211479   705 consensus_meta.cc:287] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.734s	user 0.009s	sys 0.009s
I20260709 13:13:12.212425 32267 raft_consensus.cc:1240] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:12.180141 32270 rpcz_store.cc:276] 0709 13:13:10.995214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.177809 (+1182595us) service_pool.cc:224] Handling call
0709 13:13:12.178442 (+   633us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:12.179434 (+   992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.179697 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:12.213104 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.214191 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:12.156442   709 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.218031 32195 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:12.218715 32199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 816) took 1131 ms. Trace:
W20260709 13:13:12.227125   942 log.cc:927] Time spent T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:13:12.229632 32117 raft_consensus.cc:1240] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:12.230513 32121 raft_consensus.cc:1240] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: []
W20260709 13:13:12.231484   578 consensus_meta.cc:287] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.506s	user 0.012s	sys 0.003s
I20260709 13:13:12.232398 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:12.233345 32116 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:12.233404 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:12.234130   935 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:12.234373 32118 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.235494 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:12.237143   403 raft_consensus.cc:1240] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 2 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:12.237210 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:12.237963 32271 raft_consensus.cc:1240] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:12.238066   764 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:12.239440 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:12.240836 32117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 865) took 2256 ms. Trace:
I20260709 13:13:12.241310 32117 rpcz_store.cc:276] 0709 13:13:09.984575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.256191 (+1271616us) service_pool.cc:224] Handling call
0709 13:13:11.290806 (+ 34615us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:12.230139 (+939333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.232524 (+  2385us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b54002c92d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:12.240760 (+  8236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2143557888}
I20260709 13:13:12.238215 32198 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:12.225157 32199 rpcz_store.cc:276] 0709 13:13:11.087566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.562604 (+475038us) service_pool.cc:224] Handling call
0709 13:13:12.215154 (+652550us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:12.244172   944 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:12.256002 32120 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
W20260709 13:13:12.269439 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.283196 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:12.286677 32120 raft_consensus.cc:2393] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 3: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
W20260709 13:13:12.292721 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 166131us
W20260709 13:13:12.296255 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 112004us
I20260709 13:13:12.223266   705 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:12.300304 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:12.304636 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:12.314736 32270 raft_consensus.cc:1275] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:13:12.322417 32116 raft_consensus.cc:2410] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:12.330390 32089 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:12.293555   934 consensus_queue.cc:1059] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
W20260709 13:13:12.334372 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 140200us
I20260709 13:13:12.334965 32265 raft_consensus.cc:1240] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:12.335673 32265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 817) took 1687 ms. Trace:
I20260709 13:13:12.335995 32265 rpcz_store.cc:276] 0709 13:13:10.648155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.314340 (+1666185us) service_pool.cc:224] Handling call
0709 13:13:12.334664 (+ 20324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:12.335405 (+   741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.335617 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:12.340972 32266 raft_consensus.cc:1240] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:12.342522 32266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 798) took 3926 ms. Trace:
I20260709 13:13:12.342953 32266 rpcz_store.cc:276] 0709 13:13:08.415795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.210721 (+2794926us) service_pool.cc:224] Handling call
0709 13:13:11.210975 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:12.341511 (+1130536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.342186 (+   675us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540014d554. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:12.342436 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2557638528}
I20260709 13:13:12.344797   862 consensus_queue.cc:1059] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:13:12.349642 32165 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:12.350777 32272 raft_consensus.cc:1240] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:12.357224 32022 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49556 (request call id 173) took 6762 ms. Trace:
I20260709 13:13:12.357718 32022 rpcz_store.cc:276] 0709 13:13:05.594927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.595118 (+   191us) service_pool.cc:224] Handling call
0709 13:13:12.356969 (+6761851us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:10.602444 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:10.674550 (+ 72106us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:10.677153 (+  2603us) write_op.cc:435] Acquired schema lock
0709 13:13:10.679324 (+  2171us) tablet.cc:662] Decoding operations
0709 13:13:10.815051 (+135727us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:10.816733 (+  1682us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:10.823836 (+  7103us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:13:10.899348 (+ 75512us) tablet.cc:701] Row locks acquired
0709 13:13:10.902004 (+  2656us) write_op.cc:260] PREPARE: finished
0709 13:13:10.902171 (+   167us) write_op.cc:270] Start()
0709 13:13:10.902281 (+   110us) write_op.cc:276] Timestamp: P: 1783602790902122 usec, L: 0
0709 13:13:10.902304 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:13:10.936186 (+ 33882us) log.cc:844] Serialized 1298 byte log entry
0709 13:13:11.119469 (+183283us) op_driver.cc:464] REPLICATION: finished
0709 13:13:11.370931 (+251462us) write_op.cc:301] APPLY: starting
0709 13:13:11.395365 (+ 24434us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:11.421724 (+ 26359us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:11.437634 (+ 15910us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:11.438040 (+   406us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:11.438232 (+   192us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:13:11.438276 (+    44us) write_op.cc:312] APPLY: finished
0709 13:13:11.438481 (+   205us) log.cc:844] Serialized 34 byte log entry
0709 13:13:11.438681 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:11.438768 (+    87us) write_op.cc:454] Released schema lock
0709 13:13:11.438803 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:11.439108 (+   305us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:11.439133 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":877254,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":186361,"apply.run_cpu_time_us":2400,"apply.run_wall_time_us":119720,"num_ops":3,"prepare.queue_time_us":114522,"prepare.run_cpu_time_us":5155,"prepare.run_wall_time_us":334020,"replication_time_us":203624,"thread_start_us":159610,"threads_started":2}]]}
I20260709 13:13:12.363940   934 raft_consensus.cc:3055] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:12.364472   934 raft_consensus.cc:740] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:12.365051 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:12.365329 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:12.366117 32121 raft_consensus.cc:2393] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 3: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:12.366250 32124 raft_consensus.cc:2393] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 2: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
W20260709 13:13:12.366634   832 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.053s	sys 0.055s
W20260709 13:13:12.370594   832 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.054s	sys 0.055s
I20260709 13:13:12.372803   944 consensus_queue.cc:1059] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:12.373129 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:12.373775   944 consensus_queue.cc:1243] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer 6b3ed521ce8947db80c4b4828b355c06 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:13:12.372210 32115 raft_consensus.cc:3055] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:12.374356 32115 raft_consensus.cc:740] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:12.374415   944 consensus_queue.cc:1059] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:12.374976   945 raft_consensus.cc:2749] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:12.375470   944 consensus_queue.cc:1243] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer 6b3ed521ce8947db80c4b4828b355c06 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:13:12.375943   945 raft_consensus.cc:3055] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:12.376456   945 raft_consensus.cc:740] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:12.377921   862 raft_consensus.cc:3055] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:13:12.374300 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 52652.4us
I20260709 13:13:12.367611 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:13:12.378979 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 46356.3us
I20260709 13:13:12.379666 32117 raft_consensus.cc:2393] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 2: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:12.379842 32089 leader_election.cc:304] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:12.380746 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:12.367970   705 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:12.381608 32117 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:12.365523   934 consensus_queue.cc:260] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:12.384318 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:12.367307 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:12.367189 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:12.368561 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:12.378579   862 raft_consensus.cc:740] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:13:12.393285 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 45570.5us
I20260709 13:13:12.377813 32115 consensus_queue.cc:260] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:12.370095   790 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:12.397322   862 consensus_queue.cc:260] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:12.377753   945 consensus_queue.cc:260] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:12.409904   940 log.cc:927] Time spent T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.638s	user 0.002s	sys 0.030s
I20260709 13:13:12.477252 32115 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.477504 32089 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:12.480710 32121 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:12.401172 32124 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:12.389624   709 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:12.401595   753 consensus_queue.cc:1059] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
W20260709 13:13:12.506655 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 105890us
I20260709 13:13:12.512076 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:12.507462 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:12.520947 32272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 839) took 1041 ms. Trace:
I20260709 13:13:12.521421 32272 rpcz_store.cc:276] 0709 13:13:11.479196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.203806 (+724610us) service_pool.cc:224] Handling call
0709 13:13:12.204394 (+   588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:12.351413 (+147019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.520705 (+169292us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b5400295c54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:12.520859 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":248297856}
I20260709 13:13:12.525106 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:12.516155 32118 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
W20260709 13:13:12.532575 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.538681 32120 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:12.539165 32124 raft_consensus.cc:1240] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:12.526712   862 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.525619 32190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 900) took 1253 ms. Trace:
W20260709 13:13:12.538461 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 56454.7us
I20260709 13:13:12.524081   934 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:12.545691 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 68495.8us
W20260709 13:13:12.547402 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.545145 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:12.527806   764 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:12.521112   933 consensus_queue.cc:1059] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
W20260709 13:13:12.559222 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 253426us
I20260709 13:13:12.561137   742 raft_consensus.cc:2804] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:12.561610   742 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:12.561987   742 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.562132   790 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:12.562707 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:13:12.571099 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.573962 32122 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:12.574519 32120 raft_consensus.cc:1275] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:12.578194 32089 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:12.578367   832 consensus_queue.cc:1048] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:13:12.580276   954 log.cc:927] Time spent T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:13:12.571790   945 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.583830 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:13:12.589253 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:12.589424 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.560441   838 consensus_queue.cc:1059] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
W20260709 13:13:12.591967 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.558744   709 consensus_queue.cc:1059] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:13:12.581825   764 consensus_queue.cc:1059] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
W20260709 13:13:12.598176 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.591987   788 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:12.596377 32089 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:12.605250   830 raft_consensus.cc:3055] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:12.605698   830 raft_consensus.cc:740] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:12.606729   830 consensus_queue.cc:260] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:12.607977   830 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.611245   772 consensus_queue.cc:1059] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:12.611752   898 consensus_queue.cc:1059] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.613025 32238 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:12.615156 32116 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:12.623405 32121 raft_consensus.cc:2393] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 3: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:12.580555 32118 raft_consensus.cc:2955] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
W20260709 13:13:12.627902 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 55988.4us
I20260709 13:13:12.612350   734 consensus_queue.cc:1059] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
W20260709 13:13:12.632305 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 55764.6us
I20260709 13:13:12.630990 32115 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:12.631368 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:12.622212   944 raft_consensus.cc:3055] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:12.642786 32165 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:12.631798   959 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.625265   772 consensus_queue.cc:1059] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:13:12.644649 32238 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:12.645671   772 raft_consensus.cc:3055] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:13:12.636945   578 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:13:12.646193   772 raft_consensus.cc:740] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:12.644274   959 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:12.625876   753 consensus_queue.cc:1059] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:13:12.647584   753 raft_consensus.cc:3055] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:12.647351   772 consensus_queue.cc:260] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:12.647989   753 raft_consensus.cc:740] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:12.648434   959 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:12.648370   929 raft_consensus.cc:3055] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:12.649932   807 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:12.649173   753 consensus_queue.cc:260] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:12.650398   807 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:12.651044   807 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:12.651417   753 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:12.649173   929 raft_consensus.cc:740] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:12.650426   403 raft_consensus.cc:1240] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 2 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:12.653302   929 consensus_queue.cc:260] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:12.653960 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.654699   929 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:12.641039   734 consensus_queue.cc:1243] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer 6b3ed521ce8947db80c4b4828b355c06 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:13:12.655476 32165 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:12.657536   961 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:12.658504   959 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:12.659348   956 raft_consensus.cc:3055] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:12.659859   956 raft_consensus.cc:740] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:12.543934 32190 rpcz_store.cc:276] 0709 13:13:11.267989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.842607 (+574618us) service_pool.cc:224] Handling call
0709 13:13:11.843158 (+   551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.843825 (+   667us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:12.010047 (+166222us) log.cc:844] Serialized 14 byte log entry
0709 13:13:12.514392 (+504345us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:12.514539 (+   147us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:12.514674 (+   135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.515150 (+   476us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:12.520818 (+  5668us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":371286,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":208602,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":18665,"thread_start_us":594613,"threads_started":3,"wal-append.queue_time_us":397283}
I20260709 13:13:12.638687   944 raft_consensus.cc:740] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:12.661552 32122 raft_consensus.cc:3055] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:12.661190   956 consensus_queue.cc:260] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:12.661942 32122 raft_consensus.cc:740] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:12.662596   956 raft_consensus.cc:3060] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.662994 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:12.664016 32116 raft_consensus.cc:2393] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 3: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:12.639305   718 raft_consensus.cc:3055] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:12.665002   718 raft_consensus.cc:740] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:12.666103   718 consensus_queue.cc:260] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:12.667531   718 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:12.669467   725 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:12.670116 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:12.655396   930 raft_consensus.cc:3055] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:12.671344   930 raft_consensus.cc:740] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:12.672480   930 consensus_queue.cc:260] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:12.667757 32122 consensus_queue.cc:260] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:12.642266 32121 raft_consensus.cc:2376] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4. Re-sending same reply.
I20260709 13:13:12.678880 32115 raft_consensus.cc:1275] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:13:12.676224 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 90643.2us
I20260709 13:13:12.681983 32123 raft_consensus.cc:2468] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:12.645875   862 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:12.682865 32122 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.684463   724 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.689111   935 raft_consensus.cc:3055] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:13:12.690766 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.693581 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:12.697093 32121 raft_consensus.cc:2376] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2. Re-sending same reply.
I20260709 13:13:12.677762   930 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.698710   772 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.695318   935 raft_consensus.cc:740] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:13:12.700911   935 consensus_queue.cc:260] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:12.702754   935 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.695963   791 raft_consensus.cc:3055] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:12.705224   791 raft_consensus.cc:740] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:12.691907   862 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:12.706601   862 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:12.706669   791 consensus_queue.cc:260] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:12.708766   724 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:12.709801 32089 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:12.711618   764 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:12.711719   724 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:12.661885   944 consensus_queue.cc:260] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:12.712463   764 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:12.709017 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:12.712992   764 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.713428 32120 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.713714   944 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.716394 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:12.708549   791 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:12.720728   955 log.cc:927] Time spent T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:13:12.722218 32119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 907) took 1403 ms. Trace:
I20260709 13:13:12.722609 32119 rpcz_store.cc:276] 0709 13:13:11.319036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.554106 (+235070us) service_pool.cc:224] Handling call
0709 13:13:11.554481 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:11.569659 (+ 15178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:11.572780 (+  3121us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:12.193316 (+620536us) log.cc:844] Serialized 26 byte log entry
0709 13:13:12.287291 (+ 93975us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:12.287431 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.287620 (+   189us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:12.659528 (+371908us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:13:12.721768 (+ 62240us) raft_consensus.cc:1685] finished
0709 13:13:12.721793 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:12.722024 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4185,"raft.queue_time_us":21810,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":46406,"spinlock_wait_cycles":2780544,"thread_start_us":85941,"threads_started":1,"wal-append.queue_time_us":322084}
I20260709 13:13:12.725052 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:12.726227 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:12.726833 32119 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.728037 32120 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:12.733192   807 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:12.735137   764 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:12.735929   807 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:12.737154 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:12.738219 32120 raft_consensus.cc:2393] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 2: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:12.739660   369 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:12.741284 32120 raft_consensus.cc:1275] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.745097   935 raft_consensus.cc:2749] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:12.748466 32119 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:12.757881 32239 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:12.758948   807 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:12.761049 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:12.761809 32269 raft_consensus.cc:2393] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 3: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:12.769836 32115 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:12.774608 32122 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.786420 32121 raft_consensus.cc:1275] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.788889 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:12.789466   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:13:12.791128 32089 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:12.801371 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:12.802358 32269 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:12.809008 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.811362 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:13:12.814571 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 170040us
I20260709 13:13:12.808640   753 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:12.820917 32238 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:12.826074   934 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:13:12.830696 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 175396us
I20260709 13:13:12.830953 32089 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:12.833947   862 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:12.836269   862 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:12.838462 32165 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:12.839617   959 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:12.840023   959 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:12.840173 32165 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:12.840448   959 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.840740   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:13:12.841723   401 raft_consensus.cc:2393] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 2: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:13:12.841562 32165 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:12.843230 32165 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:12.843387   961 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:12.843833 32239 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:12.843855   961 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:12.844852   961 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:12.847890   968 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:12.848760   968 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:12.837736 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:12.851238   930 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:12.853358 32022 catalog_manager.cc:5697] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index -1 to 2, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added, no longer has a pending config: VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1), VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2), VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3), NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 2 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:13:12.856909   966 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.859861 32116 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:12.861184   862 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:12.862756   862 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:12.862185 32239 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:12.864805   807 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:12.865578   862 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:12.863504   724 raft_consensus.cc:1064] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:13:12.867110 32269 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:12.866685   742 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
W20260709 13:13:12.868048 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:12.868491 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.868346   724 consensus_queue.cc:237] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:12.869192 32087 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:12.869046 32090 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:12.869639 32239 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:12.871002 32239 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:12.871291   706 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:12.875766 32199 raft_consensus.cc:1240] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:13:12.872402   706 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:13:12.877620 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.879366   742 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:12.881731 32124 raft_consensus.cc:1275] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.884430 32087 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:12.881950   772 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.885583   772 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:12.887805   945 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:12.872287 32239 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:12.890731 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:12.891662   830 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:12.890763 32199 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.892408   830 consensus_queue.cc:1059] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:12.888379   772 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:12.882947   930 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:13:12.882525 32089 connection.cc:256] RPC call timeout handler was delayed by -1.0696697170001244s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22660000000000002s for a response
I20260709 13:13:12.895327   930 raft_consensus.cc:697] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
W20260709 13:13:12.896517 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.898519 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:12.899267 32199 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:12.899398   966 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:13:12.900992 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.901355 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:12.902025 32199 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:12.903522 32124 raft_consensus.cc:1240] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:12.896813 32239 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:12.896323   930 consensus_queue.cc:237] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:12.883471   753 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:12.910012 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:12.910919 32117 raft_consensus.cc:2393] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 3: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:12.827519   764 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:12.894403   830 raft_consensus.cc:3055] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:12.913096   830 raft_consensus.cc:740] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:13:12.913707   969 log.cc:927] Time spent T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:13:12.914368 32239 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:12.907428 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:12.919965   961 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:12.908092 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:12.908756 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:12.922439 32121 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
I20260709 13:13:12.909390 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:12.923629 32123 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:13:12.912483   815 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:12.926147 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:12.914047   830 consensus_queue.cc:260] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:12.904992 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:12.933802 32116 raft_consensus.cc:2393] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 3: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:12.919314 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:12.921186 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:12.935652 32124 raft_consensus.cc:2393] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 3: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:12.922940   961 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:12.948099 32120 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:13:12.949357 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:12.949788 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:12.950372 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:12.952989 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:12.953522 32239 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:12.953892   401 raft_consensus.cc:1275] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 2 LEARNER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:13:12.954146 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:12.954784 32239 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:12.955718   724 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:12.955886   706 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:12.956202 32122 raft_consensus.cc:1240] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:12.957325 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:12.957866 32122 raft_consensus.cc:2376] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2. Re-sending same reply.
I20260709 13:13:12.932885   959 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:12.956522   724 consensus_queue.cc:1048] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:13:12.960757   959 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:12.961859 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.963276 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:12.964126 32190 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:12.966677 32117 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:13:12.969409 32195 raft_consensus.cc:1240] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:12.970590 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:12.971149 32197 raft_consensus.cc:1275] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:12.971916 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:12.972635 32191 raft_consensus.cc:1275] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:12.973373 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:12.974148 32124 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:12.954878 32115 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:12.977659 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:12.977989 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:12.979278 32119 raft_consensus.cc:1240] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:12.972806   807 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:12.978925 32239 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:12.981971 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:12.982525 32121 raft_consensus.cc:2376] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2. Re-sending same reply.
I20260709 13:13:12.982883 32123 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:13:12.985165 32196 raft_consensus.cc:1275] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.986631   706 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:12.986939 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:12.987591 32191 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:12.987910 32239 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:12.989046 32198 raft_consensus.cc:1240] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:12.989502   966 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:12.993686 32239 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:12.994921 32199 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.997323   725 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:12.998154 32195 raft_consensus.cc:1275] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.998349 32239 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
W20260709 13:13:12.999713 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 156646us
I20260709 13:13:13.004370 32120 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
W20260709 13:13:13.005352 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:13.006178 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.010465   830 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:13.000748   966 raft_consensus.cc:2804] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:13.018708 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:13.019330 32195 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:13.018198 32190 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:13.023958 32239 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:13.025942   807 consensus_queue.cc:1059] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:12.919297   862 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:13.029711 32116 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:13.036497   705 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:13.037034   705 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.037413   705 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:13.040823   725 raft_consensus.cc:3055] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:13.041317   725 raft_consensus.cc:740] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:13.041476 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:13.042338 32190 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:13:13.042450   725 consensus_queue.cc:260] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:13.044008   725 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:13.031813 32124 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:13.024780   966 raft_consensus.cc:697] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:13.055204 32239 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
W20260709 13:13:13.056107 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.053692   966 consensus_queue.cc:237] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:13.062286   862 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:13.063768   724 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:13.068426 32199 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:13.069243   724 raft_consensus.cc:697] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:13.070746 32199 raft_consensus.cc:1240] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:13.071409 32238 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:13.067261   815 consensus_queue.cc:1048] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:13:13.076749 32165 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:13.077397 32198 raft_consensus.cc:1275] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.077227   724 consensus_queue.cc:237] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:13.077975 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.077859   815 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.078379   970 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:13:13.078547 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:13.078583 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.078877   970 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:13:13.079088 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:13.079468 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.058749   706 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:13:13.069968   862 consensus_queue.cc:1048] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
W20260709 13:13:13.081725 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.082207 32165 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:13.083071   959 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:13.083767 32165 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:13.084079 32272 raft_consensus.cc:1275] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:13.084595 32269 raft_consensus.cc:1275] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:13.085381   959 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:13.072551 32191 raft_consensus.cc:1275] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.072819 32190 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:13.075147 32196 raft_consensus.cc:1240] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: []
W20260709 13:13:13.069964 32089 leader_election.cc:336] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.622s (SENT)
I20260709 13:13:13.091071   945 consensus_queue.cc:1048] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:13.091339   753 consensus_queue.cc:1048] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:13.091902 32165 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:13.079334   970 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:13.097273   959 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:13.101954 32195 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:13.093175 32165 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:13.104514 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:13.105340 32199 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:13.103570 32089 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:13.111917 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 47569.6us
I20260709 13:13:13.115970   764 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:13.112540   807 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:13.117736 32238 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:13.118124   807 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.118556   807 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:13.118728   832 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:13.120357   832 consensus_queue.cc:1048] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.120534 32199 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:13.121562 32238 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:13.124935   705 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:13.130894   705 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:13.115842   961 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:13:13.127861 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 57922.1us
I20260709 13:13:13.132162   961 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:13.132658   961 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:13.133478   838 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.132988 32238 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:13.134995 32021 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49534 (request call id 168) took 7173 ms. Trace:
I20260709 13:13:13.136439 32238 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:13.136868   979 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:13.137254   979 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.137614   979 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:13.137365   706 consensus_queue.cc:1059] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.138689   706 consensus_queue.cc:1048] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.138921   725 raft_consensus.cc:2749] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:13.139982   706 consensus_queue.cc:1048] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.141346   862 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:13.141953   862 raft_consensus.cc:697] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:13.141750   725 raft_consensus.cc:3055] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:13.142700   725 raft_consensus.cc:740] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:13.143458 32239 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:13.143170   862 consensus_queue.cc:237] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:13.146517 32238 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:13.149111 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 56005us
W20260709 13:13:13.149829 32089 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.631s (SENT) [suppressed 57 similar messages]
I20260709 13:13:13.163740 32239 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:13.157132   970 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:13.204066 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 43881.9us
W20260709 13:13:13.210762 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.224401   970 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:13.224128   725 consensus_queue.cc:260] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:13.167399   705 consensus_queue.cc:1048] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:13:13.225777   725 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:13.168429   980 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:13.226729   980 raft_consensus.cc:697] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:13.224812   815 raft_consensus.cc:2804] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:13.135320 32021 rpcz_store.cc:276] 0709 13:13:05.977847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.981426 (+  3579us) service_pool.cc:224] Handling call
0709 13:13:13.134937 (+7153511us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:12.609380 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:12.610390 (+  1010us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:12.610466 (+    76us) write_op.cc:435] Acquired schema lock
0709 13:13:12.610495 (+    29us) tablet.cc:662] Decoding operations
0709 13:13:12.611038 (+   543us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:12.611153 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:12.611208 (+    55us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:13:12.611657 (+   449us) tablet.cc:701] Row locks acquired
0709 13:13:12.611725 (+    68us) write_op.cc:260] PREPARE: finished
0709 13:13:12.611932 (+   207us) write_op.cc:270] Start()
0709 13:13:12.612123 (+   191us) write_op.cc:276] Timestamp: P: 1783602792611855 usec, L: 0
0709 13:13:12.612160 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:13:12.642078 (+ 29918us) log.cc:844] Serialized 530 byte log entry
0709 13:13:13.022858 (+380780us) op_driver.cc:464] REPLICATION: finished
0709 13:13:13.121146 (+ 98288us) spinlock_profiling.cc:243] Waited 5.96 ms on lock 0x7b1800258fa0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bf043f3 00007fb59bf067c1 00007fb59bf06779 00007fb59bf06709 00007fb59bf066d1 00007fb59bf059cd 000000000038f354 000000000038f199 00007fb59bee783a
0709 13:13:13.121323 (+   177us) write_op.cc:301] APPLY: starting
0709 13:13:13.121422 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:13.121560 (+   138us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:13.121601 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:13.121912 (+   311us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:13.122151 (+   239us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:13:13.122220 (+    69us) write_op.cc:312] APPLY: finished
0709 13:13:13.122523 (+   303us) log.cc:844] Serialized 22 byte log entry
0709 13:13:13.123553 (+  1030us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:13.123635 (+    82us) write_op.cc:454] Released schema lock
0709 13:13:13.123693 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:13.124100 (+   407us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:13.124132 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1117069,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":74003,"apply.run_cpu_time_us":1938,"apply.run_wall_time_us":2756,"num_ops":1,"prepare.queue_time_us":245649,"prepare.run_cpu_time_us":47313,"prepare.run_wall_time_us":220134,"raft.queue_time_us":122157,"raft.run_cpu_time_us":6351,"raft.run_wall_time_us":35885,"replication_time_us":410533,"spinlock_wait_cycles":13840768,"thread_start_us":409252,"threads_started":4,"wal-append.queue_time_us":150751}]]}
I20260709 13:13:13.168100   838 raft_consensus.cc:2804] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:13:13.216133 32089 leader_election.cc:336] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.676s (SENT)
I20260709 13:13:13.232990 32089 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:13.236023 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:13.236716 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 73029.6us
I20260709 13:13:13.238867   980 consensus_queue.cc:237] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:13.227582   966 consensus_queue.cc:1059] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:13:13.248652   815 raft_consensus.cc:697] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:13.250487   815 consensus_queue.cc:237] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:13.255623   970 consensus_queue.cc:1059] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:13.235291   838 raft_consensus.cc:697] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:13.257407   970 consensus_queue.cc:1059] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:13.257707   838 consensus_queue.cc:237] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:13.258900   956 raft_consensus.cc:3055] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:13.259831   956 raft_consensus.cc:740] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:13.247967   961 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:13.266582   807 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:13.286172 32269 raft_consensus.cc:1240] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:13.268482   753 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:13.261081   956 consensus_queue.cc:260] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:13.317687   956 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:13.319072   830 consensus_queue.cc:1048] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:13.323552   742 raft_consensus.cc:3055] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:13.287807   959 consensus_queue.cc:1059] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:13:13.266373   706 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:13:13.329036   959 raft_consensus.cc:3055] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:13.329473   959 raft_consensus.cc:740] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:13.330531   959 consensus_queue.cc:260] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:13.332010   959 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:13.307094   975 log.cc:927] Time spent T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:13:13.311991   832 consensus_queue.cc:1048] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:13.343647   753 consensus_queue.cc:1059] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:13.344285   807 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:13.344972   753 raft_consensus.cc:3055] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:13.345495   753 raft_consensus.cc:740] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:13.346592   753 consensus_queue.cc:260] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:13.347997   753 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:13.324191   742 raft_consensus.cc:740] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:13.350232   742 consensus_queue.cc:260] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:13.352138   742 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:13.355234 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 191940us
W20260709 13:13:13.356566 32089 leader_election.cc:336] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.826s (SENT)
I20260709 13:13:13.285426 32019 catalog_manager.cc:5697] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:13.367357 32089 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:13.368633 32019 catalog_manager.cc:5697] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:13.376510 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 112745us
W20260709 13:13:13.383715 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 145791us
I20260709 13:13:13.384744 32238 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:13.386121 32238 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:13.390901 32238 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:13.395253 32239 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:13.376273   753 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:13.392493   832 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:13:13.407588 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 50955.3us
I20260709 13:13:13.396478   862 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:13.397930 32019 catalog_manager.cc:5697] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:13.392937   807 consensus_queue.cc:1059] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.017s
W20260709 13:13:13.423237 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:13.424327 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.409698   724 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:13.416162 32019 catalog_manager.cc:5697] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:13.418079   832 raft_consensus.cc:697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:13.424430   862 raft_consensus.cc:697] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:13:13.437342 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 72907.8us
I20260709 13:13:13.430101   961 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:13.434904   705 raft_consensus.cc:3055] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:13.427026   970 consensus_queue.cc:1059] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
W20260709 13:13:13.440924 32089 leader_election.cc:336] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 2.030s (SENT)
W20260709 13:13:13.462299 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.458009 32019 catalog_manager.cc:5697] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 1 to 2, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 2 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:13.464538 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:13.464852   979 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:13.466523 32019 catalog_manager.cc:5697] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:13.440874   986 raft_consensus.cc:2804] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:13:13.469352 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 73383.8us
I20260709 13:13:13.475278 32239 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:13.459571   705 raft_consensus.cc:740] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:13:13.485472 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:13.487528 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 49807.4us
W20260709 13:13:13.488842 32089 leader_election.cc:336] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 2.266s (SENT)
I20260709 13:13:13.489383 32089 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:13.442831   830 consensus_queue.cc:1048] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
W20260709 13:13:13.497269 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:13.491242 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.490036   993 consensus_queue.cc:1059] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:13:13.500170 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:13.500990 32195 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:13.503602 32197 raft_consensus.cc:1240] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:13.503801 32269 raft_consensus.cc:1275] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
W20260709 13:13:13.508441 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.500296   753 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:13.512604 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:13.511937 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.495886   724 raft_consensus.cc:697] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:13.475033   987 consensus_queue.cc:1048] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:13:13.512967 32239 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
W20260709 13:13:13.516185 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 74702.7us
I20260709 13:13:13.503845   986 raft_consensus.cc:697] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:13.503899   995 raft_consensus.cc:2804] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:13:13.523396 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.512475   945 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:13:13.527269 32089 leader_election.cc:336] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 2.509s (SENT)
W20260709 13:13:13.520546   984 log.cc:927] Time spent T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 13:13:13.530804 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.531939 32089 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:13.520304   930 consensus_queue.cc:1048] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:13.543574 32115 raft_consensus.cc:1275] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:13:13.533923   983 log.cc:927] Time spent T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:13:13.553566 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:13.554215 32120 raft_consensus.cc:1275] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:13:13.554723 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:13.557077 32124 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:13.557209 32122 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:13.516882   753 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:13.570878 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.582232 32195 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:13.563551 32119 raft_consensus.cc:1275] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:13:13.586354   989 log.cc:927] Time spent T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:13:13.586067   986 consensus_queue.cc:237] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:13.589645   985 log.cc:927] Time spent T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:13:13.512090   862 consensus_queue.cc:237] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:13.590924   764 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:13.520493   724 consensus_queue.cc:237] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:13.593484 32117 raft_consensus.cc:1275] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:13.593714   956 raft_consensus.cc:3055] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:13.594286   956 raft_consensus.cc:740] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:13.595512   956 consensus_queue.cc:260] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:13.597982 32120 raft_consensus.cc:1240] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:13.605041 32124 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:13.509701   832 consensus_queue.cc:237] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:13.629396 32238 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:13:13.630579 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.627626 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:13.633370 32195 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:13.634383 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 50350.6us
W20260709 13:13:13.636085 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:13.658844 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.563503   830 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:13.593827   945 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.521714   705 consensus_queue.cc:260] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:13.673666 32122 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:13.689666 32195 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
W20260709 13:13:13.690819 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 167817us
W20260709 13:13:13.692909 32089 leader_election.cc:336] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 2.635s (SENT)
I20260709 13:13:13.693348 32089 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:13.693679   999 log.cc:927] Time spent T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
W20260709 13:13:13.680191   974 log.cc:927] Time spent T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 13:13:13.694865 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.695036 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:13.695747 32120 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:13.696101 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.704015 32195 raft_consensus.cc:1275] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.689450   706 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:13.665378   725 consensus_queue.cc:1059] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:13:13.727350 32120 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:13.703109   830 raft_consensus.cc:697] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:13.706863   956 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:13.740556 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.741314 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:13.692163   945 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:13.777964 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:13.829771 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.716931   838 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.729538   966 raft_consensus.cc:3055] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:13:13.851598 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 158721us
I20260709 13:13:13.744760   764 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:13:13.886339 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 182718us
I20260709 13:13:13.896780 32238 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:13:13.886582 32089 leader_election.cc:336] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 2.646s (SENT)
I20260709 13:13:13.899333 32089 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:13.878558   966 raft_consensus.cc:740] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:13.853238   930 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:13.729538  1002 consensus_queue.cc:1059] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.187s
I20260709 13:13:13.738358   993 consensus_queue.cc:1059] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.166s
I20260709 13:13:13.879910   959 consensus_queue.cc:1059] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:13:13.915031   706 raft_consensus.cc:697] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:13:13.941445  1001 log.cc:927] Time spent T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:13:13.945025   724 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:13.945680   724 raft_consensus.cc:697] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:13.946534   724 consensus_queue.cc:237] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:13.948874   988 consensus_queue.cc:1048] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:13.852012   830 consensus_queue.cc:237] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:13.880910   838 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:13.965130 32119 raft_consensus.cc:2410] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:13:13.751600 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:13.968297 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:13.969432 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:13.970379 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:13.970994 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.958120   753 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:14.003616   753 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.003855   945 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:14.004086   753 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:13:14.004783   945 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:14.005224   959 raft_consensus.cc:3055] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:14.005652   959 raft_consensus.cc:740] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:14.005565   945 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.006345   753 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:14.006966   959 consensus_queue.cc:260] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.007440   753 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:14.002811  1016 raft_consensus.cc:3055] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:13:14.009650 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:14.021704 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 70715.2us
I20260709 13:13:13.911000   930 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:14.008795   742 consensus_meta.cc:287] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.656s	user 0.006s	sys 0.006s
I20260709 13:13:14.051275   945 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:14.054914 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:14.058085 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.014153  1016 raft_consensus.cc:740] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
W20260709 13:13:14.063385 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:14.065794 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 185097us
W20260709 13:13:14.069331 32089 leader_election.cc:336] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 2.691s (SENT)
W20260709 13:13:14.067811 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.935350   706 consensus_queue.cc:237] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.078075 32089 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:14.083081 32195 raft_consensus.cc:1240] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:14.087657 32196 raft_consensus.cc:3055] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:14.088178 32196 raft_consensus.cc:740] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:14.064935   959 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:14.091708 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.052754  1002 consensus_queue.cc:1059] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
W20260709 13:13:14.097915 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.105255 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:14.089362   753 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:14.023538   966 consensus_queue.cc:260] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:13:14.109630 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.110829 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:14.111573 32122 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:14.113850 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 45172.6us
I20260709 13:13:14.102568 32196 consensus_queue.cc:260] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.115314 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:14.122671 32272 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
W20260709 13:13:14.126732 32089 leader_election.cc:336] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 3.000s (SENT)
I20260709 13:13:14.127254 32089 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:14.128399  1018 log.cc:927] Time spent T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:13:14.116689  1013 consensus_queue.cc:1048] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:13:14.130062 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:14.152005 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:14.168955 32165 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:14.170097 32165 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:14.173223 32122 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
W20260709 13:13:14.182219 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 47761.4us
I20260709 13:13:14.181680   993 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:13:14.237874 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:14.238085 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 111379us
I20260709 13:13:14.182139  1026 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.201085   993 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:14.121411  1016 consensus_queue.cc:260] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:14.241632 32089 leader_election.cc:336] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 2.055s (SENT)
W20260709 13:13:14.266760 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:14.289232 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.181841  1009 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:14.295408  1025 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:13:14.296120 32165 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:13:14.297312 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 55730.1us
W20260709 13:13:14.295882  1031 log.cc:927] Time spent T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
W20260709 13:13:14.298949 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:14.305063 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.241279   838 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:13:14.288787  1010 log.cc:927] Time spent T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.219s	user 0.000s	sys 0.002s
I20260709 13:13:14.278353   993 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:14.290494  1002 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.288641   830 consensus_queue.cc:1059] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:13:14.338976  1016 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.341562  1015 consensus_queue.cc:1048] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.140s
I20260709 13:13:14.337147  1003 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:13:14.339781  1017 log.cc:927] Time spent T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
W20260709 13:13:14.338466  1020 log.cc:927] Time spent T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:13:14.286434  1026 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.337868  1014 raft_consensus.cc:2764] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:13:14.306769   724 consensus_queue.cc:1048] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:13:14.338524   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:14.346242  1002 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:13:14.389034   956 consensus_meta.cc:287] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.533s	user 0.007s	sys 0.005s
W20260709 13:13:14.398928  1029 log.cc:927] Time spent T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:13:14.387296   401 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:14.399312  1014 consensus_queue.cc:1059] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:14.406867  1061 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:14.407581  1061 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:14.409770   956 raft_consensus.cc:3055] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:14.410147  1061 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:14.410321   956 raft_consensus.cc:740] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:14.410774  1061 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.411275  1061 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:14.411545  1026 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:14.411399   956 consensus_queue.cc:260] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.414655  1060 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.415426   987 raft_consensus.cc:3055] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:14.415949   987 raft_consensus.cc:740] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:14.418325  1002 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:14.419848  1057 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:14.421622  1037 log.cc:927] Time spent T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.175s	user 0.002s	sys 0.001s
I20260709 13:13:14.415199  1060 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:13:14.457144 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:14.474850 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:14.475747  1019 log.cc:927] Time spent T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 13:13:14.477207 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 86790.9us
I20260709 13:13:14.475296  1027 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.485015 32165 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:14.486379 32165 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:14.486619 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:14.487479 32120 raft_consensus.cc:2393] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 4: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:14.487632   970 raft_consensus.cc:2804] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:14.487923 32165 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:14.488126   970 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:14.488873  1061 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:14.489112 32165 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:14.474532  1057 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:14.491211 32165 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:14.491492  1057 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:14.489279  1002 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:13:14.492313 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.483613  1003 raft_consensus.cc:697] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:14.510543 32236 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:13:14.496204   970 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.501150   987 consensus_queue.cc:260] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.527215 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:14.528005 32190 raft_consensus.cc:2468] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 2.
I20260709 13:13:14.528781  1058 consensus_queue.cc:1059] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:14.529699   368 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:13:14.531373  1025 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:14.531864  1025 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:14.532171  1057 raft_consensus.cc:2804] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:14.532251  1025 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:14.527649  1060 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:14.532745  1057 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:14.534714 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:14.535666 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.540458 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:14.543689 32190 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 3.
I20260709 13:13:14.542871 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:14.544482 32119 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 2.
I20260709 13:13:14.542464  1064 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:14.485328  1027 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.553265  1058 consensus_queue.cc:1243] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer fcfc3281929645969ecedbb0c0af759d log is divergent from this leader: its last log entry 5.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:13:14.559724  1058 raft_consensus.cc:3055] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:14.560153  1058 raft_consensus.cc:740] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:14.561137  1058 consensus_queue.cc:260] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.562733  1058 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:14.563491  1003 consensus_queue.cc:237] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.544175   959 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:14.565028   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:14.565928  1062 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:14.565888  1064 raft_consensus.cc:697] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 4 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:14.567987  1064 consensus_queue.cc:237] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.569744 32121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 971) took 1028 ms. Trace:
I20260709 13:13:14.570247 32121 rpcz_store.cc:276] 0709 13:13:13.541114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.541762 (+   648us) service_pool.cc:224] Handling call
0709 13:13:13.546060 (+  4298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:13.583930 (+ 37870us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:13.583980 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:13.584033 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:13.584180 (+   147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:14.569472 (+985292us) spinlock_profiling.cc:243] Waited 7.51 ms on lock 0x7b5400204754. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:14.569526 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:14.569660 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17294336}
I20260709 13:13:14.537207  1057 raft_consensus.cc:3060] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:14.548834   995 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.879s	user 0.016s	sys 0.016s
I20260709 13:13:14.588554   998 raft_consensus.cc:3055] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:14.593874   998 raft_consensus.cc:740] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:14.594913   998 consensus_queue.cc:260] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:14.595865 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.558777   993 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:14.592095  1028 log.cc:927] Time spent T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.299s	user 0.001s	sys 0.001s
I20260709 13:13:14.593061  1007 raft_consensus.cc:3055] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:14.591771  1025 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:13:14.596547 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.599824 32123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 976) took 1056 ms. Trace:
W20260709 13:13:14.602083 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 211314us
I20260709 13:13:14.602530 32123 rpcz_store.cc:276] 0709 13:13:13.542992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.546315 (+  3323us) service_pool.cc:224] Handling call
0709 13:13:13.561528 (+ 15213us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:13.584769 (+ 23241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:13.584803 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:13.620819 (+ 36016us) log.cc:844] Serialized 26 byte log entry
0709 13:13:13.909391 (+288572us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:13.909443 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.909536 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:14.591654 (+682118us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b2400196688. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59bd8a9c4 00007fb59bd88acb 00007fb59bf43dc9 00007fb59bf43a55 00007fb59bf4309d 00007fb59eb7510e 00007fb59eb8c88c 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221
0709 13:13:14.599523 (+  7869us) raft_consensus.cc:1685] finished
0709 13:13:14.599544 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:14.599758 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22821,"raft.queue_time_us":30079,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":69,"spinlock_wait_cycles":70161664,"thread_start_us":213359,"threads_started":1,"wal-append.queue_time_us":564101}
I20260709 13:13:14.553987   930 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:14.605382 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.593909   725 raft_consensus.cc:3055] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:14.557529 32192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 942) took 1072 ms. Trace:
W20260709 13:13:14.602265   995 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.017s	sys 0.017s
I20260709 13:13:14.598757  1062 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.597937   993 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:14.601976  1007 raft_consensus.cc:740] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
W20260709 13:13:14.614473 32089 leader_election.cc:336] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 2.187s (SENT)
I20260709 13:13:14.603309   368 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:13:14.616679  1027 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:14.617216  1007 consensus_queue.cc:260] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.618438  1007 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:14.622481  1025 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:14.615593 32089 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:14.625569 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:14.609934   725 raft_consensus.cc:740] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:14.608641  1002 raft_consensus.cc:697] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:14.629416 32123 raft_consensus.cc:2468] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 2.
I20260709 13:13:14.626817  1062 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.614130   995 raft_consensus.cc:697] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:14.636516   725 consensus_queue.cc:260] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.635239   970 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.640153   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:13:14.625542   998 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:14.648329 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:14.663626 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.654258   403 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:14.658697   930 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:14.669984 32089 leader_election.cc:336] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 2.193s (SENT)
I20260709 13:13:14.662729  1012 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:14.663654   725 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:14.664762   807 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:14.674991 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 183849us
I20260709 13:13:14.658522   369 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:14.677873 32165 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:14.674517  1025 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.666862  1065 raft_consensus.cc:2804] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:13:14.679020 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.674584   979 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:14.676928  1027 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.667995  1002 consensus_queue.cc:237] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:14.692015 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.677421  1064 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.673437   930 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.698130 32165 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:14.696229 32194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 954) took 1107 ms. Trace:
I20260709 13:13:14.683128  1065 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:14.680749  1009 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.700812  1032 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.711315 32191 raft_consensus.cc:1275] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:14.711748  1032 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.695585  1076 raft_consensus.cc:2804] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:14.712703  1012 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.712929  1076 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:14.713513  1076 raft_consensus.cc:3060] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.713269  1012 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.714969  1032 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:14.715196   966 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:14.715662  1012 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:14.700278  1027 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.717960  1027 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:14.719939  1013 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.720463  1013 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.721428  1047 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.721982  1047 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.722838  1013 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:14.723976  1047 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:14.610538 32192 rpcz_store.cc:276] 0709 13:13:13.484572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.486179 (+  1607us) service_pool.cc:224] Handling call
0709 13:13:13.499663 (+ 13484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:13.669845 (+170182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:13.679575 (+  9730us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:13.784861 (+105286us) log.cc:844] Serialized 26 byte log entry
0709 13:13:14.062896 (+278035us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:14.069182 (+  6286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:14.077293 (+  8111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:14.421113 (+343820us) spinlock_profiling.cc:243] Waited 8.55 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:13:14.544243 (+123130us) raft_consensus.cc:1685] finished
0709 13:13:14.544273 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:14.557327 (+ 13054us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47019,"raft.queue_time_us":53658,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":31759,"spinlock_wait_cycles":19656576,"thread_start_us":242441,"threads_started":2,"wal-append.queue_time_us":276400}
I20260709 13:13:14.684649  1033 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.691264  1035 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.693925  1034 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:14.730422 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:14.710402 32190 raft_consensus.cc:3055] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:14.712137  1065 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:14.676326   995 consensus_queue.cc:237] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.746655 32199 raft_consensus.cc:1275] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:14.702603   930 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:14.755484   930 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.756057   930 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.726051 32090 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:14.706060 32194 rpcz_store.cc:276] 0709 13:13:13.596739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.689764 (+ 93025us) service_pool.cc:224] Handling call
0709 13:13:13.690058 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:13.734395 (+ 44337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:13.734424 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:13.784925 (+ 50501us) log.cc:844] Serialized 26 byte log entry
0709 13:13:14.564838 (+779913us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b18000232c0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bee6e07 00007fb5a4d41ab9 00007fb59bf0369b 00007fb59bf0193f 00007fb59bf03c02 00007fb59eb8b20b 00007fb59eb90d23 00007fb59eb910d1 00007fb59efaca0f
0709 13:13:14.626169 (+ 61331us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:14.626206 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:14.626381 (+   175us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:14.692299 (+ 65918us) raft_consensus.cc:1685] finished
0709 13:13:14.692323 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:14.696163 (+  3840us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27518,"raft.queue_time_us":139494,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":45827,"spinlock_wait_cycles":6279936,"thread_start_us":60947,"threads_started":1,"wal-append.queue_time_us":803861}
I20260709 13:13:14.705061  1062 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:14.678454   807 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:14.713025   956 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:14.734748 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:14.735028 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:14.734776 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:14.736958 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:14.737020 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:14.783691 32270 raft_consensus.cc:2393] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 3: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
W20260709 13:13:14.738113  1022 log.cc:927] Time spent T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.396s	user 0.003s	sys 0.001s
I20260709 13:13:14.728266  1058 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:14.745445   996 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.739284  1003 consensus_queue.cc:1059] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:14.791649 32199 raft_consensus.cc:1240] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:14.790720 32265 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:14.792189   996 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.792673 32272 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 4.
I20260709 13:13:14.794451   996 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:14.794831 32192 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.766063   980 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.796382   980 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.797187  1003 raft_consensus.cc:3055] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:14.797676  1003 raft_consensus.cc:740] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:14.797768   807 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:14.754614  1076 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.798707  1003 consensus_queue.cc:260] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.800160  1076 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:14.741719  1047 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.742285  1013 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.801075  1026 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.801340  1013 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:14.801563  1026 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.803509  1013 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:14.717976   705 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:14.724574  1039 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.684125  1025 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:14.749017 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.749102  1034 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:13:14.749907   987 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:14.733526  1035 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.733708 32190 raft_consensus.cc:740] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
W20260709 13:13:14.754590 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.727151   970 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:14.767262 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:14.772395 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:14.769383 32239 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:14.738821  1057 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:14.784014 32273 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:14.822723 32266 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 3.
I20260709 13:13:14.739576 32196 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:14.822947 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 53647.1us
W20260709 13:13:14.739950  1072 log.cc:927] Time spent T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:13:14.798435   980 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:14.769467  1012 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:14.705489  1064 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.758244   403 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:14.809468 32124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 979) took 1210 ms. Trace:
I20260709 13:13:14.800204  1003 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:14.815828 32199 raft_consensus.cc:1275] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:13:14.832000 32124 rpcz_store.cc:276] 0709 13:13:13.617389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.637303 (+ 19914us) service_pool.cc:224] Handling call
0709 13:13:13.637696 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:13.660819 (+ 23123us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:13.660869 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:13.698667 (+ 37798us) log.cc:844] Serialized 26 byte log entry
0709 13:13:14.102169 (+403502us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:14.102395 (+   226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:14.102665 (+   270us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:14.737739 (+635074us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b2400196688. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59bd8a9c4 00007fb59bd88acb 00007fb59bf43dc9 00007fb59bf43a55 00007fb59bf4309d 00007fb59eb7510e 00007fb59eb8c88c 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221
0709 13:13:14.800657 (+ 62918us) raft_consensus.cc:1685] finished
0709 13:13:14.800681 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:14.809396 (+  8715us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12793,"raft.queue_time_us":95,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":36358,"spinlock_wait_cycles":33714944,"thread_start_us":362045,"threads_started":1,"wal-append.queue_time_us":572165}
W20260709 13:13:14.819305 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 58945us
I20260709 13:13:14.728412  1009 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.829092  1012 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:14.836644  1012 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:14.833935  1058 consensus_queue.cc:1059] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:13:14.808722  1076 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.838382  1058 raft_consensus.cc:3055] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:14.838778  1058 raft_consensus.cc:740] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:14.838528  1076 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.839643  1058 consensus_queue.cc:260] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:14.821137 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:14.840984 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:14.841341 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.731030  1033 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.814178   930 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:14.824712 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:14.825688 32194 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:14.816983   832 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.801097  1047 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.827555  1015 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:14.830528   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
W20260709 13:13:14.841706 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.803526  1026 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:14.842669 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:14.845045 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:14.814831  1039 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.833571  1060 raft_consensus.cc:2764] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:13:14.850159   401 raft_consensus.cc:2393] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 3: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:13:14.825529  1057 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:14.849326 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:14.862677 32194 raft_consensus.cc:3060] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:14.861917 32199 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:14.837752  1009 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:14.864300 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:14.864919 32193 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:14.868345 32199 raft_consensus.cc:1240] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: []
W20260709 13:13:14.876497 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.903280 32192 raft_consensus.cc:1275] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:13:14.904981  1083 log.cc:927] Time spent T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:13:14.855280   930 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.858628  1065 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:14.894338 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:14.896912 32236 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:13:14.848405   970 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.845327  1076 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:14.909770 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.912757  1015 raft_consensus.cc:697] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:14.866365   402 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:14.857007   832 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.917289  1015 consensus_queue.cc:237] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.919433   832 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:14.920358 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 73710.7us
I20260709 13:13:14.915894   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
W20260709 13:13:14.934069 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 63970.6us
I20260709 13:13:14.934628   980 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:14.935913   980 raft_consensus.cc:697] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:14.937176   980 consensus_queue.cc:237] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:14.945443 32192 raft_consensus.cc:1275] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:14.879390  1058 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.948719 32236 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:13:14.901161  1009 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.935341   994 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.961176 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:14.979620 32165 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:14.962059 32197 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:14.988844 32193 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:14.859267 32190 consensus_queue.cc:260] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.994519 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:14.995343 32193 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:14.990001 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:14.957489  1027 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.924007   369 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:14.989487   403 raft_consensus.cc:2393] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 4: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:13:14.958981  1026 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:14.979349  1034 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:14.924397   930 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:14.930550   970 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.956934  1009 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:14.993876  1076 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:15.027454 32196 raft_consensus.cc:1275] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:13:15.029747 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:15.011405  1026 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.028017 32196 pending_rounds.cc:85] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 1
I20260709 13:13:15.016320 32190 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:15.050137 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.011636  1027 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:15.047948 32196 pending_rounds.cc:107] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:13:15.058933 32196 raft_consensus.cc:2889] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:15.059283 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.024724  1057 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:15.005023   994 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:15.059830 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:15.071352 32195 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:15.050750  1026 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:15.073205 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:15.080525 32196 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:15.081262 32194 raft_consensus.cc:2468] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 3.
W20260709 13:13:15.079052 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.079145  1035 leader_election.cc:290] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:15.038604  1082 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.074522 32165 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:15.048112   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 141705us
I20260709 13:13:15.083763 32195 raft_consensus.cc:1275] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:13:15.078769   961 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:13:15.063361  1032 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.084460 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:15.024796   998 consensus_queue.cc:1059] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:13:15.061833  1092 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.062332  1057 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:13:15.231262 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.231067  1092 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:15.232178  1094 log.cc:927] Time spent T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:13:15.232501  1009 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:15.233153  1082 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:15.185436   979 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.233814  1012 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:15.234700   979 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:15.236064  1012 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:15.150463 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:15.240888 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:15.203563  1080 log.cc:927] Time spent T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
W20260709 13:13:15.175897 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:15.250226 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:15.250690 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.238183  1032 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:15.095283 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:15.232128 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.243820 32194 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.231828   994 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:15.231536  1091 log.cc:927] Time spent T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
W20260709 13:13:15.140558 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.229755 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:15.263684 32192 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
W20260709 13:13:15.243294 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:15.264673 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:15.237685 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 163251us
W20260709 13:13:15.269769 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.269757 32119 raft_consensus.cc:1275] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:15.092813  1034 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.236334  1082 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:15.250869  1057 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.255300 32090 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:15.256721 32190 raft_consensus.cc:1275] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:15.257783  1032 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:15.096835  1064 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:15.082508  1047 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:15.120390  1062 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.260087  1033 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:15.285316 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:15.285924 32090 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:13:15.287955 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 391433us
W20260709 13:13:15.251237 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.165959  1065 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 4 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:15.165089  1014 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:15.277592 32195 raft_consensus.cc:1275] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:15.278644 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:15.217406   930 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:15.304569 32121 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:15.250108   970 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:15.269464  1007 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:15.220253 32199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10940646da924abea9f371781da8acee"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:13:15.289445 32192 raft_consensus.cc:1275] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:15.312762 32199 raft_consensus.cc:606] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:15.271763  1035 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:15.313267 32199 raft_consensus.cc:614] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:15.294710 32165 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:15.283317 32123 raft_consensus.cc:1275] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:13:15.314280 32123 pending_rounds.cc:85] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d: Aborting all ops after (but not including) 1
I20260709 13:13:15.314546 32123 pending_rounds.cc:107] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:13:15.314752 32123 raft_consensus.cc:2889] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:15.288761  1082 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:15.297432  1027 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:15.289587  1062 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:15.286792 32117 raft_consensus.cc:1275] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:15.263381   979 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:15.291455 32119 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:15.261627 32194 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 4.
I20260709 13:13:15.147672   368 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
W20260709 13:13:15.330948   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 216573us
I20260709 13:13:15.331962   368 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:13:15.280531 32124 raft_consensus.cc:1275] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:15.332394  1039 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:15.333696 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:15.305590 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:15.233834  1092 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:15.306795 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:15.334434 32124 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:15.312794  1033 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:15.335059 32265 raft_consensus.cc:2410] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:13:15.309123  1026 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:15.309998   986 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.310318 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:15.336529  1035 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:15.344643   986 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:15.345844  1060 raft_consensus.cc:2804] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:15.346554  1035 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:15.353564 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:15.310902  1014 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:15.280738  1034 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:15.311879 32115 raft_consensus.cc:1275] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:13:15.294610 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.322391  1032 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.362439  1032 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:15.364493  1032 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:15.365020   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
W20260709 13:13:15.323310   956 consensus_meta.cc:287] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.000s
I20260709 13:13:15.281801  1099 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.325402 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:15.325402 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:15.366137 32197 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:15.326578  1096 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:15.366358 32119 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:15.366565 32266 raft_consensus.cc:2393] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 5: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
W20260709 13:13:15.366607 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:15.366111 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.327370  1025 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:15.327728 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:15.328996 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:15.368482 32270 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:15.368636 32268 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:15.366297  1099 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:15.370891  1099 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:15.371637 32119 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:15.366842  1096 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:15.327099 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:15.329860 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:15.372877 32269 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:15.328382 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:15.323362  1009 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.373569  1096 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:15.373512 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:15.374063  1009 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:15.339047  1098 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.374938  1098 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:15.329133 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:15.340060 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:15.319249  1082 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.376166  1009 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:15.376384  1082 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:15.376566 32089 leader_election.cc:336] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.514s (SENT)
I20260709 13:13:15.377050 32089 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:15.377777  1009 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:15.377898 32270 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
W20260709 13:13:15.378047 32089 leader_election.cc:336] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.523s (SENT)
I20260709 13:13:15.379209 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:15.335328  1033 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.347882  1065 raft_consensus.cc:2804] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:15.384707 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:15.326071 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:15.366828  1032 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:15.374401 32119 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:15.375947 32271 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:15.354450 32123 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 1.
I20260709 13:13:15.376199 32124 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:15.323607  1062 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:15.386745 32089 leader_election.cc:336] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.631s (SENT)
I20260709 13:13:15.388334 32239 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:15.386004 32265 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.390125 32115 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:15.390254 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:15.394672 32264 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:15.392204   979 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:15.391743 32089 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:15.386978  1033 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:15.405049 32239 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:15.407084  1035 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:15.407383  1099 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:15.408655  1099 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:15.409339 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:15.409947 32123 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:15.410780 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:15.411108  1096 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:15.411368 32123 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:15.410790  1099 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:15.412226 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:15.412595  1035 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:15.414029 32118 raft_consensus.cc:1275] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:13:15.394853  1032 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:15.416754  1003 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.417428  1076 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:15.427790 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:15.418149   994 consensus_queue.cc:1048] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:15.404170  1025 raft_consensus.cc:2804] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:13:15.418689 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 141401us
I20260709 13:13:15.393401 32117 raft_consensus.cc:3060] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:15.421325 32123 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:15.423168 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:15.389140  1027 consensus_queue.cc:1048] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:13:15.426666 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:15.426923 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:15.427000 32090 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:15.428442 32194 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:15.419303  1002 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:15.396709   830 consensus_queue.cc:1048] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:13:15.433458 32199 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:15.441677 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:15.434365 32165 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:15.444011 32090 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:15.458475 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:13:15.450668 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.428068  1076 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:15.509783 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 77303.5us
W20260709 13:13:15.511729 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.404639  1060 raft_consensus.cc:697] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 4 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:13:15.462136 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:15.512740 32239 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:15.430105  1096 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.473680 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:15.510747 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 76805.7us
I20260709 13:13:15.562489 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:15.562611 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 128342us
I20260709 13:13:15.511006 32193 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:15.563052 32123 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:15.433486 32198 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:15.437288 32238 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:13:15.510609 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.510309 32191 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:15.515206 32192 raft_consensus.cc:1275] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:15.432490  1025 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.567713 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:15.571424 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 134196us
I20260709 13:13:15.563268 32090 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:15.573849 32090 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:15.565434 32195 raft_consensus.cc:1275] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:15.513342   998 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:15.430148  1036 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:13:15.586689 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.458774   930 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:15.433494   705 consensus_queue.cc:1048] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.129s
I20260709 13:13:15.576153 32090 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:13:15.578416 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 65746.1us
I20260709 13:13:15.458551  1047 consensus_queue.cc:1048] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.111s
I20260709 13:13:15.547410  1099 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:15.583174 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:15.430721  1003 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:15.605597 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:15.606370 32264 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:15.546591   987 consensus_queue.cc:1048] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:13:15.571892  1025 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.582317  1092 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:15.608650 32196 raft_consensus.cc:3055] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:15.609378 32165 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:15.442227   988 consensus_queue.cc:1059] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.148s
I20260709 13:13:15.613917 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:15.627236 32196 raft_consensus.cc:740] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:15.628136 32123 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:15.628551 32196 consensus_queue.cc:260] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:15.588359  1066 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:15.585919  1009 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:15.584378  1039 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:15.635811 32197 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:15.562166  1096 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:15.589555   930 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.605427  1099 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.603077  1036 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.512873  1060 consensus_queue.cc:237] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:15.646234 32196 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:15.584088   997 consensus_queue.cc:1048] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:13:15.650338 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:15.658847 32123 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:15.627621   753 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:15.632776  1012 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:15.603677  1065 raft_consensus.cc:697] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 3 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:13:15.627014  1044 consensus_queue.cc:1048] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:13:15.636787  1066 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:15.661422 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.676196 32265 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 4.
W20260709 13:13:15.677767  1110 log.cc:927] Time spent T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 13:13:15.678153  1089 log.cc:927] Time spent T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.603s	user 0.002s	sys 0.003s
I20260709 13:13:15.682729  1065 consensus_queue.cc:237] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:13:15.685352  1111 log.cc:927] Time spent T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:13:15.654836  1014 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:15.652081  1099 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:15.636457  1009 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.610602   815 consensus_queue.cc:1048] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:13:15.652863   930 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:15.606906   994 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
W20260709 13:13:15.669859 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.656652  1036 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:15.686970  1066 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:15.638111  1039 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.653601  1007 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:15.666160  1012 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:15.701126 32123 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
W20260709 13:13:15.667688 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 58398.9us
I20260709 13:13:15.698645 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:15.710069 32196 raft_consensus.cc:1275] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:15.710384 32120 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:15.711367 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:15.712023 32120 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:15.690486  1009 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:15.697091  1035 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:15.723268 32116 raft_consensus.cc:1275] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:15.732327  1035 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:15.732877  1035 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:15.733528  1003 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:15.728708  1106 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:13:15.724956 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:15.735013  1035 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:15.735390 32120 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
W20260709 13:13:15.730890 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:15.736363 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.739413 32124 raft_consensus.cc:1275] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:13:15.739694 32117 raft_consensus.cc:2468] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 3.
I20260709 13:13:15.739977 32124 pending_rounds.cc:85] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d: Aborting all ops after (but not including) 2
I20260709 13:13:15.740334 32124 pending_rounds.cc:107] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:13:15.736606 32120 raft_consensus.cc:1275] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:15.728418  1057 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:15.743527  1098 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:15.744383   401 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:15.745674  1057 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:15.716023 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:15.747328 32123 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
W20260709 13:13:15.748144 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.748533  1034 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:15.736265 32115 raft_consensus.cc:1275] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:13:15.748490 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:15.750312 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:15.750633 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:15.751093 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.752090 32124 raft_consensus.cc:2889] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:15.757056 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 166758us
I20260709 13:13:15.670241   753 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:15.760466 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 44765.3us
I20260709 13:13:15.713842  1012 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.697750  1039 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:15.763546 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.759938 32238 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:15.766623 32238 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:15.716830  1113 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:15.731261  1076 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:15.758057  1098 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:15.730602  1082 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:15.768622   997 raft_consensus.cc:2764] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:13:15.771670   807 raft_consensus.cc:2804] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:15.783035 32165 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6
W20260709 13:13:15.794449 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.778963 32117 raft_consensus.cc:1275] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:15.775453  1098 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:15.790879  1076 raft_consensus.cc:2764] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:13:15.806241  1098 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:15.808619  1009 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:15.782881 32238 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:15.813180  1118 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:15.813627  1118 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.813953  1118 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:15.816681  1009 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:15.823624   997 consensus_queue.cc:1048] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:15.824165  1013 raft_consensus.cc:3055] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:15.785387   807 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.774302  1033 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:15.832795   994 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:15.835222 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:15.859123 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:15.846254 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 68483.9us
W20260709 13:13:15.860146 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:15.862264 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.862365 32165 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:15.862591 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.786437   862 consensus_queue.cc:1048] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:13:15.833789   994 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:15.869517 32121 raft_consensus.cc:2393] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 3: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:15.777173  1113 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:15.824566  1013 raft_consensus.cc:740] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:15.845551   705 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.836118   807 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:15.879752  1003 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.885506   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:15.885381  1013 consensus_queue.cc:260] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:15.886894 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:15.888078 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:15.888453 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:15.873904  1076 raft_consensus.cc:2764] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:13:15.895493 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:15.896044   753 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:15.897194 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:15.884363   994 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:15.897653 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:15.896658 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:15.900432 32090 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:15.834748   815 consensus_queue.cc:1048] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:13:15.834560  1047 consensus_queue.cc:1048] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:13:15.927860 32165 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:15.894446 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:15.929368  1082 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:15.929461  1009 raft_consensus.cc:2804] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:15.930099  1009 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.930557  1009 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:15.933655  1096 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:15.936455  1026 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:15.937940  1033 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:15.938776 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:15.939464 32270 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:15.940878  1113 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:15.941061 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:15.942276  1109 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:15.944487 32165 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:15.946825   961 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:15.922525  1098 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:15.947934  1098 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:15.950711  1098 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:15.950886 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:15.951472 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:15.951812 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.956943  1013 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.959204  1012 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:15.963068 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:15.963461   986 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:15.963912 32197 raft_consensus.cc:2393] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 3: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:15.964165   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:13:15.916301  1003 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:15.964788   403 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:15.969707  1032 leader_election.cc:290] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:15.966868  1003 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:15.920845   401 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:15.973567 32019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49550 (request call id 163) took 3920 ms. Trace:
I20260709 13:13:15.917313  1122 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:15.974802  1122 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:15.977356 32022 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59534 (request call id 38) took 2833 ms. Trace:
I20260709 13:13:15.977885 32022 rpcz_store.cc:276] 0709 13:13:13.144050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.144846 (+   796us) service_pool.cc:224] Handling call
0709 13:13:13.316189 (+171343us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b5400047c54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5b090 00007fb59eff9f3a 00007fb5a4db01cc 00007fb5a4eae37e 00007fb5a336f2a4 00007fb5a336f232 00007fb5a336f161 00007fb5a336f0dc 00007fb5a336e392 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:15.977285 (+2661096us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25000,"reported_tablets":1,"spinlock_wait_cycles":360016640}
I20260709 13:13:15.944916 32118 raft_consensus.cc:1275] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:15.952327 32087 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:15.946520   930 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.002519  1012 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:16.002766 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.008000 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:15.904420   705 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.009207 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:16.014382 32266 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:15.924431  1092 raft_consensus.cc:697] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 6 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:16.015183 32270 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
W20260709 13:13:16.020027 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.020898 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:16.004146  1098 raft_consensus.cc:2764] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:13:16.022114 32120 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 2.
W20260709 13:13:16.027879 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.028064 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:15.974082 32019 rpcz_store.cc:276] 0709 13:13:12.053872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.054195 (+   323us) service_pool.cc:224] Handling call
0709 13:13:15.973439 (+3919244us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:13.916532 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:14.065991 (+149459us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:14.069405 (+  3414us) write_op.cc:435] Acquired schema lock
0709 13:13:14.073602 (+  4197us) tablet.cc:662] Decoding operations
0709 13:13:14.227079 (+153477us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:14.233868 (+  6789us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:14.235369 (+  1501us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:13:14.341429 (+106060us) tablet.cc:701] Row locks acquired
0709 13:13:14.341452 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:13:14.368655 (+ 27203us) write_op.cc:270] Start()
0709 13:13:14.375060 (+  6405us) write_op.cc:276] Timestamp: P: 1783602794359717 usec, L: 0
0709 13:13:14.377114 (+  2054us) op_driver.cc:348] REPLICATION: starting
0709 13:13:14.478081 (+100967us) log.cc:844] Serialized 2445 byte log entry
0709 13:13:14.730296 (+252215us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b18002767c0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bf043f3 00007fb59bf067c1 00007fb59bf06779 00007fb59bf06709 00007fb59bf066d1 00007fb59bf059cd 000000000038f354 000000000038f199 00007fb59bee783a
0709 13:13:14.770827 (+ 40531us) op_driver.cc:464] REPLICATION: finished
0709 13:13:14.819454 (+ 48627us) write_op.cc:301] APPLY: starting
0709 13:13:14.819539 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:14.821439 (+  1900us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:14.821461 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:14.860956 (+ 39495us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:14.894193 (+ 33237us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:13:14.894244 (+    51us) write_op.cc:312] APPLY: finished
0709 13:13:14.894589 (+   345us) log.cc:844] Serialized 52 byte log entry
0709 13:13:14.894795 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:14.902239 (+  7444us) write_op.cc:454] Released schema lock
0709 13:13:14.902304 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:14.902737 (+   433us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:14.902783 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":121586,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":48358,"apply.run_cpu_time_us":3442,"apply.run_wall_time_us":83245,"num_ops":6,"prepare.queue_time_us":382697,"prepare.run_cpu_time_us":24874,"prepare.run_wall_time_us":698879,"raft.queue_time_us":34405,"raft.run_cpu_time_us":4466,"raft.run_wall_time_us":37174,"replication_time_us":391801,"spinlock_wait_cycles":4140288,"thread_start_us":356841,"threads_started":4,"wal-append.queue_time_us":130979,"wal-append.run_cpu_time_us":15786,"wal-append.run_wall_time_us":1171101}]]}
I20260709 13:13:16.033102 32120 raft_consensus.cc:2368] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 4. Current term is 5.
I20260709 13:13:16.033118 32271 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:16.012966  1033 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.046605 32121 raft_consensus.cc:1275] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:16.047876 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:16.050637 32116 raft_consensus.cc:2368] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 for earlier term 4. Current term is 5.
I20260709 13:13:16.013335 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:16.006268  1066 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.003269  1099 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.003338  1118 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.064569  1092 consensus_queue.cc:237] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.069938  1066 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:16.070338 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:16.070587  1122 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:16.071135 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.071288 32268 raft_consensus.cc:2410] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:13:16.066102  1036 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.072144 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:16.073378  1036 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:16.073705 32266 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:16.077687 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:16.078617  1039 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.080657 32269 raft_consensus.cc:2393] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 5: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:16.082201  1009 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.082862   369 leader_election.cc:400] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 4 election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 for earlier term 4. Current term is 5.
I20260709 13:13:16.083230   369 leader_election.cc:403] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:13:16.085083  1009 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:16.087898   403 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
W20260709 13:13:16.088837  1117 log.cc:927] Time spent T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.399s	user 0.003s	sys 0.002s
I20260709 13:13:16.089008  1113 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 for earlier term 4. Current term is 5.
I20260709 13:13:16.089633 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:16.089983 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:16.090262 32118 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:16.090662 32267 raft_consensus.cc:2368] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3.
I20260709 13:13:16.090880 32236 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:13:16.091945  1044 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:16.054219  1033 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.092499 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:16.035571   994 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.100124   994 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.102231   994 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:16.103319 32116 raft_consensus.cc:1275] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:16.105417 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:16.098253   930 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:16.108834   930 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:16.109074 32118 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:13:16.109499   930 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.110258  1033 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:16.110714 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:16.112102   930 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:16.112267  1118 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:16.099601   705 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:16.103856 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:16.113145  1025 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.113189 32116 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:16.092459  1044 raft_consensus.cc:697] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:16.124727 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:16.125339 32124 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:16.116848  1099 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:16.127159 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 123814us
W20260709 13:13:16.096206 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 251820us
I20260709 13:13:16.133296 32238 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:16.134997 32238 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:16.136832 32238 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:16.121376 32272 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:16.115242  1025 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:16.144541 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.121937 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:16.122517 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:16.124053 32090 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:16.147271 32090 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:16.118099 32019 catalog_manager.cc:5697] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:16.128059 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:16.129662 32239 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:13:16.132009 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.149871 32120 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:16.121501 32021 catalog_manager.cc:5697] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 2 to 3, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 3 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:16.128978 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:16.151428 32021 catalog_manager.cc:5697] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 1 to 2, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 2 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:16.139043 32238 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:16.157433 32121 raft_consensus.cc:2393] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 4: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:16.158380 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:16.148620 32019 catalog_manager.cc:5697] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 1 to 3, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 3 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:16.165143 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:16.165452 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:16.165939 32272 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:16.169152 32238 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:16.170101 32116 raft_consensus.cc:2393] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 3: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:16.158924 32090 leader_election.cc:304] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:16.168291 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:16.175001 32267 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:16.183068 32272 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
W20260709 13:13:16.185261 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 55684.4us
I20260709 13:13:16.186208 32239 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:16.189430 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:16.189638 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:16.191097 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:16.193660 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:16.135887  1013 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:16.195472 32239 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:16.195746 32090 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:16.196934 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:16.173374  1099 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:16.200372  1106 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.172873  1118 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:16.164625   705 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:16.202538 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:16.172842  1025 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:16.172693  1009 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:16.174846 32021 catalog_manager.cc:5697] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 1 to 2, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 2 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:16.201735   807 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.197085   994 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:16.202574   980 raft_consensus.cc:2764] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:13:16.197361  1013 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.221697 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:16.250165 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:16.200417  1039 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:16.204922 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:16.214501   986 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:16.225525 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:16.226895 32194 raft_consensus.cc:1240] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:16.220858  1025 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.263782 32194 raft_consensus.cc:1275] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:13:16.264032 32269 raft_consensus.cc:2393] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 3: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:16.221704  1076 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:13:16.232220 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.217777  1118 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.216665  1130 consensus_queue.cc:1048] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:13:16.245962 32021 catalog_manager.cc:5697] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 1 to 2, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 2 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:16.221944 32120 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
I20260709 13:13:16.252360 32196 raft_consensus.cc:1217] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[3.2-3.2]   Dedup: 3.2->[]
I20260709 13:13:16.272274 32196 raft_consensus.cc:1240] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:16.272461 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:16.273132 32120 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
I20260709 13:13:16.274006 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:16.255882  1013 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:16.274712 32120 raft_consensus.cc:2393] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 3: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:16.275437 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:16.276244 32120 raft_consensus.cc:2368] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3.
I20260709 13:13:16.278244 32199 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:16.277746 32021 catalog_manager.cc:5697] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 4 to 5, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 5 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:16.252831 32124 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:16.219792   705 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.280333 32021 catalog_manager.cc:5697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 2 to 3, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 3 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:16.219893  1122 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.256810 32270 raft_consensus.cc:1240] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:16.283911 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:16.216218   706 consensus_queue.cc:1048] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:13:16.222837  1099 raft_consensus.cc:697] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 3 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:16.246803 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:16.287621 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:16.226166  1032 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:16.218587  1066 consensus_queue.cc:1048] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
W20260709 13:13:16.267648 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.258394  1015 consensus_queue.cc:1048] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:13:16.291303  1099 consensus_queue.cc:237] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.219568  1027 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:16.292778  1027 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.248167   994 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.293836   994 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:16.254488  1026 consensus_queue.cc:1048] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:13:16.297053  1032 raft_consensus.cc:697] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 4 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:16.291313   862 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:13:16.284055   705 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:16.298048  1032 consensus_queue.cc:237] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.293180  1027 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:16.265691   830 consensus_queue.cc:1048] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:13:16.281328   930 raft_consensus.cc:2764] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 13:13:16.270356 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 63980.2us
I20260709 13:13:16.281375  1109 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.309672  1109 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.247754  1009 raft_consensus.cc:697] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 3 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:16.313014  1013 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.313232  1009 consensus_queue.cc:237] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.223088  1106 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.277537 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:16.282413 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:16.262542   986 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.266113  1025 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:16.217742 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:16.221364  1003 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.285425 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:16.285830 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:16.512878 32124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:42262
I20260709 13:13:16.513237 32122 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
I20260709 13:13:16.285673 32021 catalog_manager.cc:5697] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 2 to 3, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 3 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:16.513911 32124 raft_consensus.cc:606] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:16.514534 32124 raft_consensus.cc:614] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:16.515014 32021 catalog_manager.cc:5697] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 2 to 3, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 3 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:16.288360 32196 raft_consensus.cc:2368] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 2. Current term is 3.
I20260709 13:13:16.288524 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:16.516911 32199 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:16.289352 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:16.215456  1044 consensus_queue.cc:237] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:16.293265 32239 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:16.271080  1118 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:16.213711 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:16.393155 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:16.276918   961 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:16.527659 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 234466us
W20260709 13:13:16.503628 32089 leader_election.cc:336] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.613s (SENT)
W20260709 13:13:16.506111 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.529148 32089 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:16.271256  1039 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.232s
I20260709 13:13:16.524315 32021 catalog_manager.cc:5697] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 1 to 2, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 2 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:16.271729  1076 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.533794 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:16.549782 32194 raft_consensus.cc:2410] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 13:13:16.551584 32120 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
I20260709 13:13:16.281153   815 consensus_queue.cc:1048] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.233s
I20260709 13:13:16.555116 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:16.555980 32196 raft_consensus.cc:2393] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 3: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:16.532086 32021 catalog_manager.cc:5697] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 1 to 2, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 2 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:16.553937 32120 raft_consensus.cc:1240] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:16.558322 32021 catalog_manager.cc:5697] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 1 to 2, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 2 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:16.505180   986 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:16.511967   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 119802us
I20260709 13:13:16.588045 32021 catalog_manager.cc:5697] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 1 to 2, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 2 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:16.572566 32199 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
W20260709 13:13:16.582340 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.567358   980 consensus_queue.cc:1048] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:13:16.288564  1122 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.573246 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:16.625284 32194 raft_consensus.cc:2410] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
W20260709 13:13:16.585738 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 82159.1us
W20260709 13:13:16.626243 32089 leader_election.cc:336] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.623s (SENT)
I20260709 13:13:16.626720 32089 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:16.628013 32089 leader_election.cc:336] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.957s (SENT)
I20260709 13:13:16.590024 32120 raft_consensus.cc:1240] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 6 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 4. Current term is 6. Ops: []
I20260709 13:13:16.592042  1109 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:16.555333   961 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.543152  1036 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:16.573591 32195 raft_consensus.cc:1275] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:13:16.582428   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 76530.3us
I20260709 13:13:16.566850   807 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:16.612190 32197 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:16.531368  1065 consensus_queue.cc:1048] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:13:16.621495 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:16.644786 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:16.597337 32118 raft_consensus.cc:2393] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 3: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:13:16.536099  1003 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.635073 32120 raft_consensus.cc:1240] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:16.567704  1026 consensus_queue.cc:1048] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:13:16.637534 32089 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:16.597308  1035 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:16.564478 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:16.581281  1066 consensus_queue.cc:1048] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:13:16.658644 32197 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:16.711982 32193 raft_consensus.cc:1275] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:16.638882  1109 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.666949   930 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:16.678330  1076 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:16.679689  1106 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:16.681866 32116 raft_consensus.cc:1240] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3. Ops: []
W20260709 13:13:16.686043 32271 consensus_meta.cc:287] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.560s	user 0.006s	sys 0.002s
I20260709 13:13:16.723893 32271 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
W20260709 13:13:16.705152 32273 consensus_meta.cc:287] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.509s	user 0.006s	sys 0.010s
I20260709 13:13:16.724726 32273 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
W20260709 13:13:16.724838 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 96866us
I20260709 13:13:16.709095   705 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.716562 32123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1040) took 1094 ms. Trace:
I20260709 13:13:16.726121 32123 rpcz_store.cc:276] 0709 13:13:15.621953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.291135 (+669182us) service_pool.cc:224] Handling call
0709 13:13:16.291395 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:16.291584 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:16.291857 (+   273us) log.cc:844] Serialized 14 byte log entry
0709 13:13:16.716091 (+424234us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:16.716165 (+    74us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:16.716228 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:16.716324 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:16.716489 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25318,"prepare.queue_time_us":1733,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":26045,"thread_start_us":397848,"threads_started":1}
I20260709 13:13:16.727543   705 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:16.727710 32089 leader_election.cc:336] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.973s (SENT)
I20260709 13:13:16.722565 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:16.729031 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:16.730032 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:16.730685 32197 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:16.658463  1013 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:16.728304 32089 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:16.736322 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:16.737175 32193 raft_consensus.cc:2376] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4. Re-sending same reply.
I20260709 13:13:16.732554  1099 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:16.744134 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:16.745067 32197 raft_consensus.cc:2410] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 13:13:16.748517   961 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:16.749948 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:16.750620 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:16.751061 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:16.751412 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.751305 32116 raft_consensus.cc:1275] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:13:16.760434 32266 raft_consensus.cc:1240] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:16.762444 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:16.774688 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:16.775316 32197 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:16.729256  1076 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.782282 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:16.784061 32197 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:16.785254 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:16.786008 32197 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:13:16.778949 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:16.757422   961 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:13:16.792223 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.723112  1109 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.773967  1106 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:16.779819  1128 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:16.794710   961 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.800549  1147 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:16.792335  1076 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.825788 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:16.802583  1106 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.829634 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:16.831314 32271 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 3.
W20260709 13:13:16.823182   994 consensus_meta.cc:287] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.001s
I20260709 13:13:16.835594 32195 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:16.835800 32266 raft_consensus.cc:1275] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:16.838922 32193 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:16.854301 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:16.855216 32193 raft_consensus.cc:2468] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:16.821936  1147 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:13:16.844158 32197 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:16.865195 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:16.867054 32197 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:16.872817 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:16.837441   994 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.876855 32238 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:16.855474  1003 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:16.887509 32272 raft_consensus.cc:2393] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 4: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:16.873637 32193 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:16.870967   830 consensus_queue.cc:1048] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:13:16.881640  1146 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:16.902611 32197 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:16.870033   369 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:16.879307   705 consensus_queue.cc:1048] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:13:16.901050 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:16.890661  1039 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:16.910817  1039 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.911293  1039 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:16.909471 32193 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:16.894795  1109 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:16.907131 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 351026us
I20260709 13:13:16.914120 32090 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:16.915758 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:16.917665 32197 raft_consensus.cc:2393] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 4: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:16.918334 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:16.937551 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:16.959892 32120 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:16.917073  1113 raft_consensus.cc:2804] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:16.904094  1146 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.918025  1033 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:13:16.945688   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 90647.2us
I20260709 13:13:16.952872 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:16.915601  1118 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:16.958691   994 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:16.933480  1076 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:16.955217 32121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1044) took 1123 ms. Trace:
I20260709 13:13:16.978507 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:16.979957 32197 raft_consensus.cc:2410] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:13:16.956959 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:16.980718 32190 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:16.958274 32266 raft_consensus.cc:1275] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:16.961210 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:16.982270 32120 raft_consensus.cc:2393] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 5: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:16.953634 32122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1041) took 1331 ms. Trace:
I20260709 13:13:16.982582 32122 rpcz_store.cc:276] 0709 13:13:15.622306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.527256 (+904950us) service_pool.cc:224] Handling call
0709 13:13:16.527549 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:16.585589 (+ 58040us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:16.585621 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:16.617172 (+ 31551us) log.cc:844] Serialized 26 byte log entry
0709 13:13:16.881796 (+264624us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:16.881849 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:16.881939 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:16.953411 (+ 71472us) raft_consensus.cc:1685] finished
0709 13:13:16.953431 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:16.953574 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57676,"raft.queue_time_us":69778,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":16686,"thread_start_us":241521,"threads_started":1,"wal-append.queue_time_us":313235}
I20260709 13:13:16.985877 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:13:16.986126 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.986501 32120 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:16.986764 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.987972 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:16.988214 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:16.988631 32122 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:16.978253 32121 rpcz_store.cc:276] 0709 13:13:15.831704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.538152 (+706448us) service_pool.cc:224] Handling call
0709 13:13:16.538593 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:16.585766 (+ 47173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:16.585809 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:16.586347 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 13:13:16.744007 (+157660us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b480027e4d8. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a3f1aaa1 00007fb5a3f11b37 00007fb5a3f119ca 00007fb5a400926f 00007fb5a4008f37 00007fb5a401d55c 00007fb5a401d508 00007fb5a401d488 00007fb5a401d443 00007fb5a401c6ec 00007fb5a2f46a96
0709 13:13:16.855494 (+111487us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:16.855537 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:16.855609 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:16.954947 (+ 99338us) raft_consensus.cc:1685] finished
0709 13:13:16.954966 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:16.955159 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46718,"raft.queue_time_us":59055,"raft.run_cpu_time_us":1283,"raft.run_wall_time_us":143566,"spinlock_wait_cycles":57404288,"thread_start_us":223768,"threads_started":1,"wal-append.queue_time_us":349130}
I20260709 13:13:16.989885 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:16.959605  1106 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:16.990338 32121 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:16.965692  1113 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:16.994719 32268 raft_consensus.cc:2393] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 3: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:16.995154 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:16.996377 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:16.997385 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:16.999187 32123 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:17.000183 32121 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:17.001148 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:17.001773 32121 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:17.002611 32197 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:17.004010 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:17.005626 32197 raft_consensus.cc:2393] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 3: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:17.010571 32122 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:17.011940 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:17.012624 32122 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:17.017848 32120 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
W20260709 13:13:17.023160 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.024070 32239 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:17.026623  1146 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:17.026760 32239 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:17.027513 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:17.028221 32191 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:17.027594 32239 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:17.029506 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:17.029536 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:17.029606 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:17.030406 32190 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:17.030493 32120 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:17.042614  1027 consensus_meta.cc:287] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.741s	user 0.008s	sys 0.003s
I20260709 13:13:17.043205  1027 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:17.044553 32265 raft_consensus.cc:2393] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 4: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:17.022704  1147 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:16.999858  1113 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:17.046705 32122 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:17.047374  1118 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:17.048130 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:17.048866 32122 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:16.993366  1033 raft_consensus.cc:697] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:17.049189   986 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:17.049633 32115 raft_consensus.cc:1240] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:17.050024  1033 consensus_queue.cc:237] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:17.050726  1027 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:17.050128 32124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1042) took 1220 ms. Trace:
I20260709 13:13:17.052093 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:17.039862  1065 consensus_queue.cc:1048] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:13:17.052882 32196 raft_consensus.cc:2376] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3. Re-sending same reply.
I20260709 13:13:17.051375 32124 rpcz_store.cc:276] 0709 13:13:15.829892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.526657 (+696765us) service_pool.cc:224] Handling call
0709 13:13:16.526998 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:16.666634 (+139636us) spinlock_profiling.cc:243] Waited 6.41 ms on lock 0x7b480027e4d8. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a3f1aaa1 00007fb5a3f11b37 00007fb5a3f119ca 00007fb5a400926f 00007fb5a4008f37 00007fb5a401d55c 00007fb5a401d508 00007fb5a401d488 00007fb5a401d443 00007fb5a401c6ec 00007fb5a2f46a96
0709 13:13:16.902685 (+236051us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:16.902717 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:16.932897 (+ 30180us) log.cc:844] Serialized 26 byte log entry
0709 13:13:17.020806 (+ 87909us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:17.020843 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.031632 (+ 10789us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:17.049317 (+ 17685us) raft_consensus.cc:1685] finished
0709 13:13:17.049335 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:17.050066 (+   731us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72548,"raft.queue_time_us":78862,"raft.run_cpu_time_us":2474,"raft.run_wall_time_us":50892,"spinlock_wait_cycles":14741376,"thread_start_us":365454,"threads_started":2,"wal-append.queue_time_us":90047}
I20260709 13:13:17.053735 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:17.054126 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:17.054780 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:17.055485 32196 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
W20260709 13:13:17.055819  1025 consensus_meta.cc:287] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.529s	user 0.004s	sys 0.004s
I20260709 13:13:17.044009  1039 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:17.054870 32124 raft_consensus.cc:2393] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 3: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:17.051429   986 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:17.056265 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:17.058480 32119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1043) took 1227 ms. Trace:
I20260709 13:13:17.058777 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:17.058887 32196 raft_consensus.cc:2410] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:17.059532 32198 raft_consensus.cc:2368] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 2. Current term is 3.
I20260709 13:13:17.060248 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:17.058851 32119 rpcz_store.cc:276] 0709 13:13:15.831362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.532360 (+700998us) service_pool.cc:224] Handling call
0709 13:13:16.575240 (+ 42880us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:16.585897 (+ 10657us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:16.585930 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:16.601065 (+ 15135us) log.cc:844] Serialized 26 byte log entry
0709 13:13:16.670227 (+ 69162us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b480027e4d8. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a3f1aaa1 00007fb5a3f11b37 00007fb5a3f119ca 00007fb5a400926f 00007fb5a4008f37 00007fb5a401d55c 00007fb5a401d508 00007fb5a401d488 00007fb5a401d443 00007fb5a401c6ec 00007fb5a2f46a96
0709 13:13:16.917476 (+247249us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:16.917526 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:16.917588 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:17.058084 (+140496us) raft_consensus.cc:1685] finished
0709 13:13:17.058107 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:17.058416 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10208,"raft.queue_time_us":24169,"raft.run_cpu_time_us":1168,"raft.run_wall_time_us":62743,"spinlock_wait_cycles":59296640,"thread_start_us":232450,"threads_started":1,"wal-append.queue_time_us":379168}
I20260709 13:13:17.062083  1065 consensus_queue.cc:1048] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:17.062682   705 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:17.063112   705 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.063380 32122 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:17.063467   705 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:17.060391 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:17.075975 32190 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:17.078799 32198 raft_consensus.cc:2393] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 3: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
W20260709 13:13:17.081228 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 53721.4us
I20260709 13:13:17.082000 32239 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:17.082779 32120 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:17.082855 32239 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:17.079991 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:17.084725 32198 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:17.084004 32239 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:17.085932 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:17.087801 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:17.088454 32198 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:17.091857 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.093406 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:17.056231  1025 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:17.101814   986 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:17.095283 32190 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:17.109826 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:17.069653  1076 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.110860 32239 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:17.110822 32190 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:17.114703 32239 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:17.091650  1066 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:17.102224  1027 raft_consensus.cc:2804] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:17.102075  1044 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:17.121289 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:17.122174 32192 raft_consensus.cc:2393] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 5: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:17.122224 32267 raft_consensus.cc:2393] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 4: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:17.115406 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:17.123214 32190 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:17.119103  1066 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.126783 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:17.127696 32192 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:17.121430   994 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:17.115875   986 raft_consensus.cc:697] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:17.171271 32123 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:17.125083   807 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:17.177712 32190 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:17.028182  1149 raft_consensus.cc:2804] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:17.181859 32196 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:17.191461 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:17.189425 32239 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:17.129959  1066 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:17.119933  1076 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:17.213959 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:17.192531 32190 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:17.201668 32197 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:17.204175 32196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:13:17.215934 32196 raft_consensus.cc:606] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:17.183615 32192 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:17.163457  1039 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:17.210342  1122 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:17.216442 32196 raft_consensus.cc:614] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:17.218353 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:17.224032 32123 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:17.222955 32192 raft_consensus.cc:1240] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:17.039629  1153 consensus_queue.cc:1048] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.175s
I20260709 13:13:17.236913 32196 raft_consensus.cc:1240] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:17.193467  1149 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.240862  1149 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:17.190771  1027 raft_consensus.cc:697] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:17.261083 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:13:17.273103 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.274701 32196 raft_consensus.cc:1275] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:17.234380  1118 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:17.267549 32123 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:17.280933 32192 raft_consensus.cc:1275] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 13:13:17.281417 32192 pending_rounds.cc:85] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 1
I20260709 13:13:17.281736 32192 pending_rounds.cc:107] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 4.2
W20260709 13:13:17.281872  1145 log.cc:927] Time spent T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.469s	user 0.001s	sys 0.000s
I20260709 13:13:17.282055 32192 raft_consensus.cc:2889] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:17.285655 32198 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:17.286864 32198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:43952
W20260709 13:13:17.289981 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:17.309533 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 127853us
I20260709 13:13:17.326412 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:13:17.336052 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.346625 32116 raft_consensus.cc:2393] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 3: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:17.355515 32121 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
W20260709 13:13:17.372051 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.372206 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:17.372933 32121 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:17.310587  1118 raft_consensus.cc:697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:17.310066  1044 raft_consensus.cc:697] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:17.315620  1147 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.453804 32121 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
W20260709 13:13:17.389829  1163 log.cc:927] Time spent T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7: Append to log took a long time: real 0.361s	user 0.000s	sys 0.002s
I20260709 13:13:17.455075 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:17.459293 32198 raft_consensus.cc:606] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:17.460830 32198 raft_consensus.cc:614] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:17.461033 32116 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:17.502965 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.412395   994 raft_consensus.cc:697] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:17.317806   986 consensus_queue.cc:237] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:17.517239  1174 log.cc:927] Time spent T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:13:17.458093  1025 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:17.523645 32238 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:17.524570 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.529191 32116 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:17.511670 32191 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
W20260709 13:13:17.516332  1166 log.cc:927] Time spent T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.342s	user 0.000s	sys 0.001s
I20260709 13:13:17.505195  1065 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:17.519737  1182 log.cc:927] Time spent T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:13:17.554518 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:17.561118 32191 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:17.477607  1147 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:17.524883  1106 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.564124  1065 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:13:17.567799  1177 log.cc:927] Time spent T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:13:17.415827  1027 consensus_queue.cc:237] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:17.568428   994 consensus_queue.cc:237] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:17.569043   705 consensus_meta.cc:287] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.504s	user 0.007s	sys 0.003s
I20260709 13:13:17.570510 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:17.570963  1147 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:17.572649 32199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1009) took 1259 ms. Trace:
I20260709 13:13:17.574193 32272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36080 (request call id 861) took 1380 ms. Trace:
I20260709 13:13:17.574453 32197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1013) took 1260 ms. Trace:
I20260709 13:13:17.575039  1076 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:17.591934 32191 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:17.596472 32198 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:17.602386 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.598086 32115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 892) took 1509 ms. Trace:
I20260709 13:13:17.597841 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:17.597325 32199 rpcz_store.cc:276] 0709 13:13:16.313479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.623213 (+309734us) service_pool.cc:224] Handling call
0709 13:13:16.623683 (+   470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:16.906156 (+282473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:16.906183 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:16.906599 (+   416us) log.cc:844] Serialized 26 byte log entry
0709 13:13:17.077426 (+170827us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:17.077465 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.077535 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:17.572427 (+494892us) raft_consensus.cc:1685] finished
0709 13:13:17.572442 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:17.572566 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":118930,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"thread_start_us":448484,"threads_started":2,"wal-append.queue_time_us":194146}
I20260709 13:13:17.598116 32272 rpcz_store.cc:276] 0709 13:13:16.199175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.213336 (+ 14161us) service_pool.cc:224] Handling call
0709 13:13:17.573899 (+1360563us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b54002b6bd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:17.574076 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":828038912}
I20260709 13:13:17.598272 32197 rpcz_store.cc:276] 0709 13:13:16.314494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.229461 (+914967us) service_pool.cc:224] Handling call
0709 13:13:17.230572 (+  1111us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:17.231339 (+   767us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:17.231380 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:17.231956 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 13:13:17.455867 (+223911us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:17.455930 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.456095 (+   165us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:17.574239 (+118144us) raft_consensus.cc:1685] finished
0709 13:13:17.574261 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:17.574396 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":156,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":18458,"thread_start_us":150238,"threads_started":1,"wal-append.queue_time_us":281563}
I20260709 13:13:17.605654 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:17.606235 32199 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:17.607370 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:17.608053 32191 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:17.604089 32115 rpcz_store.cc:276] 0709 13:13:16.088539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.574247 (+485708us) service_pool.cc:224] Handling call
0709 13:13:17.049478 (+475231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:17.050495 (+  1017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.597888 (+547393us) spinlock_profiling.cc:243] Waited 461 ms on lock 0x7b5400205b50. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff08ad 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:17.598034 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1059689856}
I20260709 13:13:17.582413  1025 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:17.610076 32238 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:17.606114 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:17.525602  1149 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:17.613385 32198 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:17.617815 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:17.618469 32198 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:17.585510   807 raft_consensus.cc:697] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:17.613440 32197 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:17.633910 32194 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:17.634904 32120 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.008s	sys 0.013s
I20260709 13:13:17.583009  1106 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:17.639511  1113 consensus_meta.cc:287] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6: Time spent flushing consensus metadata: real 0.593s	user 0.010s	sys 0.000s
I20260709 13:13:17.564896  1118 consensus_queue.cc:237] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:17.597819  1044 consensus_queue.cc:237] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:17.600911   705 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:17.641924  1065 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:17.642501 32197 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:17.643162  1149 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:13:17.644994  1142 log.cc:927] Time spent T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.985s	user 0.000s	sys 0.006s
I20260709 13:13:17.645179   807 consensus_queue.cc:237] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:17.622323  1025 raft_consensus.cc:697] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:17.647859 32196 raft_consensus.cc:1275] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:17.648011 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:17.703748 32195 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:17.618907  1187 raft_consensus.cc:2804] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:17.649704 32193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:43952
W20260709 13:13:17.672803 32120 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.008s	sys 0.013s
I20260709 13:13:17.674194 32199 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:17.677325 32198 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:17.714991 32194 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
W20260709 13:13:17.674110  1184 log.cc:927] Time spent T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 13:13:17.698019 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.711954  1066 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:17.724498 32267 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36080 (request call id 862) took 1524 ms (client timeout 1885 ms). Trace:
W20260709 13:13:17.725107 32267 rpcz_store.cc:269] 0709 13:13:16.199619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.199733 (+   114us) service_pool.cc:224] Handling call
0709 13:13:16.533647 (+333914us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b5800187898. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59beccb71 00007fb59becca22 00007fb5a4de5c09 00007fb5a3f3fee0 00007fb5a40090ab 00007fb5a4009131 00007fb5a3fb70a0 00007fb5a3fb6984 00007fb59d5316d4 00007fb59d531662
0709 13:13:17.724221 (+1190574us) spinlock_profiling.cc:243] Waited 587 ms on lock 0x7b54002b7fd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:17.724418 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1355891840}
W20260709 13:13:17.735494 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 112255us
I20260709 13:13:17.736418 32195 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:17.736690 32238 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:17.736974 32193 raft_consensus.cc:606] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:17.737304 32193 raft_consensus.cc:614] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:17.747432 32191 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:17.690608  1113 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:17.729048  1187 raft_consensus.cc:697] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:13:17.772454 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.777679 32192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1019) took 1085 ms. Trace:
W20260709 13:13:17.768329   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 213062us
I20260709 13:13:17.775631 32191 raft_consensus.cc:1275] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:17.778223 32192 rpcz_store.cc:276] 0709 13:13:16.692651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.283363 (+590712us) service_pool.cc:224] Handling call
0709 13:13:17.283689 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:17.284005 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:17.284032 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:17.284484 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:13:17.386284 (+101800us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:17.386348 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.386449 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:17.777405 (+390956us) raft_consensus.cc:1685] finished
0709 13:13:17.777433 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:17.777606 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":461,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":5109,"thread_start_us":100192,"threads_started":1,"wal-append.queue_time_us":199057}
I20260709 13:13:17.721575  1025 consensus_queue.cc:237] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:17.749737  1181 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:17.788004 32238 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:17.790840  1181 raft_consensus.cc:697] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:17.793754  1181 consensus_queue.cc:237] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:17.799593 32238 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:17.806842 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:17.807612 32119 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 3.
W20260709 13:13:17.809307  1190 log.cc:927] Time spent T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:13:17.786513 32118 raft_consensus.cc:1240] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 3 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:17.826431  1106 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:17.832788   369 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:17.810591   830 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:17.841267 32238 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:17.846392 32238 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:17.847601 32238 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:13:17.837322  1185 log.cc:927] Time spent T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:13:17.856019   706 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:13:17.854780   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 49687.7us
I20260709 13:13:17.874472 32190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1011) took 1560 ms. Trace:
I20260709 13:13:17.856331  1039 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:17.875051 32190 rpcz_store.cc:276] 0709 13:13:16.313971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.221295 (+907324us) service_pool.cc:224] Handling call
0709 13:13:17.221644 (+   349us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:17.221997 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:17.222026 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:17.251266 (+ 29240us) log.cc:844] Serialized 52 byte log entry
0709 13:13:17.459056 (+207790us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:17.459111 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.459771 (+   660us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:17.571711 (+111940us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b4800002958. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a3f1aaa1 00007fb5a3f11b37 00007fb5a3f119ca 00007fb5a400926f 00007fb5a4008f37 00007fb5a401d55c 00007fb5a401d508 00007fb5a401d488 00007fb5a401d443 00007fb5a401c6ec 00007fb5a2f46a96
0709 13:13:17.871237 (+299526us) raft_consensus.cc:1685] finished
0709 13:13:17.871256 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:17.874406 (+  3150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6109,"raft.run_cpu_time_us":8432,"raft.run_wall_time_us":338158,"spinlock_wait_cycles":43381632,"thread_start_us":173953,"threads_started":1,"wal-append.queue_time_us":323999}
I20260709 13:13:17.858327   994 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:17.867996   705 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:17.880822 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.877202   986 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:17.846494  1187 consensus_queue.cc:237] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:17.881753  1039 raft_consensus.cc:697] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:13:17.902379 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.885237  1066 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:17.919299  1039 consensus_queue.cc:237] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:17.921397   961 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:17.925367 32197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1022) took 1180 ms. Trace:
I20260709 13:13:17.925876 32197 rpcz_store.cc:276] 0709 13:13:16.744538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.699052 (+954514us) service_pool.cc:224] Handling call
0709 13:13:17.699506 (+   454us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:17.700006 (+   500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:17.700054 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:17.710103 (+ 10049us) log.cc:844] Serialized 52 byte log entry
0709 13:13:17.800122 (+ 90019us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:17.800161 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.800225 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:17.925150 (+124925us) raft_consensus.cc:1685] finished
0709 13:13:17.925170 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:17.925309 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2913,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":6677,"thread_start_us":79180,"threads_started":1,"wal-append.queue_time_us":198091}
W20260709 13:13:17.917086  1193 log.cc:927] Time spent T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:13:17.907784   986 raft_consensus.cc:697] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:17.969187 32271 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:13:17.932004  1206 log.cc:927] Time spent T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:13:17.895857  1217 consensus_queue.cc:1048] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
W20260709 13:13:17.989042 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 127930us
I20260709 13:13:17.976619   706 raft_consensus.cc:697] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:13:18.028044 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.985075   830 raft_consensus.cc:697] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:13:18.047382 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.005399   994 raft_consensus.cc:697] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:18.023389  1092 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:13:18.065529  1033 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:18.067662  1214 log.cc:927] Time spent T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:13:18.067500  1033 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:18.067961  1217 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:18.068408  1217 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.068955 32194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1033) took 1277 ms. Trace:
I20260709 13:13:18.069017 32192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1035) took 1232 ms. Trace:
I20260709 13:13:18.069695 32192 rpcz_store.cc:276] 0709 13:13:16.836774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.787621 (+950847us) service_pool.cc:224] Handling call
0709 13:13:17.790866 (+  3245us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:17.791280 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:13:17.791311 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:17.792700 (+  1389us) log.cc:844] Serialized 26 byte log entry
0709 13:13:17.835020 (+ 42320us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:17.835091 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.835282 (+   191us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:18.068845 (+233563us) raft_consensus.cc:1685] finished
0709 13:13:18.068863 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:18.068966 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":540,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"thread_start_us":41620,"threads_started":1,"wal-append.queue_time_us":175961}
I20260709 13:13:18.069586 32194 rpcz_store.cc:276] 0709 13:13:16.791197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.716014 (+924817us) service_pool.cc:224] Handling call
0709 13:13:17.717059 (+  1045us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:17.728379 (+ 11320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:17.728425 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:17.732148 (+  3723us) log.cc:844] Serialized 26 byte log entry
0709 13:13:17.869357 (+137209us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:17.869442 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.869613 (+   171us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:18.068740 (+199127us) raft_consensus.cc:1685] finished
0709 13:13:18.068760 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:18.068898 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":396,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":5561,"thread_start_us":98594,"threads_started":1,"wal-append.queue_time_us":238884}
I20260709 13:13:18.071919 32199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1023) took 1327 ms. Trace:
I20260709 13:13:18.072669 32199 rpcz_store.cc:276] 0709 13:13:16.744891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.712614 (+967723us) service_pool.cc:224] Handling call
0709 13:13:17.713087 (+   473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:17.719265 (+  6178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:17.719309 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:17.729037 (+  9728us) log.cc:844] Serialized 26 byte log entry
0709 13:13:17.814667 (+ 85630us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:17.814729 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.814836 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:18.027193 (+212357us) raft_consensus.cc:1685] finished
0709 13:13:18.027215 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:18.071863 (+ 44648us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3411,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":9721,"thread_start_us":46219,"threads_started":1,"wal-append.queue_time_us":137886}
I20260709 13:13:18.074536  1217 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:18.043823  1206 log.cc:927] Time spent T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:13:18.081394 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:18.084381 32194 raft_consensus.cc:2393] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 3: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:18.085374 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:13:18.066375  1207 log.cc:927] Time spent T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:13:18.086400 32199 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:18.023039   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 192170us
I20260709 13:13:18.092196 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:18.092840 32192 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:18.099526 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:18.100342 32194 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:18.101524 32122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1070) took 1114 ms. Trace:
I20260709 13:13:18.073329  1113 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:18.101951 32122 rpcz_store.cc:276] 0709 13:13:16.987179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.831920 (+844741us) service_pool.cc:224] Handling call
0709 13:13:17.832257 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:17.855769 (+ 23512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:17.856097 (+   328us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:17.870493 (+ 14396us) log.cc:844] Serialized 26 byte log entry
0709 13:13:17.933767 (+ 63274us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:17.933834 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.941140 (+  7306us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:18.101292 (+160152us) raft_consensus.cc:1685] finished
0709 13:13:18.101313 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:18.101461 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1139,"raft.queue_time_us":1395,"spinlock_wait_cycles":26844032,"thread_start_us":48705,"threads_started":1,"wal-append.queue_time_us":202907}
I20260709 13:13:18.107246 32122 raft_consensus.cc:1275] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:13:18.107780 32122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1073) took 1090 ms. Trace:
I20260709 13:13:18.108078 32122 rpcz_store.cc:276] 0709 13:13:17.017597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.106603 (+1089006us) service_pool.cc:224] Handling call
0709 13:13:18.106988 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:18.107550 (+   562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:18.107727 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:18.115695 32124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1061) took 1161 ms. Trace:
I20260709 13:13:18.116182 32124 rpcz_store.cc:276] 0709 13:13:16.954422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.519507 (+565085us) service_pool.cc:224] Handling call
0709 13:13:17.519854 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:17.520245 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:17.688638 (+168393us) log.cc:844] Serialized 14 byte log entry
0709 13:13:17.787588 (+ 98950us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:17.788171 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 13:13:17.788290 (+   119us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:17.788320 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.788385 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:18.115489 (+327104us) raft_consensus.cc:1685] finished
0709 13:13:18.115508 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:18.115624 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":211230,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":3941,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":12965,"thread_start_us":252023,"threads_started":2,"wal-append.queue_time_us":121292}
I20260709 13:13:18.122991 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:18.123450 32199 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:18.124114 32124 raft_consensus.cc:2393] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 3: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
W20260709 13:13:18.112459  1213 log.cc:927] Time spent T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:13:18.066711   706 consensus_queue.cc:237] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:18.129802 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:18.112399  1092 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:18.132516 32124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1075) took 1015 ms. Trace:
W20260709 13:13:18.125473 32265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36080 (request call id 868) took 1816 ms (client timeout 1848 ms). Trace:
W20260709 13:13:18.138759 32265 rpcz_store.cc:269] 0709 13:13:16.317835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.505231 (+187396us) service_pool.cc:224] Handling call
0709 13:13:18.125215 (+1619984us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b54004277d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:18.125408 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":749077248}
I20260709 13:13:18.139757  1217 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:18.144294   369 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:18.145867 32123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1079) took 1024 ms. Trace:
I20260709 13:13:18.146317 32123 rpcz_store.cc:276] 0709 13:13:17.121508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.144886 (+1023378us) service_pool.cc:224] Handling call
0709 13:13:18.145247 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:18.145510 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:18.145548 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:18.145603 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:18.145635 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:18.145691 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:18.145803 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:18.152215 32165 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:54172 dropped due to backpressure: service queue is full with 50 items
I20260709 13:13:18.152549 32165 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:54172 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1055)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1056)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1058)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1060)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1061)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1062)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56926 (request call id 38)
I20260709 13:13:18.132339   830 consensus_queue.cc:237] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:18.156344 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.148363 32123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1080) took 1026 ms. Trace:
I20260709 13:13:18.161124 32123 rpcz_store.cc:276] 0709 13:13:17.122291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.147445 (+1025154us) service_pool.cc:224] Handling call
0709 13:13:18.147809 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:18.148002 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:18.148030 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:18.148077 (+    47us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:18.148112 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:18.148168 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:18.148286 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:18.133536 32124 rpcz_store.cc:276] 0709 13:13:17.117345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.128505 (+1011160us) service_pool.cc:224] Handling call
0709 13:13:18.132017 (+  3512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:18.132200 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:18.132225 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:18.132266 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:18.132297 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:18.132355 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:18.132460 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:18.137329 32268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36084 (request call id 907) took 1994 ms. Trace:
I20260709 13:13:18.137415 32115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1067) took 1181 ms. Trace:
I20260709 13:13:18.112532  1033 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:18.098196   986 consensus_queue.cc:237] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:18.142184 32117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1028) took 2788 ms. Trace:
I20260709 13:13:18.162827 32268 rpcz_store.cc:276] 0709 13:13:16.143008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.143146 (+   138us) service_pool.cc:224] Handling call
0709 13:13:18.137101 (+1993955us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b54002b8ed4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:18.137273 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1850131328}
I20260709 13:13:18.163424 32192 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:18.163064 32115 rpcz_store.cc:276] 0709 13:13:16.956119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.616438 (+660319us) service_pool.cc:224] Handling call
0709 13:13:17.631052 (+ 14614us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:17.631599 (+   547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:17.631638 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:17.691749 (+ 60111us) log.cc:844] Serialized 52 byte log entry
0709 13:13:17.785291 (+ 93542us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:17.785340 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.785415 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:18.137215 (+351800us) raft_consensus.cc:1685] finished
0709 13:13:18.137234 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:18.137360 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":143,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":10515,"thread_start_us":67761,"threads_started":1,"wal-append.queue_time_us":168915}
I20260709 13:13:18.179119 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:13:18.167258 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.179888 32192 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:18.179281 32194 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:18.181624 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:18.182216 32266 raft_consensus.cc:1240] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:18.182694 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:18.183111 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:18.183429 32192 raft_consensus.cc:2393] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 3: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:18.185292 32194 raft_consensus.cc:2368] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 4. Current term is 5.
I20260709 13:13:18.125264   994 consensus_queue.cc:237] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:18.186065 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:18.189157  1217 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:18.189065   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:18.186990  1230 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:18.206275   403 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:18.208611 32087 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:18.162674  1092 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:18.178387 32117 rpcz_store.cc:276] 0709 13:13:15.353601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.871048 (+517447us) service_pool.cc:224] Handling call
0709 13:13:15.918817 (+ 47769us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:16.004026 (+ 85209us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:16.036027 (+ 32001us) log.cc:844] Serialized 14 byte log entry
0709 13:13:16.212190 (+176163us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:16.212279 (+    89us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:16.212360 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:16.774972 (+562612us) spinlock_profiling.cc:243] Waited 8.68 ms on lock 0x7b1800333100. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bed22a6 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419
0709 13:13:18.141883 (+1366911us) spinlock_profiling.cc:243] Waited 58.8 ms on lock 0x7b5400035cd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:18.141942 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:18.142098 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":228,"prepare.queue_time_us":23152,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":128,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":3934,"spinlock_wait_cycles":155219072,"thread_start_us":156353,"threads_started":1,"wal-append.queue_time_us":219385,"wal-append.run_cpu_time_us":1109,"wal-append.run_wall_time_us":1009803}
I20260709 13:13:18.228839 32192 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:18.218004 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:18.259788 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:18.260067 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:18.260677 32268 raft_consensus.cc:1275] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:18.260939 32117 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:18.261335 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:18.261685 32194 raft_consensus.cc:2368] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4.
I20260709 13:13:18.262326 32192 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:18.264395 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:18.273517 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:18.276057 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:18.233055  1033 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:18.302418 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:18.302626 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:18.305967 32194 raft_consensus.cc:2393] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 3: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:18.307325 32117 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 4.
I20260709 13:13:18.297495  1033 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.362366 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:18.351213 32119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1068) took 1373 ms. Trace:
I20260709 13:13:18.316088 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:13:18.322741 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.315562 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:18.364738 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:18.364238 32119 rpcz_store.cc:276] 0709 13:13:16.977587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.808381 (+830794us) service_pool.cc:224] Handling call
0709 13:13:17.808777 (+   396us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:17.809339 (+   562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:17.809372 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:17.810096 (+   724us) log.cc:844] Serialized 52 byte log entry
0709 13:13:18.034938 (+224842us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:18.035696 (+   758us) log.cc:844] Serialized 14 byte log entry
0709 13:13:18.036617 (+   921us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:18.036720 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:18.350872 (+314152us) raft_consensus.cc:1685] finished
0709 13:13:18.350895 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:18.351107 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":560,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":8911,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":16538,"thread_start_us":215778,"threads_started":1,"wal-append.queue_time_us":431225}
I20260709 13:13:18.366334 32192 raft_consensus.cc:2376] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6. Re-sending same reply.
I20260709 13:13:18.367198 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:18.367758 32192 raft_consensus.cc:2410] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:18.365010 32194 raft_consensus.cc:2368] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 4. Current term is 5.
W20260709 13:13:18.334812  1237 log.cc:927] Time spent T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.127s	user 0.002s	sys 0.000s
I20260709 13:13:18.373828 32198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1027) took 1627 ms. Trace:
W20260709 13:13:18.375010  1221 log.cc:927] Time spent T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:13:18.375128  1033 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:18.376294 32116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1072) took 1361 ms. Trace:
I20260709 13:13:18.375274 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:18.378744 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:18.376446 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:18.380103 32191 raft_consensus.cc:2393] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 5: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:18.380775 32197 raft_consensus.cc:2393] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 3: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:18.381256 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:18.374328 32198 rpcz_store.cc:276] 0709 13:13:16.745936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.713991 (+968055us) service_pool.cc:224] Handling call
0709 13:13:17.714358 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:17.718766 (+  4408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:17.718813 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:17.728718 (+  9905us) log.cc:844] Serialized 26 byte log entry
0709 13:13:17.774419 (+ 45701us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:17.774477 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.774574 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:18.209565 (+434991us) spinlock_profiling.cc:243] Waited 6.15 ms on lock 0x7b4800002958. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a3f1aaa1 00007fb5a3f11b37 00007fb5a3f119ca 00007fb5a400926f 00007fb5a4008f37 00007fb5a401d55c 00007fb5a401d508 00007fb5a401d488 00007fb5a401d443 00007fb5a401c6ec 00007fb5a2f46a96
0709 13:13:18.373350 (+163785us) raft_consensus.cc:1685] finished
0709 13:13:18.373374 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:18.373749 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2232,"raft.run_cpu_time_us":3259,"raft.run_wall_time_us":510422,"spinlock_wait_cycles":14149504,"thread_start_us":5711,"threads_started":1,"wal-append.queue_time_us":577065}
I20260709 13:13:18.386179 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:18.387681 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:18.388329 32194 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:18.396358 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:18.401232 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:18.408658 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:13:18.391312  1144 log.cc:927] Time spent T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 1.579s	user 0.000s	sys 0.005s
I20260709 13:13:18.413600 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:13:18.375306  1234 log.cc:927] Time spent T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 13:13:18.334600   369 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:13:18.422561  1248 log.cc:927] Time spent T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:13:18.426003  1092 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:18.441126 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:18.429471  1217 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:13:18.427714   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 96588.7us
W20260709 13:13:18.447499  1240 log.cc:927] Time spent T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:13:18.453883  1217 raft_consensus.cc:697] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 4 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:13:18.377079 32116 rpcz_store.cc:276] 0709 13:13:17.015273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.835925 (+820652us) service_pool.cc:224] Handling call
0709 13:13:17.836308 (+   383us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:17.837698 (+  1390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:17.837744 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:17.838455 (+   711us) log.cc:844] Serialized 52 byte log entry
0709 13:13:17.971493 (+133038us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:17.971562 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.971640 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:18.376111 (+404471us) raft_consensus.cc:1685] finished
0709 13:13:18.376127 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:18.376244 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":588,"raft.queue_time_us":1872,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":14844,"thread_start_us":130906,"threads_started":1,"wal-append.queue_time_us":408187}
I20260709 13:13:18.539143  1217 consensus_queue.cc:237] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:13:18.544764  1239 log.cc:927] Time spent T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.172s	user 0.003s	sys 0.000s
I20260709 13:13:18.546048 32116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1085) took 1234 ms. Trace:
I20260709 13:13:18.546711  1033 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:18.546557 32116 rpcz_store.cc:276] 0709 13:13:17.311362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.544945 (+1233583us) service_pool.cc:224] Handling call
0709 13:13:18.545376 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:18.545627 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:18.545672 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:18.545730 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:18.545776 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:18.545850 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:18.545987 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:18.551133 32121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1060) took 1598 ms. Trace:
I20260709 13:13:18.551589 32121 rpcz_store.cc:276] 0709 13:13:16.954044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.455000 (+500956us) service_pool.cc:224] Handling call
0709 13:13:17.455385 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:17.455651 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:17.596469 (+140818us) log.cc:844] Serialized 14 byte log entry
0709 13:13:18.550598 (+954129us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b1800333580. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59eb994bc 00007fb59bee748b 00007fb5a4d41ab9 00007fb59bf0369b 00007fb59bf0193f 00007fb59bf03c02 00007fb59eb8b20b 00007fb59eb90d23 00007fb59eb9123a
0709 13:13:18.550806 (+   208us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:18.550862 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:18.550901 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:18.550963 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:18.551065 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":697,"prepare.queue_time_us":262644,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"spinlock_wait_cycles":35698944,"thread_start_us":271077,"threads_started":2,"wal-append.queue_time_us":502864}
I20260709 13:13:18.551153  1033 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:13:18.755455 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:18.755905 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.767015  1122 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.767506  1122 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:18.769183  1122 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:18.769603  1122 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:18.770035  1122 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:18.771760  1122 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:18.786870  1170 log.cc:927] Time spent T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 1.479s	user 0.002s	sys 0.005s
I20260709 13:13:18.872267  1153 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.872929  1153 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:18.875008  1153 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:18.879086  1232 log.cc:927] Time spent T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.743s	user 0.002s	sys 0.000s
W20260709 13:13:18.879854 32165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.888975  1264 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:18.889562  1264 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:18.891711  1264 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:18.891955 32165 connection.cc:256] RPC call timeout handler was delayed by -1.1069594799998868s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
W20260709 13:13:18.892428 32165 connection.cc:256] RPC call timeout handler was delayed by -1.1069594799998868s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
W20260709 13:13:18.892840 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:18.893136 32165 connection.cc:256] RPC call timeout handler was delayed by -1.0457594799997878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
W20260709 13:13:18.893539 32165 connection.cc:256] RPC call timeout handler was delayed by -1.0457594799997878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
I20260709 13:13:18.895042 32165 leader_election.cc:400] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3.
I20260709 13:13:18.895357 32165 leader_election.cc:403] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:13:18.896302 32165 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:18.897737  1265 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3.
I20260709 13:13:18.898406  1265 raft_consensus.cc:2764] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:13:18.898885 32165 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:18.898972  1265 consensus_queue.cc:1059] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:18.899966  1265 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:18.900264 32165 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:18.900388  1265 raft_consensus.cc:697] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 4 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:18.905745  1265 consensus_queue.cc:237] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:18.917500  1267 raft_consensus.cc:3055] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:18.918115  1267 raft_consensus.cc:740] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:18.919114 32165 leader_election.cc:400] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 4. Current term is 5.
I20260709 13:13:18.918823  1268 raft_consensus.cc:2764] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:13:18.919612 32165 leader_election.cc:403] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:18.918954  1267 consensus_queue.cc:260] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:18.920431  1267 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:18.920734  1264 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:18.921183 32165 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:18.921329  1264 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:18.922274 32165 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:18.923787 32165 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:18.925947  1264 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:18.926636  1264 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 4. Current term is 5.
I20260709 13:13:18.927523  1264 raft_consensus.cc:2764] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:13:18.928228  1264 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:18.928862  1264 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:18.937176 32165 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:18.940219  1267 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:18.943218 32119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1084) took 1632 ms. Trace:
I20260709 13:13:18.943672 32119 rpcz_store.cc:276] 0709 13:13:17.311044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.395539 (+1084495us) service_pool.cc:224] Handling call
0709 13:13:18.942625 (+547086us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:18.942846 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:18.942877 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:18.942925 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:18.942961 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:18.943026 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:18.943155 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:18.945135 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:18.946656 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:18.948352 32119 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:18.948623 32117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1083) took 1824 ms. Trace:
I20260709 13:13:18.949113 32117 rpcz_store.cc:276] 0709 13:13:17.124697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.386221 (+1261524us) service_pool.cc:224] Handling call
0709 13:13:18.386776 (+   555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:18.387131 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:18.941730 (+554599us) log.cc:844] Serialized 14 byte log entry
0709 13:13:18.948236 (+  6506us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:18.948302 (+    66us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:18.948350 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:18.948414 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:18.948544 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":6149,"threads_started":1,"wal-append.queue_time_us":6524}
W20260709 13:13:18.950811  1246 log.cc:927] Time spent T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.427s	user 0.002s	sys 0.000s
W20260709 13:13:18.954140 32090 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.30.63.3:36651 timed out after 2.798s (SENT) [suppressed 17 similar messages]
I20260709 13:13:18.941820 32165 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:18.956110  1268 raft_consensus.cc:2764] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:13:18.957429 32165 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:18.958403  1268 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:18.959836 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:18.962744 32119 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:18.964272 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:18.965632 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:18.967013  1268 raft_consensus.cc:2764] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:13:18.968406 32165 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:18.969228  1268 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:18.970875 32165 leader_election.cc:400] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3.
I20260709 13:13:18.971192 32165 leader_election.cc:403] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:13:18.971714  1268 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3.
I20260709 13:13:18.972921 32165 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:18.974035  1268 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:18.975205 32165 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:18.975279 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:18.976040 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:18.977296 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:18.978142 32119 raft_consensus.cc:2410] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:13:18.978752 32123 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.019s	sys 0.035s
W20260709 13:13:18.979126 32123 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.019s	sys 0.035s
I20260709 13:13:18.978942 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:18.980221 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:18.981457 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:18.982564 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:18.983426  1268 raft_consensus.cc:2764] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:13:18.983461 32124 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
I20260709 13:13:18.986166 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:18.989920 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:19.019338 32196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 857) took 2387 ms. Trace:
I20260709 13:13:18.950644 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:19.022828 32089 connection.cc:256] RPC call timeout handler was delayed by -2.16360302399994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
I20260709 13:13:19.024530 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:19.035116 32115 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:19.036811 32198 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.012s	sys 0.004s
W20260709 13:13:19.037143 32198 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.012s	sys 0.004s
I20260709 13:13:19.029556 32196 rpcz_store.cc:276] 0709 13:13:16.632418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.278384 (+645966us) service_pool.cc:224] Handling call
0709 13:13:17.647561 (+369177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:17.703436 (+ 55875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:19.019043 (+1315607us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b54001d42d0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff08ad 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:19.019258 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":848391552}
W20260709 13:13:19.043262 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 89154us
I20260709 13:13:19.044514  1099 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:19.045083  1099 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:19.030857 32089 connection.cc:256] RPC call timeout handler was delayed by -2.1231030239998745s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
W20260709 13:13:19.047189 32089 connection.cc:256] RPC call timeout handler was delayed by -2.0979030239998337s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17270000000000002s for a response
I20260709 13:13:19.047410  1099 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:18.982628 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:19.030942 32117 raft_consensus.cc:2410] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:19.050750 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:19.032523 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:19.054328 32124 raft_consensus.cc:1240] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:19.054991 32124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1089) took 1511 ms. Trace:
I20260709 13:13:19.033427 32118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 903) took 2882 ms. Trace:
I20260709 13:13:19.056022 32117 raft_consensus.cc:2410] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:19.055800 32118 rpcz_store.cc:276] 0709 13:13:16.151300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.682615 (+531315us) service_pool.cc:224] Handling call
0709 13:13:16.683011 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:17.829107 (+1146096us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:19.033144 (+1204037us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54002c9cd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:19.033354 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2516179328}
I20260709 13:13:19.057544 32117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1090) took 1497 ms. Trace:
I20260709 13:13:19.057873 32117 rpcz_store.cc:276] 0709 13:13:17.560528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.056797 (+1496269us) service_pool.cc:224] Handling call
0709 13:13:19.057090 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:19.057262 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:19.057287 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:19.057325 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:19.057353 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:19.057402 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:19.057496 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:19.058497 32197 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.008s	sys 0.005s
W20260709 13:13:19.058866 32197 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.008s	sys 0.006s
I20260709 13:13:19.055343 32116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1086) took 1739 ms. Trace:
I20260709 13:13:19.060211 32117 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:13:19.060317 32199 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.017s	sys 0.033s
W20260709 13:13:19.076159 32199 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.018s	sys 0.033s
W20260709 13:13:19.048990 32089 leader_election.cc:336] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 2.144s (SENT)
I20260709 13:13:19.081938 32089 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:19.055351 32124 rpcz_store.cc:276] 0709 13:13:17.543793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.053711 (+1509918us) service_pool.cc:224] Handling call
0709 13:13:19.054102 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:19.054777 (+   675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:19.054940 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:19.060645 32116 rpcz_store.cc:276] 0709 13:13:17.316137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.547978 (+1231841us) service_pool.cc:224] Handling call
0709 13:13:18.548395 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:18.549006 (+   611us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:18.951760 (+402754us) log.cc:844] Serialized 14 byte log entry
0709 13:13:19.055039 (+103279us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:19.055090 (+    51us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:19.055133 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:19.055190 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:19.055292 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":393818,"prepare.queue_time_us":401197,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":101,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"thread_start_us":111112,"threads_started":2,"wal-append.queue_time_us":93255}
W20260709 13:13:19.065407 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.084446  1243 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:13:19.084677 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:19.084985 32089 connection.cc:256] RPC call timeout handler was delayed by -1.9899030239998865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
W20260709 13:13:19.085354 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:19.085394 32089 connection.cc:256] RPC call timeout handler was delayed by -1.9764030239998647s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
W20260709 13:13:19.086113 32089 connection.cc:256] RPC call timeout handler was delayed by -1.9591163489999417s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1592s for a response
I20260709 13:13:19.086314  1106 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:19.086876  1106 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:19.087530 32115 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:19.087670  1268 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:19.088276  1268 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:19.088842  1106 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:19.086441 32089 connection.cc:256] RPC call timeout handler was delayed by -1.9017030239997439s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1945s for a response
W20260709 13:13:19.032656 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 57538.1us
W20260709 13:13:19.090840 32089 connection.cc:256] RPC call timeout handler was delayed by -1.887303023999948s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19610000000000002s for a response
W20260709 13:13:19.091185 32089 connection.cc:256] RPC call timeout handler was delayed by -1.8001550559999941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2015s for a response
W20260709 13:13:19.091470 32089 connection.cc:256] RPC call timeout handler was delayed by -1.7870364799998697s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1638s for a response
W20260709 13:13:19.091873 32089 connection.cc:256] RPC call timeout handler was delayed by -1.7658030239997515s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2096s for a response
I20260709 13:13:19.091903 32165 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:19.092307 32089 connection.cc:256] RPC call timeout handler was delayed by -1.7582364800000505s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.167s for a response
W20260709 13:13:19.092644 32089 connection.cc:256] RPC call timeout handler was delayed by -1.7578550559999258s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2062s for a response
I20260709 13:13:19.082157 32120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1059) took 2129 ms. Trace:
W20260709 13:13:19.092862 32191 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.026s	sys 0.050s
I20260709 13:13:19.092954  1106 raft_consensus.cc:2764] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 13:13:19.093330 32191 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.026s	sys 0.050s
W20260709 13:13:19.093010 32089 connection.cc:256] RPC call timeout handler was delayed by -1.7421487659999002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2074s for a response
W20260709 13:13:19.095112 32089 connection.cc:256] RPC call timeout handler was delayed by -1.7421487659999002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2074s for a response
W20260709 13:13:19.095520 32089 connection.cc:256] RPC call timeout handler was delayed by -1.7335550559998865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
I20260709 13:13:19.094610 32122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55358 (request call id 18) took 2030 ms. Trace:
W20260709 13:13:19.096156 32089 connection.cc:256] RPC call timeout handler was delayed by -1.7240799440000956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
W20260709 13:13:19.098321 32089 connection.cc:256] RPC call timeout handler was delayed by -1.6920030239998596s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2178s for a response
I20260709 13:13:19.093178 32120 rpcz_store.cc:276] 0709 13:13:16.952423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.083565 (+131142us) service_pool.cc:224] Handling call
0709 13:13:17.083873 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:17.084063 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:19.039477 (+1955414us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b1800333400. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59eb994bc 00007fb59bee748b 00007fb5a4d41ab9 00007fb59bf0369b 00007fb59bf0193f 00007fb59bf01455 00007fb5a29e93c7 00007fb59effb9a7 00007fb59f00b0bf
0709 13:13:19.039630 (+   153us) log.cc:844] Serialized 14 byte log entry
0709 13:13:19.081848 (+ 42218us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:19.081895 (+    47us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:19.081938 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:19.082000 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:19.082104 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":621877,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":4466,"raft.queue_time_us":89,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"spinlock_wait_cycles":9067776,"thread_start_us":648339,"threads_started":2,"wal-append.queue_time_us":40689}
I20260709 13:13:19.098948 32019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59534 (request call id 39) took 3034 ms. Trace:
W20260709 13:13:19.098718 32089 connection.cc:256] RPC call timeout handler was delayed by -1.6650030239998159s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22080000000000002s for a response
W20260709 13:13:19.100100 32089 connection.cc:256] RPC call timeout handler was delayed by -1.6457364799998686s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1795s for a response
W20260709 13:13:19.100556 32089 connection.cc:256] RPC call timeout handler was delayed by -1.6219988369998646s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
I20260709 13:13:19.096563 32122 rpcz_store.cc:276] 0709 13:13:17.064361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.113675 (+1049314us) service_pool.cc:224] Handling call
0709 13:13:18.126275 (+ 12600us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:18.131110 (+  4835us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:18.131140 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:18.134714 (+  3574us) log.cc:844] Serialized 26 byte log entry
0709 13:13:18.247999 (+113285us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:18.248143 (+   144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:18.248468 (+   325us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:18.950238 (+701770us) spinlock_profiling.cc:243] Waited 980 us on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:13:19.094292 (+144054us) raft_consensus.cc:1685] finished
0709 13:13:19.094316 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:19.094548 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5582,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":6473,"spinlock_wait_cycles":2253056,"thread_start_us":60200,"threads_started":1,"wal-append.queue_time_us":278795}
I20260709 13:13:19.101094 32165 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:19.101231 32089 connection.cc:256] RPC call timeout handler was delayed by -1.5653276619998451s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
W20260709 13:13:19.101802 32089 connection.cc:256] RPC call timeout handler was delayed by -1.5445249459999104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
W20260709 13:13:19.102423 32089 connection.cc:256] RPC call timeout handler was delayed by -1.4418134989998634s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
W20260709 13:13:19.103186 32089 connection.cc:256] RPC call timeout handler was delayed by -1.4031134990000282s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16410000000000002s for a response
W20260709 13:13:19.103688 32089 connection.cc:256] RPC call timeout handler was delayed by -1.3531862449999608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
W20260709 13:13:19.104167 32089 connection.cc:256] RPC call timeout handler was delayed by -1.2877372619998368s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
W20260709 13:13:19.104633 32089 connection.cc:256] RPC call timeout handler was delayed by -1.2576683659999617s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2013s for a response
W20260709 13:13:19.105053 32089 connection.cc:256] RPC call timeout handler was delayed by -1.2573134990000199s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18030000000000002s for a response
I20260709 13:13:19.105258 32119 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:19.105536 32089 connection.cc:256] RPC call timeout handler was delayed by -1.0967364799998904s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2405s for a response
I20260709 13:13:19.102396 32165 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:19.099750 32019 rpcz_store.cc:276] 0709 13:13:16.064486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.078890 (+ 14404us) service_pool.cc:224] Handling call
0709 13:13:19.098848 (+3019958us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:16.283537 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:16.595400 (+311863us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:16.595435 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:13:16.595452 (+    17us) tablet.cc:662] Decoding operations
0709 13:13:16.595827 (+   375us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:16.595880 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:16.595923 (+    43us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:13:16.596246 (+   323us) tablet.cc:701] Row locks acquired
0709 13:13:16.596263 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:13:16.596395 (+   132us) write_op.cc:270] Start()
0709 13:13:16.596523 (+   128us) write_op.cc:276] Timestamp: P: 1783602796596348 usec, L: 0
0709 13:13:16.596545 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:13:16.732984 (+136439us) log.cc:844] Serialized 906 byte log entry
0709 13:13:17.835504 (+1102520us) op_driver.cc:464] REPLICATION: finished
0709 13:13:17.929834 (+ 94330us) write_op.cc:301] APPLY: starting
0709 13:13:17.932896 (+  3062us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:17.974184 (+ 41288us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:17.995265 (+ 21081us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:18.088874 (+ 93609us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:18.106081 (+ 17207us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:13:18.112826 (+  6745us) write_op.cc:312] APPLY: finished
0709 13:13:18.127894 (+ 15068us) log.cc:844] Serialized 28 byte log entry
0709 13:13:18.137647 (+  9753us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:18.137734 (+    87us) write_op.cc:454] Released schema lock
0709 13:13:18.137778 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:18.138301 (+   523us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:18.138334 (+    33us) write_op.cc:454] Released schema lock
0709 13:13:19.044794 (+906460us) spinlock_profiling.cc:243] Waited 9.8 ms on lock 0x7b5400047c54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59efee32a 00007fb59ef73f14 00007fb59ef73ec3 00007fb59ef73e38 00007fb59ef73df3 00007fb59ef730dc 00007fb59ef9ce16 00007fb59ef84cbb 00007fb59ef6f39d 00007fb59ef72d75
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":71322,"apply.run_cpu_time_us":3337,"apply.run_wall_time_us":220376,"num_ops":2,"prepare.queue_time_us":98002,"prepare.run_cpu_time_us":18738,"prepare.run_wall_time_us":727229,"raft.queue_time_us":1449526,"raft.run_cpu_time_us":21302,"raft.run_wall_time_us":1310474,"replication_time_us":1208756,"spinlock_wait_cycles":22533888,"thread_start_us":501779,"threads_started":4,"wal-append.queue_time_us":282686}]]}
I20260709 13:13:19.091574  1268 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:19.121333 32089 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:19.121688 32165 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:19.122282  1243 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:19.122726  1243 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:19.123046  1265 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:19.123633  1265 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:19.124089  1265 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:19.124573 32089 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:19.116832  1267 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:19.123097  1243 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:19.117944  1106 raft_consensus.cc:2749] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:19.127720 32089 leader_election.cc:304] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:19.131557  1033 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:19.132813 32089 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:19.133607 32119 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:19.128795  1092 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:19.131938  1033 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:19.135684 32089 leader_election.cc:400] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 2. Current term is 3.
I20260709 13:13:19.137153 32089 leader_election.cc:403] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:13:19.134971  1099 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:19.139552 32089 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:19.138733  1173 raft_consensus.cc:2749] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 2. Current term is 3.
I20260709 13:13:19.140355  1032 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:19.142481 32191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1058) took 1101 ms. Trace:
I20260709 13:13:19.142661 32089 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:19.140761  1032 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:19.144517 32121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1087) took 1825 ms. Trace:
I20260709 13:13:19.145674 32119 raft_consensus.cc:1240] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:19.145985 32089 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:19.145188 32121 rpcz_store.cc:276] 0709 13:13:17.319456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.557269 (+1237813us) service_pool.cc:224] Handling call
0709 13:13:18.566386 (+  9117us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:18.566645 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:19.047088 (+480443us) log.cc:844] Serialized 14 byte log entry
0709 13:13:19.144221 (+ 97133us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:19.144276 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:19.144312 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:19.144369 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:19.144466 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":378645,"prepare.queue_time_us":383735,"prepare.run_cpu_time_us":22,"prepare.run_wall_time_us":23,"raft.queue_time_us":68,"thread_start_us":198138,"threads_started":2}
I20260709 13:13:19.138265  1033 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:19.148777 32119 raft_consensus.cc:1240] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 3 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:19.149099 32089 leader_election.cc:400] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 4. Current term is 5.
I20260709 13:13:19.147255  1032 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:19.148815  1092 consensus_queue.cc:1048] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:13:19.152225 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:19.150195  1173 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:19.153096 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:19.162308 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:19.163224  1106 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:19.147900  1153 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:19.164832  1106 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:19.167840 32194 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.030s	sys 0.065s
W20260709 13:13:19.168309 32194 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.030s	sys 0.065s
I20260709 13:13:19.148494  1236 consensus_queue.cc:1048] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:13:19.148348  1267 consensus_queue.cc:1059] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:13:19.169930  1106 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:19.170199  1267 consensus_queue.cc:1243] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer fcfc3281929645969ecedbb0c0af759d log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:13:19.164875  1153 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:19.171267  1153 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:19.172188  1211 log.cc:927] Time spent T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 1.194s	user 0.000s	sys 0.004s
I20260709 13:13:19.177817  1265 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:19.170640  1106 raft_consensus.cc:3055] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:19.179704 32194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1056) took 1139 ms. Trace:
I20260709 13:13:19.180397 32089 leader_election.cc:400] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4.
I20260709 13:13:19.178258 32193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:43952 (request call id 3) took 1605 ms. Trace:
I20260709 13:13:19.182139 32089 leader_election.cc:403] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:13:19.181646 32195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56926 (request call id 35) took 2386 ms. Trace:
I20260709 13:13:19.181522 32194 rpcz_store.cc:276] 0709 13:13:18.040413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.389502 (+349089us) service_pool.cc:224] Handling call
0709 13:13:18.389667 (+   165us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:18.389799 (+   132us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:19.168710 (+778911us) log.cc:844] Serialized 14 byte log entry
0709 13:13:19.179390 (+ 10680us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:19.179439 (+    49us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:19.179479 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:19.179542 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:19.179651 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17363,"prepare.queue_time_us":42615,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":107,"thread_start_us":763836,"threads_started":2}
I20260709 13:13:19.182682 32195 rpcz_store.cc:276] 0709 13:13:16.795218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.738089 (+942871us) service_pool.cc:224] Handling call
0709 13:13:17.761219 (+ 23130us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:17.767505 (+  6286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:17.767537 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:17.768025 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:13:17.851316 (+ 83291us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:17.851395 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.851507 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:19.171605 (+1320098us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:13:19.181362 (+  9757us) raft_consensus.cc:1685] finished
0709 13:13:19.181384 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:19.181585 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":966,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":10767,"spinlock_wait_cycles":11226112,"thread_start_us":67683,"threads_started":1,"wal-append.queue_time_us":122279}
I20260709 13:13:19.182204 32193 rpcz_store.cc:276] 0709 13:13:17.572313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.649558 (+ 77245us) service_pool.cc:224] Handling call
0709 13:13:19.177982 (+1528424us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b54000fad54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59efeb853 00007fb5a3fb960a 00007fb59d53f7d4 00007fb59d53f762 00007fb59d53f691 00007fb59d53f60c 00007fb59d53e8c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:19.178128 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58376960}
I20260709 13:13:19.188557  1236 raft_consensus.cc:2749] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4.
I20260709 13:13:19.181439  1106 raft_consensus.cc:740] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:19.193568 32123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1081) took 2070 ms. Trace:
I20260709 13:13:19.194015 32089 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:19.194846 32123 rpcz_store.cc:276] 0709 13:13:17.123097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.185773 (+1062676us) service_pool.cc:224] Handling call
0709 13:13:18.219982 (+ 34209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:18.291938 (+ 71956us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:18.306021 (+ 14083us) log.cc:844] Serialized 14 byte log entry
0709 13:13:18.979602 (+673581us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:18.979676 (+    74us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:18.979722 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:19.193336 (+213614us) spinlock_profiling.cc:243] Waited 71.7 ms on lock 0x7b5400031954. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:19.193368 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:19.193510 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16191,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":573,"raft.queue_time_us":2606,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":88,"spinlock_wait_cycles":164863744,"thread_start_us":673222,"threads_started":1,"wal-append.queue_time_us":237626}
I20260709 13:13:19.197644 32194 raft_consensus.cc:1240] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:19.197852 32089 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:19.197436  1179 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.198815  1173 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:19.199393 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:19.200253 32089 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:19.196280  1178 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:19.201686 32194 raft_consensus.cc:1275] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:13:19.201764 32199 raft_consensus.cc:3055] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:19.202239 32194 pending_rounds.cc:85] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 1
I20260709 13:13:19.202308 32199 raft_consensus.cc:740] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:19.202641 32194 pending_rounds.cc:107] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:13:19.202911   401 raft_consensus.cc:1275] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:13:19.202971 32194 raft_consensus.cc:2889] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:19.203336 32199 consensus_queue.cc:260] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:19.204123  1173 raft_consensus.cc:2749] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:19.204268 32199 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:19.205302   400 raft_consensus.cc:1240] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 4 LEADER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:19.205454 32089 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:19.206243  1173 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:19.207285 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:19.207456 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:19.207890 32089 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:19.208125 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:19.210567 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:19.211385 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:19.209878 32089 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:19.212838 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:19.212941 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:19.204255   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:13:19.216235 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:19.234421 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:19.234376 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:19.235134 32193 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:19.230857 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:19.237988 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:19.237418   986 consensus_queue.cc:1048] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:19.236891  1009 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:19.241817  1009 consensus_queue.cc:1059] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:19.242640  1009 consensus_queue.cc:1243] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer 6b3ed521ce8947db80c4b4828b355c06 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:13:19.243682 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:19.201634  1178 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:19.247857 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:19.248538  1178 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:19.199347  1179 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:19.248965 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:19.250059 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:19.250851  1179 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:19.251083 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:19.251870 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:19.252755 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:19.252225 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:19.212749  1173 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:19.255738  1106 consensus_queue.cc:260] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:19.256815  1173 raft_consensus.cc:3055] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:19.257042  1106 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:19.257201  1173 raft_consensus.cc:740] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:19.239476 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:19.238363 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:19.239696 32197 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:19.217077 32089 leader_election.cc:400] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 4. Current term is 5.
I20260709 13:13:19.258987 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:19.259744 32195 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:19.239743 32193 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
W20260709 13:13:19.261807 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 43916.1us
I20260709 13:13:19.263051  1265 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:19.200043  1236 raft_consensus.cc:2804] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:19.237489  1150 consensus_queue.cc:1059] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:19.264811  1236 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:19.264982  1150 consensus_queue.cc:1243] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer 94085cf341634eb686a95983b6b7f7e6 log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:13:19.265270  1236 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:19.265522  1150 raft_consensus.cc:3055] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:19.265844  1150 raft_consensus.cc:740] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:19.223495 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:19.263762   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:19.266661  1150 consensus_queue.cc:260] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:19.267446 32194 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:19.267879  1150 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:19.263799   402 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:19.221356 32199 raft_consensus.cc:1275] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:13:19.271705 32199 pending_rounds.cc:85] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 2
I20260709 13:13:19.272078 32199 pending_rounds.cc:107] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:13:19.260046 32089 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:19.272404 32199 raft_consensus.cc:2889] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:19.273502 32089 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:19.275218 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:19.277150 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:19.275029  1290 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:19.278093 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:19.278820 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:19.216415  1122 consensus_queue.cc:1048] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:13:19.283023 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:19.280926 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:19.285089 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:19.285308 32266 raft_consensus.cc:1240] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:19.283077   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:13:19.286454   400 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:19.288856 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:19.291335  1236 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:19.292506 32194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d002861120de41408d48712b6bd491e1"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:13:19.258144  1173 consensus_queue.cc:260] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:19.293092 32194 raft_consensus.cc:606] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:19.293486 32194 raft_consensus.cc:614] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:19.294855  1236 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:19.252125  1153 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:19.296953 32267 raft_consensus.cc:1240] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:19.297987  1153 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:19.283077  1128 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:19.281483  1033 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:19.283468 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:19.298955 32272 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:19.299841  1033 leader_election.cc:290] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:19.294778   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:19.294770 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:13:19.302419 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 88379.9us
I20260709 13:13:19.303315 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:19.302083 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:19.282310 32089 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:19.305580  1033 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:19.306499 32089 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:19.307135 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:19.307653 32089 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:19.277698  1092 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.308893 32089 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:19.309340 32123 raft_consensus.cc:1275] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:13:19.310595 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:19.311406 32165 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:19.313668 32165 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:19.314535  1153 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:19.315024 32165 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:19.315289 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 732378us
I20260709 13:13:19.315797  1268 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:19.315894  1032 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:19.319754 32165 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:19.316566  1268 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:19.320310 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:19.321491 32165 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:19.326506 32165 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:19.327033  1267 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:19.327239  1270 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:19.322283 32089 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:19.322422 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:19.327729 32165 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:19.330687 32089 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:19.331233 32165 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:19.324810  1236 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:19.333464  1236 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:19.334666  1236 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:19.325256  1146 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:19.336076 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:19.328220  1265 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:19.337525  1032 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:19.340018 32165 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:19.343580 32089 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:19.344192 32165 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:19.313359  1128 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:19.345046 32089 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:19.346306 32165 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:19.348115 32165 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:19.352038 32165 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:19.344019 32090 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:19.341065  1033 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:19.341014  1270 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:19.343084  1146 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:19.345479  1153 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:19.313848  1092 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:19.318554  1230 consensus_queue.cc:1048] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:13:19.346014   400 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:19.348665  1122 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:19.349375  1267 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:19.350216  1268 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:19.350394  1099 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:19.360960  1290 consensus_queue.cc:1059] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:13:19.362303  1287 consensus_queue.cc:1048] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:13:19.351547  1265 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:19.369812  1146 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:19.370688 32087 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:19.370860  1122 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:19.371527  1122 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:19.372876   401 raft_consensus.cc:1240] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:13:19.373766  1122 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:19.359525  1032 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:19.354677  1264 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:19.374332 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:19.375353  1009 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:19.377225  1243 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:19.377911  1092 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:19.357832 32089 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:19.386629 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 58908.2us
I20260709 13:13:19.392491 32089 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:19.395573 32089 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:19.394654  1092 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:19.383965   402 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:19.395833  1032 consensus_queue.cc:1048] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:13:19.412400  1173 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:19.413364  1236 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:19.415512  1236 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:19.384343  1009 raft_consensus.cc:697] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 6 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:19.417644  1009 consensus_queue.cc:237] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:19.143064 32191 rpcz_store.cc:276] 0709 13:13:18.041099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.390665 (+349566us) service_pool.cc:224] Handling call
0709 13:13:18.390923 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:18.391126 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:19.094365 (+703239us) log.cc:844] Serialized 14 byte log entry
0709 13:13:19.138884 (+ 44519us) log.cc:844] Serialized 14 byte log entry
0709 13:13:19.142041 (+  3157us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:19.142112 (+    71us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:19.142170 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:19.142259 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:19.142409 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27015,"prepare.queue_time_us":59761,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":73,"raft.queue_time_us":6471,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":1983,"thread_start_us":716998,"threads_started":2,"wal-append.queue_time_us":36045}
I20260709 13:13:19.423821  1243 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:19.426023  1187 consensus_queue.cc:1059] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:19.427139  1187 raft_consensus.cc:3055] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:19.427524  1187 raft_consensus.cc:740] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:19.428121 32239 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:19.428364  1187 consensus_queue.cc:260] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:19.431599  1187 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:19.429605  1122 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:19.396361  1153 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:19.430475 32089 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:19.430579   980 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:19.449069   980 raft_consensus.cc:697] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:19.450068   980 consensus_queue.cc:237] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:19.429236  1287 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:19.455497 32089 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:19.458366 32089 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:19.455189  1243 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:19.461181  1287 raft_consensus.cc:2804] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:19.461737 32089 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:19.462865  1287 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:19.460039  1236 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:19.461436  1243 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:19.476652  1153 consensus_queue.cc:1048] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:19.473028  1236 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.465948  1287 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:19.472093  1290 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:19.480696  1243 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:19.510936 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 166978us
I20260709 13:13:19.510838 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:19.512038 32267 raft_consensus.cc:2410] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:13:19.516180 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:19.483728  1236 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:19.517678 32266 raft_consensus.cc:2368] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 for earlier term 3. Current term is 4.
I20260709 13:13:19.493180  1290 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.527578 32021 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49534 (request call id 169) took 4835 ms. Trace:
I20260709 13:13:19.528458 32266 raft_consensus.cc:1275] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:13:19.528968 32266 pending_rounds.cc:85] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06: Aborting all ops after (but not including) 4
I20260709 13:13:19.529366 32266 pending_rounds.cc:107] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:13:19.529743 32266 raft_consensus.cc:2889] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:19.527999 32021 rpcz_store.cc:276] 0709 13:13:14.695594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:14.699294 (+  3700us) service_pool.cc:224] Handling call
0709 13:13:19.527516 (+4828222us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:17.028665 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:17.091555 (+ 62890us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:17.094890 (+  3335us) write_op.cc:435] Acquired schema lock
0709 13:13:17.103497 (+  8607us) tablet.cc:662] Decoding operations
0709 13:13:17.482515 (+379018us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:17.506540 (+ 24025us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:17.509137 (+  2597us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:13:17.736293 (+227156us) tablet.cc:701] Row locks acquired
0709 13:13:17.745029 (+  8736us) write_op.cc:260] PREPARE: finished
0709 13:13:17.772702 (+ 27673us) write_op.cc:270] Start()
0709 13:13:17.779874 (+  7172us) write_op.cc:276] Timestamp: P: 1783602797772546 usec, L: 0
0709 13:13:17.779904 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:13:17.782861 (+  2957us) log.cc:844] Serialized 4733 byte log entry
0709 13:13:19.045235 (+1262374us) op_driver.cc:464] REPLICATION: finished
0709 13:13:19.083369 (+ 38134us) write_op.cc:301] APPLY: starting
0709 13:13:19.083455 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:19.083703 (+   248us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:19.083818 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:19.090090 (+  6272us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:19.090319 (+   229us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:13:19.090363 (+    44us) write_op.cc:312] APPLY: finished
0709 13:13:19.090674 (+   311us) log.cc:844] Serialized 88 byte log entry
0709 13:13:19.092228 (+  1554us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:19.092353 (+   125us) write_op.cc:454] Released schema lock
0709 13:13:19.092400 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:19.117706 (+ 25306us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:19.119768 (+  2062us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8485,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":37913,"apply.run_cpu_time_us":3159,"apply.run_wall_time_us":26975,"num_ops":12,"prepare.queue_time_us":317811,"prepare.run_cpu_time_us":27668,"prepare.run_wall_time_us":772430,"replication_time_us":1265186,"thread_start_us":41775,"threads_started":1}]]}
I20260709 13:13:19.532550 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:19.526589  1290 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:19.549234 32199 raft_consensus.cc:1240] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: []
W20260709 13:13:19.552176 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 123007us
I20260709 13:13:19.556416 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:19.556813 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:19.564574 32239 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:19.578536  1243 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:19.587267 32191 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:19.570858  1303 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:19.589226 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:19.589963 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:19.593294   369 leader_election.cc:400] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 3 election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 for earlier term 3. Current term is 4.
W20260709 13:13:19.555138 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 203158us
I20260709 13:13:19.594251 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:19.594594  1287 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:19.596369 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:19.571308  1187 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:13:19.598420 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:19.600538 32195 raft_consensus.cc:1275] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:19.606078  1303 raft_consensus.cc:697] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:19.606995  1303 consensus_queue.cc:237] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:19.607501  1236 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:19.609575  1236 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:19.594983 32165 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:19.611744 32239 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:19.611764 32165 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:19.614591 32165 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:19.616401 32165 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:19.618983 32165 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:19.630508 32165 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:19.633436 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:19.634348 32115 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:19.636364 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:19.641796 32115 raft_consensus.cc:1275] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:19.618438  1265 raft_consensus.cc:2804] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:19.616768  1306 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:19.617017  1106 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:19.626641  1268 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:19.643733 32165 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:19.619024  1302 raft_consensus.cc:2804] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:19.647317 32120 raft_consensus.cc:1240] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:19.648422 32116 raft_consensus.cc:1240] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:19.648988 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:19.617466  1146 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:19.640019  1267 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:19.644662  1270 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:19.646939  1265 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:19.649839  1287 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:19.670280 32116 raft_consensus.cc:1275] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:13:19.648226 32220 debug-util.cc:398] Leaking SignalData structure 0x7b080017e6c0 after lost signal to thread 30975
W20260709 13:13:19.672542 32220 debug-util.cc:398] Leaking SignalData structure 0x7b0800121a00 after lost signal to thread 32056
I20260709 13:13:19.669102  1265 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:19.667615  1106 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:19.661325  1268 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:19.698004 32116 raft_consensus.cc:1275] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:19.681391  1302 raft_consensus.cc:697] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:13:19.692399 32220 debug-util.cc:398] Leaking SignalData structure 0x7b08001ac180 after lost signal to thread 32070
I20260709 13:13:19.679294  1195 consensus_queue.cc:1048] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:13:19.706233  1243 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:19.708927  1302 consensus_queue.cc:237] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:19.713651 32123 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:19.712199 32239 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:19.731096 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:19.747400 32116 raft_consensus.cc:1275] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:13:19.750073 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 99709.3us
W20260709 13:13:19.754637 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 110995us
I20260709 13:13:19.756799 32265 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 4.
W20260709 13:13:19.750767 32220 debug-util.cc:398] Leaking SignalData structure 0x7b0800352140 after lost signal to thread 32148
I20260709 13:13:19.816294 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:19.815547  1267 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:19.817170  1270 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:19.817679  1318 log.cc:927] Time spent T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:13:19.817546  1106 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:13:19.818368  1314 log.cc:927] Time spent T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 13:13:19.818955  1315 log.cc:927] Time spent T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
W20260709 13:13:19.819669  1313 log.cc:927] Time spent T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
W20260709 13:13:19.820545 32220 debug-util.cc:398] Leaking SignalData structure 0x7b080003e560 after lost signal to thread 32223
I20260709 13:13:19.760562  1298 consensus_queue.cc:1048] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:13:19.770342  1294 consensus_queue.cc:1059] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:13:19.827819 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:19.829449 32123 raft_consensus.cc:1240] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:19.865846 32191 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:19.866914 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:19.867221 32123 raft_consensus.cc:1275] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:19.867517 32191 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:19.830627 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:19.833012 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:19.835624 32116 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:19.751725  1288 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:19.839519 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:19.871763 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:19.872520 32190 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:19.840435 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:19.874650 32195 raft_consensus.cc:2410] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:19.842046 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:19.845120 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:19.875432 32198 raft_consensus.cc:2368] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4.
I20260709 13:13:19.875775 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:19.873564 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:19.877947 32190 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:19.824515  1290 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:19.865327  1146 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.879623  1288 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.887334  1146 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:19.887903  1288 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:19.889573  1146 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:19.851821  1267 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:19.838594  1150 consensus_queue.cc:1059] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:13:19.891055  1268 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:19.893079 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:19.893231 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:19.893719 32194 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:19.892488 32119 raft_consensus.cc:1240] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:13:19.893662 32193 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:19.905081 32123 raft_consensus.cc:1275] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:13:19.905573 32123 pending_rounds.cc:85] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d: Aborting all ops after (but not including) 2
I20260709 13:13:19.905859 32123 pending_rounds.cc:107] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:13:19.906147 32123 raft_consensus.cc:2889] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:19.911715 32193 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:19.912134 32199 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:19.916756 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:19.917569 32198 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:19.919328 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:19.898751 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:19.926939 32192 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:19.931097 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:19.901916 32116 raft_consensus.cc:1275] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:19.937405 32191 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:19.939877 32194 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:19.943022 32190 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:19.942865 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:19.891108  1179 raft_consensus.cc:3055] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:19.887365  1290 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:19.860153  1106 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:19.907703  1294 raft_consensus.cc:3055] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:13:19.949324 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 195116us
I20260709 13:13:19.853755  1270 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:19.968705 32192 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
W20260709 13:13:19.970669 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 215680us
I20260709 13:13:19.971028 32123 raft_consensus.cc:1275] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:19.916332  1268 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:13:19.954317 32220 debug-util.cc:398] Leaking SignalData structure 0x7b080036ac00 after lost signal to thread 32297
I20260709 13:13:19.951746  1179 raft_consensus.cc:740] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:19.958484  1294 raft_consensus.cc:740] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:19.970546  1146 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.980298  1268 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:20.019522 32220 debug-util.cc:398] Leaking SignalData structure 0x7b08003524a0 after lost signal to thread 427
W20260709 13:13:20.069847 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 60867.2us
I20260709 13:13:20.008881  1146 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:20.077603  1270 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:20.019133  1303 consensus_queue.cc:1048] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
W20260709 13:13:20.073725 32220 debug-util.cc:398] Leaking SignalData structure 0x7b08001c9e60 after lost signal to thread 1026
W20260709 13:13:20.133522 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 159867us
W20260709 13:13:20.097659 32220 debug-util.cc:398] Leaking SignalData structure 0x7b08003c49e0 after lost signal to thread 1036
I20260709 13:13:20.101552  1267 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:20.154192  1324 log.cc:927] Time spent T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:13:20.166373 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:20.052717  1294 consensus_queue.cc:260] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:20.179979  1341 log.cc:927] Time spent T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:13:20.180253  1146 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:20.180786  1146 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:20.181352  1146 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:20.182546  1331 log.cc:927] Time spent T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 13:13:20.183308  1336 log.cc:927] Time spent T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:13:20.183480  1146 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:20.184237 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:20.185483  1333 log.cc:927] Time spent T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:13:20.189455  1268 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:20.191196 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 376087us
I20260709 13:13:20.193323  1033 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:20.167366  1320 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.193897  1033 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:20.194000  1320 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:20.165161  1267 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:20.196152  1033 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:20.196735  1267 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:20.198032  1153 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.167868  1270 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:13:20.175894 32220 debug-util.cc:398] Leaking SignalData structure 0x7b0800319f60 after lost signal to thread 1166
W20260709 13:13:20.199982  1265 consensus_meta.cc:287] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.000s
I20260709 13:13:20.196187  1320 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:20.201892 32089 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:20.215915 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:20.190656  1236 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.220697 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:20.230744 32124 raft_consensus.cc:1240] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: []
W20260709 13:13:20.237605 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 78979.5us
I20260709 13:13:20.240353 32122 raft_consensus.cc:1240] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:20.242372  1334 consensus_queue.cc:1048] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:13:20.242740  1033 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:13:20.232457 32220 debug-util.cc:398] Leaking SignalData structure 0x7b08003c01e0 after lost signal to thread 1181
I20260709 13:13:20.239382 32268 raft_consensus.cc:1275] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:13:20.249694 32268 pending_rounds.cc:85] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06: Aborting all ops after (but not including) 5
I20260709 13:13:20.250047 32268 pending_rounds.cc:107] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:13:20.250334 32268 raft_consensus.cc:2889] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:20.238068 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:20.252441 32117 raft_consensus.cc:2393] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 4: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
W20260709 13:13:20.252431 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 152639us
I20260709 13:13:20.217309  1106 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:20.243908 32220 debug-util.cc:398] Leaking SignalData structure 0x7b0800325e00 after lost signal to thread 1186
I20260709 13:13:20.228816  1270 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:20.263456  1356 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:13:20.270290  1354 consensus_queue.cc:1059] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:20.222465  1307 consensus_queue.cc:1048] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:13:20.203332  1288 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:20.280076   402 raft_consensus.cc:1275] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:13:20.280999  1342 raft_consensus.cc:3055] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:20.281387  1359 consensus_queue.cc:1048] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:20.281797  1267 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:20.238034  1236 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:20.223484  1153 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:20.286550 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 84718.6us
I20260709 13:13:20.227402  1265 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:20.298508 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:20.314056 32117 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:20.316483  1265 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:13:20.294453 32220 debug-util.cc:398] Leaking SignalData structure 0x7b08002c01a0 after lost signal to thread 1218
I20260709 13:13:20.305111  1358 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:13:20.305642  1357 consensus_queue.cc:1048] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:13:20.320147 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:20.306018 32089 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:20.306871  1351 consensus_queue.cc:1059] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:13:20.297248  1354 consensus_queue.cc:1048] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:13:20.309908  1179 consensus_queue.cc:260] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:20.310866  1236 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:20.311331 32238 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:20.297587  1342 raft_consensus.cc:740] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:20.312419  1334 consensus_queue.cc:1048] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:20.327407 32265 raft_consensus.cc:1240] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:20.332681  1342 consensus_queue.cc:260] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:20.333519  1265 consensus_queue.cc:1048] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:20.333940  1342 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:20.327251   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:13:20.336998 32165 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:20.338335  1288 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:20.339443  1265 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:20.340269  1153 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:20.340778 32165 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:20.313405  1340 log.cc:927] Time spent T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.146s	user 0.003s	sys 0.000s
I20260709 13:13:20.301148 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:20.342258  1179 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:20.342594 32124 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
I20260709 13:13:20.344033  1265 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:20.344452  1265 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.344879  1265 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:20.317132 32199 raft_consensus.cc:1240] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:20.318030 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:20.316655  1270 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:20.325129 32089 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:20.326089 32123 raft_consensus.cc:1275] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:20.327011 32115 raft_consensus.cc:1275] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:20.327709 32120 raft_consensus.cc:1275] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:20.354527 32199 raft_consensus.cc:1275] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:20.355304 32089 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:20.355753 32196 raft_consensus.cc:1240] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 5. Current term is 6. Ops: []
W20260709 13:13:20.319449 32220 debug-util.cc:398] Leaking SignalData structure 0x7b08002a0860 after lost signal to thread 1219
I20260709 13:13:20.356720 32193 raft_consensus.cc:1275] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:20.356815 32195 raft_consensus.cc:1275] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:20.358158  1354 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:20.359666 32193 raft_consensus.cc:1275] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:20.359932 32198 raft_consensus.cc:1275] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:20.331364  1304 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:20.348742  1230 consensus_queue.cc:1059] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:20.371390  1364 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:20.360986  1153 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:20.361968  1099 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.362075 32199 raft_consensus.cc:1275] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:20.364326 32195 raft_consensus.cc:1240] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:20.382928 32195 raft_consensus.cc:1240] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:20.366887 32198 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:20.372960 32089 leader_election.cc:400] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4.
I20260709 13:13:20.360991 32196 raft_consensus.cc:1275] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:20.374660 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:20.386428 32089 leader_election.cc:403] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:20.387246  1364 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4.
I20260709 13:13:20.387633 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:20.375191 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:20.388898 32194 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:20.388818 32089 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:20.390996  1364 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:20.376577 32165 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:20.376057 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:20.392603 32165 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:20.392946 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:20.393599 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:20.394323 32120 raft_consensus.cc:2393] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 4: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:20.395037 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:20.395565 32120 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:20.395516 32089 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:20.396898  1270 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:20.397289  1270 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:20.381435  1153 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:20.397904  1364 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:20.397644  1270 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:20.399243 32089 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:20.399420  1099 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:20.398056  1153 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:20.392629 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:20.401679 32123 raft_consensus.cc:2393] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 5: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:20.400969 32198 raft_consensus.cc:1240] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:20.402079 32089 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:20.402602 32194 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:20.421826 32165 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:20.424644 32198 raft_consensus.cc:1275] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:20.429881 32198 raft_consensus.cc:1275] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:20.430706 32196 raft_consensus.cc:1240] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:13:20.398087  1363 raft_consensus.cc:2749] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:20.433385 32089 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:20.460855 32089 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:20.462047 32089 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:20.462251 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:20.471693 32089 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:20.473327 32089 leader_election.cc:304] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:20.423462  1364 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:20.429980  1267 raft_consensus.cc:2804] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:20.381227  1290 consensus_queue.cc:1048] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
W20260709 13:13:20.482350  1330 log.cc:927] Time spent T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.345s	user 0.000s	sys 0.002s
I20260709 13:13:20.476613  1236 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:20.483134  1236 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.483489  1236 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:20.478338  1243 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:20.476744  1122 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:20.505370 32198 raft_consensus.cc:1240] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:20.461032  1304 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:20.392628  1265 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:20.478823  1267 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.478291  1033 raft_consensus.cc:2804] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:20.513389  1362 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:20.529894  1304 raft_consensus.cc:697] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 4 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:20.537400 32191 raft_consensus.cc:1240] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:20.519207  1243 raft_consensus.cc:697] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
W20260709 13:13:20.730486 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 162666us
I20260709 13:13:20.534036  1267 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:20.746552  1270 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:20.553253  1362 raft_consensus.cc:697] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:20.748622  1365 consensus_queue.cc:1048] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:20.730244  1033 raft_consensus.cc:697] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 4 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:20.749789   980 consensus_queue.cc:1048] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:13:20.755026  1033 consensus_queue.cc:237] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:20.557003  1356 consensus_queue.cc:1048] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.202s
I20260709 13:13:20.768971  1358 consensus_queue.cc:1059] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:20.769124  1243 consensus_queue.cc:237] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:20.770059  1358 raft_consensus.cc:3055] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:20.752439  1099 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:20.741806  1179 consensus_queue.cc:1048] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:13:20.770407  1358 raft_consensus.cc:740] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:20.757259  1357 consensus_queue.cc:1059] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:13:20.756685  1302 consensus_queue.cc:1048] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:13:20.770910  1298 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:13:20.818979 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:20.820672 32123 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:20.824467  1358 consensus_queue.cc:260] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:20.804872  1099 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:20.828691 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:20.800345  1359 consensus_queue.cc:1048] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:13:20.776207  1296 consensus_queue.cc:1048] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:13:20.826285  1347 raft_consensus.cc:3055] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:20.830955  1358 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:20.853976  1130 consensus_queue.cc:1059] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:13:20.771643  1304 consensus_queue.cc:237] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:20.851861  1150 consensus_queue.cc:1048] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:13:20.875005  1179 consensus_queue.cc:1059] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:20.817620  1362 consensus_queue.cc:237] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:20.826381  1357 consensus_queue.cc:1048] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:13:20.868292  1347 raft_consensus.cc:740] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:20.876365  1302 consensus_queue.cc:1059] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:13:20.879375 32123 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:20.908265 32124 raft_consensus.cc:1240] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:13:20.853299  1099 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:20.912171 32123 raft_consensus.cc:1275] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:13:20.913781  1376 log.cc:927] Time spent T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:13:20.915025  1368 log.cc:927] Time spent T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:13:20.917925 32122 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:20.918419 32019 catalog_manager.cc:5697] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 3 to 4, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 4 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } }
I20260709 13:13:20.920331 32019 catalog_manager.cc:5697] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 1 to 2, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 2 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:20.879860  1265 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:20.922139 32019 catalog_manager.cc:5697] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 2 to 3, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 3 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
W20260709 13:13:20.924086 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 56416.5us
I20260709 13:13:20.924342 32019 catalog_manager.cc:5697] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:20.927901  1099 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:20.931075  1153 consensus_meta.cc:287] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.501s	user 0.004s	sys 0.004s
I20260709 13:13:20.932662 32019 catalog_manager.cc:5697] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 1 to 2, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:20.878750  1236 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:20.944548 32121 raft_consensus.cc:1240] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: []
W20260709 13:13:20.946657  1378 log.cc:927] Time spent T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:13:20.947788  1236 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:20.940726  1379 raft_consensus.cc:3055] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:20.963426  1379 raft_consensus.cc:740] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:20.944382  1347 consensus_queue.cc:260] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:20.957274  1298 consensus_queue.cc:1048] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:20.958055  1357 consensus_queue.cc:1048] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:20.958509  1389 consensus_queue.cc:1059] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:20.950161  1150 consensus_queue.cc:1059] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:13:20.931546  1153 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:20.956259  1130 consensus_queue.cc:1048] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:13:20.976055 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.978855  1267 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:20.986317  1347 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:20.964323  1379 consensus_queue.cc:260] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:20.987126  1379 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:20.973181  1349 raft_consensus.cc:3055] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:20.998974 32239 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:20.995203  1349 raft_consensus.cc:740] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:21.011065  1349 consensus_queue.cc:260] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.012224  1349 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:21.013640  1304 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:21.014232  1304 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.016189  1365 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:21.026458 32115 raft_consensus.cc:1240] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:21.016499  1304 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.026866  1392 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:21.067593 32120 raft_consensus.cc:1240] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 4 LEADER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:21.019780  1389 consensus_queue.cc:1048] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:13:21.036072  1357 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:13:21.099658  1345 raft_consensus.cc:3055] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:21.100246  1345 raft_consensus.cc:740] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:21.101312  1345 consensus_queue.cc:260] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.103153  1345 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:21.103703  1302 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.104233  1302 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:21.107564   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:21.108222 32265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 893) took 1293 ms. Trace:
I20260709 13:13:21.108678 32265 rpcz_store.cc:276] 0709 13:13:19.814809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.816284 (+  1475us) service_pool.cc:224] Handling call
0709 13:13:19.854364 (+ 38080us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:20.332503 (+478139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.107942 (+775439us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b5400305554. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:21.108146 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1050702592}
I20260709 13:13:21.110018  1302 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:21.113133 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:21.090008  1153 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.118141 32124 raft_consensus.cc:1275] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:13:21.122237 32239 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:21.132606  1236 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:21.124812  1349 consensus_queue.cc:1059] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:13:21.134259  1236 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:21.134601  1395 log.cc:927] Time spent T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:13:21.081624  1392 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:21.155049  1391 log.cc:927] Time spent T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:13:21.155493  1294 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:21.157161 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.150604  1153 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:21.139204  1267 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:21.185640  1396 log.cc:927] Time spent T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:13:21.171099  1389 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:21.190241  1236 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.205283  1153 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:21.226881 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.227974  1153 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.172560   986 consensus_queue.cc:1048] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.004s
W20260709 13:13:21.220528 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 60529.5us
W20260709 13:13:21.233896 32089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.001s	sys 0.034s
W20260709 13:13:21.234268 32089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.001s	sys 0.034s
W20260709 13:13:21.234777 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 761506us
I20260709 13:13:21.235400 32089 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:21.238788  1236 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:21.241602  1236 raft_consensus.cc:697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 6 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
W20260709 13:13:21.245728 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.254453 32089 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:21.255264  1153 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:21.255657  1153 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:21.256062  1153 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:21.264207  1153 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.265336 32089 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:21.266549  1153 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.266844  1122 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:21.267436  1122 raft_consensus.cc:697] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:21.268356  1122 consensus_queue.cc:237] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.236660  1307 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:21.242463  1236 consensus_queue.cc:237] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.289004  1307 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.295114 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:13:21.305123 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 71851.9us
I20260709 13:13:21.322593  1033 consensus_queue.cc:1048] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:21.323000  1230 raft_consensus.cc:3055] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:21.323598  1230 raft_consensus.cc:740] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:13:21.327709  1033 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:21.328419  1033 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.330659  1033 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.331037 32022 catalog_manager.cc:5697] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 1 to 4, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 4 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:21.347149  1373 log.cc:927] Time spent T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.543s	user 0.004s	sys 0.000s
I20260709 13:13:21.340023  1230 consensus_queue.cc:260] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:21.349843  1230 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:21.354041  1392 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:21.367162  1403 log.cc:927] Time spent T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.300s	user 0.000s	sys 0.003s
I20260709 13:13:21.387943  1270 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.393422 32120 raft_consensus.cc:1240] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:21.411737 32193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1089) took 1048 ms. Trace:
I20260709 13:13:21.419967  1106 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.415643  1146 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.418022  1268 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.418985  1363 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:21.428000 32196 raft_consensus.cc:1240] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:21.423691  1270 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.420259  1265 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:21.426744 32191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1081) took 1073 ms. Trace:
I20260709 13:13:21.434279  1363 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.435617 32191 rpcz_store.cc:276] 0709 13:13:20.352934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.353036 (+   102us) service_pool.cc:224] Handling call
0709 13:13:20.353258 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:20.538026 (+184768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.426475 (+888449us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54001d2ed4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:21.426670 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":422823680}
I20260709 13:13:21.422858  1267 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.438035  1267 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.438726  1363 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.439457  1363 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:21.440009  1363 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.440830  1267 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.418322  1236 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:21.422979  1352 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.423655  1306 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:21.426128  1033 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:21.421703  1320 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:21.443339 32123 raft_consensus.cc:1240] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:21.429811  1106 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:13:21.432561  1268 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.430907  1146 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.461602  1236 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.473541  1106 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.474177  1106 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:21.441864  1270 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.444059  1265 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.456694  1352 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.464651  1320 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.461082  1267 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:21.463289  1033 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.474663  1106 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.496699  1427 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.463347  1306 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.504086  1363 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.504325  1268 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.505029  1363 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:21.505223  1268 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:21.505739  1363 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.505993  1268 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.511619  1363 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.514403  1363 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:21.514560  1431 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.515092  1363 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.515440  1431 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.516938  1430 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:21.517691  1430 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:13:21.518805  1431 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.519645  1431 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:21.520164  1431 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.520955  1430 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.521834  1430 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.522922 32191 raft_consensus.cc:1240] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:21.524163  1430 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.492494  1428 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:21.526762 32190 raft_consensus.cc:1275] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:21.495498  1429 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:21.528373 32191 raft_consensus.cc:1240] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:13:21.493919  1267 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:21.537434  1420 log.cc:927] Time spent T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:13:21.537988  1432 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:21.538615  1432 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.528079  1433 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:21.530596  1033 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:21.537523  1404 log.cc:927] Time spent T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.294s	user 0.000s	sys 0.004s
I20260709 13:13:21.546398 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:21.513348  1427 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.549161 32190 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:21.551143 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:21.551892 32190 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:21.549893  1146 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.567041  1431 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.567229  1106 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.566987  1146 consensus_queue.cc:1059] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:13:21.570115  1146 raft_consensus.cc:3055] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:21.570490  1146 raft_consensus.cc:740] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:21.571533  1146 consensus_queue.cc:260] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.573025  1270 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.573004  1146 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:21.574759  1267 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.549968  1268 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.548261  1433 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.578938  1433 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.580993  1430 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.583026 32196 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:21.598726 32190 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:21.584513 32165 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:21.604192 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:21.542322  1429 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.605098  1430 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:21.605366  1427 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.606550  1306 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.607141  1429 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.541177  1428 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.609149 32199 pending_rounds.cc:85] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 1
I20260709 13:13:21.609566 32199 pending_rounds.cc:107] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:13:21.609874 32199 raft_consensus.cc:2889] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:21.612648 32190 raft_consensus.cc:2393] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 4: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:21.611119  1265 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.613806 32089 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:21.615471 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:21.616500 32089 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:21.617141 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:21.618595 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:21.619057  1430 raft_consensus.cc:697] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:21.622530 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:21.624984 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:21.625662 32190 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:21.619488  1033 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:21.631353  1428 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.631101  1430 consensus_queue.cc:237] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.632666   980 raft_consensus.cc:3055] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:21.633224   980 raft_consensus.cc:740] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:21.634743  1388 raft_consensus.cc:3055] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:21.634240   980 consensus_queue.cc:260] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.635157  1388 raft_consensus.cc:740] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:21.624450  1304 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:21.646509  1388 consensus_queue.cc:260] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.648751  1426 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.649847  1388 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:21.649608  1426 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.650833  1304 raft_consensus.cc:697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:21.635778   980 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:21.651820  1304 consensus_queue.cc:237] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.661031  1428 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:21.662057  1428 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.665824 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:21.667675 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:21.636479  1432 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.629630  1033 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:21.675323  1033 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:21.683878 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:21.685797 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:21.686574 32194 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:21.687852 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:21.689357 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:21.690186 32194 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:21.688336 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:21.412196 32193 rpcz_store.cc:276] 0709 13:13:20.363259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.367399 (+  4140us) service_pool.cc:224] Handling call
0709 13:13:20.367749 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:20.368013 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:20.371826 (+  3813us) log.cc:844] Serialized 14 byte log entry
0709 13:13:20.607196 (+235370us) log.cc:844] Serialized 14 byte log entry
0709 13:13:21.016842 (+409646us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b18002e10e0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bf043f3 00007fb59bf067c1 00007fb59bf06779 00007fb59bf06709 00007fb59bf066d1 00007fb59bf059cd 000000000038f354 000000000038f199 00007fb59bee783a
0709 13:13:21.411241 (+394399us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b18002e10e0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59be7ec0a 00007fb5a55be219 00007fb59bf06a40 00007fb59bf014e4 00007fb59bf01455 00007fb59efe9060 00007fb59effb716 00007fb59f00c287 00007fb59f00c208
0709 13:13:21.411413 (+   172us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:21.411462 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:21.411502 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.411566 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:21.411679 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":788815,"prepare.queue_time_us":3015,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":69,"raft.queue_time_us":806305,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":3550,"spinlock_wait_cycles":64305280,"thread_start_us":234604,"threads_started":1,"wal-append.queue_time_us":397039}
I20260709 13:13:21.707926  1426 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:21.711246 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 298381us
W20260709 13:13:21.713935 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:21.717043 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:21.721048 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.721743  1392 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:21.722465 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.722257  1392 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.723677 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:21.724406  1392 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:21.725082 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:21.726336 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:21.728305 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:21.730203 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:21.732684  1298 raft_consensus.cc:3055] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:13:21.732923  1436 log.cc:927] Time spent T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:13:21.733275  1298 raft_consensus.cc:740] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:21.736485  1398 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:21.737141  1398 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:21.737912  1394 log.cc:927] Time spent T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.708s	user 0.004s	sys 0.000s
I20260709 13:13:21.739567  1398 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:21.742523  1294 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:21.742736  1400 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:21.743150  1294 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.743386  1358 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.744165  1358 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.745553  1294 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:21.747026  1358 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:21.747447 32238 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:21.743242  1400 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.747185  1351 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:21.749588 32269 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:21.776211 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:21.779389 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:21.734383  1298 consensus_queue.cc:260] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.775128 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:21.775220 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:21.783690  1428 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.784008 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:21.784297 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:21.786283 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:21.785804 32266 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:21.775039  1173 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:21.788435 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:21.788767 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:21.790162 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:21.792943 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:21.794564 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:21.794598 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:21.779218  1392 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:21.796147 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:21.797062 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:21.797971 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 49411.8us
I20260709 13:13:21.799240 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:21.800789 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:21.789146  1302 consensus_queue.cc:1048] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:13:21.797979  1150 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:21.802433  1150 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:21.802529  1307 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:21.802860  1150 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:21.789129  1388 consensus_queue.cc:1059] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:13:21.786332 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:21.796428  1173 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.804417 32195 raft_consensus.cc:1275] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:21.800855 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:21.808020 32271 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:13:21.805177 32022 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59534 (request call id 40) took 1455 ms. Trace:
I20260709 13:13:21.809140 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:21.811548  1173 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.809806 32022 rpcz_store.cc:276] 0709 13:13:20.350158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.357844 (+  7686us) service_pool.cc:224] Handling call
0709 13:13:21.805097 (+1447253us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:21.334608 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:21.337530 (+  2922us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:21.337564 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:13:21.338021 (+   457us) tablet.cc:662] Decoding operations
0709 13:13:21.338736 (+   715us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:21.338821 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:21.338856 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:13:21.389512 (+ 50656us) tablet.cc:701] Row locks acquired
0709 13:13:21.389543 (+    31us) write_op.cc:260] PREPARE: finished
0709 13:13:21.389800 (+   257us) write_op.cc:270] Start()
0709 13:13:21.389980 (+   180us) write_op.cc:276] Timestamp: P: 1783602801389733 usec, L: 0
0709 13:13:21.390013 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:13:21.485113 (+ 95100us) log.cc:844] Serialized 529 byte log entry
0709 13:13:21.548711 (+ 63598us) op_driver.cc:464] REPLICATION: finished
0709 13:13:21.588192 (+ 39481us) write_op.cc:301] APPLY: starting
0709 13:13:21.588315 (+   123us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:21.588449 (+   134us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:21.588663 (+   214us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:21.588967 (+   304us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:21.589187 (+   220us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:13:21.589260 (+    73us) write_op.cc:312] APPLY: finished
0709 13:13:21.589530 (+   270us) log.cc:844] Serialized 22 byte log entry
0709 13:13:21.589781 (+   251us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:21.589890 (+   109us) write_op.cc:454] Released schema lock
0709 13:13:21.589941 (+    51us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":145286,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":38152,"apply.run_cpu_time_us":2186,"apply.run_wall_time_us":2185,"num_ops":1,"prepare.queue_time_us":102,"replication_time_us":154409,"spinlock_wait_cycles":126066048,"thread_start_us":25417,"threads_started":1}]]}
I20260709 13:13:21.822839 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:21.775621  1351 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.825877 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:21.823881 32195 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:21.828088 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:21.830127 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:21.839570 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:21.840107 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:21.836462 32089 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:21.841904 32089 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:21.848724 32190 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:21.844548  1380 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:21.815917  1236 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:21.807385  1392 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.868899 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:21.873762 32270 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:21.878166 32124 raft_consensus.cc:1240] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:21.853004  1009 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:21.876536 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:21.860569  1380 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:21.892792  1380 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:21.894942 32117 raft_consensus.cc:1240] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: []
W20260709 13:13:21.882550 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 61759.1us
I20260709 13:13:21.805204  1326 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:13:21.883337 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:21.883275  1445 log.cc:927] Time spent T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:13:21.884855 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 66350.7us
I20260709 13:13:21.882018  1264 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:21.886713 32198 raft_consensus.cc:1240] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:21.887140  1434 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:21.889832  1392 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:21.894822  1400 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:21.936255  1351 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:21.936133  1334 consensus_queue.cc:1059] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:21.868270  1173 consensus_queue.cc:1048] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:13:21.938050  1351 raft_consensus.cc:3055] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:21.899932 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:21.874764  1430 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:21.878552  1428 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:21.943171 32238 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:21.943289 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:21.932492 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:21.881690  1009 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:21.938426  1351 raft_consensus.cc:740] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:21.933993  1426 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:21.952888 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:21.975574 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:21.947057  1430 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.939342  1431 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.984807 32238 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:21.987097 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:22.001262 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:21.953198  1009 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:22.004804 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:21.950887  1146 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:22.002292 32116 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:22.017266 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:22.026876 32191 raft_consensus.cc:1275] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:21.939249  1264 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:22.047616 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 62888.4us
I20260709 13:13:21.944887  1434 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:22.003686  1334 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:21.951670  1428 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:22.043802  1236 consensus_queue.cc:1048] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:13:21.985440  1426 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:21.956740  1033 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:22.045990 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:22.051774 32197 raft_consensus.cc:1275] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:22.059235 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:22.067498 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:22.059657 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:22.066042 32271 raft_consensus.cc:2410] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:22.059953 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:22.068722 32123 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:22.072772 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:22.063617  1428 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:22.073935 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:22.074290 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:22.074970 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:22.078155 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:22.077282 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:22.082391 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:22.071308  1122 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.012s	sys 0.010s
I20260709 13:13:22.087149 32122 raft_consensus.cc:1240] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:22.054080  1334 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:22.066390  1398 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:22.010120  1431 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:22.092543 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:22.093361 32271 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
I20260709 13:13:22.042748  1146 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:22.089649  1122 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.012s	sys 0.010s
W20260709 13:13:22.139930 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 89943.6us
I20260709 13:13:22.095165  1334 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:22.144019 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:22.094683  1398 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:22.153864 32271 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
I20260709 13:13:22.053696  1351 consensus_queue.cc:260] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:22.090233  1153 consensus_queue.cc:1048] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:13:22.152251  1430 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:22.159428  1398 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:22.169188  1401 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.104s	user 0.038s	sys 0.071s
I20260709 13:13:22.188021  1351 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:22.516714 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 346423us
I20260709 13:13:22.519037 32193 raft_consensus.cc:1240] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
W20260709 13:13:22.400419 32195 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.024s	sys 0.039s
I20260709 13:13:22.452718 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:22.453300  1146 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:22.454878 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:22.534914 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:22.536198  1426 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:22.536779 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:22.538082 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:22.538323 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:22.539713 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:22.519330  1450 log.cc:927] Time spent T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.374s	user 0.011s	sys 0.007s
I20260709 13:13:22.543032 32196 raft_consensus.cc:1275] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:22.545194  1457 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:22.546243  1457 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:22.549948  1457 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:22.454810  1009 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:22.391049 32194 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.009s	sys 0.054s
I20260709 13:13:22.457331 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:22.551219 32194 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.012s	sys 0.062s
I20260709 13:13:22.551687 32272 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:22.553064 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:22.457240 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:22.459565 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:22.462756 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:22.469200  1033 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:22.536484 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:22.472499  1230 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:22.475714 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:22.478778 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:22.189728  1401 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.125s	user 0.038s	sys 0.072s
I20260709 13:13:22.137264  1411 consensus_queue.cc:1059] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.254s
I20260709 13:13:22.561504  1009 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:22.463776  1153 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:22.565101  1153 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:22.566071 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:22.505550  1431 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:22.569514 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:22.569701 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:22.571309 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:22.572494 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:22.573745 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:22.574127 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:22.575424 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:22.575718 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:22.571238 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:22.577158  1230 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:22.578517  1320 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:22.511675  1432 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.581002  1432 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:22.582434 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:22.511834  1434 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:22.512562  1406 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.016s	sys 0.010s
W20260709 13:13:21.805924  1329 consensus_queue.cc:1175] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "113b5461952d47e0944d463ea4e32801" responder_term: 5 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:13:22.090425   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 313245us
I20260709 13:13:22.530833  1270 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:22.531137 32195 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.027s	sys 0.050s
I20260709 13:13:22.519487 32191 raft_consensus.cc:1275] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:13:22.539739 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:22.559746  1304 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.577792 32115 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:13:22.507673 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:22.584245 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:13:22.590672 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 72453us
I20260709 13:13:22.596611 32267 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:22.598174 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:22.598596 32195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1124) took 1012 ms. Trace:
W20260709 13:13:22.595115  1406 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.017s	sys 0.010s
I20260709 13:13:22.603729 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:22.582976  1352 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:22.604928 32196 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:13:22.609339 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:22.608125  1304 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:22.599200 32195 rpcz_store.cc:276] 0709 13:13:21.586170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.840419 (+254249us) service_pool.cc:224] Handling call
0709 13:13:21.840748 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:21.841340 (+   592us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:21.841370 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:21.842038 (+   668us) log.cc:844] Serialized 26 byte log entry
0709 13:13:22.597987 (+755949us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:22.598128 (+   141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.598264 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:22.598328 (+    64us) raft_consensus.cc:1685] finished
0709 13:13:22.598346 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.598531 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":77,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":113,"thread_start_us":746325,"threads_started":1,"wal-append.queue_time_us":689492}
I20260709 13:13:22.614243  1304 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:22.617136  1270 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:22.618103  1411 consensus_queue.cc:1059] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:13:22.619033  1380 consensus_meta.cc:287] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.726s	user 0.018s	sys 0.004s
I20260709 13:13:22.619246 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:22.619905  1411 raft_consensus.cc:3055] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:22.620076 32121 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 4.
I20260709 13:13:22.599722  1363 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:22.585170  1153 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:22.610440 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:22.619562  1380 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:22.627178 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:22.628036 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:22.639400 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:22.632344 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:22.620409  1270 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:22.642438  1153 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:22.643675 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:22.641086 32193 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 4.
I20260709 13:13:22.644809 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:22.646210 32118 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
I20260709 13:13:22.636214  1432 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:22.650527 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:22.620411  1411 raft_consensus.cc:740] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:22.658725  1380 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:22.652925  1153 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:22.660178 32194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 967) took 1112 ms. Trace:
W20260709 13:13:22.660501 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:22.664011  1150 consensus_meta.cc:287] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.861s	user 0.022s	sys 0.004s
I20260709 13:13:22.672241  1264 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:22.677008 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:22.656204  1230 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:22.649345  1304 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:22.713802 32117 raft_consensus.cc:2393] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 3: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:22.679673 32194 rpcz_store.cc:276] 0709 13:13:21.548110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.690948 (+142838us) service_pool.cc:224] Handling call
0709 13:13:21.691302 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:21.691547 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:22.551828 (+860281us) log.cc:844] Serialized 14 byte log entry
0709 13:13:22.659506 (+107678us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:22.659655 (+   149us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:22.659789 (+   134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.659913 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.660103 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":351057,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":12908,"raft.queue_time_us":8481,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":175,"thread_start_us":955031,"threads_started":2}
W20260709 13:13:22.717651 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 77604.3us
I20260709 13:13:22.728511 32264 raft_consensus.cc:1275] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:22.693550  1150 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:22.743377 32124 raft_consensus.cc:1240] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:22.743616  1359 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.744411  1359 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:22.744549  1304 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:22.744572 32273 raft_consensus.cc:2393] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 4: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:22.746372  1150 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:22.752624 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 48064.1us
I20260709 13:13:22.756753 32165 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:22.758168  1153 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:22.761353  1363 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:22.765951  1243 consensus_queue.cc:1048] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:13:22.766708 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.767840  1243 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:22.768983  1236 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:22.769743  1236 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:22.772603  1033 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:22.773306  1033 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:22.774266 32269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36080 (request call id 900) took 1051 ms. Trace:
I20260709 13:13:22.774696 32269 rpcz_store.cc:276] 0709 13:13:21.722512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.724776 (+  2264us) service_pool.cc:224] Handling call
0709 13:13:22.773918 (+1049142us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b5400427cd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:22.774088 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54214400}
W20260709 13:13:22.776301  1398 consensus_meta.cc:287] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.574s	user 0.009s	sys 0.009s
I20260709 13:13:22.776935  1398 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:22.779657  1298 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:22.782871  1150 consensus_queue.cc:1059] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:13:22.785732  1304 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:22.788244  1334 consensus_meta.cc:287] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.623s	user 0.007s	sys 0.011s
I20260709 13:13:22.780246  1398 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:22.792309 32268 raft_consensus.cc:2410] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:13:22.758119 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 44549.4us
I20260709 13:13:22.794869 32272 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:22.818431 32264 raft_consensus.cc:1275] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:22.772194  1236 leader_election.cc:290] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:22.815153  1359 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:22.818158  1033 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:22.810165  1334 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:22.823045  1398 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:22.834816  1236 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:22.862165 32270 raft_consensus.cc:1240] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:22.862080 32165 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:22.814078  1243 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:22.840955   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 100145us
I20260709 13:13:22.872004  1304 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.849699  1033 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:13:22.884022 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 123713us
I20260709 13:13:22.873085  1304 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:22.861692  1236 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:22.884207  1363 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:22.878264  1398 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:22.896404   980 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.899519   980 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:22.900278  1243 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:22.896505   986 consensus_queue.cc:1059] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
W20260709 13:13:22.906176 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 76262us
I20260709 13:13:22.906828 32271 raft_consensus.cc:1275] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:22.907217 32165 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:22.908829  1432 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:13:22.896467  1399 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.801s	user 0.014s	sys 0.034s
I20260709 13:13:22.910766   980 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:22.913115  1399 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.847s	user 0.015s	sys 0.035s
W20260709 13:13:22.916980 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 116636us
I20260709 13:13:22.919167  1388 raft_consensus.cc:3055] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:22.920831 32190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1132) took 1290 ms. Trace:
I20260709 13:13:22.921164 32190 rpcz_store.cc:276] 0709 13:13:21.630085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.911304 (+281219us) service_pool.cc:224] Handling call
0709 13:13:21.911637 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:22.030765 (+119128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:22.030811 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:22.030867 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:22.030911 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.920416 (+889505us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54002a7e54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:22.920479 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.920703 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":273310592}
I20260709 13:13:22.919709  1388 raft_consensus.cc:740] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:22.928905   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:22.929777   402 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:22.929553  1388 consensus_queue.cc:260] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:22.933017  1334 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:22.894910  1033 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:22.889724   368 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:13:22.935211 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 54062.4us
I20260709 13:13:22.939028  1398 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:22.919667  1304 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:22.940151 32239 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:22.935747   986 raft_consensus.cc:3055] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:22.941332   986 raft_consensus.cc:740] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:22.936795  1379 raft_consensus.cc:3055] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:22.936717 32236 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:13:22.942940  1379 raft_consensus.cc:740] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:22.943951  1388 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:22.944094  1379 consensus_queue.cc:260] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:22.945930   986 consensus_queue.cc:260] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:22.947881   986 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:22.949453  1243 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:22.950239  1418 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.950366  1243 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:22.950822  1418 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:22.952718 32165 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:22.953176  1418 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:22.953774  1363 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:22.954243  1363 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:22.954631  1363 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:22.957315 32268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36080 (request call id 906) took 1204 ms. Trace:
I20260709 13:13:22.957749 32268 rpcz_store.cc:276] 0709 13:13:21.752959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.753507 (+   548us) service_pool.cc:224] Handling call
0709 13:13:22.957081 (+1203574us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54001f7054. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:22.957257 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2313042688}
I20260709 13:13:22.959532  1304 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:22.959487 32265 raft_consensus.cc:1275] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:13:22.967046 32265 pending_rounds.cc:85] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06: Aborting all ops after (but not including) 2
I20260709 13:13:22.969099 32265 pending_rounds.cc:107] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:13:22.969494 32265 raft_consensus.cc:2889] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:22.969542  1406 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:22.969962 32239 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:22.970773  1243 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:22.971242 32124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1185) took 1081 ms. Trace:
W20260709 13:13:22.971462   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 86319.8us
I20260709 13:13:22.972222  1457 raft_consensus.cc:2804] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:22.972754  1457 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:22.973304  1457 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:22.972050 32124 rpcz_store.cc:276] 0709 13:13:21.889788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.890235 (+   447us) service_pool.cc:224] Handling call
0709 13:13:21.890529 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:22.743973 (+853444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.970920 (+226947us) spinlock_profiling.cc:243] Waited 744 ms on lock 0x7b54002c88d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:22.971171 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1712142080}
I20260709 13:13:22.976137  1356 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:22.978513 32197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:13:22.979559 32197 raft_consensus.cc:606] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:22.980019 32197 raft_consensus.cc:614] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:22.960794  1304 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:22.983189  1304 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:22.983690  1411 consensus_queue.cc:260] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:22.985052  1411 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:22.986490  1304 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:22.987187  1304 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:22.988214 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 51639.3us
I20260709 13:13:22.990432 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:22.989097 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 70190.2us
I20260709 13:13:22.963896 32165 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:22.993055 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:22.993942 32199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 956) took 1448 ms. Trace:
I20260709 13:13:22.994431 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:22.996436 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:22.990175  1476 raft_consensus.cc:2804] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:23.000826 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:22.964949  1359 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.003273 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:23.003099 32273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36080 (request call id 919) took 1209 ms. Trace:
I20260709 13:13:23.007686 32266 raft_consensus.cc:1240] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:23.008098 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:23.008704 32267 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:23.009456  1380 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:23.010202  1380 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.006485 32273 rpcz_store.cc:276] 0709 13:13:21.793721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.796842 (+  3121us) service_pool.cc:224] Handling call
0709 13:13:23.000763 (+1203921us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b540014d054. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:23.003041 (+  2278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2173538176}
I20260709 13:13:23.017156 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:23.003016  1432 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:23.018461  1401 consensus_queue.cc:1048] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:13:23.021358  1471 log.cc:927] Time spent T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:13:23.002182  1476 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:23.002681  1243 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:23.022493  1476 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:22.994352 32199 rpcz_store.cc:276] 0709 13:13:21.545097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.545231 (+   134us) service_pool.cc:224] Handling call
0709 13:13:21.545537 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:21.610504 (+ 64967us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:21.610551 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:21.611064 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:13:21.748921 (+137857us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:22.065967 (+317046us) log.cc:844] Serialized 14 byte log entry
0709 13:13:22.067283 (+  1316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.635867 (+568584us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b18003fc1c0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bed22a6 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419
0709 13:13:22.993433 (+357566us) spinlock_profiling.cc:243] Waited 63.3 ms on lock 0x7b54002ea754. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:22.993485 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:22.993548 (+    63us) raft_consensus.cc:1685] finished
0709 13:13:22.993559 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.993728 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40159,"prepare.queue_time_us":312362,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":396,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":8205,"spinlock_wait_cycles":155080320,"thread_start_us":411536,"threads_started":2,"wal-append.queue_time_us":117598}
W20260709 13:13:23.038594 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 78119.8us
I20260709 13:13:23.040064 32165 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:23.040673 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:23.040956  1432 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:23.041476  1432 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:23.041908  1432 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:23.041966 32268 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:23.043022 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:23.045501  1437 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:23.046140  1437 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.051568 32165 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:23.052631  1264 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:23.053166  1264 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:23.053596  1264 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:23.055656 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:23.056205  1432 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.058338  1432 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:23.058696  1359 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.059191 32165 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:23.059365 32273 raft_consensus.cc:1275] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:23.059975 32268 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:13:23.060367 32268 pending_rounds.cc:85] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06: Aborting all ops after (but not including) 2
I20260709 13:13:23.060680 32268 pending_rounds.cc:107] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:13:23.060364 32165 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:23.061024 32268 raft_consensus.cc:2889] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:23.063495  1270 raft_consensus.cc:2804] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:23.064075  1270 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:23.064126 32165 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:23.064527  1270 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:23.065073  1430 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:23.066596  1352 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.067214  1352 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.069056  1430 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:23.069579  1430 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:23.072027  1352 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:23.076984 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:23.079964 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:23.080731  1399 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
W20260709 13:13:23.089330  1471 log.cc:927] Time spent T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:13:23.105839 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:23.103577 32090 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:23.105479 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:23.109074 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 45061.4us
I20260709 13:13:23.113229 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:23.114867 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:23.080758  1430 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.111303 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:23.120985 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:23.122942 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:23.105876  1304 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:23.119071  1352 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:23.113538  1437 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:23.137018 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:23.121207  1153 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:23.138058 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:23.141548 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:23.142690 32121 raft_consensus.cc:1275] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:23.109789  1243 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.149495 32118 raft_consensus.cc:2393] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 4: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:23.129621  1236 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:23.111387  1457 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:13:23.154536 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 123666us
I20260709 13:13:23.141898  1352 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:23.155821 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:23.156780 32165 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:23.159454 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:23.160156 32266 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:23.157729 32267 raft_consensus.cc:2376] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5. Re-sending same reply.
I20260709 13:13:23.129302  1399 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:23.158147  1352 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:23.167966 32165 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.167182 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:23.174279  1476 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:23.174759  1432 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:23.175264  1432 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:23.170262  1411 consensus_queue.cc:1059] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:13:23.175719  1432 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:23.178545  1349 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.179159  1437 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:23.179555  1380 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:23.179179  1349 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.179605  1388 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.184098  1173 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:23.185093  1379 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:23.184909  1173 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.163317  1033 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:23.179734  1437 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:23.189759  1270 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.190408   401 raft_consensus.cc:1240] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:23.190707   986 consensus_queue.cc:1059] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:23.193764 32119 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:13:23.197101  1243 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:23.199878  1399 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:23.210023 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:23.239914 32195 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:23.239701  1363 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.209707 32021 catalog_manager.cc:5697] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:23.209713 32090 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:23.213621  1349 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:23.213816  1430 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:23.215988 32019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49550 (request call id 164) took 3786 ms. Trace:
I20260709 13:13:23.216171 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:23.244242  1363 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:23.216665   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:23.216902 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:23.217264 32118 raft_consensus.cc:1240] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:23.217607   986 raft_consensus.cc:3055] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:23.246757   986 raft_consensus.cc:740] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:23.247948   986 consensus_queue.cc:260] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.249186   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:13:23.249413   986 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:23.248939 32021 catalog_manager.cc:5697] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 3 to 5, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 5 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:23.250003  1264 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.247835  1380 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:23.205542  1437 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:23.251951  1418 consensus_queue.cc:1059] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:23.252262  1264 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:23.224792  1359 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:23.212311  1388 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.233495 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:23.233722 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:23.287411 32117 raft_consensus.cc:2410] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:13:23.234159 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:23.234563 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:23.235092  1270 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:23.217268  1476 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:23.238992 32123 raft_consensus.cc:1240] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
W20260709 13:13:23.243345 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 75070.9us
I20260709 13:13:23.253957 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:23.255306  1334 raft_consensus.cc:3055] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:23.247267 32019 rpcz_store.cc:276] 0709 13:13:19.429487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.429668 (+   181us) service_pool.cc:224] Handling call
0709 13:13:23.215714 (+3786046us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:20.978809 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:20.979773 (+   964us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:20.979820 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:13:20.979859 (+    39us) tablet.cc:662] Decoding operations
0709 13:13:20.980868 (+  1009us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:20.980981 (+   113us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:20.981024 (+    43us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:13:20.981785 (+   761us) tablet.cc:701] Row locks acquired
0709 13:13:20.981811 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:13:20.982008 (+   197us) write_op.cc:270] Start()
0709 13:13:20.982147 (+   139us) write_op.cc:276] Timestamp: P: 1783602800981947 usec, L: 0
0709 13:13:20.982176 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:13:20.983073 (+   897us) log.cc:844] Serialized 2059 byte log entry
0709 13:13:21.321308 (+338235us) op_driver.cc:464] REPLICATION: finished
0709 13:13:21.470186 (+148878us) write_op.cc:301] APPLY: starting
0709 13:13:21.470311 (+   125us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:21.470521 (+   210us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:21.471909 (+  1388us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:21.493994 (+ 22085us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:21.527244 (+ 33250us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:13:21.529852 (+  2608us) write_op.cc:312] APPLY: finished
0709 13:13:21.543161 (+ 13309us) log.cc:844] Serialized 46 byte log entry
0709 13:13:21.545641 (+  2480us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:21.549433 (+  3792us) write_op.cc:454] Released schema lock
0709 13:13:21.551916 (+  2483us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:21.600960 (+ 49044us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:21.602413 (+  1453us) write_op.cc:454] Released schema lock
0709 13:13:22.771924 (+1169511us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b18002763a0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bf04522 00007fb59bf067c1 00007fb59bf06779 00007fb59bf06709 00007fb59bf066d1 00007fb59bf059cd 000000000038f354 000000000038f199 00007fb59bee783a
Metrics: {"mutex_wait_us":96778,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":147563,"apply.run_cpu_time_us":3805,"apply.run_wall_time_us":114686,"num_ops":5,"prepare.queue_time_us":32023,"prepare.run_cpu_time_us":11992,"prepare.run_wall_time_us":17463,"raft.queue_time_us":187886,"raft.run_cpu_time_us":41894,"raft.run_wall_time_us":168974,"replication_time_us":338994,"spinlock_wait_cycles":29916928,"thread_start_us":255339,"threads_started":4,"wal-append.queue_time_us":13064,"wal-append.run_cpu_time_us":33881,"wal-append.run_wall_time_us":1604089}]]}
I20260709 13:13:23.257565 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:23.258167  1380 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:23.259191 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 95180.2us
I20260709 13:13:23.295696 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:23.218979  1173 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:23.261797  1437 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.267506  1457 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:23.297314 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:23.298095 32199 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:23.298386  1437 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:23.301263 32090 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:23.302929 32090 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:23.303781 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:23.304973 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:23.305099 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:23.305851 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:23.306118 32273 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:23.306504 32265 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:23.307607 32198 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:23.305210 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:23.262128 32021 catalog_manager.cc:5697] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 1 to 2, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 2 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:23.270743 32195 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:23.317085 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:23.279939  1392 raft_consensus.cc:3055] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:23.280820 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:23.321717 32194 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:23.289686 32121 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:23.295089 32191 raft_consensus.cc:2393] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 5: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:23.318003 32116 raft_consensus.cc:2410] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:13:23.318778 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:23.316227 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:23.323839 32165 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:23.325011 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:23.323076 32122 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:13:23.325335 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:23.326328 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:23.327008 32122 raft_consensus.cc:2393] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 4: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:23.321388  1392 raft_consensus.cc:740] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:23.328178 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:23.328470 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:23.329152 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:23.329792 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:23.329210 32265 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:23.331614 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:23.333308 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:23.333448 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:23.334205 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:23.292883  1334 raft_consensus.cc:740] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:23.330717 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:23.334872 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:23.324505  1033 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:23.329813 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:23.331569 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:23.338296 32191 raft_consensus.cc:2410] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:13:23.336824 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:23.339139 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:23.342314 32119 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:23.328922  1392 consensus_queue.cc:260] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.344183  1392 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:23.337160  1153 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:13:23.345940 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:23.335404  1270 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:23.347221  1270 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.349334  1270 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:23.316267  1380 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.349984 32089 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:23.350319   986 consensus_queue.cc:1059] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:23.351029  1236 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:23.351459  1303 raft_consensus.cc:3055] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:23.351719  1380 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:23.351883  1303 raft_consensus.cc:740] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:23.352833  1303 consensus_queue.cc:260] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.364491 32090 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:23.366905 32165 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.369040 32190 raft_consensus.cc:1240] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:23.367983 32198 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:23.308063  1432 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.337312  1243 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:23.364188  1303 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:23.378439 32021 catalog_manager.cc:5697] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 1 to 4, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 4 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:23.383774 32021 catalog_manager.cc:5697] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 1 to 4, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 4 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:23.391441 32194 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 5.
I20260709 13:13:23.393694   402 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:23.384397  1430 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:23.408969  1430 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.409842  1334 consensus_queue.cc:260] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:23.411064  1430 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:23.411353  1334 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:23.412688  1264 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:23.415364 32121 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:23.422066  1432 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:23.423828 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:23.424439 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:23.426091 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:23.434873  1352 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.437892 32270 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:23.407192 32271 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:23.412815 32196 raft_consensus.cc:1240] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: [2.4-4.5]
I20260709 13:13:23.412722 32236 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:13:23.379355  1153 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.415999 32165 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.416189 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:23.416658  1388 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:23.417080 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:23.418810 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:13:23.400990 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 45772.5us
I20260709 13:13:23.420779 32238 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:23.446344 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 59871.3us
W20260709 13:13:23.453035 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.442246  1270 raft_consensus.cc:2764] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:13:23.455960 32090 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:23.453094 32199 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
W20260709 13:13:23.457293 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.458066 32239 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:23.454416 32021 catalog_manager.cc:5697] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 1 to 2, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 2 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:23.455384  1379 raft_consensus.cc:2804] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:13:23.469261 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 53363.8us
I20260709 13:13:23.471457 32265 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:13:23.472318 32265 raft_consensus.cc:606] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:23.472757 32265 raft_consensus.cc:614] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:23.471231 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:23.454106  1491 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:13:23.476011 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 55395.6us
I20260709 13:13:23.455713  1264 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.477248  1295 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:23.471038 32021 catalog_manager.cc:5697] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 1 to 2, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 2 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:23.445996  1153 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:23.500825 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 49190.6us
I20260709 13:13:23.478216  1352 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:23.479357  1363 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:23.488965  1437 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.489243 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.491026 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:23.507360  1437 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.508111 32165 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.508285 32197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:13:23.508901 32197 raft_consensus.cc:606] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.509254 32197 raft_consensus.cc:614] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:23.509449 32165 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.509675  1437 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:23.510131  1270 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:23.491730 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:23.511056  1363 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:23.511197 32165 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.492421 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:23.502035  1264 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.512709 32190 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:23.512718 32165 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.497187 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:23.514771 32198 raft_consensus.cc:2393] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 5: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:23.488371 32239 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.470369  1476 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:23.463304  1379 raft_consensus.cc:697] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:23.503717 32021 catalog_manager.cc:5697] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 1 to 4, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 4 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:23.482043  1243 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:23.515341 32238 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.516943 32165 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.513857  1352 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:23.516121  1295 raft_consensus.cc:697] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:23.517961  1130 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:23.530923 32238 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.527832  1295 consensus_queue.cc:237] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.533239  1437 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:23.533354 32165 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.533653  1476 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:23.534238  1430 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:23.535455 32165 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.528167  1363 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:23.536079 32021 catalog_manager.cc:5697] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:23.546222 32191 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:13:23.546883 32191 raft_consensus.cc:606] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.547231 32191 raft_consensus.cc:614] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:23.550025 32090 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:23.551357 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.522895  1304 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:23.552017  1153 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:23.558535 32238 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.549881  1270 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:23.561419 32021 catalog_manager.cc:5697] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 1 to 4, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 4 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:23.546347   986 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:23.554983  1352 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:23.569399 32192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d002861120de41408d48712b6bd491e1"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:13:23.574513 32192 raft_consensus.cc:606] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.571101  1349 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:23.574959 32192 raft_consensus.cc:614] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:23.564823  1243 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:23.581717 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.577865 32090 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:23.586443 32165 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.559753  1304 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.646989 32021 catalog_manager.cc:5697] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 1 to 2, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 2 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:23.664145 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 77759.9us
I20260709 13:13:23.593701  1363 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:13:23.669106 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 83310.3us
I20260709 13:13:23.672865 32021 catalog_manager.cc:5697] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 2 to 3, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 3 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:23.649992  1264 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:23.678960 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 88350.6us
I20260709 13:13:23.679857 32238 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.665752  1153 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:13:23.680148 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 105204us
I20260709 13:13:23.576086  1379 consensus_queue.cc:237] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:23.685461 32165 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.691174 32090 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:23.692384 32165 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.691965 32021 catalog_manager.cc:5697] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 1 to 4, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 4 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:23.690575 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:13:23.695096 32238 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.696442 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:23.703338  1345 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:23.703960  1345 raft_consensus.cc:697] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:13:23.705015  1492 log.cc:927] Time spent T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:13:23.704891  1345 consensus_queue.cc:237] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.713001 32238 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.714607  1296 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.715248  1296 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.715258  1303 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:23.715854 32238 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.717370  1296 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:23.717816  1303 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:23.724547  1304 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:23.727418 32238 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.688388  1363 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:23.728416  1399 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:23.729033  1399 raft_consensus.cc:697] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:23.692974  1349 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:23.735703 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 48832.1us
I20260709 13:13:23.735561 32021 catalog_manager.cc:5697] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 2 to 3, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 3 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:23.737905  1363 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:23.734017  1304 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:23.745112  1380 consensus_queue.cc:1048] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:13:23.745776  1494 log.cc:927] Time spent T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.170s	user 0.001s	sys 0.003s
I20260709 13:13:23.747936 32090 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:23.748003 32266 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 5.
I20260709 13:13:23.748302  1399 consensus_queue.cc:237] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.751538 32090 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:23.752103  1491 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:23.752782 32090 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:23.749119 32021 catalog_manager.cc:5697] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 3 to 4, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 4 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:23.749801  1173 consensus_queue.cc:1059] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:23.753182  1033 consensus_queue.cc:1059] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:23.748658  1304 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:23.752851  1491 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:23.747964  1380 consensus_queue.cc:1048] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:13:23.758003 32021 catalog_manager.cc:5697] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 1 to 4, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 4 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:23.760007  1236 raft_consensus.cc:3055] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:23.760421  1236 raft_consensus.cc:740] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:23.761322  1236 consensus_queue.cc:260] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.759123  1491 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:23.762532  1236 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:23.762756  1491 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:23.761425 32021 catalog_manager.cc:5697] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 2 to 3, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 3 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:23.764809  1495 log.cc:927] Time spent T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:13:23.765026  1122 raft_consensus.cc:3055] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:23.766301  1122 raft_consensus.cc:740] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:23.767414  1122 consensus_queue.cc:260] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.757364  1153 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:23.769285  1153 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:23.765429 32021 catalog_manager.cc:5697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:23.756202 32238 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.769650  1153 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:23.770139  1033 consensus_queue.cc:1048] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:23.771159  1122 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:23.755138 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 62831.8us
I20260709 13:13:23.774367  1349 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:23.775022 32165 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.777410 32238 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:23.777441 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.778841  1349 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:23.779671  1363 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:23.780735 32238 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.782039  1349 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:23.788224  1153 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.790618  1153 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:23.781149 32165 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.798149  1363 raft_consensus.cc:2749] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:23.799489 32165 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:23.806584   369 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.807917  1457 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:23.803896  1363 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:23.808869  1363 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:23.809244  1363 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:23.815796 32165 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.802480  1349 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:23.827546 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:23.828423 32195 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:23.826570  1349 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:23.834944 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 79830.1us
I20260709 13:13:23.835554 32165 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.837003 32090 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:23.840561 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:23.841274 32119 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:23.826932  1352 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:23.840469  1236 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:23.847223  1363 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.840410  1264 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:23.853225  1236 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:23.840659  1122 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:13:23.853669  1236 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:23.854698  1363 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:23.832518  1491 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.864311  1236 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.865051  1491 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:23.894109 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:23.894474 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:23.895004 32269 raft_consensus.cc:2393] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 5: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:23.895927 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:23.897207 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:23.897935  1236 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:23.898397 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:23.899606 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:23.900765 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:23.873396 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:23.875713 32165 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.894138 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:23.903888 32165 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:23.904865  1264 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:23.905640  1264 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:23.882699   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 44156.4us
I20260709 13:13:23.910004 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:23.910240 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:23.910898 32265 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:23.883913 32195 raft_consensus.cc:1240] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:23.910951  1349 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.901994 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:23.912442  1363 consensus_queue.cc:1048] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:23.912854 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:23.913417  1349 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:23.913486 32272 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:23.914356 32165 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:23.914979 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:23.917238 32090 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:23.918015  1236 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:23.918869 32265 pending_rounds.cc:85] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06: Aborting all ops after (but not including) 2
I20260709 13:13:23.919198 32265 pending_rounds.cc:107] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:13:23.919574 32265 raft_consensus.cc:2889] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:23.913655  1264 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:23.919994 32165 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:23.878639 32238 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:13:23.925099 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 46537.4us
I20260709 13:13:23.925037 32165 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:23.921334  1352 raft_consensus.cc:2804] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:23.920213 32090 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:23.929822 32271 raft_consensus.cc:1240] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:13:23.930725 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:23.931648 32195 raft_consensus.cc:2368] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 4. Current term is 5.
I20260709 13:13:23.933024 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:23.933600 32195 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:23.934773 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:23.938792 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:23.939357 32273 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:23.927979  1352 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:23.937912  1270 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:23.940786  1352 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:23.941112  1270 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:23.941800  1270 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:23.951486 32195 raft_consensus.cc:1240] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:13:23.936136  1363 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:23.954303 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:23.955382 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:23.957072  1355 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:23.957520  1355 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:23.957664 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:23.957903  1355 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:23.959043 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:23.960245 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:23.960933 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:23.961143 32090 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:23.962417 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:23.962692 32090 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:23.963066 32269 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:23.966609 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 76209us
I20260709 13:13:23.970207  1270 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:23.940021  1491 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:23.975677 32269 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:23.982118 32090 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:23.986845 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:23.979496  1033 raft_consensus.cc:2804] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:23.990232  1033 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:23.990599  1033 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:23.994952  1349 consensus_queue.cc:1059] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:23.996071  1401 raft_consensus.cc:3055] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:23.996475 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:23.979681  1503 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:23.997386 32195 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:23.997583  1503 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:23.998059  1503 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:23.979794  1236 consensus_queue.cc:1059] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:13:24.001595  1236 raft_consensus.cc:3055] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:24.001926  1236 raft_consensus.cc:740] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:24.002727  1236 consensus_queue.cc:260] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:24.003944  1236 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:23.955032  1363 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:23.996486  1401 raft_consensus.cc:740] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:24.004868  1363 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:24.005610  1401 consensus_queue.cc:260] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:24.006981  1401 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:24.015806 32267 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:24.016875 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:24.018342 32090 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:24.021853 32192 raft_consensus.cc:1275] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:24.020862  1304 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:23.988713  1153 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:24.015626  1270 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:24.028853 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:24.031482   369 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:24.033478  1457 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:24.036901  1153 raft_consensus.cc:697] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 6 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:24.038026  1153 consensus_queue.cc:237] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:24.026369  1304 raft_consensus.cc:697] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 4 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:24.042805  1304 consensus_queue.cc:237] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:24.045711  1437 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:24.046504  1437 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:24.049693  1437 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:24.071970 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.059360 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:24.060621 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:24.061088 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:24.061967 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:24.073982 32197 raft_consensus.cc:1240] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:24.062996 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:24.064373 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:24.066192 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:24.075934 32193 raft_consensus.cc:2368] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6.
I20260709 13:13:24.069599  1352 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:24.097540 32192 raft_consensus.cc:1240] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:24.108930 32195 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:24.111938 32192 raft_consensus.cc:1240] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:24.119190 32195 raft_consensus.cc:1240] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:13:24.125058 32273 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:24.117535 32238 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:24.133246 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:24.134109 32192 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:24.135176  1303 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:24.135751  1303 raft_consensus.cc:697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:24.136937  1303 consensus_queue.cc:237] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:24.144114 32090 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:24.152004 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:24.134130  1352 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:24.154453 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.156698 32194 raft_consensus.cc:1240] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:24.157192 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:24.156128 32199 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:24.136217  1355 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:24.165920 32196 raft_consensus.cc:1240] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:24.161449  1491 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:24.206717 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:24.207679 32193 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:24.183161  1503 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:24.224663  1503 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:24.229008  1517 log.cc:927] Time spent T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:13:24.229665  1355 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:24.232867 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:24.233525 32195 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:13:24.240859 32192 raft_consensus.cc:1275] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:24.242980 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:24.244215 32192 raft_consensus.cc:2368] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 4. Current term is 5.
I20260709 13:13:24.245414  1355 consensus_queue.cc:1048] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:24.252930   402 raft_consensus.cc:1275] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:13:24.261135 32195 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:24.275008 32118 raft_consensus.cc:1275] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:24.283190 32194 raft_consensus.cc:1275] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:13:24.299463  1363 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:24.302470  1363 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:24.305135 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:24.305879 32165 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:24.306502 32192 raft_consensus.cc:2393] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 4: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:24.307344 32165 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:24.308344  1352 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:24.309012  1352 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:24.308846  1296 consensus_queue.cc:1048] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:13:24.308873 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 45952.9us
I20260709 13:13:24.255807  1033 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:24.313930  1033 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:24.315621  1355 consensus_queue.cc:1048] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:24.318994 32122 raft_consensus.cc:2410] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:13:24.325979 32089 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.557s (SENT) [suppressed 10 similar messages]
I20260709 13:13:24.269070  1491 raft_consensus.cc:697] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:24.328338  1491 consensus_queue.cc:237] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:24.329226 32116 raft_consensus.cc:1275] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:13:24.329756 32116 pending_rounds.cc:85] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d: Aborting all ops after (but not including) 3
I20260709 13:13:24.330063 32116 pending_rounds.cc:107] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:13:24.330482 32116 raft_consensus.cc:2889] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:24.333127 32120 raft_consensus.cc:1275] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:13:24.334230 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 74997.8us
I20260709 13:13:24.337034 32194 raft_consensus.cc:1240] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:24.338791 32165 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:24.345294 32190 raft_consensus.cc:1240] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:24.347705 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:24.350240 32123 raft_consensus.cc:2393] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 4: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:24.350978 32193 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:24.359643 32197 raft_consensus.cc:1275] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:13:24.368714 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.362720 32238 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:24.376010 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:13:24.378126 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 52194.5us
W20260709 13:13:24.368366 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 190013us
I20260709 13:13:24.380151 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:24.380982 32272 raft_consensus.cc:2393] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 4: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:24.382266 32165 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:24.362833  1363 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:24.391475 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:24.392216 32272 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:24.362454  1355 consensus_queue.cc:1048] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:13:24.360844  1499 consensus_queue.cc:1048] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:13:24.387197  1352 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:24.410394 32272 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:24.393752  1349 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:24.415803 32165 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:24.417042  1363 consensus_queue.cc:1048] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:24.417377 32165 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:24.418627  1270 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:24.418824  1363 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:24.418906 32165 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:24.419405  1363 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:24.419837  1363 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:24.420075  1270 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:24.420452  1270 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:24.420619 32165 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:24.420989  1270 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:24.427183 32165 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:24.428309  1264 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:24.428862 32165 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:24.429823  1264 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:24.429677  1270 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:24.430383 32165 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:24.431391  1264 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:24.432019  1270 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:24.431933 32165 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:24.433331  1270 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:24.433883 32165 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:24.435031  1270 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:24.435470 32165 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:24.436945  1270 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:24.438182 32165 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:24.439527  1270 raft_consensus.cc:2764] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:13:24.439847 32165 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:24.440917  1264 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:24.441341  1264 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:24.441727  1264 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:24.442858 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:24.443225 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:24.443677 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:24.444036 32265 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:24.444538 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:24.446092 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:24.446617 32272 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:24.447494 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:24.448721 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:24.450109 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:24.455498 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:24.456928 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:24.457607 32265 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:24.457904 32272 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:24.459060 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:24.462538 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:24.465648 32273 raft_consensus.cc:1240] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:13:24.466679 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:24.468411 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:24.469209 32197 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:24.471277 32268 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
I20260709 13:13:24.475451  1264 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:24.481508 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 63130.7us
I20260709 13:13:24.481371 32165 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:13:24.486178 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 72770.7us
I20260709 13:13:24.491016 32165 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:24.421761  1437 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:24.466053 32265 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:13:24.487015 32197 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:24.489193 32089 leader_election.cc:400] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 4. Current term is 5.
I20260709 13:13:24.495285 32089 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:24.504843 32089 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:24.509387  1491 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:24.509891 32089 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:24.511720 32089 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:24.501999  1349 raft_consensus.cc:697] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:24.512624  1033 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:24.517108  1349 consensus_queue.cc:237] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:24.501052  1270 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:24.500777  1352 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:24.514674  1491 raft_consensus.cc:2749] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:24.522903 32089 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:24.523612 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 122668us
I20260709 13:13:24.492817  1401 consensus_queue.cc:1048] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:13:24.508524  1304 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:24.534145 32090 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:24.540097 32089 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:24.500043  1363 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:24.514706  1437 consensus_queue.cc:1059] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
W20260709 13:13:24.553869 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 64766.5us
I20260709 13:13:24.524297  1352 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:24.552125 32089 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:24.529166  1270 raft_consensus.cc:697] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:24.537377  1525 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:24.551729  1380 consensus_queue.cc:1059] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:13:24.539300  1122 raft_consensus.cc:2804] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:24.525311  1033 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
W20260709 13:13:24.561462  1526 log.cc:927] Time spent T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:13:24.557518  1533 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:24.565021 32089 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:24.573782  1543 raft_consensus.cc:3055] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:24.584367  1270 consensus_queue.cc:237] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:24.590000  1527 log.cc:927] Time spent T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.058s	user 0.002s	sys 0.000s
I20260709 13:13:24.576469  1304 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:24.558286  1352 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:24.593760 32265 raft_consensus.cc:1275] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:13:24.595711  1536 consensus_queue.cc:1048] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:13:24.607915 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.614991 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:24.621194 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:24.575739  1543 raft_consensus.cc:740] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:24.568212  1525 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:24.590020  1363 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:24.624244 32118 raft_consensus.cc:2393] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 5: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:24.625579 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:24.627691 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:24.629366 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:24.630388 32122 raft_consensus.cc:2368] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 3. Current term is 4.
I20260709 13:13:24.630806  1535 consensus_queue.cc:1048] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:24.633754 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:24.634603 32122 raft_consensus.cc:2410] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:13:24.637322 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:24.599038  1296 consensus_queue.cc:1059] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:13:24.639880  1296 raft_consensus.cc:3055] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:24.640268  1296 raft_consensus.cc:740] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:24.641198  1296 consensus_queue.cc:260] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:24.575968  1122 raft_consensus.cc:697] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 4 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:24.643874 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:24.655587 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:24.637473 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:24.670832 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:24.671511 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:24.671842 32123 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:13:24.618738  1153 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:24.679592 32199 raft_consensus.cc:1240] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:24.681167 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:24.627879  1398 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:24.649585   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 92134.7us
W20260709 13:13:24.696420 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 131480us
I20260709 13:13:24.674790   986 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.678467  1296 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:24.682667  1153 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:24.698653 32089 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:24.711053 32199 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:13:24.699961  1264 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:24.727573  1153 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:24.737336 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:24.738276 32268 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:24.739841  1536 raft_consensus.cc:2749] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:24.740950  1352 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:24.743378  1352 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:24.695322  1398 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:24.712365   986 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:24.751504   986 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:24.705749  1543 consensus_queue.cc:260] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:24.715463  1122 consensus_queue.cc:237] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:24.779537  1528 raft_consensus.cc:3055] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:24.779807 32199 raft_consensus.cc:1275] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:24.780010  1528 raft_consensus.cc:740] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:24.785564  1528 consensus_queue.cc:260] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:24.748342  1398 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:24.788992 32268 raft_consensus.cc:1240] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:24.796094 32121 raft_consensus.cc:1240] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 6 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:13:24.788759 32090 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:24.812019 32123 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:13:24.717656 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:24.830816 32089 leader_election.cc:400] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6.
I20260709 13:13:24.831455 32089 leader_election.cc:403] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:24.833904 32089 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:24.835948 32089 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:24.829077  1243 raft_consensus.cc:2804] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:24.853035  1243 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:24.835093  1503 consensus_queue.cc:1059] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:13:24.846545 32022 catalog_manager.cc:5697] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 3 to 6, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 6 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:13:24.861207 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 188381us
I20260709 13:13:24.853756  1243 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:24.860888  1528 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:24.861135  1270 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:24.872031 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:24.868515  1270 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:24.840850  1544 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6.
I20260709 13:13:24.843604  1153 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:24.873580 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:24.877633 32192 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:24.883899 32089 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:24.860888  1542 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:24.895821 32121 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:13:24.862003  1476 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.900203 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:24.907625 32118 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:24.902575 32121 pending_rounds.cc:85] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d: Aborting all ops after (but not including) 2
I20260709 13:13:24.899098 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:24.908931 32123 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:24.844095  1173 consensus_queue.cc:1059] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:13:24.908427 32121 pending_rounds.cc:107] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:13:24.911856 32121 raft_consensus.cc:2889] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:24.913023 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 67864us
I20260709 13:13:24.869618 32022 catalog_manager.cc:5697] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 2 to 4, now has a pending config: VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1), VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2), VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3), VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 4 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:13:24.917003 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 421964us
I20260709 13:13:24.918310 32165 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:24.919495 32165 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:24.922312 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:24.922772 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:24.923625 32021 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49556 (request call id 174) took 5326 ms. Trace:
I20260709 13:13:24.926309 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:24.928660 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:24.932505 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:24.932622 32165 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:24.916627  1033 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:24.935652 32116 raft_consensus.cc:2393] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 4: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:24.936295 32165 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:24.947228 32020 catalog_manager.cc:5697] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:24.962210 32165 leader_election.cc:400] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 3. Current term is 4.
I20260709 13:13:24.962661 32165 leader_election.cc:403] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:24.950129  1503 consensus_queue.cc:1059] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:24.951082 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:24.965116 32115 raft_consensus.cc:2393] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 5: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:24.952142 32271 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:24.917142  1476 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:24.969820 32020 catalog_manager.cc:5697] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:24.925132  1352 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:24.926700 32021 rpcz_store.cc:276] 0709 13:13:19.591906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.592034 (+   128us) service_pool.cc:224] Handling call
0709 13:13:24.917917 (+5325883us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:23.893891 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:23.894552 (+   661us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:23.894601 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:13:23.894621 (+    20us) tablet.cc:662] Decoding operations
0709 13:13:23.896203 (+  1582us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:23.896318 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:23.896348 (+    30us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:13:23.898650 (+  2302us) tablet.cc:701] Row locks acquired
0709 13:13:23.898710 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:13:23.898898 (+   188us) write_op.cc:270] Start()
0709 13:13:23.899051 (+   153us) write_op.cc:276] Timestamp: P: 1783602803898834 usec, L: 0
0709 13:13:23.899088 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:13:23.900013 (+   925us) log.cc:844] Serialized 7029 byte log entry
0709 13:13:24.133520 (+233507us) op_driver.cc:464] REPLICATION: finished
0709 13:13:24.254943 (+121423us) write_op.cc:301] APPLY: starting
0709 13:13:24.255044 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:24.255423 (+   379us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:24.255568 (+   145us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:24.279657 (+ 24089us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:24.280165 (+   508us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:13:24.280250 (+    85us) write_op.cc:312] APPLY: finished
0709 13:13:24.371903 (+ 91653us) log.cc:844] Serialized 124 byte log entry
0709 13:13:24.387048 (+ 15145us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:24.395647 (+  8599us) write_op.cc:454] Released schema lock
0709 13:13:24.410930 (+ 15283us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:24.477071 (+ 66141us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:24.477116 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":22660,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":121152,"apply.run_cpu_time_us":6132,"apply.run_wall_time_us":222118,"num_ops":18,"prepare.queue_time_us":30642,"prepare.run_cpu_time_us":17103,"prepare.run_wall_time_us":45873,"raft.queue_time_us":98680,"raft.run_cpu_time_us":21762,"raft.run_wall_time_us":55506,"replication_time_us":234278,"spinlock_wait_cycles":12672,"thread_start_us":193665,"threads_started":4,"wal-append.queue_time_us":56702}]]}
I20260709 13:13:24.963897 32165 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:24.930202  1264 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:24.957692  1491 raft_consensus.cc:3055] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:25.005627 32238 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:13:25.006808 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 122540us
I20260709 13:13:24.983798 32020 catalog_manager.cc:5697] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 3 to 4, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 4 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:25.009042 32020 catalog_manager.cc:5697] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 4 to 5, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 5 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:24.981475  1437 raft_consensus.cc:2749] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:25.013283 32020 catalog_manager.cc:5697] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 2 to 4, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 4 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:25.020679 32020 catalog_manager.cc:5697] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 2 to 4, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 4 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:25.022864 32020 catalog_manager.cc:5697] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 1 to 3, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 3 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:25.027860 32268 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:24.978818  1535 consensus_queue.cc:1059] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:13:25.033347 32020 catalog_manager.cc:5697] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
W20260709 13:13:25.040560 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 76775.3us
I20260709 13:13:25.004557  1491 raft_consensus.cc:740] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:25.043139 32165 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:25.022413  1388 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:13:25.046344 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 135101us
I20260709 13:13:25.005944  1296 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:13:25.010854  1303 consensus_queue.cc:1048] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:13:25.036350 32020 catalog_manager.cc:5697] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 1 to 3, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 3 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:25.016659  1554 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 3. Current term is 4.
I20260709 13:13:25.049990 32165 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:25.056077  1549 log.cc:927] Time spent T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:13:25.078959 32020 catalog_manager.cc:5697] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 2 to 5, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 5 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:25.079805 32165 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:25.080422 32020 catalog_manager.cc:5697] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 2 to 4, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 4 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:25.047199  1388 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.111660 32020 catalog_manager.cc:5697] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 1 to 3, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 3 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:25.110320  1363 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:25.077907  1437 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:25.125337 32089 leader_election.cc:400] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 4. Current term is 5.
I20260709 13:13:25.130282 32089 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:25.125763 32273 raft_consensus.cc:1275] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:25.118611 32020 catalog_manager.cc:5697] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:25.132426 32020 catalog_manager.cc:5697] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:25.102792  1542 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:25.138059 32020 catalog_manager.cc:5697] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 4 to 5, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 5 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:25.114156  1388 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:25.115516  1554 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:25.140275 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 60550.6us
I20260709 13:13:25.115499  1560 consensus_queue.cc:1059] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:13:25.151165 32165 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:25.158002 32165 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:25.132982  1352 raft_consensus.cc:697] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 3 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:25.138156  1437 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:25.162690  1476 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:25.162945  1529 log.cc:927] Time spent T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:13:25.164294  1437 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:25.150228  1561 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:25.149413  1542 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:25.120007  1491 consensus_queue.cc:260] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:25.173319  1491 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:25.184085 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:25.184497  1552 log.cc:927] Time spent T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.204s	user 0.001s	sys 0.001s
I20260709 13:13:25.184702 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:25.185426 32191 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:25.186895  1153 consensus_queue.cc:1059] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:25.207345  1437 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:25.207854  1554 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:25.208550  1437 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:25.208851  1554 consensus_queue.cc:1059] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:25.209815  1554 consensus_queue.cc:1243] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Peer fcfc3281929645969ecedbb0c0af759d log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:13:25.207204  1566 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:25.214315  1173 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:25.215088  1173 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:25.222393  1542 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:25.225929  1243 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:25.246652 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:13:25.255256 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 71901.3us
W20260709 13:13:25.259995 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 101151us
I20260709 13:13:25.199314  1270 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:25.267459 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:25.268282 32273 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
I20260709 13:13:25.268868 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:25.200788  1122 consensus_queue.cc:1048] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:13:25.269552 32265 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:25.276201 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:25.276270 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:25.274327 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:25.276969 32165 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:25.277014 32198 raft_consensus.cc:1240] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:25.275733 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:25.280208 32120 raft_consensus.cc:2393] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 3: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:25.281653 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:25.283125 32199 raft_consensus.cc:1240] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:25.284847 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:25.264297  1264 raft_consensus.cc:697] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 6 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:25.287119 32239 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:25.289646 32165 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:25.290021 32192 raft_consensus.cc:2393] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 5: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:25.291152 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:25.291864 32198 raft_consensus.cc:2393] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 5: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:13:25.293268 32190 raft_consensus.cc:1275] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:25.269248  1352 consensus_queue.cc:237] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:25.301596 32165 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:25.304164  1388 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:25.306042  1558 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:25.306692  1388 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:25.298164  1355 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:25.314803 32165 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:25.314072   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:25.293371  1572 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:25.335193 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:25.312413  1270 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:25.297425  1243 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:25.322690   401 raft_consensus.cc:2393] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 5: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:13:25.338244 32197 raft_consensus.cc:2393] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 5: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:25.336057 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:25.321705 32089 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:25.318995  1355 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.342206 32195 raft_consensus.cc:1275] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:25.350353  1173 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:25.352828  1355 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:25.357720 32089 leader_election.cc:304] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:25.359450 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.359926  1380 raft_consensus.cc:3055] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:25.359477  1576 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:25.362161  1380 raft_consensus.cc:740] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:25.362625  1243 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:25.363168  1380 consensus_queue.cc:260] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:25.363596  1576 consensus_queue.cc:1059] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:25.367462 32089 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:25.368597  1173 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:25.370599  1033 raft_consensus.cc:3055] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:25.371043  1033 raft_consensus.cc:740] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:25.371840  1033 consensus_queue.cc:260] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:25.373262 32115 raft_consensus.cc:1275] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:25.373639 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:25.373730 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:25.374229 32122 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:25.374358 32119 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:25.376451 32272 raft_consensus.cc:1275] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:25.374241 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:25.381043  1355 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:25.396763 32272 raft_consensus.cc:1275] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:25.397184 32124 raft_consensus.cc:1275] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:13:25.397574 32124 pending_rounds.cc:85] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d: Aborting all ops after (but not including) 2
I20260709 13:13:25.397785 32124 pending_rounds.cc:107] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:13:25.398010 32124 raft_consensus.cc:2889] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:25.334009  1567 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:25.336485  1574 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:25.338629  1571 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:25.320427  1264 consensus_queue.cc:237] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:25.399700 32119 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:25.402045  1491 consensus_queue.cc:1048] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:13:25.402175  1363 consensus_queue.cc:1048] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:13:25.406973 32196 raft_consensus.cc:1240] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:25.344300  1270 raft_consensus.cc:697] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:25.412833 32273 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:25.424892 32239 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:25.425558  1533 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.409158  1270 consensus_queue.cc:237] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:25.426470  1533 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:25.427888  1555 raft_consensus.cc:3055] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:25.428292  1555 raft_consensus.cc:740] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:25.428918  1533 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:25.429224  1555 consensus_queue.cc:260] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:25.430771  1555 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:25.431360  1304 raft_consensus.cc:3055] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:25.431825  1304 raft_consensus.cc:740] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:25.364313  1380 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:25.435465 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:13:25.448477 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.402312  1571 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:25.409698  1173 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:25.453033  1499 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:25.465081  1568 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:25.405525  1503 consensus_queue.cc:1048] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:13:25.409862  1574 raft_consensus.cc:697] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 4 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:25.476610 32090 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:25.481150 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:25.482095 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:25.482928 32267 raft_consensus.cc:2410] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:25.482240 32268 raft_consensus.cc:2393] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 3: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:25.465648  1033 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:25.468407  1499 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.467124  1571 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:25.544721 32239 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:13:25.553972 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 63998.6us
I20260709 13:13:25.551497  1567 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.557762  1567 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:13:25.466117  1304 consensus_queue.cc:260] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:25.560710  1304 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:25.560885  1355 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:25.569629  1574 consensus_queue.cc:237] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:25.573326  1562 log.cc:927] Time spent T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:13:25.579231  1577 raft_consensus.cc:2804] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:25.486106  1568 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:25.582082  1548 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:25.582717  1548 raft_consensus.cc:697] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:25.582885   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:25.583374  1568 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:25.458206  1550 consensus_queue.cc:1048] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:13:25.583719  1548 consensus_queue.cc:237] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:25.597892 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:25.598369 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:25.598858 32119 raft_consensus.cc:2410] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:13:25.600091 32197 raft_consensus.cc:1240] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:25.543969  1528 consensus_queue.cc:1048] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
W20260709 13:13:25.552477   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 64120.1us
I20260709 13:13:25.552260  1499 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:25.631798 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 76732.4us
I20260709 13:13:25.637943 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:25.638936 32119 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:25.662595 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:25.663270 32199 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:25.664664 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:25.666743  1564 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:25.667294  1564 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:25.671942 32191 raft_consensus.cc:1275] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:25.673007 32199 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:25.681757  1561 raft_consensus.cc:3055] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:25.682193  1561 raft_consensus.cc:740] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:25.684963 32165 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:25.685983  1554 raft_consensus.cc:2749] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:25.696012 32119 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
W20260709 13:13:25.697419 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 209934us
I20260709 13:13:25.698212 32090 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:25.680387  1543 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:25.721167 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:25.722534 32192 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:13:25.728938 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:25.730310 32268 raft_consensus.cc:2410] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:13:25.738200 32165 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:25.739101 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 154416us
I20260709 13:13:25.719434  1304 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:25.720381  1577 raft_consensus.cc:697] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
W20260709 13:13:25.749015 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 49038us
I20260709 13:13:25.733960  1567 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:25.757362 32239 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:25.760267 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:25.765285 32124 raft_consensus.cc:2368] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 5. Current term is 6.
I20260709 13:13:25.742534  1554 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:25.779893 32191 raft_consensus.cc:1240] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:25.756748  1270 consensus_queue.cc:1048] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:13:25.751955  1525 consensus_queue.cc:1059] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:13:25.795584  1577 consensus_queue.cc:237] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:25.770301  1537 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:25.806955 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:25.812635  1525 raft_consensus.cc:3055] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:25.813169  1525 raft_consensus.cc:740] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:25.814110  1525 consensus_queue.cc:260] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:25.815474  1525 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:25.815673  1499 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:25.817085  1537 raft_consensus.cc:697] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:25.817879  1499 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:25.818171  1533 consensus_queue.cc:1059] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:25.828119 32191 raft_consensus.cc:1240] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:25.802821  1564 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:25.815676  1304 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:25.839931 32162 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
W20260709 13:13:25.867749 32162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 80534.1us
I20260709 13:13:25.838542  1398 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.880389 32165 leader_election.cc:400] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 5. Current term is 6.
I20260709 13:13:25.880980 32165 leader_election.cc:403] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:25.873147  1564 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:25.886883  1587 log.cc:927] Time spent T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:13:25.940028  1528 raft_consensus.cc:3055] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:25.873383  1491 consensus_queue.cc:1059] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:13:25.817998  1537 consensus_queue.cc:237] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:25.884056  1398 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:25.956753  1571 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:25.957481 32268 raft_consensus.cc:1275] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:25.959862  1571 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:25.961374 32266 raft_consensus.cc:1275] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:25.874404  1270 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:13:25.973481  1579 log.cc:927] Time spent T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.480s	user 0.008s	sys 0.003s
I20260709 13:13:25.973978  1270 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:13:25.977212  1571 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.977793  1571 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:25.979887  1571 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:25.985667  1571 consensus_queue.cc:1048] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:25.986625 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:25.986812 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:25.987622 32266 raft_consensus.cc:2368] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 3. Current term is 4.
I20260709 13:13:25.988152  1568 consensus_queue.cc:1048] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:25.995922 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:25.998063 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:25.999958 32121 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:25.997627 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:26.005055 32116 raft_consensus.cc:2393] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 3: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
W20260709 13:13:26.012470 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 58836us
I20260709 13:13:26.021310  1153 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.025487  1571 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.042184  1571 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:26.031441  1476 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:26.043751  1476 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:26.044355  1571 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:26.041019 32165 leader_election.cc:400] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 3. Current term is 4.
I20260709 13:13:26.045039 32165 leader_election.cc:403] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:13:26.045593  1571 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:26.045856  1476 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:26.004832  1541 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.050786  1541 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:26.054677  1264 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.055382  1264 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:26.058786  1264 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:26.060154  1571 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 3. Current term is 4.
I20260709 13:13:26.062049  1398 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:26.064570  1561 consensus_queue.cc:260] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:26.067034  1561 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:26.001621  1528 raft_consensus.cc:740] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:26.073163  1528 consensus_queue.cc:260] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:26.075093  1528 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:26.070336 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:26.094451  1270 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:26.095822 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:26.096797 32193 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 5.
W20260709 13:13:26.098717 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 99591.4us
I20260709 13:13:26.105583  1153 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:26.118103  1264 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.119866  1264 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:26.036266 32192 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:26.150252  1567 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 5. Current term is 6.
I20260709 13:13:26.158630  1264 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:26.158882  1541 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:26.163673  1264 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:26.164522  1264 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:26.169445  1264 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:26.171442  1264 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:26.172905  1264 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:26.177042  1574 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.040s	sys 0.026s
W20260709 13:13:26.177556  1574 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.040s	sys 0.026s
I20260709 13:13:26.179224  1264 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:26.181559 32089 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:26.196003 32022 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59534 (request call id 41) took 4309 ms. Trace:
I20260709 13:13:26.196818 32022 rpcz_store.cc:276] 0709 13:13:21.886992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.887172 (+   180us) service_pool.cc:224] Handling call
0709 13:13:26.195920 (+4308748us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:25.149226 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:25.186887 (+ 37661us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:25.186924 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:13:25.186941 (+    17us) tablet.cc:662] Decoding operations
0709 13:13:25.187369 (+   428us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:25.187422 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:25.187448 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:13:25.241942 (+ 54494us) tablet.cc:701] Row locks acquired
0709 13:13:25.243011 (+  1069us) write_op.cc:260] PREPARE: finished
0709 13:13:25.263029 (+ 20018us) write_op.cc:270] Start()
0709 13:13:25.267074 (+  4045us) write_op.cc:276] Timestamp: P: 1783602805261489 usec, L: 0
0709 13:13:25.269847 (+  2773us) op_driver.cc:348] REPLICATION: starting
0709 13:13:25.334151 (+ 64304us) log.cc:844] Serialized 1210 byte log entry
0709 13:13:25.756596 (+422445us) op_driver.cc:464] REPLICATION: finished
0709 13:13:26.184068 (+427472us) write_op.cc:301] APPLY: starting
0709 13:13:26.184173 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:26.184438 (+   265us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:26.184613 (+   175us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:26.185024 (+   411us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:26.185242 (+   218us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:13:26.185308 (+    66us) write_op.cc:312] APPLY: finished
0709 13:13:26.185557 (+   249us) log.cc:844] Serialized 28 byte log entry
0709 13:13:26.185786 (+   229us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:26.185885 (+    99us) write_op.cc:454] Released schema lock
0709 13:13:26.185950 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:26.186409 (+   459us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:26.186449 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1198124,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":422660,"apply.run_cpu_time_us":2283,"apply.run_wall_time_us":2284,"num_ops":2,"prepare.queue_time_us":138637,"prepare.run_cpu_time_us":3859,"prepare.run_wall_time_us":214566,"replication_time_us":468256,"thread_start_us":149233,"threads_started":2}]]}
I20260709 13:13:26.202401  1503 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:26.210803  1153 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:26.215061 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:26.215230 32194 raft_consensus.cc:1275] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:13:26.215725 32194 pending_rounds.cc:85] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 2
I20260709 13:13:26.215757 32123 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 5.
I20260709 13:13:26.216241 32194 pending_rounds.cc:107] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:13:26.216766 32194 raft_consensus.cc:2889] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:26.218264 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 425728us
I20260709 13:13:26.218829  1564 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.219466  1564 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:26.223963 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:26.226284  1153 consensus_queue.cc:1048] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:26.229066 32197 raft_consensus.cc:1275] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:26.231235  1033 consensus_queue.cc:1048] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:26.238521 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:26.239217 32272 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:26.239387  1564 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:26.241386 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:26.248214   369 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:26.249330  1541 raft_consensus.cc:2804] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:26.249725  1541 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.250087  1541 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:26.254106 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:26.254849 32118 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:26.262506  1476 consensus_queue.cc:1048] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:26.273793 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:26.274925 32271 raft_consensus.cc:2410] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:26.283819 32273 raft_consensus.cc:1275] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:26.284946 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:26.290930 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:26.296998 32090 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:26.300971 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:26.305930  1568 consensus_queue.cc:1048] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:26.313251 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:26.315462 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:26.314697 32022 catalog_manager.cc:5697] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 4 to 5, leader changed from 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 5 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:13:26.320355 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:26.321338 32195 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:26.339833 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:26.343227 32192 raft_consensus.cc:2393] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 4: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:26.361591 32266 raft_consensus.cc:1275] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:26.345369  1577 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:26.367272  1577 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.367650  1577 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:26.384857 32118 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:26.393832 32191 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:26.395787 32020 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49550 (request call id 165) took 2588 ms. Trace:
I20260709 13:13:26.354946  1122 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.406929  1243 consensus_queue.cc:1048] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:26.409094  1528 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:26.411748  1574 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:26.412282  1574 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:26.391601 32019 catalog_manager.cc:5697] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 3 to 4, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 4 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:26.418431 32019 catalog_manager.cc:5697] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 4 to 6, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 6 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:26.423637 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:26.409725  1528 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:26.431030 32019 catalog_manager.cc:5697] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 2 to 3, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 3 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:26.414353  1574 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:26.395545  1503 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.396341 32020 rpcz_store.cc:276] 0709 13:13:23.806917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.807711 (+   794us) service_pool.cc:224] Handling call
0709 13:13:26.395706 (+2587995us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:25.351119 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:25.354950 (+  3831us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:25.354979 (+    29us) write_op.cc:435] Acquired schema lock
0709 13:13:25.354994 (+    15us) tablet.cc:662] Decoding operations
0709 13:13:25.356293 (+  1299us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:25.356340 (+    47us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:25.356373 (+    33us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:13:25.574422 (+218049us) tablet.cc:701] Row locks acquired
0709 13:13:25.574453 (+    31us) write_op.cc:260] PREPARE: finished
0709 13:13:25.574666 (+   213us) write_op.cc:270] Start()
0709 13:13:25.574906 (+   240us) write_op.cc:276] Timestamp: P: 1783602805574596 usec, L: 0
0709 13:13:25.574956 (+    50us) op_driver.cc:348] REPLICATION: starting
0709 13:13:25.575855 (+   899us) log.cc:844] Serialized 5883 byte log entry
0709 13:13:25.883000 (+307145us) op_driver.cc:464] REPLICATION: finished
0709 13:13:26.186882 (+303882us) write_op.cc:301] APPLY: starting
0709 13:13:26.186966 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:26.187406 (+   440us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:26.187521 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:26.202701 (+ 15180us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:26.202999 (+   298us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:13:26.203042 (+    43us) write_op.cc:312] APPLY: finished
0709 13:13:26.203376 (+   334us) log.cc:844] Serialized 106 byte log entry
0709 13:13:26.220741 (+ 17365us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:26.220909 (+   168us) write_op.cc:454] Released schema lock
0709 13:13:26.220964 (+    55us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":21848,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":299936,"apply.run_cpu_time_us":3824,"apply.run_wall_time_us":34405,"num_ops":15,"prepare.queue_time_us":143032,"prepare.run_cpu_time_us":6610,"prepare.run_wall_time_us":225059,"replication_time_us":297059,"thread_start_us":364073,"threads_started":1}]]}
I20260709 13:13:26.510866 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:26.512806 32266 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 5.
I20260709 13:13:26.514313 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:26.400997  1491 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:26.398677  1033 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:13:26.429330  1602 log.cc:927] Time spent T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:13:26.437240  1525 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:26.509635  1567 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.388991  1541 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:26.550191  1033 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:26.613708  1525 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:26.544765  1503 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:26.863866  1564 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.019s	sys 0.032s
I20260709 13:13:26.415024  1122 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:26.547753  1491 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:26.616425   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 70453.7us
W20260709 13:13:27.031014  1564 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.019s	sys 0.032s
I20260709 13:13:26.813499  1567 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:27.033573  1577 consensus_meta.cc:287] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.666s	user 0.006s	sys 0.005s
I20260709 13:13:27.387749  1577 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:27.038643  1561 consensus_meta.cc:287] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.967s	user 0.010s	sys 0.000s
I20260709 13:13:27.084671  1491 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:27.087181  1122 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:27.088382  1033 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:27.089578  1525 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:27.093987  1610 log.cc:927] Time spent T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:13:27.116539  1503 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:27.130388  1541 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:27.283421  1528 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:27.294258  1304 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:13:27.320233 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 803807us
I20260709 13:13:27.330067  1632 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:13:27.331501  1614 log.cc:927] Time spent T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.785s	user 0.003s	sys 0.000s
W20260709 13:13:27.338562 32197 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.984s	user 0.041s	sys 0.084s
W20260709 13:13:27.615525 32197 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.261s	user 0.041s	sys 0.084s
W20260709 13:13:27.341370 32273 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.985s	user 0.003s	sys 0.012s
W20260709 13:13:27.616243 32273 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.260s	user 0.003s	sys 0.012s
I20260709 13:13:27.347252  1633 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.347788  1634 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:13:27.352643 32269 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.038s	user 0.072s	sys 0.166s
I20260709 13:13:27.353826  1635 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:13:27.367822  1612 log.cc:927] Time spent T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.818s	user 0.003s	sys 0.007s
W20260709 13:13:27.559180 32190 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.200s	user 0.044s	sys 0.038s
W20260709 13:13:27.635260 32190 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.279s	user 0.044s	sys 0.056s
I20260709 13:13:27.550998  1636 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:27.582319  1418 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:13:27.414593   367 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.009s	sys 0.058s
W20260709 13:13:27.563305  1613 log.cc:927] Time spent T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.998s	user 0.001s	sys 0.001s
W20260709 13:13:27.574797 32196 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.179s	user 0.008s	sys 0.041s
W20260709 13:13:27.658810 32196 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.263s	user 0.008s	sys 0.048s
W20260709 13:13:27.425776 32194 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.015s	user 0.001s	sys 0.047s
W20260709 13:13:27.433118 32195 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.048s	user 0.024s	sys 0.023s
I20260709 13:13:27.566336 32119 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:27.550521  1528 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:27.551928  1033 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:27.635555  1153 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.582048  1349 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:13:27.400553 32022 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.060s	user 0.091s	sys 0.107s
W20260709 13:13:27.680138 32022 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.340s	user 0.097s	sys 0.112s
W20260709 13:13:27.653456   367 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.040s	user 0.013s	sys 0.065s
W20260709 13:13:27.633519 32269 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.319s	user 0.075s	sys 0.166s
I20260709 13:13:27.611541  1533 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.633991  1564 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.551314  1525 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:27.635106  1633 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:27.660377 32194 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.250s	user 0.007s	sys 0.049s
I20260709 13:13:27.584764  1639 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:27.617107 32273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 996) took 1286 ms. Trace:
I20260709 13:13:27.617551  1304 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:27.681594  1122 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:27.624346  1567 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:27.683557  1491 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:27.682278  1033 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:27.694273  1525 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:27.695246 32195 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.310s	user 0.031s	sys 0.024s
I20260709 13:13:27.685635 32269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 995) took 1373 ms. Trace:
I20260709 13:13:27.705183 32269 rpcz_store.cc:276] 0709 13:13:26.312368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.312777 (+   409us) service_pool.cc:224] Handling call
0709 13:13:26.313115 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:26.313336 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:26.313359 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:26.313810 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:13:27.685191 (+1371381us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:27.685241 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:27.685331 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:27.685385 (+    54us) raft_consensus.cc:1685] finished
0709 13:13:27.685401 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:27.685552 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1370988,"threads_started":1,"wal-append.queue_time_us":771270}
I20260709 13:13:27.697754 32273 rpcz_store.cc:276] 0709 13:13:26.330941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.331098 (+   157us) service_pool.cc:224] Handling call
0709 13:13:26.331386 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:26.355252 (+ 23866us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:26.355282 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:26.355707 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 13:13:27.616694 (+1260987us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:27.616737 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:27.616817 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:27.616863 (+    46us) raft_consensus.cc:1685] finished
0709 13:13:27.616873 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:27.617001 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23492,"raft.queue_time_us":24433,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":16984,"thread_start_us":1260624,"threads_started":1,"wal-append.queue_time_us":745594}
I20260709 13:13:27.676954  1561 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:27.653898  1636 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:27.643450  1635 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:13:27.687526  1130 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:27.640926  1634 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:27.671196  1418 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:27.682390  1528 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:27.683027  1153 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:27.717543 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:27.725550 32121 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:27.716763 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 105377us
I20260709 13:13:27.691803  1533 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:27.696960  1564 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:27.710860  1567 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:27.712982  1561 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:27.693372  1349 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.317734  1349 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:27.707422  1639 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.321206  1639 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.322108  1639 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:28.322818  1639 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:27.761494  1638 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.326319  1638 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:27.851563  1641 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:27.845690  1644 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.328008  1641 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.328682  1644 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.330382  1641 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.330906  1641 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.330946  1644 leader_election.cc:290] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:27.857270  1646 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.331430  1641 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.331703  1646 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.333429 32022 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59534 (request call id 42) took 2126 ms. Trace:
I20260709 13:13:28.333914  1646 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:27.864403  1645 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:28.334767  1645 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.335750  1638 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.336470  1641 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:27.865171  1642 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:28.333798 32022 rpcz_store.cc:276] 0709 13:13:26.207387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.256703 (+ 49316us) service_pool.cc:224] Handling call
0709 13:13:27.680621 (+1423918us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:27.680661 (+    40us) write_op.cc:454] Released schema lock
0709 13:13:28.332570 (+651909us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:27.116625 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:27.130842 (+ 14217us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:27.130889 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:13:27.130914 (+    25us) tablet.cc:662] Decoding operations
0709 13:13:27.131341 (+   427us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:27.131413 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:27.131455 (+    42us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:13:27.131646 (+   191us) tablet.cc:701] Row locks acquired
0709 13:13:27.132040 (+   394us) write_op.cc:260] PREPARE: finished
0709 13:13:27.137739 (+  5699us) write_op.cc:270] Start()
0709 13:13:27.141981 (+  4242us) write_op.cc:276] Timestamp: P: 1783602807136726 usec, L: 0
0709 13:13:27.142443 (+   462us) op_driver.cc:348] REPLICATION: starting
0709 13:13:27.149100 (+  6657us) log.cc:844] Serialized 529 byte log entry
0709 13:13:27.154705 (+  5605us) op_driver.cc:464] REPLICATION: finished
0709 13:13:27.157119 (+  2414us) write_op.cc:301] APPLY: starting
0709 13:13:27.157196 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:27.157265 (+    69us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:27.157355 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:27.157540 (+   185us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:27.157705 (+   165us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:13:27.157757 (+    52us) write_op.cc:312] APPLY: finished
0709 13:13:27.157951 (+   194us) log.cc:844] Serialized 22 byte log entry
0709 13:13:27.158121 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:27.158200 (+    79us) write_op.cc:454] Released schema lock
0709 13:13:27.158236 (+    36us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":44087,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":2141,"apply.run_cpu_time_us":1450,"apply.run_wall_time_us":1454,"num_ops":1,"prepare.queue_time_us":773752,"prepare.run_cpu_time_us":7404,"prepare.run_wall_time_us":33956,"replication_time_us":12096,"thread_start_us":1342142,"threads_started":2}]]}
I20260709 13:13:27.893160  1650 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:27.909018  1647 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:27.925807  1657 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.338860 32124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1359) took 1932 ms. Trace:
I20260709 13:13:27.904960  1640 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.339318  1639 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.339099  1647 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.339519  1640 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.339278 32124 rpcz_store.cc:276] 0709 13:13:26.406095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.406261 (+   166us) service_pool.cc:224] Handling call
0709 13:13:26.406552 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:28.211836 (+1805284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:28.211885 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:28.211947 (+    62us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:28.211990 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:28.338595 (+126605us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b54002e2054. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:28.338640 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:28.338800 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4150961024}
I20260709 13:13:27.926652  1655 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.341179 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:28.341833  1647 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.341573  1655 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:28.342052 32124 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:28.343122 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:28.343871  1655 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:27.933459  1658 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:13:28.344331 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 347362us
I20260709 13:13:28.344627  1658 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.346817  1658 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:27.950819  1660 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:27.950943  1661 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:27.952526  1662 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:27.954170  1663 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:13:27.957412 32119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56890 (request call id 1362) took 1443 ms (client timeout 1804 ms). Trace:
W20260709 13:13:28.354174 32119 rpcz_store.cc:269] 0709 13:13:26.513690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.513959 (+   269us) service_pool.cc:224] Handling call
0709 13:13:27.957080 (+1443121us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400346a54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:27.957273 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2417038592}
I20260709 13:13:27.965713 32118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1360) took 1541 ms. Trace:
I20260709 13:13:27.977337  1664 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:27.978839  1665 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:28.358369 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:28.358525  1665 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.338868  1650 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:27.984167  1666 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.360853  1666 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.361927  1650 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:27.985594  1667 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.362968  1667 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:27.993685  1668 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:28.364753  1646 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.365000  1668 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.365298  1646 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.366227  1304 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:27.877826 32194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 1059) took 1648 ms. Trace:
I20260709 13:13:28.347471  1660 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:27.919268 32199 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.560s	user 0.055s	sys 0.100s
W20260709 13:13:28.372025 32199 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.013s	user 0.057s	sys 0.102s
I20260709 13:13:28.356954 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:27.748483 32190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1289) took 1439 ms. Trace:
I20260709 13:13:27.869272 32195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1299) took 1543 ms. Trace:
I20260709 13:13:27.873380 32196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1301) took 1546 ms. Trace:
I20260709 13:13:28.374125 32195 rpcz_store.cc:276] 0709 13:13:26.326369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.331529 (+  5160us) service_pool.cc:224] Handling call
0709 13:13:26.331861 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.332092 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:27.704553 (+1372461us) log.cc:844] Serialized 14 byte log entry
0709 13:13:27.869017 (+164464us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:27.869069 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:27.869098 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:27.869145 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:27.869229 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23738,"prepare.queue_time_us":78813,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":25184,"raft.run_cpu_time_us":56,"raft.run_wall_time_us":56,"thread_start_us":1483669,"threads_started":2,"wal-append.queue_time_us":144539}
I20260709 13:13:28.375587  1640 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.374750 32196 rpcz_store.cc:276] 0709 13:13:26.327130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.328766 (+  1636us) service_pool.cc:224] Handling call
0709 13:13:26.342669 (+ 13903us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.342875 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:27.659591 (+1316716us) log.cc:844] Serialized 14 byte log entry
0709 13:13:27.872887 (+213296us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:27.872962 (+    75us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:27.873021 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:27.873116 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:27.873288 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45668,"prepare.queue_time_us":68194,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":23,"raft.queue_time_us":21502,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":4100,"thread_start_us":1476696,"threads_started":2,"wal-append.queue_time_us":232798}
I20260709 13:13:28.376032 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:28.376142  1640 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.376600 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:28.376729  1640 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.377194 32196 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:28.377863 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:28.378219 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:28.378731  1640 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:27.858531 32197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 1060) took 1624 ms. Trace:
W20260709 13:13:28.412895 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 56560.1us
W20260709 13:13:27.841769 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 113409us
W20260709 13:13:27.893407 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 136013us
I20260709 13:13:27.898918 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:27.943238 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.431229 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.431982 32264 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:28.432963 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:27.946597 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:27.942960 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.453975 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:28.454615 32268 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:27.945293 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:27.869129 32269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05806ba48f814549969547f21c7101c3"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:13:27.947197 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:27.896658 32272 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.630s	user 0.048s	sys 0.056s
I20260709 13:13:28.023388  1670 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.460251 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.461031 32270 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:27.943465 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.462025 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.462155 32271 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:27.708037  1122 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.465852 32268 raft_consensus.cc:2410] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:13:28.466477  1122 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:27.726296  1130 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.011243  1153 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:27.838291  1633 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.470451  1130 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:27.769032  1636 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.463068 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.472106 32271 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:27.845759  1635 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:27.618449  1632 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.479600  1632 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:27.742887  1634 leader_election.cc:290] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.038237  1674 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.038448 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:28.041395 32115 raft_consensus.cc:1275] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:28.054877  1675 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.483306  1674 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.483734  1675 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.484301 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:28.485525 32122 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:28.485796  1675 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.485996  1638 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.056541  1676 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.486465  1638 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.487493 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:28.061549  1677 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.488900  1677 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.489344  1638 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.489650 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:28.490252 32122 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:28.490787  1677 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.068779  1679 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.070688  1681 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.485687  1674 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.491441  1681 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.491369  1679 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.493952  1681 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.072234  1682 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.494320  1679 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.491348 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:28.494779  1682 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.495688 32122 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:13:28.497107 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:28.497351  1682 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.115861  1684 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.497812 32122 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:28.498204  1684 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.498937  1349 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.499485 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:28.117074  1685 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.135346  1688 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.140733 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:28.501973  1688 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.170975  1690 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.169061  1689 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.503118  1689 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.178838  1692 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:28.199038  1694 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.202451  1669 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.503031 32122 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:28.505800  1689 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.506668  1669 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.219170  1680 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.507437 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:28.506414  1692 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.507750  1680 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.219862 32123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1361) took 1782 ms. Trace:
I20260709 13:13:28.509851  1692 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.508939 32123 rpcz_store.cc:276] 0709 13:13:26.437726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.437900 (+   174us) service_pool.cc:224] Handling call
0709 13:13:26.438207 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.438400 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:28.200290 (+1761890us) log.cc:844] Serialized 14 byte log entry
0709 13:13:28.218745 (+ 18455us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:28.218809 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:28.218876 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:28.219631 (+   755us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:28.219787 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1789733,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":45,"raft.queue_time_us":101,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"thread_start_us":17824,"threads_started":1,"wal-append.queue_time_us":16620}
I20260709 13:13:28.506449  1694 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.511020 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:28.511705 32123 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:13:28.253005  1699 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.513204  1694 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.512964  1699 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.502751 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:28.515156  1699 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.263289 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:28.516124 32120 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:28.266342  1701 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.516750 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:28.516848  1701 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.517597 32117 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:13:28.518520 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:28.519073 32117 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:13:27.769728  1418 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:27.987499  1503 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.519878 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:28.521817 32117 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:13:27.811353  1525 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:27.842645  1541 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:27.737466  1567 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.527657  1541 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:28.529858  1567 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:27.752842  1577 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:27.765821  1528 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:27.767496  1561 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:27.764125  1564 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:28.299235 32089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.000s	sys 0.033s
I20260709 13:13:26.439601 32019 catalog_manager.cc:5697] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 3 to 4, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 4 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
W20260709 13:13:28.534694 32089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.000s	sys 0.034s
I20260709 13:13:28.535398 32019 catalog_manager.cc:5697] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:28.536259  1669 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.534745 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:28.537190 32019 catalog_manager.cc:5697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 4 to 5, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 5 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:28.538283 32123 raft_consensus.cc:1275] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:28.335613   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:27.891397  1651 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:28.539323  1651 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.337088  1645 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:28.338014  1642 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.540937 32019 catalog_manager.cc:5697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 3 to 6, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 6 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:28.542480 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:28.543170  1642 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:27.891623  1649 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:28.534699  1688 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.543942  1649 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.349344 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:28.349900 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:28.546736 32191 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:28.355538 32118 rpcz_store.cc:276] 0709 13:13:26.424492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.424756 (+   264us) service_pool.cc:224] Handling call
0709 13:13:26.425112 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:27.963936 (+1538824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:27.963984 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:27.964048 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:27.964093 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:27.965357 (+  1264us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54000357d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:27.965420 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:27.965623 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3538077952}
I20260709 13:13:28.366732  1655 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.355677  1661 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.339275  1657 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:28.369633 32121 consensus_meta.cc:287] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.643s	user 0.010s	sys 0.001s
I20260709 13:13:28.357435  1647 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.357465  1662 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.370831  1660 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:28.357519  1663 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.372685  1656 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.373560 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:28.381242 32199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1300) took 2054 ms. Trace:
I20260709 13:13:28.368983 32194 rpcz_store.cc:276] 0709 13:13:26.229042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.229227 (+   185us) service_pool.cc:224] Handling call
0709 13:13:26.229765 (+   538us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:26.234627 (+  4862us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:26.234668 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:26.235116 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 13:13:26.343626 (+108510us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:27.330908 (+987282us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:13:27.700455 (+369547us) log.cc:844] Serialized 14 byte log entry
0709 13:13:27.870399 (+169944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:27.870500 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:27.870557 (+    57us) raft_consensus.cc:1685] finished
0709 13:13:27.877582 (+  7025us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:27.877756 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51672,"prepare.queue_time_us":67697,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":151592,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":173,"spinlock_wait_cycles":3451648,"thread_start_us":1563713,"threads_started":3,"wal-append.queue_time_us":160937}
I20260709 13:13:28.382736  1640 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.377082  1664 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.373179 32190 rpcz_store.cc:276] 0709 13:13:26.309137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.311119 (+  1982us) service_pool.cc:224] Handling call
0709 13:13:26.311456 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.311661 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:13:27.635826 (+1324165us) log.cc:844] Serialized 14 byte log entry
0709 13:13:27.748083 (+112257us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:27.748162 (+    79us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:27.748205 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:27.748277 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:27.748416 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30447,"prepare.queue_time_us":99077,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":103184,"raft.run_cpu_time_us":60,"raft.run_wall_time_us":56,"thread_start_us":1391612,"threads_started":2,"wal-append.queue_time_us":112259}
I20260709 13:13:28.356014  1641 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.384553  1665 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.388489  1702 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.388342  1703 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.402796  1646 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.404623  1667 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.406749   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:28.407469  1668 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.414979 32165 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:28.413126 32197 rpcz_store.cc:276] 0709 13:13:26.234148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.267609 (+ 33461us) service_pool.cc:224] Handling call
0709 13:13:26.282375 (+ 14766us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:13:26.286867 (+  4492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:26.286895 (+    28us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:13:26.314776 (+ 27881us) log.cc:844] Serialized 78 byte log entry
0709 13:13:27.615958 (+1301182us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:27.647628 (+ 31670us) log.cc:844] Serialized 14 byte log entry
0709 13:13:27.857266 (+209638us) log.cc:844] Serialized 14 byte log entry
0709 13:13:27.858151 (+   885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:27.858234 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:27.858275 (+    41us) raft_consensus.cc:1685] finished
0709 13:13:27.858297 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:27.858467 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3960,"prepare.queue_time_us":35600,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":81,"raft.queue_time_us":244823,"raft.run_cpu_time_us":437,"raft.run_wall_time_us":26440,"thread_start_us":1469995,"threads_started":2,"wal-append.queue_time_us":786369}
I20260709 13:13:28.416666  1671 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.417645  1666 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.419241 32238 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:28.448665 32264 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:28.450276 32090 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:28.458281 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.459070 32269 raft_consensus.cc:606] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:28.460664  1670 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:27.897130  1033 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:28.463060 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.467062 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.473129 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:28.460182 32272 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.194s	user 0.049s	sys 0.057s
I20260709 13:13:28.474583 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.475746 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.480382 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:28.480897  1130 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:28.486516  1676 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.061451  1678 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.499509  1349 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:28.500671  1684 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.116915  1683 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.501914  1685 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.502986  1690 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.172101  1691 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.188205  1693 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.508098 32122 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:28.240875  1695 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.712050  1491 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.520856 32198 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:28.587836 32124 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
I20260709 13:13:28.588323 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.521600  1503 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.553469 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.591360 32116 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
W20260709 13:13:28.594933 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 180029us
I20260709 13:13:28.525538 32117 raft_consensus.cc:1240] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:28.014282  1533 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.532644  1541 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.546751 32192 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:28.647290  1349 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:28.548503 32118 raft_consensus.cc:1275] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:28.589564 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.589619 32199 rpcz_store.cc:276] 0709 13:13:26.326744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.326891 (+   147us) service_pool.cc:224] Handling call
0709 13:13:26.327195 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:26.327547 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:26.327575 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:26.337486 (+  9911us) log.cc:844] Serialized 26 byte log entry
0709 13:13:28.372371 (+2034885us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:28.372413 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:28.372492 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:28.372534 (+    42us) raft_consensus.cc:1685] finished
0709 13:13:28.372549 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:28.381189 (+  8640us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8771,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":3360,"thread_start_us":2013244,"threads_started":1,"wal-append.queue_time_us":778757,"wal-append.run_cpu_time_us":6595,"wal-append.run_wall_time_us":1271835}
I20260709 13:13:28.519466  1701 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.543182 32196 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 5.
I20260709 13:13:28.648988 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.650053  1670 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.650718  1661 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:28.590940 32121 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 6.
I20260709 13:13:28.651052 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.593007 32270 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:28.591939 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.594571 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.523977 32120 raft_consensus.cc:1275] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:13:28.525502  1680 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:28.596174 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 176979us
I20260709 13:13:28.597721 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:28.593441 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 91688.9us
I20260709 13:13:28.599634 32122 raft_consensus.cc:1275] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:13:28.600562 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 150349us
I20260709 13:13:28.600414 32272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 985) took 2346 ms. Trace:
I20260709 13:13:28.603349 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.635267 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.655318 32269 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:28.636540 32119 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
W20260709 13:13:28.636894 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 91312.4us
I20260709 13:13:28.594316  1691 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.595183  1669 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.661100 32270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:13:28.640731  1657 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.598948  1693 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:13:28.640892  1561 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.640998 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.641670  1686 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.599604  1656 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.701018  1686 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.642081  1685 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.642344  1491 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.631775  1665 raft_consensus.cc:2804] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:28.642508  1684 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.643946  1651 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:28.640763  1690 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.642125  1528 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.648962   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:28.651194   368 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:13:28.654902 32273 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:28.660012 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:28.601886 32165 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:28.631140  1645 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:28.598333  1695 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.594501  1658 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:28.661755 32270 raft_consensus.cc:606] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:28.600093  1640 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.714972 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.749902 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:28.750910 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 149216us
I20260709 13:13:28.750957 32273 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:28.752657 32165 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:28.753010 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.753754 32270 raft_consensus.cc:614] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:28.664502 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.668298 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.668326 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.663193 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.668431 32090 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:28.654600 32272 rpcz_store.cc:276] 0709 13:13:26.243585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.243769 (+   184us) service_pool.cc:224] Handling call
0709 13:13:26.244204 (+   435us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:26.265346 (+ 21142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:26.265379 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:26.265982 (+   603us) log.cc:844] Serialized 52 byte log entry
0709 13:13:28.589134 (+2323152us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:28.589172 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:28.589230 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:28.589271 (+    41us) raft_consensus.cc:1685] finished
0709 13:13:28.589280 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:28.589367 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20626,"raft.queue_time_us":21060,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":119,"thread_start_us":2322650,"threads_started":1,"wal-append.queue_time_us":841034,"wal-append.run_cpu_time_us":4435,"wal-append.run_wall_time_us":1190193}
I20260709 13:13:28.757802 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.600760  1649 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:28.681953  1691 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.678478  1664 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.670351  1662 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.760965 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.695915  1693 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.698226 32238 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:28.699048 32193 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:28.600067  1647 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.599701  1130 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.758965 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.759632 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.704262  1656 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.759693 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.760392 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.760111  1688 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:28.751647  1665 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:28.763790 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 95422.7us
I20260709 13:13:28.654904  1682 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:28.780642  1695 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.780874  1682 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:28.780645 32090 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:28.781396  1682 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:28.781946  1640 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.782657  1640 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.783303  1491 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:28.783159  1640 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.783751  1491 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.784230  1491 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:28.760994  1684 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.785672  1640 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.786504  1684 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.765304 32271 raft_consensus.cc:2410] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:28.600157  1641 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.635095  1671 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.760974 32165 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:28.679697  1503 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.766185 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:28.767231 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 69089.9us
I20260709 13:13:28.795789 32271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:13:28.796357 32271 raft_consensus.cc:606] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:28.788992  1665 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:28.768338  1541 raft_consensus.cc:2804] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:28.686774  1676 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.749256  1645 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.704432  1686 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.678146  1663 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.601020  1655 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.777941   400 raft_consensus.cc:2393] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 6: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:13:28.778184  1661 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:28.778517  1688 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.764664  1673 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:28.705111  1561 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.766088  1690 raft_consensus.cc:2804] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:28.682862  1669 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.600198  1703 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:28.764990   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 113884us
I20260709 13:13:28.779642  1647 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.782541 32090 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:28.787940 32269 raft_consensus.cc:1240] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 5. Current term is 6. Ops: []
W20260709 13:13:28.765123 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 72669.7us
I20260709 13:13:28.791945 32193 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 6.
I20260709 13:13:28.600317  1678 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.795261  1640 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:28.793602 32165 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:28.796128 32266 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:28.599951  1702 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.599350  1683 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.760630  1528 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.842537 32199 raft_consensus.cc:1275] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:13:28.802057 32115 raft_consensus.cc:2376] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4. Re-sending same reply.
I20260709 13:13:28.760942  1658 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.820801 32195 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:28.798571  1541 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.815783  1688 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:28.816107  1673 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.827593 32269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:13:28.848417 32269 raft_consensus.cc:606] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:28.828573 32090 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:28.806684  1645 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:28.840363 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:28.823235 32165 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:28.863653 32194 raft_consensus.cc:2393] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 6: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:28.864181 32165 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:28.815790  1690 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.865324 32165 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:28.823945  1686 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:28.823813  1640 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:28.875757 32165 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:28.876529  1693 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:28.876947  1693 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.877332  1693 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:28.877774  1656 consensus_queue.cc:1059] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:28.878587  1656 consensus_queue.cc:1048] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:28.879906  1656 consensus_queue.cc:1048] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:28.880744  1657 raft_consensus.cc:3055] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:28.881283  1657 raft_consensus.cc:740] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:28.880115  1682 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:28.882342  1657 consensus_queue.cc:260] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.883702  1657 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:28.843016  1379 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.829972  1661 raft_consensus.cc:697] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:28.884862  1379 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.885330  1661 consensus_queue.cc:237] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.886006  1682 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:28.887203  1379 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:28.889411  1693 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.849255  1541 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:28.845255  1649 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:28.895744  1649 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:28.829610  1647 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:28.897374  1647 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.897855  1647 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:28.847363  1561 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.892452 32165 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:28.862704 32090 leader_election.cc:304] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:13:28.912240 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 49625.5us
I20260709 13:13:28.896515  1693 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.850632  1673 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:28.877388  1662 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:28.890879  1691 consensus_queue.cc:1048] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:28.873188  1690 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:28.948215 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:28.904716  1658 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:28.905751 32193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56926 (request call id 58) took 1007 ms. Trace:
I20260709 13:13:28.905820 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:28.906661 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:28.908236 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:28.964824 32195 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:28.966020 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:28.963655 32193 rpcz_store.cc:276] 0709 13:13:27.898563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:27.898689 (+   126us) service_pool.cc:224] Handling call
0709 13:13:28.905597 (+1006908us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b54002418d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:28.905695 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":620461952}
I20260709 13:13:28.969405   368 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:28.908541 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:28.908885 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:28.901454  1640 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:28.915475 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:28.915863  1528 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.855772  1503 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:29.000919  1503 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:29.001495  1503 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:28.942281 32089 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:28.942294 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.006335 32115 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
I20260709 13:13:29.007349 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.007956 32115 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:28.944046 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:28.944355 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.946074 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.009514 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.010125 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.010748 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:28.946370 32090 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:28.946501 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.011664 32120 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:29.012409 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:28.947150 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.014129 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.014636 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:28.950757 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:28.951201 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.015544 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:28.947829 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.016170 32119 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 1.
I20260709 13:13:29.016564 32123 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
W20260709 13:13:29.017174 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 191069us
W20260709 13:13:29.017299 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 71008.5us
I20260709 13:13:29.017428 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:29.017493 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 75309.7us
I20260709 13:13:29.018090 32123 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:29.018952 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.019695 32123 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:13:28.952576 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:28.953658 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.954977 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.956230 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.875135  1695 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:28.961637 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.023152 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:28.900600  1686 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.901083  1663 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:28.909454 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:28.972136 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.033099 32191 raft_consensus.cc:2393] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 6: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:28.976902 32196 raft_consensus.cc:2393] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 6: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:28.970644 32197 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:28.986086  1671 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.986953  1678 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:28.927114   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 80440.5us
I20260709 13:13:28.988714 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:28.927565  1655 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:28.996831  1650 raft_consensus.cc:2804] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:28.928516  1682 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:29.008355 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.010927 32118 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:13:29.014693 32121 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:13:28.947708 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.017989 32090 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:29.021106 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.021865 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.061733 32193 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:29.022491 32117 raft_consensus.cc:2368] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 3. Current term is 4.
I20260709 13:13:29.024137 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.063416 32268 raft_consensus.cc:2410] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:13:28.929052  1656 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:28.939010  1662 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:29.026434 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.026968 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.023846  1695 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.028129 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.029055 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.031100 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.068928 32119 raft_consensus.cc:2468] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:13:29.034189 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:13:29.044826 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.047538 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.047780 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.050292 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.051208 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:28.996117  1491 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:29.024011  1684 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:29.032164  1663 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.024653  1528 raft_consensus.cc:2804] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:29.055006 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.055245 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.059158 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.089679 32123 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:13:29.033324  1686 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:29.066040 32199 raft_consensus.cc:2393] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 6: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:13:29.071169 32197 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:29.092655 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.072288 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.093343 32123 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:29.094161 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:29.061676 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 43759us
I20260709 13:13:29.074939 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.096254 32192 raft_consensus.cc:2410] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:13:29.077960 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.078480 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.097048 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.097345 32271 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
I20260709 13:13:29.098569 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.099759 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.079394 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.083899 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.084920 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.101841 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.103178 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.103282 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.085724 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.086961 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:29.053829 32145 debug-util.cc:398] Leaking SignalData structure 0x7b080030f640 after lost signal to thread 30975
I20260709 13:13:29.104825 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.058048  1669 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:29.105556 32145 debug-util.cc:398] Leaking SignalData structure 0x7b080028a5a0 after lost signal to thread 32056
W20260709 13:13:29.105986 32145 debug-util.cc:398] Leaking SignalData structure 0x7b0800225dc0 after lost signal to thread 32070
I20260709 13:13:29.090283 32122 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
W20260709 13:13:29.107164 32145 debug-util.cc:398] Leaking SignalData structure 0x7b08001aac80 after lost signal to thread 32148
I20260709 13:13:29.060469  1130 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:29.061795  1682 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.097792 32196 raft_consensus.cc:2468] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:29.107545 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.108347 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.108621 32199 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
W20260709 13:13:29.107446 32145 debug-util.cc:398] Leaking SignalData structure 0x7b08001aafa0 after lost signal to thread 32149
I20260709 13:13:29.109517 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.110188 32266 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
W20260709 13:13:29.110931 32145 debug-util.cc:398] Leaking SignalData structure 0x7b08001e0bc0 after lost signal to thread 32223
W20260709 13:13:29.112042 32145 debug-util.cc:398] Leaking SignalData structure 0x7b080017d620 after lost signal to thread 32224
I20260709 13:13:29.076180  1676 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:29.111932 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.069159  1662 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:29.077248  1695 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:29.113617 32117 raft_consensus.cc:2393] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 6: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:13:29.113530 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.121594 32199 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:29.110924 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:29.107295 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.107302 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.124773 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.125541 32197 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:29.076663  1649 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:29.075029  1684 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.127120  1684 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:29.127610  1690 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:29.128705 32198 raft_consensus.cc:1240] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:29.141125 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.142474 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:13:29.114899 32145 debug-util.cc:398] Leaking SignalData structure 0x7b0800323080 after lost signal to thread 32297
I20260709 13:13:29.069783  1656 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:29.117462 32193 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 1.
I20260709 13:13:29.147311  1641 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:29.147500  1656 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:29.089193  1528 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:29.119928 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.091090  1663 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:29.154469 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.154907  1703 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:29.155194 32123 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:29.155344  1130 raft_consensus.cc:993] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:13:29.118460 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.156723  1491 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:29.149904 32145 debug-util.cc:398] Leaking SignalData structure 0x7b08003b3da0 after lost signal to thread 427
W20260709 13:13:29.158025 32145 debug-util.cc:398] Leaking SignalData structure 0x7b08003bb640 after lost signal to thread 428
I20260709 13:13:29.160979  1683 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:29.161962  1663 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:29.162729  1640 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:29.163424 32194 raft_consensus.cc:2368] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7.
I20260709 13:13:29.165438 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.152597 32122 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:29.193517 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.194293 32122 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:29.196995 32190 raft_consensus.cc:1240] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:29.113121  1682 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:29.201825  1640 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:29.202497  1684 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:29.205866  1345 raft_consensus.cc:1081] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Signalling peer fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:13:29.119624  1676 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.114459  1702 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:29.164219  1528 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:29.223592 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.218776 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:29.220659 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.221014 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.221504 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.221779 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.222827 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.224525 32270 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:29.228612 32269 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:29.236501 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.237766 32196 raft_consensus.cc:2393] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 3: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:29.211632  1676 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:29.235265 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:29.239476 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:29.246506 32122 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:29.248757 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.231930  1345 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.256842 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.252840 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.254995 32192 raft_consensus.cc:1275] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:29.258858 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.258904 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.261847 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.265424 32196 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:29.269531 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.272805 32198 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:29.273195 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.274178 32269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:13:29.274870 32269 raft_consensus.cc:606] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:29.275269 32269 raft_consensus.cc:614] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:29.251029  1684 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:29.282564 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:29.283207 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 264506us
I20260709 13:13:29.287809 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.353053 32269 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:29.289350 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.354354 32196 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:29.293864 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:29.294894   424 debug-util.cc:398] Leaking SignalData structure 0x7b08002e55c0 after lost signal to thread 30975
I20260709 13:13:29.297565  1658 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:29.299724 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:13:29.352100 32089 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.684s (SENT) [suppressed 11 similar messages]
I20260709 13:13:29.360363 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:29.254225  1665 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:29.314442 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:29.361164 32264 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:13:29.315335 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.316871 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.362331 32194 raft_consensus.cc:2393] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 7: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:29.320245  1690 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:29.263561  1345 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:29.321069  1688 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:29.321333  1695 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:29.323460  1686 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:29.362483 32089 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:29.324164 32122 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:13:29.325157 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:29.324757  1503 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:29.330950 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.334028 32270 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 6.
I20260709 13:13:29.332355  1719 raft_consensus.cc:993] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:13:29.344558 32090 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:29.346082 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.348532 32272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 1110) took 1078 ms. Trace:
I20260709 13:13:29.381439 32272 rpcz_store.cc:276] 0709 13:13:28.270272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:28.776500 (+506228us) service_pool.cc:224] Handling call
0709 13:13:28.776742 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:28.776936 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:13:28.847030 (+ 70094us) log.cc:844] Serialized 14 byte log entry
0709 13:13:29.307878 (+460848us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b180007efa0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bf043f3 00007fb59bf067c1 00007fb59bf06779 00007fb59bf06709 00007fb59bf066d1 00007fb59bf059cd 000000000038f354 000000000038f199 00007fb59bee783a
0709 13:13:29.348267 (+ 40389us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:29.348314 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:29.348344 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:29.348393 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:29.348482 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4638,"prepare.queue_time_us":69240,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":59207,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":2845,"spinlock_wait_cycles":65703808,"thread_start_us":566400,"threads_started":3,"wal-append.queue_time_us":274134}
I20260709 13:13:29.367440 32266 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:13:29.374511 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.391779 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.392756 32197 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:13:29.396178 32192 raft_consensus.cc:2368] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5.
W20260709 13:13:29.394275 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 49798us
I20260709 13:13:29.399171 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.400012 32190 raft_consensus.cc:2468] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:29.401686 32115 raft_consensus.cc:1240] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:29.361302  1663 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:29.402148 32195 raft_consensus.cc:2393] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 7: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:29.403709 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.407830  1660 raft_consensus.cc:1081] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:13:29.409485 32090 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:29.385702  1690 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.415045 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.401223  1669 raft_consensus.cc:2804] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:13:29.413797   424 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5ca0 after lost signal to thread 32056
I20260709 13:13:29.434999  1682 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:29.379659  1673 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:29.455308 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 51380.6us
I20260709 13:13:29.458777 32089 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:29.460103 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.472065 32117 raft_consensus.cc:2393] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 7: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
W20260709 13:13:29.449272   424 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5d60 after lost signal to thread 32070
I20260709 13:13:29.474407 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.475198 32190 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:29.478080  1682 leader_election.cc:290] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:29.479228 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.442523  1669 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.493219  1561 raft_consensus.cc:2804] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:29.493745  1561 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:29.494148  1561 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:29.417393  1662 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:29.507016  1662 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:29.507722  1645 consensus_meta.cc:287] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.605s	user 0.008s	sys 0.000s
I20260709 13:13:29.512853  1645 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:29.514191 32267 raft_consensus.cc:2368] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4.
I20260709 13:13:29.514513  1561 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:29.426240  1690 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:29.508765  1345 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:29.509932   424 debug-util.cc:398] Leaking SignalData structure 0x7b0800216fe0 after lost signal to thread 32148
I20260709 13:13:29.539006 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:29.563045 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.462749  1491 raft_consensus.cc:2804] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:29.577714 32190 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:29.579238 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:29.580003 32190 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:29.538524 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.554260 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.536938 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.542102 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.581517 32195 raft_consensus.cc:2393] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 5: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:29.581604 32194 raft_consensus.cc:2393] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 4: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:29.541108 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.582746 32193 raft_consensus.cc:2393] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 5: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:29.582904 32192 raft_consensus.cc:2393] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 3: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:29.541602 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.589587 32197 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:29.593680 32165 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:29.595839 32165 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:29.596819 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.582100 32198 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:29.597450 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:13:29.600114 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 341695us
I20260709 13:13:29.516234  1695 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:29.520372  1541 consensus_meta.cc:287] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6: Time spent flushing consensus metadata: real 0.627s	user 0.002s	sys 0.009s
W20260709 13:13:29.597983   424 debug-util.cc:398] Leaking SignalData structure 0x7b080031fd00 after lost signal to thread 32149
I20260709 13:13:29.492148  1669 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:29.607955 32266 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:13:29.535097  1665 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:29.522692  1688 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:29.529937  1673 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:29.556013  1503 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:29.535605  1561 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:29.516053  1645 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:29.533064  1686 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:29.599231  1662 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:29.634985 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 170099us
I20260709 13:13:29.638520 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:29.639200 32267 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:13:29.617871  1541 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:13:29.633138  1647 consensus_meta.cc:287] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.734s	user 0.011s	sys 0.002s
I20260709 13:13:29.642400 32238 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:29.643474  1345 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:29.644150  1345 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:29.610476 32264 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:29.598995  1491 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:29.644639  1345 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:29.644932  1491 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:29.645823 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:29.646001 32238 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:29.646435 32266 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:13:29.646912  1700 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:29.647281  1700 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:29.647651  1700 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:29.613869 32239 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.014s	sys 0.023s
W20260709 13:13:29.648633 32239 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.014s	sys 0.023s
W20260709 13:13:29.648931 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 605837us
W20260709 13:13:29.649875   369 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.016s	sys 0.028s
W20260709 13:13:29.650226   369 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.016s	sys 0.028s
I20260709 13:13:29.653053  1379 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:29.653383  1690 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:29.615023 32194 raft_consensus.cc:2393] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 7: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
W20260709 13:13:29.613332  1650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.009s	sys 0.035s
I20260709 13:13:29.533983  1656 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:29.658034  1650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.009s	sys 0.035s
I20260709 13:13:29.658234 32267 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 8.
I20260709 13:13:29.658368  1650 raft_consensus.cc:697] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 6 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:13:29.659293  1650 consensus_queue.cc:237] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:29.652339 32239 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:29.618116  1663 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:29.660372  1676 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:29.660806  1663 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.661307  1663 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:29.661688   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:13:29.662581  1676 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:29.664067 32087 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:29.665081  1676 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:29.666097 32190 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:13:29.667932 32165 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:29.636955   424 debug-util.cc:398] Leaking SignalData structure 0x7b080036c740 after lost signal to thread 32223
I20260709 13:13:29.661309 32239 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:29.669459  1726 raft_consensus.cc:2764] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:13:29.669866   424 debug-util.cc:398] Leaking SignalData structure 0x7b0800318220 after lost signal to thread 32297
I20260709 13:13:29.670682 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:29.670779 32239 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:29.671167   424 debug-util.cc:398] Leaking SignalData structure 0x7b08002effc0 after lost signal to thread 427
I20260709 13:13:29.671284 32267 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:13:29.671598   424 debug-util.cc:398] Leaking SignalData structure 0x7b08001ee580 after lost signal to thread 986
W20260709 13:13:29.671950   424 debug-util.cc:398] Leaking SignalData structure 0x7b08002f73a0 after lost signal to thread 1296
W20260709 13:13:29.672184   424 debug-util.cc:398] Leaking SignalData structure 0x7b080032cc60 after lost signal to thread 1303
I20260709 13:13:29.672243 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:29.673238  1491 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:29.674006 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:29.659736  1656 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:29.608891  1684 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:29.677384 32239 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:29.678237 32238 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:29.684554 32090 leader_election.cc:400] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4.
I20260709 13:13:29.684916 32090 leader_election.cc:403] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:29.685005 32239 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
W20260709 13:13:29.672526   424 debug-util.cc:398] Leaking SignalData structure 0x7b080033dd20 after lost signal to thread 1334
I20260709 13:13:29.685559 32090 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:29.691144 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.692775 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.691854 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.694527 32115 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:29.680174 32266 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:13:29.682456  1642 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:29.637282  1528 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:29.701249 32165 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:29.694002  1379 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:13:29.702248  1130 consensus_queue.cc:1059] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:13:29.702899  1731 log.cc:927] Time spent T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:13:29.703435  1719 raft_consensus.cc:3055] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:29.703836  1719 raft_consensus.cc:740] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:29.704649  1719 consensus_queue.cc:260] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:29.705394  1656 raft_consensus.cc:2804] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:29.705888  1719 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:29.705948  1656 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.706609  1656 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:29.697954  1661 raft_consensus.cc:2764] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:13:29.705410  1684 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:13:29.686589  1726 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:29.685554  1722 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:29.685863  1688 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:13:29.692652   424 debug-util.cc:398] Leaking SignalData structure 0x7b0800372860 after lost signal to thread 1355
I20260709 13:13:29.720654 32165 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:29.715571 32267 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:13:29.699652 32238 leader_election.cc:400] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7.
I20260709 13:13:29.675554  1647 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:29.730962 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.732013 32115 raft_consensus.cc:2393] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 6: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:13:29.720412 32090 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:29.732082 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.733003 32089 leader_election.cc:304] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:29.733619 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.732977 32117 raft_consensus.cc:2468] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 2.
I20260709 13:13:29.735524 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.735934 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.736129 32118 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:29.718166  1726 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:13:29.730422   424 debug-util.cc:398] Leaking SignalData structure 0x7b080032af20 after lost signal to thread 1418
I20260709 13:13:29.745167 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:29.745779 32089 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:29.746474 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:29.741650 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.747361 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.747702 32122 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:29.743379 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:29.740182 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.743651 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.694897  1725 consensus_queue.cc:1059] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:13:29.729609  1702 raft_consensus.cc:2764] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:13:29.757128  1737 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:29.760447 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:29.761133 32115 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:29.767079  1669 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:29.748672 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:29.749879 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:13:29.750910   424 debug-util.cc:398] Leaking SignalData structure 0x7b080032b0a0 after lost signal to thread 1491
W20260709 13:13:29.780426   424 debug-util.cc:398] Leaking SignalData structure 0x7b08003411e0 after lost signal to thread 1503
W20260709 13:13:29.780776   424 debug-util.cc:398] Leaking SignalData structure 0x7b080032b040 after lost signal to thread 1525
W20260709 13:13:29.781036   424 debug-util.cc:398] Leaking SignalData structure 0x7b080032aea0 after lost signal to thread 1528
W20260709 13:13:29.781270   424 debug-util.cc:398] Leaking SignalData structure 0x7b08002b7dc0 after lost signal to thread 1533
W20260709 13:13:29.781531   424 debug-util.cc:398] Leaking SignalData structure 0x7b0800365660 after lost signal to thread 1541
W20260709 13:13:29.781817   424 debug-util.cc:398] Leaking SignalData structure 0x7b080037ada0 after lost signal to thread 1561
W20260709 13:13:29.782055   424 debug-util.cc:398] Leaking SignalData structure 0x7b080032b0c0 after lost signal to thread 1564
W20260709 13:13:29.782282   424 debug-util.cc:398] Leaking SignalData structure 0x7b08000c2ea0 after lost signal to thread 1567
W20260709 13:13:29.782548   424 debug-util.cc:398] Leaking SignalData structure 0x7b080037ad80 after lost signal to thread 1577
I20260709 13:13:29.782610  1669 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:29.722133  1688 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:29.784425  1688 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:29.785665  1528 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:29.786991  1541 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 6 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:29.787633 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:29.788215 32199 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:29.727849  1715 raft_consensus.cc:2764] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:13:29.728724  1673 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:29.790186  1673 raft_consensus.cc:697] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:29.748113 32121 raft_consensus.cc:2368] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5.
I20260709 13:13:29.791165  1673 consensus_queue.cc:237] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:29.791918 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.751121 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.792552 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:29.793040 32118 raft_consensus.cc:2393] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 6: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:29.793835 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.744000 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:29.795312 32199 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 6.
I20260709 13:13:29.795673 32124 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:29.796566  1676 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:29.796877   400 raft_consensus.cc:1240] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:29.797338  1676 raft_consensus.cc:697] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:29.798240  1676 consensus_queue.cc:237] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:29.799847  1656 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:29.769474 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.802698 32122 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:29.804493 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.805774 32121 raft_consensus.cc:2368] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5.
I20260709 13:13:29.805908 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:29.806135 32122 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:29.753604 32090 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:29.748086 32238 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:29.726629  1491 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:29.774765 32120 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:29.750228 32191 raft_consensus.cc:2393] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 8: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:29.775871 32270 raft_consensus.cc:2393] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 7: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:29.811162 32115 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:29.737599  1642 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:13:29.745146  1726 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:29.752880  1561 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:29.801421 32123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:56890
I20260709 13:13:29.801826  1715 consensus_queue.cc:1059] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:29.809252 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:29.741693 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:29.810730 32266 raft_consensus.cc:2393] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 7: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:29.818123  1711 raft_consensus.cc:3055] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:29.835526  1711 raft_consensus.cc:740] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:29.836344  1711 consensus_queue.cc:260] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:29.837558  1711 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:29.808156 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 60142.6us
I20260709 13:13:29.811784 32121 raft_consensus.cc:1240] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:29.839758 32238 leader_election.cc:400] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5.
I20260709 13:13:29.840047 32238 leader_election.cc:403] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:29.841801 32264 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:13:29.827580 32123 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:29.843273 32123 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:29.730297  1663 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:29.823378 32124 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:13:29.849826 32191 raft_consensus.cc:1240] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:29.851022 32118 raft_consensus.cc:1240] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 5. Current term is 6. Ops: []
W20260709 13:13:29.812837 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 59349.7us
I20260709 13:13:29.834143 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:29.813859 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:29.796614   368 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:13:29.815429  1725 raft_consensus.cc:2804] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:29.816475  1647 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:29.816490  1345 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:29.828831 32272 raft_consensus.cc:2393] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 5: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:29.843132 32120 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
I20260709 13:13:29.810300 32239 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:29.853951 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:29.873220 32192 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
W20260709 13:13:29.814723 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.855664 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:29.874513 32191 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:29.859462 32193 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05806ba48f814549969547f21c7101c3"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:13:29.876161 32193 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:29.862077 32121 raft_consensus.cc:1240] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:13:29.862895 32197 raft_consensus.cc:1240] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:13:29.863811 32123 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:29.863847 32165 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:29.866784 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:29.867223 32090 leader_election.cc:304] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:29.883518 32193 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:29.924052 32118 raft_consensus.cc:2393] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 7: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
W20260709 13:13:29.924352 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 57185.7us
I20260709 13:13:29.925067 32090 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:29.925287 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:29.929124 32115 raft_consensus.cc:1240] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: []
W20260709 13:13:29.931738 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 99758us
I20260709 13:13:29.932682 32165 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:29.936012 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:29.940912 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:29.942792 32123 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:29.904742   369 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:29.950357 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 140109us
I20260709 13:13:29.951660 32239 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:29.952273 32165 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:29.884371 32196 raft_consensus.cc:1275] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:29.827222  1561 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:29.818735  1684 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4.
I20260709 13:13:29.858493  1642 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:13:29.835075  1736 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:29.909912 32191 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:29.867771  1725 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.959301  1733 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:29.959689  1725 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:29.818857  1700 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:29.962656  1700 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:29.904184  1541 raft_consensus.cc:2804] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:29.963771  1541 raft_consensus.cc:697] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 6 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:13:29.964814  1736 raft_consensus.cc:697] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 8 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:29.964972  1541 consensus_queue.cc:237] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:29.965866  1736 consensus_queue.cc:237] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:29.878182   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 81673.9us
W20260709 13:13:29.920420 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 174696us
I20260709 13:13:29.907686  1647 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:29.828298  1715 raft_consensus.cc:3055] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:29.945402 32121 raft_consensus.cc:2393] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 5: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:29.949535 32118 raft_consensus.cc:1240] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:29.941411  1491 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:29.882361 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:29.957278  1561 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:29.958992  1750 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:29.941177  1678 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:29.957283 32165 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:30.003750 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 46551.5us
I20260709 13:13:30.004534 32165 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:29.971853 32089 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:29.984786  1700 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:29.944548  1702 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:29.956313  1656 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:30.007339 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:29.986768  1715 raft_consensus.cc:740] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:29.923262  1688 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:29.967695  1695 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:29.980106 32239 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:30.000844  1750 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:13:29.969542   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 101047us
I20260709 13:13:29.958559  1665 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:30.010351 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:30.032634 32264 raft_consensus.cc:2393] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 4: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:30.010502 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:30.008014  1656 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:30.013664 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:30.014420 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:30.015202 32269 raft_consensus.cc:1240] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:30.016232 32271 raft_consensus.cc:1240] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:30.016682 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:30.018249 32122 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:30.023376 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:30.000078 32193 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.024394 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:13:30.025739 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 54001.6us
I20260709 13:13:30.037457 32199 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:30.037704 32089 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:30.028875 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 50641.5us
I20260709 13:13:30.006053  1662 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:29.987730  1647 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.039170 32195 raft_consensus.cc:1240] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:30.039748 32193 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:30.041854 32239 leader_election.cc:400] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5.
I20260709 13:13:30.046348 32239 leader_election.cc:403] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:30.043713 32089 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.012342  1491 raft_consensus.cc:697] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:30.050513 32239 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:30.054369 32239 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:30.050704 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 46267us
I20260709 13:13:30.050944 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:30.057896 32269 raft_consensus.cc:3055] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:30.058043 32165 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:30.018962  1695 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:30.058260 32269 raft_consensus.cc:740] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:30.019145  1678 raft_consensus.cc:697] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:30.059130 32165 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.065024 32199 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:30.059902  1345 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:30.094269 32165 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:30.091841 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 48213.6us
I20260709 13:13:30.096269 32089 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.063541 32269 consensus_queue.cc:260] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.097512 32269 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:30.032127  1665 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:30.041796  1663 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:30.032955  1671 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:30.030614  1750 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:30.031005  1700 consensus_queue.cc:1059] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:13:30.139210 32269 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:30.106186 32089 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.091820  1656 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:30.115025  1345 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5.
I20260709 13:13:30.116787  1662 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:30.109952  1684 consensus_queue.cc:1059] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:13:30.066990  1695 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:30.094867  1688 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:30.062160  1741 raft_consensus.cc:2804] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:13:30.144783 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 88799.1us
W20260709 13:13:30.152705 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 46674.7us
I20260709 13:13:30.163259 32089 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.114542  1665 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:30.160072 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 138941us
I20260709 13:13:30.110085  1669 raft_consensus.cc:2804] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:30.117303  1686 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:30.104239  1749 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:30.157191  1743 log.cc:927] Time spent T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:13:30.188191 32089 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.151017  1718 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:30.150197  1662 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:30.153038  1663 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:30.149094   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 99763.1us
I20260709 13:13:30.110643  1673 consensus_queue.cc:1059] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 13:13:30.160660  1683 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:30.161767  1741 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:30.185595  1669 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:30.066740  1715 consensus_queue.cc:260] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:30.187635  1686 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:30.191689  1503 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:13:30.238209 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 144115us
I20260709 13:13:30.238996 32239 leader_election.cc:400] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5.
I20260709 13:13:30.238916 32165 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.239882 32239 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:30.193535  1658 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:30.192575  1748 raft_consensus.cc:2749] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:30.202798   400 raft_consensus.cc:1240] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 6 LEADER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:30.201644  1682 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:30.201793  1662 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:30.237563  1503 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:30.255025  1503 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:30.255697  1726 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.256717 32267 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:30.244019  1663 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:30.257493  1663 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:30.258016  1663 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.232192  1678 consensus_queue.cc:237] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.266315 32123 raft_consensus.cc:1275] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:13:30.237648  1686 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:30.189203  1491 consensus_queue.cc:237] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.231921  1741 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:30.237861  1669 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:30.284873  1727 consensus_queue.cc:1059] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:30.286020  1733 raft_consensus.cc:3055] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:30.286377  1733 raft_consensus.cc:740] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:13:30.234443  1752 raft_consensus.cc:3055] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:30.287276  1752 raft_consensus.cc:740] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:30.287330  1733 consensus_queue.cc:260] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:30.288219  1752 consensus_queue.cc:260] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.289539  1752 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:30.288722  1733 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:30.293206  1751 log.cc:927] Time spent T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:13:30.294061  1755 log.cc:927] Time spent T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:13:30.291271  1663 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.241880 32165 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.276721  1726 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:30.271832 32267 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
W20260709 13:13:30.309312 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.279493  1561 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:30.310642 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.269696  1715 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:30.324064 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 70786.7us
I20260709 13:13:30.325347 32269 raft_consensus.cc:1240] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4. Ops: []
W20260709 13:13:30.325618 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 83788.3us
W20260709 13:13:30.310902  1743 log.cc:927] Time spent T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:13:30.245504  1658 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.357539 32165 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:30.363288 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 162495us
I20260709 13:13:30.363778 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:30.320353  1719 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:30.364286 32089 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.369756 32089 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.371389 32165 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.372685 32165 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:30.374413 32165 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:30.372915  1766 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:30.376701  1656 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:30.376878  1767 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:30.377350  1767 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:30.376576  1766 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:30.377766  1767 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:30.377954  1766 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:30.384462 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:30.384742  1753 log.cc:927] Time spent T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:13:30.387137 32239 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:30.389415  1671 raft_consensus.cc:3055] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:30.389882  1645 consensus_queue.cc:1059] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:30.391305  1645 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:30.391762  1645 raft_consensus.cc:697] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:13:30.391954  1711 consensus_meta.cc:287] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.554s	user 0.011s	sys 0.000s
I20260709 13:13:30.389899  1671 raft_consensus.cc:740] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:30.353499  1690 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:30.397365 32089 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:30.401139 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.329123  1663 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:30.405674 32269 raft_consensus.cc:1275] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:13:30.405416 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 205398us
I20260709 13:13:30.413934  1750 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.371348  1719 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.354647  1541 consensus_queue.cc:1048] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:13:30.403772  1682 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:30.402427  1690 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:30.369242  1647 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:30.416551  1750 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:30.392521  1711 raft_consensus.cc:3055] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:30.420442  1695 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.444820  1645 consensus_queue.cc:237] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.447813  1695 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:30.404397  1491 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:30.448554  1491 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:30.426249  1503 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:30.450207 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 75898.2us
I20260709 13:13:30.450629  1735 raft_consensus.cc:3055] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:30.450999  1735 raft_consensus.cc:740] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:30.451050 32165 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:30.451514  1503 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:30.416806  1719 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:30.452984  1768 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:30.453697  1768 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:30.455943  1662 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.444844  1671 consensus_queue.cc:260] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.459050  1671 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:30.423740  1690 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:30.421999  1725 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.449083  1491 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:30.434926 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 47816.6us
W20260709 13:13:30.492600 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 51485.1us
W20260709 13:13:30.500628 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 78960.2us
W20260709 13:13:30.501420 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 104115us
I20260709 13:13:30.490694 32165 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:30.502983 32089 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.503566 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:30.505023 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:13:30.505368 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 66879.5us
I20260709 13:13:30.509572 32269 raft_consensus.cc:1275] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:30.511519 32165 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:30.463356  1662 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:30.419608  1718 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:30.514082 32090 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:30.515038 32089 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.522253 32115 raft_consensus.cc:1240] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:30.523236 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:30.482117 32021 catalog_manager.cc:5697] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 4 to 6, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4), pending config changed. New cstate: current_term: 6 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:13:30.519258 32273 raft_consensus.cc:2368] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4.
I20260709 13:13:30.523794 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:30.433687  1561 leader_election.cc:290] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:30.441969  1711 raft_consensus.cc:740] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:30.451900  1735 consensus_queue.cc:260] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.525660 32116 raft_consensus.cc:1240] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:30.527096 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:30.538681 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:30.527434 32118 raft_consensus.cc:1240] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:30.525596 32089 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.467775  1642 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5.
I20260709 13:13:30.467530  1741 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.479279  1766 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.537770  1683 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:30.538938 32121 raft_consensus.cc:2368] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7.
W20260709 13:13:30.576028 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 53873.8us
I20260709 13:13:30.513420  1702 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:30.542523 32089 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.567068 32238 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:30.567235  1730 consensus_queue.cc:1048] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:13:30.531809  1737 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:30.518275  1772 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:30.510047  1682 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:30.577258 32115 raft_consensus.cc:1240] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:30.513104 32165 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:30.640125  1702 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:30.640159 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 127113us
I20260709 13:13:30.566210  1711 consensus_queue.cc:260] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.640991 32165 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.641615  1711 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:30.642083 32165 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.642745  1725 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:30.515756  1695 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:13:30.644662  1715 consensus_queue.cc:1175] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "113b5461952d47e0944d463ea4e32801" responder_term: 7 status { last_received { term: 4 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: [6.3-6.3]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:13:30.646603  1665 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.572638  1686 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.642086  1766 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:30.649423  1662 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:30.649824  1662 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:30.650185  1662 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:30.650348  1686 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:30.569646  1741 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:30.468094  1669 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:13:30.590602 32121 raft_consensus.cc:1275] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:30.558769  1503 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:13:30.653363  1775 log.cc:927] Time spent T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:13:30.653528 32123 raft_consensus.cc:1240] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:30.653805 32165 leader_election.cc:400] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 3. Current term is 4.
I20260709 13:13:30.652398  1669 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:30.543711  1769 consensus_queue.cc:1059] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:13:30.634241  1718 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:30.634574 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:30.654940 32190 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:30.656926 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:30.657575  1719 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.660001  1719 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:30.635192  1776 log.cc:927] Time spent T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:13:30.571060  1774 consensus_queue.cc:1059] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:13:30.596873  1682 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:30.660972  1682 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:30.660279  1767 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.663410  1767 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:30.664216 32165 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:30.637042  1780 consensus_queue.cc:1048] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:30.660988  1702 raft_consensus.cc:2804] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:30.665181  1702 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:30.665565  1702 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:30.588884  1683 raft_consensus.cc:697] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:30.667354 32165 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:30.667318  1683 consensus_queue.cc:237] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:30.637650 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 49474.5us
I20260709 13:13:30.671476  1528 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:30.672137 32239 leader_election.cc:400] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7.
I20260709 13:13:30.672613 32239 leader_election.cc:403] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:13:30.672457  1752 consensus_queue.cc:1059] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:30.673069 32191 raft_consensus.cc:1240] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:30.673518  1752 consensus_queue.cc:1059] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:30.673822 32192 raft_consensus.cc:1240] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:30.674476  1752 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7.
I20260709 13:13:30.674961  1726 raft_consensus.cc:3055] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:30.675099  1752 raft_consensus.cc:3055] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:30.675379  1726 raft_consensus.cc:740] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:30.634287 32195 raft_consensus.cc:1240] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:30.675849  1718 raft_consensus.cc:697] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:30.676273  1726 consensus_queue.cc:260] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.638552 32198 raft_consensus.cc:1240] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:30.672089  1528 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:30.648461  1690 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.677480  1718 consensus_queue.cc:237] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.677991  1528 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:30.677507  1726 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:30.636158 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:30.679476 32193 raft_consensus.cc:1240] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:30.679804 32199 raft_consensus.cc:2368] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7.
I20260709 13:13:30.675477  1752 raft_consensus.cc:740] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:30.681542  1752 consensus_queue.cc:260] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.682528  1766 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:30.682094  1768 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:30.682828  1752 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:30.685654  1690 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:30.686503 32195 raft_consensus.cc:1275] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:13:30.688191  1650 consensus_queue.cc:1048] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:30.688722  1777 consensus_queue.cc:1048] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:30.690137 32270 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:30.692420 32117 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:30.693553 32165 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.694617 32267 raft_consensus.cc:1275] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:13:30.694980 32165 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.695482  1768 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:30.695848  1766 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:30.696234  1766 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:30.696380 32267 raft_consensus.cc:1275] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:13:30.696677  1766 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:30.696842  1665 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:30.698120 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:30.698365 32090 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:30.698711 32121 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:30.638613 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 96672.5us
I20260709 13:13:30.699991 32089 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.701160 32165 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:30.701700 32190 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:30.702486 32165 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.710074 32089 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.711251 32089 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.711457 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:30.711992 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:30.713374 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:30.716733 32165 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:30.718645 32089 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.721221 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:30.721494  1772 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:30.732126 32119 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:30.734790 32165 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.732756 32089 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:30.736061 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.724351  1650 consensus_queue.cc:1048] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:13:30.715617  1665 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:30.737934  1665 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:30.738346  1665 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:30.738566  1686 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:30.739784  1658 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:30.742748 32165 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.743952 32165 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.718431  1671 consensus_queue.cc:1048] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:13:30.745198  1647 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:30.745604  1647 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:30.733839  1503 raft_consensus.cc:2749] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:30.695859  1768 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:30.754427  1647 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:30.754838  1768 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:30.752242 32272 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:30.707621  1690 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:30.747983 32089 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.742905 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:30.758697 32089 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.755945 32121 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:30.734983  1780 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:30.764122  1780 raft_consensus.cc:697] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:30.757385  1663 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:30.764956  1735 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:30.763516  1662 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.760192 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:30.761549  1671 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:30.763236  1682 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.758960 32193 raft_consensus.cc:2393] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 4: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:30.758268  1686 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:30.755558  1695 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:30.767220 32089 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.766206  1669 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:30.771190 32121 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:30.760823 32239 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:30.750298 32165 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:30.825894 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 65234.6us
W20260709 13:13:30.826124 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 75969.1us
I20260709 13:13:30.826839 32165 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:30.779742 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.733994  1684 raft_consensus.cc:2804] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:30.741669  1767 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:30.765132  1663 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:30.828363 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 61238.9us
I20260709 13:13:30.842383 32089 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.831071 32120 raft_consensus.cc:1240] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:30.827814 32090 leader_election.cc:400] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4.
I20260709 13:13:30.842844 32198 raft_consensus.cc:1240] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:30.843238 32090 leader_election.cc:403] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:13:30.834051 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:30.844067 32199 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:30.846076  1761 raft_consensus.cc:2804] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:13:30.846925 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.846837  1761 raft_consensus.cc:697] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:30.862147 32199 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:30.765045  1780 consensus_queue.cc:237] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.859722 32089 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.867374 32119 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:30.786134  1503 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:30.868891 32120 raft_consensus.cc:1240] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:30.871381 32089 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.785872  1695 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:30.860002 32165 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:30.827859  1669 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:30.833141  1656 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:30.843595  1690 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:30.848039  1761 consensus_queue.cc:237] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.890127  1662 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:30.886806  1690 raft_consensus.cc:697] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:30.858577  1663 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:30.858060  1676 raft_consensus.cc:2764] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:13:30.857656  1684 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:30.860661  1678 raft_consensus.cc:2749] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:30.827258  1733 consensus_queue.cc:1048] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:13:30.827747  1702 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.860718  1737 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4.
I20260709 13:13:30.902554 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:30.876096  1695 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:30.884424  1669 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:30.883613  1767 raft_consensus.cc:2804] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:30.910569  1789 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:30.913241 32089 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:30.915222 32196 raft_consensus.cc:1275] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:13:30.916002 32270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36080 (request call id 1049) took 1102 ms. Trace:
W20260709 13:13:30.920747 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.925733 32238 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:30.908458  1684 raft_consensus.cc:3060] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:30.899340  1491 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.857486  1784 consensus_queue.cc:1059] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:13:30.945147 32270 rpcz_store.cc:276] 0709 13:13:29.813475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:29.813618 (+   143us) service_pool.cc:224] Handling call
0709 13:13:30.915836 (+1102218us) spinlock_profiling.cc:243] Waited 733 ms on lock 0x7b540014cb54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:30.915942 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1685758336}
I20260709 13:13:30.950855 32194 raft_consensus.cc:1240] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:30.955103 32238 leader_election.cc:400] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7.
I20260709 13:13:30.956045 32238 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:30.981818  1650 consensus_queue.cc:1048] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:13:30.982769 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 122814us
I20260709 13:13:30.983587 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:30.984372  1784 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:30.984802  1784 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:30.985188  1784 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:30.985029  1758 consensus_queue.cc:1059] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:30.985733  1766 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.986181  1758 consensus_queue.cc:1059] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:30.987236  1758 raft_consensus.cc:3055] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:30.987675  1758 raft_consensus.cc:740] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:30.988039  1715 raft_consensus.cc:3055] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:30.988459  1715 raft_consensus.cc:740] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:30.991083 32124 raft_consensus.cc:1240] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:30.991353 32199 raft_consensus.cc:1240] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
W20260709 13:13:30.951390 32089 connection.cc:256] RPC call timeout handler was delayed by -1.0503729220001787s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
I20260709 13:13:30.991518 32165 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:30.941483  1767 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:30.999018  1656 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:30.998812  1690 consensus_queue.cc:237] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.999428  1656 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:30.999861  1656 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:30.993595  1766 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:31.002267 32165 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:30.952740  1737 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:13:31.003006 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 47073.1us
I20260709 13:13:31.003177 32165 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:13:31.004896  1783 log.cc:927] Time spent T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:13:31.007753 32165 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:13:31.012732  1790 log.cc:927] Time spent T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:13:31.008759  1661 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:31.013634  1661 raft_consensus.cc:697] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:30.989271  1715 consensus_queue.cc:260] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:31.014868  1715 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:31.014691  1661 consensus_queue.cc:237] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:30.988533  1758 consensus_queue.cc:260] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:31.016914  1788 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:30.957407  1528 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:31.026866  1761 consensus_queue.cc:1059] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:30.996728  1771 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:31.003438  1767 raft_consensus.cc:3060] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:31.003600  1491 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:31.006688  1737 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:30.994822  1750 consensus_queue.cc:1059] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:13:31.032716 32238 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:31.028159  1766 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:31.044292  1528 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:31.054272  1786 raft_consensus.cc:2804] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:31.037983  1737 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:31.040026  1682 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:31.043380  1645 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:31.077003  1788 raft_consensus.cc:697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 4 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:31.029227  1784 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:31.080454  1788 consensus_queue.cc:237] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:31.093281  1645 raft_consensus.cc:697] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:31.057706  1771 consensus_queue.cc:1059] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:13:31.055142  1766 raft_consensus.cc:697] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 6 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:31.061455  1786 raft_consensus.cc:697] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 3 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:31.099677  1645 consensus_queue.cc:237] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:31.058600  1761 consensus_queue.cc:1059] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:13:31.100816  1786 consensus_queue.cc:237] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:31.101369  1766 consensus_queue.cc:237] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:31.095723 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 88051.1us
I20260709 13:13:31.109937 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:31.110972 32192 raft_consensus.cc:2393] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 8: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:31.112836 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:31.113588 32192 raft_consensus.cc:2393] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 7: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:31.115165 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:31.115952 32197 raft_consensus.cc:2393] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 3: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:31.113147 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:31.119494 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:31.061024  1656 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:31.121551 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:31.121810 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:31.122342 32195 raft_consensus.cc:2393] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 5: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:31.096279 32196 raft_consensus.cc:2955] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:13:31.123256 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:31.123713 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:31.124014 32197 raft_consensus.cc:2393] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 7: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:31.124923 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:31.124969 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:31.125699 32197 raft_consensus.cc:2368] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4.
I20260709 13:13:31.084461  1695 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:31.126631 32195 raft_consensus.cc:2393] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 5: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:31.127785  1695 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:31.137398 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:31.113219  1702 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:31.142558 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:31.144311 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:31.154774 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:31.155718 32192 raft_consensus.cc:2393] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 7: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:31.157205 32192 raft_consensus.cc:1240] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:31.158564 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:31.159756 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:31.160058 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:31.163210 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:31.165213 32266 raft_consensus.cc:2393] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 8: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:31.166849 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:31.172111 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:31.179088 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:31.180106 32266 raft_consensus.cc:2393] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 7: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:31.180776 32198 raft_consensus.cc:1275] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:31.182717 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:31.183359 32267 raft_consensus.cc:1240] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:31.186702 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:31.198004 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:31.200069 32089 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:31.201508 32192 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:31.202329  1656 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:31.201656  1682 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:31.204150 32192 raft_consensus.cc:1275] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:31.204752 32089 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:31.206400 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:31.208923 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:31.206671 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:31.207062  1700 consensus_queue.cc:1059] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:31.215085 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:31.210485 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:31.210784 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:31.212960 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:31.217142 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:31.217737 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:31.218199 32270 raft_consensus.cc:2393] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 5: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:31.212487 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:31.219323 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:31.183039  1503 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:31.232821 32192 raft_consensus.cc:1275] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:13:31.225824 32165 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:31.221700  1752 consensus_meta.cc:287] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.004s
I20260709 13:13:31.214497  1682 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:31.239595 32165 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:31.241255 32192 raft_consensus.cc:1240] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6. Ops: []
W20260709 13:13:31.258157 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 53556.5us
W20260709 13:13:31.258874 32089 leader_election.cc:336] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.656s (SENT)
I20260709 13:13:31.257402 32165 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:31.259197 32089 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:31.260190 32089 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:31.260826 32165 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:31.261400 32089 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:31.237594  1690 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:31.265416 32165 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:31.221244  1684 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:31.266081  1702 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:31.283686  1799 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:13:31.291435 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.292870  1662 raft_consensus.cc:3055] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:31.302228  1796 raft_consensus.cc:2955] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 6 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:13:31.333314 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:31.333623 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:31.275302  1695 raft_consensus.cc:2749] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:31.303947 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:31.267587  1682 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:31.304198  1345 raft_consensus.cc:3055] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:31.306049 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:31.338950 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:31.339244 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:31.302107 32272 raft_consensus.cc:1275] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:13:31.307838  1660 raft_consensus.cc:3055] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:31.329739 32194 raft_consensus.cc:1240] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:31.330585 32191 raft_consensus.cc:1240] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:31.340868 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:31.330536 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:31.025204 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:31.265774  1735 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:31.343071 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:31.334290 32116 raft_consensus.cc:2393] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 4: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:31.277292  1780 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:31.338068 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:31.345309 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:31.313556  1784 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:31.337462  1783 log.cc:927] Time spent T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.072s	user 0.000s	sys 0.006s
I20260709 13:13:31.348948 32195 raft_consensus.cc:1240] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
W20260709 13:13:31.349478 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 88145.4us
W20260709 13:13:31.350368 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 85010.7us
I20260709 13:13:31.351179 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:31.351564 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:31.332613  1662 raft_consensus.cc:740] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:31.353303 32194 raft_consensus.cc:1240] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:31.352749 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:31.360757 32116 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:31.336484  1768 consensus_meta.cc:287] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.571s	user 0.015s	sys 0.001s
I20260709 13:13:31.336887  1797 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:31.360239 32115 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:31.362026 32165 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:31.352788 32122 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:31.360733 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:31.364651 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:31.355265 32089 leader_election.cc:400] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4.
I20260709 13:13:31.337860  1736 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:31.339280  1345 raft_consensus.cc:740] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:31.367381 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:31.371253 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:31.378396 32191 raft_consensus.cc:2393] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 8: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:31.371596 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:31.375788 32089 leader_election.cc:304] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:31.344381  1660 raft_consensus.cc:740] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:31.382292 32089 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:31.383692 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:31.384023 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:31.388479 32089 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:31.389652 32119 raft_consensus.cc:2393] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 7: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:31.377133 32268 raft_consensus.cc:2955] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:13:31.394723 32115 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
I20260709 13:13:31.395679 32115 raft_consensus.cc:1240] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:31.383713  1686 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:31.397501  1772 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:31.398924 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:31.397709  1763 consensus_queue.cc:1059] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:31.400982  1686 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:13:31.401731  1665 consensus_meta.cc:287] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.663s	user 0.011s	sys 0.001s
I20260709 13:13:31.402271  1665 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:31.403429  1345 consensus_queue.cc:260] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:31.405607  1647 consensus_meta.cc:287] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.651s	user 0.011s	sys 0.000s
I20260709 13:13:31.382908  1736 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:31.406046  1647 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:31.407904  1647 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:31.408782 32190 raft_consensus.cc:1240] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 5. Current term is 6. Ops: []
W20260709 13:13:31.410405  1726 consensus_meta.cc:287] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.731s	user 0.006s	sys 0.006s
I20260709 13:13:31.411116  1752 consensus_queue.cc:1059] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:31.411664  1660 consensus_queue.cc:260] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:31.412317  1752 raft_consensus.cc:3055] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:31.412840  1752 raft_consensus.cc:740] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:31.413691  1665 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:31.408696  1684 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:31.413866  1752 consensus_queue.cc:260] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:31.415127 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:31.415508  1752 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:31.373574  1799 raft_consensus.cc:2804] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:31.405385 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:31.416414 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:31.429241 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:31.430783 32116 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:31.362342  1719 consensus_queue.cc:1059] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
W20260709 13:13:31.399775  1793 log.cc:927] Time spent T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:13:31.397562  1725 raft_consensus.cc:3055] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:31.438448 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:13:31.435843 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 47444us
I20260709 13:13:31.412796  1660 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:31.454658 32199 raft_consensus.cc:1240] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:31.407938  1736 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:31.375777  1690 consensus_queue.cc:1059] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:13:31.368357  1768 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:31.397748  1663 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:31.480119 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:31.437166  1774 consensus_queue.cc:1059] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:13:31.521551 32239 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:31.522826 32089 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:31.531265 32089 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:31.533324 32089 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:31.442461  1799 raft_consensus.cc:697] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
W20260709 13:13:31.534444 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 142093us
I20260709 13:13:31.487629  1658 raft_consensus.cc:3055] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:13:31.577364 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 55962.4us
I20260709 13:13:31.541632 32192 raft_consensus.cc:1240] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:31.576951 32193 raft_consensus.cc:1240] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:13:31.463665  1784 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.438992  1662 consensus_queue.cc:260] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:31.458865  1725 raft_consensus.cc:740] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:13:31.489861  1794 log.cc:927] Time spent T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
I20260709 13:13:31.436631  1767 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:31.532246  1736 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:31.433991  1669 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:31.581162  1715 consensus_meta.cc:287] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.566s	user 0.009s	sys 0.003s
I20260709 13:13:31.541045  1819 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:31.530051  1711 consensus_queue.cc:1059] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
W20260709 13:13:31.699780  1790 log.cc:927] Time spent T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
W20260709 13:13:31.693516 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.596010 32090 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:31.592733  1806 log.cc:927] Time spent T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
W20260709 13:13:31.696084 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 104648us
I20260709 13:13:31.581753  1658 raft_consensus.cc:740] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:13:31.688398  1807 log.cc:927] Time spent T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.317s	user 0.001s	sys 0.000s
I20260709 13:13:31.585458  1770 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:31.688660  1804 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:31.578068  1678 consensus_queue.cc:1048] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.121s
W20260709 13:13:31.693111 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 110913us
I20260709 13:13:31.593824  1772 consensus_queue.cc:1048] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.110s
I20260709 13:13:31.593469  1561 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.126s
I20260709 13:13:31.594060  1784 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:31.690055  1671 consensus_queue.cc:1048] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.131s
W20260709 13:13:31.738934 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.740132 32120 raft_consensus.cc:2393] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 5: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
W20260709 13:13:31.743995  1816 log.cc:927] Time spent T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
W20260709 13:13:31.751487 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 159350us
I20260709 13:13:31.752772 32090 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:31.746487 32089 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:31.756544 32272 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:31.766453 32267 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:31.736896  1804 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:31.785224 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:31.788146 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:13:31.788466  1818 log.cc:927] Time spent T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.287s	user 0.001s	sys 0.000s
I20260709 13:13:31.774422  1676 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:31.778056  1770 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:13:31.806954 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 305095us
I20260709 13:13:31.791265  1804 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:31.812875 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 59475.2us
I20260709 13:13:31.818100 32197 raft_consensus.cc:1240] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:31.772310  1819 consensus_queue.cc:1059] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:13:31.824647 32123 raft_consensus.cc:2393] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 3: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:31.826598  1820 consensus_queue.cc:1048] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
W20260709 13:13:31.828383 32122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56890 (request call id 1417) took 1305 ms (client timeout 1638 ms). Trace:
W20260709 13:13:31.828904 32122 rpcz_store.cc:269] 0709 13:13:30.522847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.522999 (+   152us) service_pool.cc:224] Handling call
0709 13:13:31.828145 (+1305146us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b54002c9cd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:31.828293 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1644648832}
I20260709 13:13:31.843032  1823 raft_consensus.cc:3055] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:31.843618  1823 raft_consensus.cc:740] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:13:31.848294  1814 log.cc:927] Time spent T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
I20260709 13:13:31.857856 32265 raft_consensus.cc:1240] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:31.860041 32265 raft_consensus.cc:1275] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:13:31.860445 32265 pending_rounds.cc:85] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06: Aborting all ops after (but not including) 2
I20260709 13:13:31.860697 32265 pending_rounds.cc:107] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:13:31.860962 32265 raft_consensus.cc:2889] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:31.864238 32121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1435) took 1164 ms. Trace:
I20260709 13:13:31.898936 32194 raft_consensus.cc:1275] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:31.864734 32121 rpcz_store.cc:276] 0709 13:13:30.699876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.824946 (+125070us) service_pool.cc:224] Handling call
0709 13:13:30.825288 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:30.829174 (+  3886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:30.829222 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:30.992449 (+163227us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b2c000278a8. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59d8eaa11 00007fb59d8fa372 00007fb59f02ca01 00007fb59eff143a 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2
0709 13:13:30.996977 (+  4528us) log.cc:844] Serialized 26 byte log entry
0709 13:13:31.176317 (+179340us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:31.176379 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:31.176537 (+   158us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:31.858489 (+681952us) raft_consensus.cc:1685] finished
0709 13:13:31.858508 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:31.864168 (+  5660us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3400,"raft.queue_time_us":11233,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":19657,"spinlock_wait_cycles":70046080,"thread_start_us":146682,"threads_started":1,"wal-append.queue_time_us":212281}
I20260709 13:13:31.852753  1661 consensus_queue.cc:1059] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:31.903328 32199 raft_consensus.cc:1240] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:31.917733 32192 raft_consensus.cc:1240] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:31.771709  1799 consensus_queue.cc:237] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:31.902597 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:31.901315 32196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:56910 (request call id 1) took 29696 ms. Trace:
W20260709 13:13:31.921643  1815 log.cc:927] Time spent T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.356s	user 0.000s	sys 0.001s
I20260709 13:13:31.866681  1663 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:31.816982  1774 consensus_queue.cc:1059] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.109s
I20260709 13:13:31.955029  1832 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.955890  1832 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:31.929749 32196 rpcz_store.cc:276] 0709 13:13:02.163706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.163840 (+   134us) service_pool.cc:224] Handling call
0709 13:13:02.329628 (+165788us) log.cc:844] Serialized 492 byte log entry
0709 13:13:31.860278 (+29530650us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9621,"raft.queue_time_us":12375,"raft.run_cpu_time_us":2001,"raft.run_wall_time_us":2000,"thread_start_us":42425,"threads_started":2,"wal-append.queue_time_us":45465,"wal-append.run_cpu_time_us":1788,"wal-append.run_wall_time_us":1003676}
I20260709 13:13:31.958595  1832 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:31.910852  1642 consensus_queue.cc:1059] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
W20260709 13:13:31.971864  1809 log.cc:927] Time spent T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.629s	user 0.002s	sys 0.000s
I20260709 13:13:31.912824  1788 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:13:31.898309  1695 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:13:31.917011  1730 consensus_queue.cc:1059] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:13:31.914485  1830 consensus_queue.cc:1059] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:13:31.867154  1651 consensus_queue.cc:1059] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 13:13:31.972421  1833 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
W20260709 13:13:31.981056  1752 consensus_meta.cc:287] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.565s	user 0.013s	sys 0.002s
I20260709 13:13:32.000393  1784 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:32.006090  1733 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:31.909802  1823 consensus_queue.cc:260] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.007647  1750 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:32.031102  1829 log.cc:927] Time spent T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:13:32.042625  1791 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.043510  1791 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:32.034376  1823 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:32.034550  1733 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:32.051527 32193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1380) took 1191 ms. Trace:
I20260709 13:13:32.051970 32193 rpcz_store.cc:276] 0709 13:13:30.860616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.864604 (+  3988us) service_pool.cc:224] Handling call
0709 13:13:30.864940 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:31.582456 (+717516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:32.051265 (+468809us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b54001df6d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:32.051461 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1557145472}
I20260709 13:13:32.056780  1730 raft_consensus.cc:3055] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:32.058476  1730 raft_consensus.cc:740] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:32.027475  1833 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:32.061652  1833 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:32.061692  1840 raft_consensus.cc:3055] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:32.062952  1840 raft_consensus.cc:740] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:13:32.064119  1660 consensus_meta.cc:287] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.529s	user 0.007s	sys 0.001s
I20260709 13:13:32.063944  1840 consensus_queue.cc:260] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.037040  1750 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.068702  1651 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.074007  1651 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.075572  1750 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:32.080322  1345 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:32.080981 32196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56926 (request call id 69) took 1071 ms. Trace:
I20260709 13:13:32.081440  1763 raft_consensus.cc:3055] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:32.081540  1651 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:32.081979  1763 raft_consensus.cc:740] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:32.082880  1763 consensus_queue.cc:260] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.081459 32196 rpcz_store.cc:276] 0709 13:13:31.009226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.009387 (+   161us) service_pool.cc:224] Handling call
0709 13:13:31.011751 (+  2364us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:13:31.089949 (+ 78198us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:31.425727 (+335778us) log.cc:844] Serialized 14 byte log entry
0709 13:13:32.065873 (+640146us) log.cc:844] Serialized 14 byte log entry
0709 13:13:32.066737 (+   864us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:13:32.069684 (+  2947us) log.cc:844] Serialized 600 byte log entry
0709 13:13:32.069905 (+   221us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:32.069966 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:32.070059 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:32.080667 (+ 10608us) raft_consensus.cc:1685] finished
0709 13:13:32.080697 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:32.080898 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15617,"raft.queue_time_us":111868,"raft.run_cpu_time_us":499,"raft.run_wall_time_us":6263,"thread_start_us":516638,"threads_started":4,"wal-append.queue_time_us":346205}
W20260709 13:13:32.088492  1737 consensus_meta.cc:287] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 1.002s	user 0.008s	sys 0.003s
I20260709 13:13:32.088627 32266 raft_consensus.cc:3055] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:32.088748  1791 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:32.090627  1730 consensus_queue.cc:260] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:13:32.091931  1730 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:32.089162  1737 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.092715 32266 raft_consensus.cc:740] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:32.102495  1763 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:32.106875  1503 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:32.107502  1503 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:32.116609  1768 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:32.117612  1669 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:32.121667  1842 raft_consensus.cc:3055] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:13:32.095108  1796 consensus_meta.cc:287] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6: Time spent flushing consensus metadata: real 0.606s	user 0.013s	sys 0.000s
I20260709 13:13:32.125234 32119 raft_consensus.cc:2393] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 5: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:32.128428   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
W20260709 13:13:32.128963 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:32.129604   400 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:32.131317 32236 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:13:32.122176  1842 raft_consensus.cc:740] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:32.133152  1842 consensus_queue.cc:260] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.134317  1842 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:32.134796  1733 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:32.158345  1774 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:32.170477  1774 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:32.170928  1774 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:32.173508 32190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1386) took 1263 ms. Trace:
I20260709 13:13:32.173911 32190 rpcz_store.cc:276] 0709 13:13:30.910422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.912825 (+  2403us) service_pool.cc:224] Handling call
0709 13:13:30.913198 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:31.409210 (+496012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:32.173252 (+764042us) spinlock_profiling.cc:243] Waited 495 ms on lock 0x7b54002a7954. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:32.173440 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1139236736}
W20260709 13:13:32.135964   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 49797.5us
I20260709 13:13:32.178294  1658 consensus_queue.cc:260] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:32.190632 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:32.194304  1737 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:32.202566 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:32.160002  1804 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.208518 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:32.209954 32194 raft_consensus.cc:1240] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:32.210732 32198 raft_consensus.cc:1240] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:32.210870 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:32.212522 32193 raft_consensus.cc:1240] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:32.212884 32198 raft_consensus.cc:1240] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:32.214337 32191 raft_consensus.cc:1275] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:32.215308 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:32.216629 32271 raft_consensus.cc:1240] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:32.217196 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:32.216130 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:32.218544 32199 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:32.220520 32195 raft_consensus.cc:1240] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:32.220702 32196 raft_consensus.cc:1275] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:32.214082  1766 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:32.222798  1379 consensus_queue.cc:1059] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:32.207021  1823 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.201078  1725 consensus_queue.cc:260] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:32.224692  1850 log.cc:927] Time spent T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:13:32.225167  1725 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:32.226612 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 480260us
I20260709 13:13:32.230544 32268 raft_consensus.cc:1275] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:32.231616 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:32.230404 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:13:32.233983  1847 log.cc:927] Time spent T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:13:32.235090  1767 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:32.236227  1799 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:32.242039  1822 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:32.223304  1766 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.245070  1766 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:32.244652  1503 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.245600  1718 raft_consensus.cc:3055] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:32.248167  1853 consensus_queue.cc:1048] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:13:32.218384  1768 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:32.236837  1799 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.236937  1823 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.250136  1718 raft_consensus.cc:740] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:32.264174 32272 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:32.260912  1379 consensus_queue.cc:1059] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:13:32.258478  1768 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.259869  1799 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:32.258219  1718 consensus_queue.cc:260] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.286360 32117 raft_consensus.cc:1240] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:32.274109 32123 raft_consensus.cc:1240] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:32.275625 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:32.287178 32122 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 5.
I20260709 13:13:32.279808 32115 raft_consensus.cc:1275] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:32.280088 32120 raft_consensus.cc:1240] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:32.280766 32118 raft_consensus.cc:1240] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:32.283227 32124 raft_consensus.cc:1240] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:32.288743 32115 raft_consensus.cc:1240] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:32.246556  1660 consensus_queue.cc:1059] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:13:32.290519 32120 raft_consensus.cc:1275] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:32.287882 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:32.294025 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:32.294476 32123 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
W20260709 13:13:32.291483 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:32.291419 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:32.295522 32118 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:32.277873  1737 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:32.292354  1813 consensus_queue.cc:1059] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:13:32.295858 32115 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:32.292636  1777 consensus_queue.cc:1059] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:32.297605 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:32.302443 32122 raft_consensus.cc:2393] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 5: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:32.256724  1852 consensus_queue.cc:1059] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.122s
I20260709 13:13:32.312497  1823 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:32.277565  1761 consensus_queue.cc:1059] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:13:32.302670 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:32.302027  1737 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.304910  1671 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:32.304970  1777 raft_consensus.cc:3055] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:32.281759  1853 consensus_queue.cc:1059] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:13:32.299451  1772 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.328042 32238 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:32.299863  1832 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.307565  1658 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:32.314746 32118 raft_consensus.cc:1240] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:32.323822 32122 raft_consensus.cc:1275] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:32.325340 32117 raft_consensus.cc:1240] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:32.327314 32090 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:32.306757  1804 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:32.315735  1852 raft_consensus.cc:3055] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:32.326426  1822 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:32.340663  1789 raft_consensus.cc:3055] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:32.340191  1822 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.341198  1789 raft_consensus.cc:740] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:32.342211 32117 raft_consensus.cc:1275] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:32.330992  1769 consensus_queue.cc:1048] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:13:32.343207  1804 consensus_queue.cc:1048] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:32.343063  1789 consensus_queue.cc:260] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.339612 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:32.337384  1832 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.335410  1772 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.346081  1772 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:32.346835 32265 raft_consensus.cc:1275] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:32.332717   369 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:32.352826 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:32.325233  1777 raft_consensus.cc:740] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:32.357975 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:32.337069  1682 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:32.371073 32266 consensus_queue.cc:260] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.371654  1682 raft_consensus.cc:697] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:32.353732 32269 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:32.372349 32266 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:32.372550  1682 consensus_queue.cc:237] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.373301 32090 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:32.374225  1819 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:32.374603  1819 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.374927  1819 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:32.355140   369 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:32.371048 32197 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:32.336196  1823 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:32.356873 32194 raft_consensus.cc:1240] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:32.379449 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:32.380466 32122 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:32.348141  1852 raft_consensus.cc:740] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:32.381126  1856 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:32.367143  1821 log.cc:927] Time spent T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.646s	user 0.003s	sys 0.001s
I20260709 13:13:32.357007 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:32.382469  1503 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:32.369722  1733 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:32.383973 32238 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:32.357203 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:32.387149 32195 raft_consensus.cc:1275] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:32.321797  1774 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:32.327203  1671 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.390259 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:32.346081  1832 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:32.392834 32266 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
I20260709 13:13:32.396235 32267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36080 (request call id 1064) took 1186 ms. Trace:
I20260709 13:13:32.383833  1768 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:32.405378 32266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36080 (request call id 1056) took 1223 ms. Trace:
I20260709 13:13:32.334868  1725 consensus_queue.cc:1048] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:13:32.404682 32267 rpcz_store.cc:276] 0709 13:13:31.210102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.210230 (+   128us) service_pool.cc:224] Handling call
0709 13:13:32.396032 (+1185802us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b54000f1254. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:32.396165 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1166326528}
I20260709 13:13:32.384514  1823 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.385715  1733 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.411041 32273 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 5.
I20260709 13:13:32.407826 32266 rpcz_store.cc:276] 0709 13:13:31.181945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.186272 (+  4327us) service_pool.cc:224] Handling call
0709 13:13:32.088488 (+902216us) spinlock_profiling.cc:243] Waited 50.7 ms on lock 0x7b54003b1b20. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59ef68dc0 00007fb59eff4e18 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:32.370741 (+282253us) spinlock_profiling.cc:243] Waited 8.25 ms on lock 0x7b54003b1b20. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59ef6f06f 00007fb59efe7f60 00007fb59efe97de 00007fb59eff527c 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2
0709 13:13:32.405330 (+ 34589us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135547520}
I20260709 13:13:32.409031  1788 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.393388  1750 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.406450  1804 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:32.403847  1737 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:32.413636  1749 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:13:32.371073  1777 consensus_queue.cc:260] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.413475  1823 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:32.414300  1733 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:32.428364 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:32.416738  1768 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:32.432319 32192 raft_consensus.cc:2955] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:13:32.439813  1768 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.405915  1761 consensus_queue.cc:1059] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:13:32.407604  1719 consensus_queue.cc:1048] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
W20260709 13:13:32.446113  1859 log.cc:927] Time spent T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:13:32.446237  1702 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.447052  1702 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.449113  1774 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:32.449858   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:13:32.451570 32119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56884 (request call id 1106) took 1066 ms. Trace:
I20260709 13:13:32.424243  1804 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.451929 32119 rpcz_store.cc:276] 0709 13:13:31.385558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.390173 (+  4615us) service_pool.cc:224] Handling call
0709 13:13:32.451362 (+1061189us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b54002c7ed4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:32.451513 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1625710464}
I20260709 13:13:32.453423 32121 raft_consensus.cc:1240] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:32.453608  1345 raft_consensus.cc:3055] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:32.453970  1345 raft_consensus.cc:740] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:32.454756  1345 consensus_queue.cc:260] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.456007  1345 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:32.423959  1750 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.452284  1804 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:32.458585  1750 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:32.416317  1788 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.462458  1788 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:32.466912  1804 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.467799  1769 consensus_queue.cc:1048] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:32.469385  1804 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:32.467502  1671 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:32.471153  1789 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:32.471510  1702 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:32.473609  1822 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:32.473913  1768 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:32.477751 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:32.478649 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:32.479830 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:32.480520 32270 raft_consensus.cc:2393] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 4: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:32.480995 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:32.481972 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:32.497376 32190 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:32.499145 32272 raft_consensus.cc:1240] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 13:13:32.503461 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:32.504300 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:32.504758 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:32.505586 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:32.499384 32265 raft_consensus.cc:1275] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:32.506392 32116 raft_consensus.cc:2393] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 6: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:32.494908  1777 raft_consensus.cc:3060] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:32.508940 32122 raft_consensus.cc:1275] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:13:32.510171 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:32.511059 32122 raft_consensus.cc:2393] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 3: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:32.511943 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:32.512188 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:32.513041 32271 raft_consensus.cc:2393] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 8: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:32.514142 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:32.515070 32124 raft_consensus.cc:2393] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 6: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:32.507215 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:32.517822 32116 raft_consensus.cc:2393] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 6: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:32.518553 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:32.518888 32193 raft_consensus.cc:1275] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:32.518860 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:32.521270 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:32.522012 32195 raft_consensus.cc:2393] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 3: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:32.522796  1774 consensus_queue.cc:1048] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:32.525018 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:32.525751 32123 raft_consensus.cc:2393] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 8: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:32.529594 32265 raft_consensus.cc:1240] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:32.531418 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:32.531920 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:32.532174 32197 raft_consensus.cc:2393] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 5: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:32.533996 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:32.535315 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:32.536074 32267 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:13:32.537479 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:32.537812 32117 raft_consensus.cc:1275] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:32.538204 32267 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:13:32.540022 32196 raft_consensus.cc:2393] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 5: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:32.541091 32239 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:32.547065 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:32.547451 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:32.549216 32115 raft_consensus.cc:1240] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:32.551146 32194 raft_consensus.cc:1275] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:32.533222 32118 raft_consensus.cc:2955] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:13:32.552934 32239 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:32.554354 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:32.554682 32195 raft_consensus.cc:1275] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:32.555379 32115 raft_consensus.cc:2393] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 2: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:32.556229 32267 raft_consensus.cc:1275] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:13:32.515832  1737 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.561172 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:32.565186 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:32.566262 32165 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:32.567739 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:32.568509 32196 raft_consensus.cc:2393] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 5: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:32.569101  1718 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:32.566356 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:32.566170 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:32.573596 32195 raft_consensus.cc:2393] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 2: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:32.525785  1797 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:32.572783  1737 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.575428  1855 raft_consensus.cc:3055] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:32.575898  1855 raft_consensus.cc:740] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:32.576745 32120 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:32.578926  1852 consensus_queue.cc:260] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.580145 32269 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
I20260709 13:13:32.580623  1852 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:32.527870  1822 consensus_queue.cc:1059] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:13:32.581759  1822 raft_consensus.cc:3055] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:32.582139  1822 raft_consensus.cc:740] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:32.575102  1797 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.582953  1822 consensus_queue.cc:260] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.584704  1797 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:32.584858  1832 raft_consensus.cc:2804] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:32.585398  1832 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.585763  1832 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:32.590451 32090 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:32.592046 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:32.593384 32194 raft_consensus.cc:2393] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 5: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:32.596143 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:32.601260 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:13:32.600692 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 47828.4us
I20260709 13:13:32.602144 32119 raft_consensus.cc:2393] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 5: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:32.586510  1700 raft_consensus.cc:3055] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:13:32.624778 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 58601.6us
I20260709 13:13:32.495257  1823 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.625893 32165 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:32.584414  1822 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:32.499169  1733 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:32.627884 32165 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:32.632684 32165 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:32.634930 32165 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:32.636070  1647 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:32.631804  1855 consensus_queue.cc:260] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.636575 32165 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:32.624364  1700 raft_consensus.cc:740] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:32.643126  1700 consensus_queue.cc:260] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.644955  1700 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:32.648770  1647 raft_consensus.cc:2749] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:32.554716  1763 consensus_queue.cc:1048] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 13:13:32.599707  1737 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:32.638645 32165 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:32.624104  1846 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:32.641871  1733 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:32.653128 32268 raft_consensus.cc:1240] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:32.550736  1719 consensus_queue.cc:1059] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 13:13:32.624881  1735 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:32.657172 32273 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
I20260709 13:13:32.659368 32165 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:32.679754 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:32.680552 32119 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:32.680616 32165 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:32.634661  1768 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:32.695168 32239 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:32.696415 32239 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:32.604996  1725 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:13:32.632927  1784 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:32.632648  1686 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:32.635171  1702 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:13:32.674288 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:32.699237 32165 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:32.661374  1846 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.660672  1690 raft_consensus.cc:3055] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:32.660192  1647 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:32.717217  1804 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:32.700284   400 raft_consensus.cc:2368] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 5. Current term is 6.
I20260709 13:13:32.695967  1735 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:32.696539  1855 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:32.714429  1834 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:32.713840  1786 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:32.698056  1766 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:13:32.730420 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:32.700614  1658 consensus_queue.cc:1059] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:13:32.712738  1842 consensus_queue.cc:1048] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:13:32.725914  1690 raft_consensus.cc:740] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:32.696990  1774 consensus_queue.cc:1048] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:13:32.733415  1735 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:32.726802  1799 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:32.726954  1846 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:32.733130  1804 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:32.723451  1686 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.748968  1752 raft_consensus.cc:3055] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:32.752386  1752 raft_consensus.cc:740] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:32.748454  1804 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:32.756844  1690 consensus_queue.cc:260] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.763496  1752 consensus_queue.cc:260] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.765347  1823 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:32.765987  1752 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:32.770936  1804 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.773334  1804 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:32.763588  1832 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.777580  1832 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:32.779222  1819 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.811676 32116 raft_consensus.cc:1240] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:32.719003 32165 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:32.823707 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 104678us
I20260709 13:13:32.848125 32165 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:32.832638 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 118901us
I20260709 13:13:32.831957  1669 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:32.837289  1690 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:32.837877  1647 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.838815  1656 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:32.839620  1702 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:32.856119  1647 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:32.857520 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:32.861377  1669 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.861423 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:32.863554  1702 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:32.867178  1741 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.867262 32272 raft_consensus.cc:2393] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 5: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:32.868151  1741 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.872627  1741 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:32.874696  1766 consensus_queue.cc:1059] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:32.875888 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:32.876783  1702 raft_consensus.cc:697] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 3 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:32.878866  1702 consensus_queue.cc:237] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.881590  1660 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:32.882606  1660 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:32.839829  1686 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:32.865525  1647 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:32.901237 32165 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:32.908669  1820 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.909292  1660 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:32.915064  1822 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:32.917232  1768 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:32.917682  1822 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.917330  1820 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.915202   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:32.939232 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:32.940019 32269 raft_consensus.cc:1275] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:32.940181 32271 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:32.957710  1735 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:32.959749 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:32.933590  1669 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:32.979562 32190 raft_consensus.cc:1240] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
W20260709 13:13:33.002728 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:32.981179 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:32.973709 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:33.019634 32123 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:33.017138 32270 raft_consensus.cc:2468] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
W20260709 13:13:33.017810 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 116960us
I20260709 13:13:33.014006 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:32.969640  1772 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.035097  1772 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.042083  1772 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:32.967033  1662 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:32.973305  1379 raft_consensus.cc:3055] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:32.966866  1686 raft_consensus.cc:476] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Not starting pre-election -- already a leader
I20260709 13:13:33.004235  1822 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:33.071630 32165 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:32.967213  1741 consensus_queue.cc:1059] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.107s
I20260709 13:13:33.076061  1758 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:33.078184  1735 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:32.966575  1832 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.976280  1819 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:33.078449  1820 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:33.107228 32123 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:33.091717 32122 raft_consensus.cc:1240] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:33.088019 32269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:13:32.962929  1780 consensus_queue.cc:1048] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.132s
I20260709 13:13:33.087150 32119 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 6.
I20260709 13:13:33.065354  1840 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:33.096485 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:33.068866  1379 raft_consensus.cc:740] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:33.089461 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:33.095019  1741 raft_consensus.cc:3055] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:33.123776 32124 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:33.096787  1715 raft_consensus.cc:3055] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:33.126513  1715 raft_consensus.cc:740] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:33.129786  1749 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:33.131512  1852 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.122722  1741 raft_consensus.cc:740] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:33.132404  1852 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.133812  1379 consensus_queue.cc:260] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.134126  1741 consensus_queue.cc:260] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.134851  1852 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:33.135067  1379 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:33.135739  1741 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:33.136022 32070 auto_rebalancer.cc:629] Failed to schedule move for tablet 6565a440fcf14a499c191f2835d21508: Illegal state: Replica 6b3ed521ce8947db80c4b4828b355c06 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:33.087389  1722 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.127972  1715 consensus_queue.cc:260] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.137681  1715 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:33.137295  1722 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.123778 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:33.121207 32269 raft_consensus.cc:606] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
W20260709 13:13:33.143797   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 55564.4us
I20260709 13:13:33.120543  1766 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.152968  1722 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:33.156940 32236 leader_election.cc:400] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Vote denied by peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025) with higher term. Message: Invalid argument: T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 5. Current term is 6.
I20260709 13:13:33.157460 32236 leader_election.cc:403] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:13:33.150156 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:33.159741  1660 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.165155 32267 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:33.150013  1768 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:33.160420  1660 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.175185 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:13:33.178910 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 107584us
I20260709 13:13:33.180797  1819 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.183794  1819 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.182780 32269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:13:33.185072 32269 raft_consensus.cc:606] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:33.185956 32269 raft_consensus.cc:614] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:33.186882  1819 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:33.184019 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:33.189313  1660 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:33.189920  1660 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.190835 32190 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:33.191354  1846 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.196709 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:33.181185  1768 raft_consensus.cc:697] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:33.190785  1660 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.212232  1768 consensus_queue.cc:237] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.212965  1846 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:33.150600  1766 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.201048 32021 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59534 (request call id 44) took 2841 ms. Trace:
I20260709 13:13:33.215022  1660 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:33.202528 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:33.203631 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:33.203035 32022 catalog_manager.cc:5697] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:33.147715  1832 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.208974 32270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:13:33.197368 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:33.221060 32269 raft_consensus.cc:2393] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 7: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:33.221163 32124 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:33.224926 32270 raft_consensus.cc:606] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:33.228135 32270 raft_consensus.cc:614] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:33.228276 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:33.233412   369 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:33.237829 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:33.237001  1764 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.250288 32270 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:33.247922  1764 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.252646 32272 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:33.254066 32199 raft_consensus.cc:1240] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:13:33.236300  1855 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:33.263808 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.265172 32273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:13:33.268823 32190 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:33.269196 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:33.271142 32271 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:13:33.267818 32273 raft_consensus.cc:606] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:33.272289 32273 raft_consensus.cc:614] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:33.275233 32273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:13:33.275746 32273 raft_consensus.cc:606] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:33.277439 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:13:33.283303 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.285485 32264 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 2.
W20260709 13:13:33.288955  1889 log.cc:927] Time spent T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.090s	user 0.000s	sys 0.002s
I20260709 13:13:33.295725 32267 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 6.
I20260709 13:13:33.296408  1722 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025) with higher term. Message: Invalid argument: T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 5. Current term is 6.
I20260709 13:13:33.297559  1832 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:33.302248  1764 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:33.303124 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:13:33.304713  1882 log.cc:927] Time spent T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 13:13:33.305399 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 74875.4us
I20260709 13:13:33.306777  1788 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:33.308185 32165 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:33.308717  1883 log.cc:927] Time spent T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.094s	user 0.002s	sys 0.000s
I20260709 13:13:33.310201 32165 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:33.214919 32021 rpcz_store.cc:276] 0709 13:13:30.401761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.410744 (+  8983us) service_pool.cc:224] Handling call
0709 13:13:33.200804 (+2790060us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:31.436193 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:31.578636 (+142443us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:31.580526 (+  1890us) write_op.cc:435] Acquired schema lock
0709 13:13:31.585489 (+  4963us) tablet.cc:662] Decoding operations
0709 13:13:31.725546 (+140057us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:31.734187 (+  8641us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:31.740822 (+  6635us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:13:31.780215 (+ 39393us) tablet.cc:701] Row locks acquired
0709 13:13:31.786755 (+  6540us) write_op.cc:260] PREPARE: finished
0709 13:13:31.799805 (+ 13050us) write_op.cc:270] Start()
0709 13:13:31.811466 (+ 11661us) write_op.cc:276] Timestamp: P: 1783602811797222 usec, L: 0
0709 13:13:31.814688 (+  3222us) op_driver.cc:348] REPLICATION: starting
0709 13:13:31.963407 (+148719us) log.cc:844] Serialized 833 byte log entry
0709 13:13:32.388021 (+424614us) op_driver.cc:464] REPLICATION: finished
0709 13:13:32.526595 (+138574us) write_op.cc:301] APPLY: starting
0709 13:13:32.533371 (+  6776us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:32.553792 (+ 20421us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:32.637389 (+ 83597us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:32.639859 (+  2470us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:32.640140 (+   281us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:13:32.640186 (+    46us) write_op.cc:312] APPLY: finished
0709 13:13:32.640386 (+   200us) log.cc:844] Serialized 22 byte log entry
0709 13:13:32.640557 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:32.656660 (+ 16103us) write_op.cc:454] Released schema lock
0709 13:13:32.659802 (+  3142us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:32.702656 (+ 42854us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:32.712599 (+  9943us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":933353,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":52789,"apply.run_cpu_time_us":2306,"apply.run_wall_time_us":165110,"num_ops":1,"prepare.queue_time_us":365425,"prepare.run_cpu_time_us":14371,"prepare.run_wall_time_us":639841,"raft.queue_time_us":97264,"raft.run_cpu_time_us":9572,"raft.run_wall_time_us":88096,"replication_time_us":561361,"thread_start_us":385855,"threads_started":4,"wal-append.queue_time_us":123771}]]}
W20260709 13:13:33.313153  1887 log.cc:927] Time spent T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.108s	user 0.000s	sys 0.002s
I20260709 13:13:33.315652  1662 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:33.316440  1662 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:33.316720  1733 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:33.317456  1733 raft_consensus.cc:697] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 6 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:13:33.318662  1733 consensus_queue.cc:237] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:33.319895 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:33.288112  1855 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.322906  1855 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:33.320513 32165 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:33.327247 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:33.328034 32197 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:33.330757 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:33.331629 32192 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:33.334019  1840 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.334661  1702 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:33.334733  1840 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:13:33.335435  1702 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.337322  1840 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:33.325147  1766 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:33.340883  1702 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:33.340919  1561 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.344344 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:33.348865  1702 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:33.355894 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:33.358079 32121 raft_consensus.cc:1240] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:33.362356 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:33.363057  1676 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.363114 32199 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:33.368233 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:33.369949 32190 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:13:33.371058 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.374011 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:33.375480 32165 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:33.375779 32199 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:33.374404 32121 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:33.377033 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:33.373387 32090 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:33.359445  1561 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.379724  1766 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:33.380401 32090 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:33.382292 32124 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:33.383914 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:33.388360 32090 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:33.380326  1780 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:33.366150  1676 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.388901  1768 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:13:33.390548  1820 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:33.392262  1780 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.392831  1780 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:33.397629  1820 raft_consensus.cc:697] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:33.398393 32090 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:33.400164 32199 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:33.401120 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:33.408051 32190 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:33.402444  1822 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:33.401074  1735 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:33.409777  1822 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:33.410878  1676 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:33.411026 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:33.411049  1822 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:33.416009  1855 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.416633  1855 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.419793  1855 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:33.420516 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:33.421249 32118 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:33.423029 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:33.423825 32193 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:33.410904  1735 raft_consensus.cc:697] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 2 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:33.435513 32118 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:33.425115  1822 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.439108 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:33.440708 32118 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:33.437589  1820 consensus_queue.cc:237] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.441020 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:33.441255  1735 consensus_queue.cc:237] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.440725 32238 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:33.443164  1855 raft_consensus.cc:2749] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:33.443467 32238 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:33.443796 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:33.447626 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.437839  1379 consensus_queue.cc:1059] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:13:33.450671 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:33.451460 32272 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:33.451941  1750 raft_consensus.cc:3055] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:33.451928 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:33.452512  1750 raft_consensus.cc:740] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:33.452881 32118 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:33.452402 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:33.453361 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:33.454113 32121 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:33.455917  1855 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:33.457818 32090 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:33.458361  1561 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:33.458992  1561 raft_consensus.cc:2804] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:33.459349  1561 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.459685  1561 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:33.462634 32238 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:13:33.463480  1893 log.cc:927] Time spent T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:13:33.463938 32238 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:33.464059 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:33.464246  1379 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:33.464836 32268 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:33.466902 32090 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:33.468061  1686 raft_consensus.cc:2804] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:33.468482  1686 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:33.468571 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.469018  1686 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:33.472913  1780 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.477429  1840 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:33.480607  1750 consensus_queue.cc:260] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.481897  1750 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:33.484529 32022 catalog_manager.cc:5697] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 3 to 4, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 4 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:33.485301 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:33.486891 32121 raft_consensus.cc:2468] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:33.489559  1686 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.490536 32022 catalog_manager.cc:5697] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 2 to 3, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 3 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:33.491834  1722 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.493577  1379 raft_consensus.cc:697] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:33.503953 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:13:33.505657 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 56974.5us
I20260709 13:13:33.500622 32238 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:33.517320 32239 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:33.526540 32022 catalog_manager.cc:5697] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:33.529078 32239 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:33.532337  1771 raft_consensus.cc:993] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:13:33.532951  1661 raft_consensus.cc:2804] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:33.532945  1771 raft_consensus.cc:1081] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:13:33.533592  1661 raft_consensus.cc:697] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:33.534638  1661 consensus_queue.cc:237] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.538267  1686 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:33.513101  1855 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:33.544902  1855 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.545388  1855 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:33.523108  1722 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.548909  1561 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.524871 32238 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:33.556043 32238 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:33.556906 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:33.560910 32238 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:33.560138 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:33.562543 32273 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:33.527112  1832 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:33.562928 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:33.530246  1822 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:33.563524 32264 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:33.568425  1827 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:33.568997  1827 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.561470  1748 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:33.561620  1857 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:33.569686  1748 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.570159  1857 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.570353  1748 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:33.570698  1857 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:33.564051 32022 catalog_manager.cc:5697] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 4 to 5, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 5 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:33.569430  1827 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:33.569391 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.574791  1832 raft_consensus.cc:697] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:33.575588 32019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49534 (request call id 170) took 10084 ms. Trace:
I20260709 13:13:33.575896  1832 consensus_queue.cc:237] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.591123  1722 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:33.591993  1379 consensus_queue.cc:237] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.597875 32238 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:33.604794  1771 raft_consensus.cc:993] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:13:33.605594  1722 raft_consensus.cc:1081] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:13:33.605788  1561 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:33.607760  1736 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.608464 32238 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:33.608310  1736 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.609838 32238 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:33.611161  1736 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:33.614676 32198 raft_consensus.cc:1240] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:33.617308  1561 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.623514 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:33.619091  1561 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.627611 32193 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:13:33.628301 32193 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:33.628680 32193 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:33.576167 32019 rpcz_store.cc:276] 0709 13:13:23.490806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.491454 (+   648us) service_pool.cc:224] Handling call
0709 13:13:33.575381 (+10083927us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:28.849594 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:29.028844 (+179250us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:29.028888 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:13:29.028909 (+    21us) tablet.cc:662] Decoding operations
0709 13:13:29.096432 (+ 67523us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:29.096524 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:29.112395 (+ 15871us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:13:29.247330 (+134935us) tablet.cc:701] Row locks acquired
0709 13:13:29.248719 (+  1389us) write_op.cc:260] PREPARE: finished
0709 13:13:29.423172 (+174453us) spinlock_profiling.cc:243] Waited 7.5 ms on lock 0x7b2c000daef8. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59d8eaa11 00007fb59d8f9a0a 00007fb59d8f9693 00007fb59d8f9631 00007fb59f02c902 00007fb59f02c6dd 00007fb5a2a27243 00007fb5a2a26d58 00007fb5a2a2b9f1 00007fb5a2a2b9a9 00007fb5a2a2b939
0709 13:13:29.423243 (+    71us) write_op.cc:270] Start()
0709 13:13:29.423450 (+   207us) write_op.cc:276] Timestamp: P: 1783602809267620 usec, L: 0
0709 13:13:29.423473 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:13:29.435288 (+ 11815us) log.cc:844] Serialized 2827 byte log entry
0709 13:13:29.816839 (+381551us) spinlock_profiling.cc:243] Waited 36.8 ms on lock 0x7b180019a200. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bee6e07 00007fb5a4d41ab9 00007fb59bf0369b 00007fb59bf0193f 00007fb59bf01455 00007fb59ef6e190 00007fb59ef67ae7 00007fb59ef66dd9 00007fb59ef71930
0709 13:13:29.970028 (+153189us) op_driver.cc:464] REPLICATION: finished
0709 13:13:30.327816 (+357788us) write_op.cc:301] APPLY: starting
0709 13:13:30.354751 (+ 26935us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:30.354982 (+   231us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:30.355016 (+    34us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:30.417194 (+ 62178us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:30.417409 (+   215us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:13:30.417455 (+    46us) write_op.cc:312] APPLY: finished
0709 13:13:30.417719 (+   264us) log.cc:844] Serialized 58 byte log entry
0709 13:13:30.417889 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:30.417998 (+   109us) write_op.cc:454] Released schema lock
0709 13:13:30.418045 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:30.418411 (+   366us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:30.418440 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":154696,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":330511,"apply.run_cpu_time_us":3245,"apply.run_wall_time_us":96323,"num_ops":7,"prepare.queue_time_us":229728,"prepare.run_cpu_time_us":43208,"prepare.run_wall_time_us":905482,"raft.queue_time_us":192331,"raft.run_cpu_time_us":9488,"raft.run_wall_time_us":227809,"replication_time_us":546398,"spinlock_wait_cycles":101810176,"thread_start_us":781574,"threads_started":4,"wal-append.queue_time_us":308635,"wal-append.run_cpu_time_us":43341,"wal-append.run_wall_time_us":1692014}]]}
I20260709 13:13:33.590734 32022 catalog_manager.cc:5697] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.633057 32273 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:33.634848 32264 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:13:33.634356 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:33.610880  1764 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:33.636294 32090 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:33.643638  1764 raft_consensus.cc:697] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:33.637524  1561 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:33.644500  1561 raft_consensus.cc:2804] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:33.645036  1561 raft_consensus.cc:697] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:33.644838  1764 consensus_queue.cc:237] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.646066  1561 consensus_queue.cc:237] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.637574  1749 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.638351  1702 consensus_queue.cc:1048] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:33.648247  1768 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:33.639082 32267 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:33.640424  1852 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.648120  1749 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.650280  1852 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:33.651427 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.651836  1749 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:33.640470 32199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:13:33.652902 32199 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:33.653304 32199 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:33.641742 32198 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:33.634163  1771 raft_consensus.cc:2804] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:33.652796 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:33.642701 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:33.654752 32271 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:33.656548 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:13:33.650578 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 111388us
I20260709 13:13:33.658530 32238 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:33.660638 32090 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:33.661485 32239 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:33.663031 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:33.663724 32272 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 8.
I20260709 13:13:33.663038 32198 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:33.652382  1852 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:33.665562 32090 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:33.666698 32238 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:33.667896 32239 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:33.669343  1726 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.669639  1822 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:33.669891  1726 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.675606  1726 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:33.671890  1840 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:33.677105  1840 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.677292  1676 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:33.677529  1840 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:33.677745  1676 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.678180  1676 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:33.658422  1771 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.681387 32090 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:33.681819 32165 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:33.682143  1736 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:33.682574  1822 raft_consensus.cc:697] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:33.682741  1702 consensus_queue.cc:1059] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:33.683070 32165 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:33.683590  1766 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:33.680995  1780 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:33.684669 32022 catalog_manager.cc:5697] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 3 to 5, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 5 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:33.685676 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:33.685695 32239 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:33.680154 32193 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.681402  1771 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:33.694684 32268 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:33.671711  1660 raft_consensus.cc:2804] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:33.683673  1702 raft_consensus.cc:3055] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:33.697701 32199 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.683952  1788 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:33.698705 32022 catalog_manager.cc:5697] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 3 to 4, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 4 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:33.700194 32193 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:33.686543  1661 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:33.682579  1736 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.762387 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:33.683609  1822 consensus_queue.cc:237] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.721798  1855 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.724092 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:33.703344  1819 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.709714 32165 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:33.701031  1660 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.687191  1852 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:33.699616  1722 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:33.701130  1702 raft_consensus.cc:740] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:33.755138 32022 catalog_manager.cc:5697] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 2 to 4, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 4 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:33.776321 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:33.722836  1780 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.734530  1827 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.704361  1788 raft_consensus.cc:697] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:33.774154 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:33.774435 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 64853.3us
I20260709 13:13:33.774963 32199 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:33.774000  1660 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:33.715844  1748 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.758785  1857 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.777139 32090 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:33.775754  1766 raft_consensus.cc:2804] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:33.779217 32022 catalog_manager.cc:5697] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 5 to 6, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 6 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:33.780242 32271 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:33.770138  1661 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.771517  1736 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:33.784652 32116 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:33.785025  1766 raft_consensus.cc:697] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 3 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:33.785506  1820 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:33.770004  1379 raft_consensus.cc:2804] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:33.774361  1852 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.732547  1840 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.788213 32239 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:33.791708  1715 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:33.792117  1715 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.789420  1741 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:33.786027  1766 consensus_queue.cc:237] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.793054  1741 raft_consensus.cc:697] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:33.793124  1682 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:33.778297  1676 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.793810  1682 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.794061  1741 consensus_queue.cc:237] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.795770  1682 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:33.796458  1676 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:33.792500  1715 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:33.787842  1661 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:33.797981 32090 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:33.786051  1820 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.799237  1780 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.805560  1686 raft_consensus.cc:2804] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:33.806095  1686 raft_consensus.cc:697] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 4 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:33.806882  1820 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:33.807006  1686 consensus_queue.cc:237] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.788656  1852 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:33.803987  1768 consensus_queue.cc:1059] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:33.813882  1768 raft_consensus.cc:3055] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:33.814241  1768 raft_consensus.cc:740] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:33.815184  1768 consensus_queue.cc:260] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.816483  1820 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:33.817359  1820 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.818435  1855 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:33.819658 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:33.820377  1722 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.820462 32193 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:33.820946  1722 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:33.823338  1827 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:33.774501  1819 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.824560 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:33.825508 32198 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:33.825634  1819 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:33.830150 32116 raft_consensus.cc:1275] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:13:33.830883 32124 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
W20260709 13:13:33.833209  1907 log.cc:927] Time spent T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:13:33.833734 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:33.834698 32264 raft_consensus.cc:2368] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6.
I20260709 13:13:33.816453  1768 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:33.836809 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:33.836910 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:33.837719 32272 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:33.839718 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:33.841411  1796 consensus_queue.cc:1048] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:33.841938  1735 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:33.842491  1735 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.845882 32090 leader_election.cc:400] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6.
I20260709 13:13:33.846266 32090 leader_election.cc:403] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:33.847738  1682 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:13:33.849444 32239 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:33.850193 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:33.850821 32116 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:33.789705  1561 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:33.851786  1840 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:33.852427  1840 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:33.852857  1840 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.852033  1561 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.853214  1840 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:33.853772  1748 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:33.806914  1780 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:33.856091 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:33.856225  1857 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:33.808357  1656 consensus_queue.cc:1048] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:33.857182 32190 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:33.819710  1788 consensus_queue.cc:237] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.857910 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:33.858443 32195 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:33.860034 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:33.860952 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:33.861593 32192 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:33.862903 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:33.864255 32271 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:33.809334 32165 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:33.846550  1735 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:33.865423 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 56175.9us
I20260709 13:13:33.864006  1736 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.865965 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:33.873504 32123 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:33.866906 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:33.790987 32022 catalog_manager.cc:5697] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 4 to 5, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 5 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:33.869012 32116 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:33.869587 32268 raft_consensus.cc:2368] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 4. Current term is 5.
I20260709 13:13:33.788000  1379 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.871340 32193 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:33.873427 32195 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:33.875373 32239 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:33.867087 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:33.877941  1656 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:33.878950 32165 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:33.876842 32090 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:33.879968 32022 catalog_manager.cc:5697] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 4 to 5, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 5 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:33.884783  1820 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:33.885390  1662 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:33.885511  1820 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:33.890283 32273 raft_consensus.cc:1275] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:13:33.893105 32198 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:33.877696 32124 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:13:33.906713 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:33.879839  1379 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:33.911216 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:33.783303  1771 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
W20260709 13:13:33.923450 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.912858 32022 catalog_manager.cc:5697] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 3 to 5, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 5 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:33.914522  1840 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.916838  1857 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.922657 32267 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:33.912478 32272 raft_consensus.cc:1275] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:33.881688  1726 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:33.885869  1662 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:33.877683 32190 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:33.892174  1736 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:33.927798 32264 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:33.928149 32090 leader_election.cc:400] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 4. Current term is 5.
I20260709 13:13:33.933835 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:33.934263 32090 leader_election.cc:403] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:33.928946 32123 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:33.929741 32271 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:13:33.886222  1820 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.937754 32239 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:33.808434  1702 consensus_queue.cc:260] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:33.939307 32124 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
W20260709 13:13:33.945281 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 66412.2us
I20260709 13:13:33.939306 32192 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:33.943708 32238 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:33.928248  1561 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:33.945912 32239 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:33.949834 32238 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:33.935040  1662 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:33.959059 32022 catalog_manager.cc:5697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 6 to 7, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 7 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:33.940896  1820 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:33.941036  1726 raft_consensus.cc:697] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:33.944242  1750 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:33.958719  1832 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:33.983917 32165 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:33.958119  1758 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:13:33.991472 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.957916  1822 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 4. Current term is 5.
I20260709 13:13:33.993207 32090 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:34.001103 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:34.001893 32124 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:33.946949  1857 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.004571 32090 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:34.007670 32267 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
W20260709 13:13:34.011938 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 62205.4us
I20260709 13:13:34.012316  1917 consensus_queue.cc:1048] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:34.002720  1819 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:13:34.018675 32124 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:34.000173  1702 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:34.004037  1846 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:34.004051  1766 raft_consensus.cc:2764] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:13:34.005089  1758 raft_consensus.cc:697] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:13:34.028270 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 61887.5us
I20260709 13:13:34.027613 32199 raft_consensus.cc:1240] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:34.015377  1686 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:34.036916  1661 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.024897  1780 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:34.025126  1832 raft_consensus.cc:697] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:34.043903  1686 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:34.073581 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:34.081148 32090 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:34.068887 32268 raft_consensus.cc:2368] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 6. Current term is 7.
I20260709 13:13:34.041633  1846 raft_consensus.cc:697] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:34.135214 32267 raft_consensus.cc:2468] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:34.043788  1771 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:34.135007 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 53934us
I20260709 13:13:34.053128  1766 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:13:34.083120  1910 log.cc:927] Time spent T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:13:34.141495 32165 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:34.082423  1911 log.cc:927] Time spent T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:13:34.143590 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:34.143749 32239 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:34.070523  1682 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6.
I20260709 13:13:34.134538  1750 raft_consensus.cc:697] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:34.087594  1780 raft_consensus.cc:697] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:34.134276  1686 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:34.081962  1914 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:34.164772  1819 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.164526  1780 consensus_queue.cc:237] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.169855  1819 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.056099  1852 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.172753  1827 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:34.173544  1827 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.174891  1820 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.141804  1722 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.177989  1832 consensus_queue.cc:237] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.066008  1661 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:34.154871 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:34.141134  1656 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:34.053265  1715 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.138182  1676 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:34.154999  1788 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:34.160019 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:34.161283  1912 log.cc:927] Time spent T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.092s	user 0.004s	sys 0.000s
I20260709 13:13:34.041117  1726 consensus_queue.cc:237] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.183773 32123 raft_consensus.cc:2393] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 6: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:34.149566  1840 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:34.222465 32119 raft_consensus.cc:2468] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:34.221560 32118 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:13:34.073158  1758 consensus_queue.cc:237] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.211302  1771 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:34.184437  1819 leader_election.cc:290] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:34.236176 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 74777.9us
I20260709 13:13:34.166463  1766 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:34.259258 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.262759 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:34.263340 32190 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:34.232010  1661 raft_consensus.cc:2804] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:34.230237  1676 raft_consensus.cc:697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
W20260709 13:13:34.264047 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 80005.3us
I20260709 13:13:34.271804 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:34.272014 32239 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:34.272449 32199 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:13:34.255396  1656 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:34.276149 32124 raft_consensus.cc:1275] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:34.274356 32118 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:34.225423  1379 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.227499  1788 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.276986 32192 raft_consensus.cc:1275] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:34.280824 32190 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:34.281205 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:34.166138  1914 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.281270 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:34.291059 32199 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:34.269372  1771 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.297506 32119 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:34.286291 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:34.297981 32165 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:34.309875 32120 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:34.320266  1661 raft_consensus.cc:697] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:34.321324  1771 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:34.323395  1852 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:34.326260  1827 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:34.331719 32117 raft_consensus.cc:1275] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:34.337114  1764 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.337680  1764 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.338683  1927 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.338788 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:34.339298 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:34.339776  1764 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:34.339952 32192 raft_consensus.cc:2468] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:34.339313  1927 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.343364 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:13:34.344290 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 65904.8us
I20260709 13:13:34.345523 32119 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:34.352401 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:34.353159 32264 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 8.
I20260709 13:13:34.356890 32199 raft_consensus.cc:1240] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:34.301458  1846 consensus_queue.cc:237] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.362870  1766 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:34.363636  1932 raft_consensus.cc:2804] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:34.364101  1932 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.334152  1857 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:34.368088 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:34.344383  1726 consensus_queue.cc:1048] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:13:34.368973 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:34.283717  1656 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.373953  1379 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:34.374826  1660 consensus_meta.cc:287] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.590s	user 0.008s	sys 0.002s
I20260709 13:13:34.375221  1660 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.375492  1656 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:34.333076  1928 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:34.373221 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:34.364452  1932 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:34.382733 32198 raft_consensus.cc:2393] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 6: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
W20260709 13:13:34.383848  1930 log.cc:927] Time spent T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:13:34.384800  1788 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:34.386039 32090 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:34.386327  1914 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:34.387311  1722 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:34.321348  1661 consensus_queue.cc:237] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:13:34.410471 32090 leader_election.cc:400] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 6. Current term is 7.
I20260709 13:13:34.410794 32090 leader_election.cc:403] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:34.412129 32238 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:34.413224  1840 consensus_queue.cc:1059] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:13:34.418522  1686 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.409680  1766 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:34.419925  1766 raft_consensus.cc:697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:34.420599  1922 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:34.420958 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:34.421124  1922 raft_consensus.cc:697] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:34.421042  1766 consensus_queue.cc:237] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.422248  1922 consensus_queue.cc:237] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.426369  1840 raft_consensus.cc:3055] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:13:34.426522  1913 log.cc:927] Time spent T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.405s	user 0.002s	sys 0.000s
I20260709 13:13:34.426867  1840 raft_consensus.cc:740] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:34.428043  1820 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:34.409813  1736 raft_consensus.cc:2804] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:34.427935  1840 consensus_queue.cc:260] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.429200  1736 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:34.429678  1736 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.430770  1715 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:34.345466  1750 consensus_queue.cc:237] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.432687  1927 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:34.432987 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:34.433699 32123 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:34.435338 32117 raft_consensus.cc:1275] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:13:34.435738 32117 pending_rounds.cc:85] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d: Aborting all ops after (but not including) 3
I20260709 13:13:34.437043 32268 raft_consensus.cc:2393] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 6: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:34.438925 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:34.440325 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:34.440886 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:34.441788 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:34.442340 32193 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:34.444312 32121 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:34.445520 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:34.446190 32115 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:34.446741 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:13:34.448266 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 353352us
I20260709 13:13:34.449218 32195 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:34.450019 32190 raft_consensus.cc:3055] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:34.459446 32190 raft_consensus.cc:740] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:34.435984 32117 pending_rounds.cc:107] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:13:34.461705 32117 raft_consensus.cc:2889] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:34.463361  1927 consensus_queue.cc:1059] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:13:34.470345 32192 raft_consensus.cc:1275] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:34.413340  1780 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 6. Current term is 7.
I20260709 13:13:34.442811  1686 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:34.475402 32090 leader_election.cc:304] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:34.416409  1379 consensus_queue.cc:1048] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:13:34.486091 32238 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:34.409310  1662 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.380445  1676 consensus_queue.cc:237] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.462543  1660 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:34.496358 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:34.489084 32190 consensus_queue.cc:260] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:34.506961 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 209942us
I20260709 13:13:34.511186 32190 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:34.511883 32239 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:34.513022 32239 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:34.501358  1741 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:34.517218 32165 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:34.517479 32239 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:34.524190 32239 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:34.525068 32239 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:34.520234 32193 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:34.504166  1758 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:34.534300 32190 raft_consensus.cc:1275] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:13:34.537210 32190 pending_rounds.cc:85] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 2
I20260709 13:13:34.537681 32190 pending_rounds.cc:107] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 3.3
W20260709 13:13:34.538318 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 48876us
I20260709 13:13:34.522854  1741 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.531461  1722 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:34.522125  1857 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:34.533771  1758 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.522990  1928 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:34.534181  1764 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:34.542164 32190 raft_consensus.cc:2889] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:34.547887 32238 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:34.531344  1749 consensus_queue.cc:1048] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:13:34.540014  1855 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.553560  1920 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:34.554165  1919 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:34.596355  1715 raft_consensus.cc:3055] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:34.596761  1920 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:34.596937  1715 raft_consensus.cc:740] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:34.597328  1920 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:34.597908  1715 consensus_queue.cc:260] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.546383  1561 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:34.555042  1939 log.cc:927] Time spent T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:13:34.543978  1758 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:34.543597  1857 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:34.564900  1764 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:34.552320  1827 consensus_queue.cc:1048] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:13:34.612010  1840 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:34.613473  1736 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.542994  1741 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:34.557387  1940 raft_consensus.cc:2804] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:34.585217 32197 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.615119  1940 raft_consensus.cc:697] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 3 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:34.616261  1940 consensus_queue.cc:237] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.586659 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:34.589416 32123 raft_consensus.cc:1275] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:13:34.617908 32121 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:34.546406 32089 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.604s (SENT) [suppressed 3 similar messages]
I20260709 13:13:34.591043 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:34.592659 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:34.620445 32117 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:34.593458 32272 raft_consensus.cc:1275] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:34.593868 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:34.594172 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:34.594627 32264 raft_consensus.cc:1275] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:34.594847 32273 raft_consensus.cc:1275] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:13:34.622978 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.600000  1561 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:34.601331 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:34.601426 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 49108.7us
I20260709 13:13:34.606714  1749 consensus_queue.cc:1048] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:34.547104  1722 raft_consensus.cc:697] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:34.596541  1919 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.608740  1857 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:34.622956 32115 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:34.555912  1934 log.cc:927] Time spent T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:13:34.647374 32119 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
W20260709 13:13:34.640458 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 90630.2us
W20260709 13:13:34.608736  1702 consensus_meta.cc:287] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.575s	user 0.011s	sys 0.003s
I20260709 13:13:34.660527  1919 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:34.667609 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 123474us
I20260709 13:13:34.646792  1764 raft_consensus.cc:697] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:34.601682  1855 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.653119  1822 consensus_queue.cc:1048] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.108s
I20260709 13:13:34.654174  1846 consensus_queue.cc:1048] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:13:34.767663 32121 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:34.769218 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:34.784312 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.786947 32264 raft_consensus.cc:2393] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 4: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:34.787271 32273 raft_consensus.cc:1240] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:34.788918 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:34.668483  1748 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.109s
I20260709 13:13:34.805343 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:34.806370 32267 raft_consensus.cc:2368] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 3. Current term is 4.
I20260709 13:13:34.762251  1928 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.807453  1764 consensus_queue.cc:237] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.790766  1662 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:34.825188  1736 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:34.832775 32271 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:34.862036  1855 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:34.761644  1950 consensus_queue.cc:1048] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.138s
W20260709 13:13:34.868705 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:34.869720 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:34.871591  1945 log.cc:927] Time spent T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:13:34.872164  1922 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.872960  1922 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.875757  1922 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:34.889833  1561 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:34.898609 32117 raft_consensus.cc:2468] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:34.904690 32115 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:34.904881 32197 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:34.803121  1702 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:34.924374 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.927866 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:34.928539 32199 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:34.930275 32193 raft_consensus.cc:1275] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:34.859861  1741 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.899772  1662 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.954913 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:34.963843 32239 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:34.843248  1928 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.968786 32239 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:34.968253  1936 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:34.972077 32239 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:34.959052  1846 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.972446 32194 raft_consensus.cc:3055] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:34.978319 32194 raft_consensus.cc:740] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:34.979343 32194 consensus_queue.cc:260] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.842501  1722 consensus_queue.cc:237] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.983671 32194 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:34.950603  1950 consensus_queue.cc:1048] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:13:34.956341  1822 consensus_queue.cc:1048] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:13:34.972576  1379 raft_consensus.cc:2804] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:34.963734  1702 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.964373  1662 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.974460  1936 raft_consensus.cc:697] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:34.954538  1919 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.973829  1758 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:34.981417  1832 raft_consensus.cc:2804] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:35.021469 32115 raft_consensus.cc:1275] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:35.029927 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:34.999770  1656 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:35.033543 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:35.034413 32119 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:35.030588 32118 raft_consensus.cc:1275] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:34.985246  1846 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:35.006592  1379 raft_consensus.cc:697] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:35.049537 32116 raft_consensus.cc:2468] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:35.052398 32115 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:13:35.029078  1932 consensus_meta.cc:287] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.620s	user 0.010s	sys 0.001s
I20260709 13:13:35.064985 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:35.068930 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:35.073104 32239 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:35.075469 32120 raft_consensus.cc:1275] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:35.033535  1832 raft_consensus.cc:697] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:35.100221 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:35.101073 32116 raft_consensus.cc:2368] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 3. Current term is 4.
I20260709 13:13:35.101991 32239 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:35.113042  1855 consensus_queue.cc:1048] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:35.116744  1660 raft_consensus.cc:2804] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:35.117213  1660 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.117583  1660 raft_consensus.cc:3060] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:35.119066  1948 log.cc:927] Time spent T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.510s	user 0.003s	sys 0.001s
I20260709 13:13:35.121048  1928 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:35.121215  1832 consensus_queue.cc:237] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:35.110195  1927 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:35.124799  1927 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.125169  1927 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:35.128976  1954 log.cc:927] Time spent T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:13:35.134258 32115 raft_consensus.cc:1275] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:13:35.135125 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.138895  1662 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:35.140501  1702 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:35.142174  1758 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:35.143849 32116 raft_consensus.cc:1240] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:35.144168 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:35.144066 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:35.145153 32120 raft_consensus.cc:2393] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 7: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:35.146498 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:35.145838  1936 consensus_queue.cc:237] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:35.160894 32116 raft_consensus.cc:1240] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:35.148857 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:35.042505  1656 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:35.061164  1932 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:35.166838 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:35.170463 32124 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:35.058235  1920 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:35.100113  1827 consensus_queue.cc:1048] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 13:13:35.148490  1846 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:35.157305  1379 consensus_queue.cc:237] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:35.482594  1955 log.cc:927] Time spent T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7: Append to log took a long time: real 0.526s	user 0.002s	sys 0.000s
I20260709 13:13:35.236377  1927 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:35.381160  1840 consensus_meta.cc:287] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.769s	user 0.012s	sys 0.000s
I20260709 13:13:35.599985  1927 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:35.368075  1920 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:35.241068 32194 raft_consensus.cc:1275] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:13:35.291745 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:35.610790 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:35.611668 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.165228  1741 leader_election.cc:290] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:35.602808 32090 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:13:35.288401 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:35.425863  1857 consensus_meta.cc:287] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.758s	user 0.009s	sys 0.004s
I20260709 13:13:35.255682  1656 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:35.202915 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:35.291447 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 189515us
W20260709 13:13:35.176638 32165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.235817 32124 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
W20260709 13:13:35.229049  1966 log.cc:927] Time spent T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
W20260709 13:13:35.565505  1957 log.cc:927] Time spent T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.521s	user 0.002s	sys 0.000s
I20260709 13:13:35.177592 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:35.625871 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:35.168292   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 44199.2us
W20260709 13:13:35.333662  1944 log.cc:927] Time spent T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.733s	user 0.000s	sys 0.002s
W20260709 13:13:35.533903  1964 log.cc:927] Time spent T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.256s	user 0.000s	sys 0.000s
W20260709 13:13:35.661260 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 58571.6us
I20260709 13:13:35.233709  1919 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:35.668174 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:35.365757  1932 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:35.625666  1715 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:35.167635  1660 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:35.623266  1662 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.346324  1686 consensus_queue.cc:1048] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.327s
I20260709 13:13:35.679950 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:35.687140 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:35.687471 32124 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:13:35.682947 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:35.683189 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:35.667621 32122 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:35.658375  1656 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.669627  1780 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:35.695235 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:13:35.666925  1971 log.cc:927] Time spent T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.063s	user 0.003s	sys 0.002s
I20260709 13:13:35.693410  1662 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:35.701202 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:35.702325 32190 raft_consensus.cc:2410] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:13:35.702471 32116 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:35.706312 32264 raft_consensus.cc:1240] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:35.709259 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:35.711951 32119 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:35.717346 32116 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:35.718140 32119 raft_consensus.cc:2468] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:35.718508 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:35.718986 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:35.719570 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:35.719971 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:35.680011  1920 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.729192 32194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1487) took 1248 ms. Trace:
I20260709 13:13:35.667429  1927 consensus_queue.cc:1048] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:13:35.721434 32267 raft_consensus.cc:1240] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 5. Current term is 7. Ops: []
I20260709 13:13:35.733618 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:35.733807 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:35.734432 32271 raft_consensus.cc:2368] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 4. Current term is 5.
I20260709 13:13:35.729851 32194 rpcz_store.cc:276] 0709 13:13:34.459753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:34.459900 (+   147us) service_pool.cc:224] Handling call
0709 13:13:34.468971 (+  9071us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:35.608829 (+1139858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:35.708229 (+ 99400us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b54000b2f54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:35.708418 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1151291264}
I20260709 13:13:35.722759 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:35.635098  1857 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:35.731196 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:35.735962 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:35.720547 32119 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:35.686414  1764 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.738653 32124 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:35.757220 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:35.758276 32197 raft_consensus.cc:2368] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6.
I20260709 13:13:35.752056 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:35.761072 32272 raft_consensus.cc:1240] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:35.738994 32267 raft_consensus.cc:1240] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:35.763262 32198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1491) took 1101 ms. Trace:
I20260709 13:13:35.729547  1682 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.764081 32198 rpcz_store.cc:276] 0709 13:13:34.662280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:34.662480 (+   200us) service_pool.cc:224] Handling call
0709 13:13:34.662767 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:34.663112 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:34.663140 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:34.761515 (+ 98375us) log.cc:844] Serialized 26 byte log entry
0709 13:13:34.977003 (+215488us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:34.977040 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:34.977101 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:35.762981 (+785880us) raft_consensus.cc:1685] finished
0709 13:13:35.763008 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:35.763187 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":452,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":6143,"thread_start_us":172121,"threads_started":1,"wal-append.queue_time_us":381603}
I20260709 13:13:35.767215 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:35.732086  1780 raft_consensus.cc:697] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 4 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:35.738387  1919 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:35.791136  1919 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:35.793473  1919 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:35.755224  1735 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:35.794700  1735 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:35.797068  1735 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:35.738867  1656 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:35.799577  1656 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:35.801003 32272 raft_consensus.cc:1240] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:35.801203  1660 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:35.802780 32266 raft_consensus.cc:1240] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:35.771277 32271 raft_consensus.cc:1240] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:13:35.737676  1920 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:35.773823 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:35.807228  1920 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:35.778756 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:35.811061 32191 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:13:35.783275 32123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1540) took 1124 ms. Trace:
I20260709 13:13:35.783913 32118 raft_consensus.cc:1240] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:13:35.812125  1662 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:35.784880 32268 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:35.815930 32122 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
W20260709 13:13:35.819134 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 109073us
I20260709 13:13:35.811843 32123 rpcz_store.cc:276] 0709 13:13:34.658520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:34.659603 (+  1083us) service_pool.cc:224] Handling call
0709 13:13:34.659934 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:34.964215 (+304281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:34.964248 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:34.968795 (+  4547us) log.cc:844] Serialized 26 byte log entry
0709 13:13:35.298790 (+329995us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:35.298846 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:35.298951 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:35.782969 (+484018us) raft_consensus.cc:1685] finished
0709 13:13:35.782994 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:35.783174 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48434,"raft.queue_time_us":135800,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":94,"thread_start_us":554716,"threads_started":2,"wal-append.queue_time_us":703910}
I20260709 13:13:35.819240 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:35.739215  1748 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.845532 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:35.846982 32119 raft_consensus.cc:1240] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:35.825513  1662 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.850944 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:35.854198 32191 raft_consensus.cc:1275] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:35.744628  1924 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:35.859934 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.861738 32193 raft_consensus.cc:1275] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:35.861855 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:35.862471 32199 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:35.752687  1764 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:35.851809   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:35.866120 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:35.869154 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:35.821857  1656 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:35.869750 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 48834us
I20260709 13:13:35.811074  1857 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:35.880936  1780 consensus_queue.cc:237] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:35.870844 32195 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:35.883430 32123 raft_consensus.cc:1275] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:35.877691 32239 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:35.823479  1686 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:35.777287  1682 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:35.853797  1982 log.cc:927] Time spent T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:13:35.875900 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:35.893280 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:35.855268  1932 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.906975 32192 raft_consensus.cc:2393] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 2: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:35.908119 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:35.894785 32239 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:35.895568 32193 raft_consensus.cc:1275] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:35.898931  1846 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.899037  1922 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:35.869360 32264 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:35.911044 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:35.914800 32193 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:35.916054 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:35.919023 32239 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:35.921383 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:35.911789 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:35.912256 32199 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:35.876672  1702 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.857749  1748 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:35.934952 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:35.935559 32239 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:35.924326 32190 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:35.935981 32192 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:35.870707  1715 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:35.902525  1741 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.854643  1662 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:35.876407  1919 consensus_queue.cc:1048] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:13:35.961236 32192 raft_consensus.cc:1275] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:35.955042 32193 raft_consensus.cc:2468] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:35.957906 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:35.962913 32267 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:35.870062  1924 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:35.916819  1750 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.972285 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:35.973896 32190 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:35.975253 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:35.976410 32193 raft_consensus.cc:2368] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6.
I20260709 13:13:35.971752  1983 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.942302  1855 raft_consensus.cc:2804] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:35.954810  1857 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:35.890218  1656 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:35.992676 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:36.002827 32192 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:13:36.000932 32199 raft_consensus.cc:1275] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:35.953236  1922 raft_consensus.cc:697] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:13:36.026872 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.918188  1932 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:35.904628  1686 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:36.042891 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:36.043613 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.044009 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.057052 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.057166 32193 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:36.058071 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.058832 32193 raft_consensus.cc:2368] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4.
I20260709 13:13:36.050133 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.059957 32194 raft_consensus.cc:2368] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 4. Current term is 5.
I20260709 13:13:36.050704 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.053005 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:36.061223 32195 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:36.057662 32199 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:35.933880  1846 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:36.070104 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.071309 32198 raft_consensus.cc:2393] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 4: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:35.949545  1702 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:36.072075 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.079334 32193 raft_consensus.cc:2368] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 6. Current term is 7.
I20260709 13:13:36.072474 32197 raft_consensus.cc:2393] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 5: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:36.072700 32196 raft_consensus.cc:2368] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6.
W20260709 13:13:36.072870 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.080680 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:36.081147 32269 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:35.965384  1741 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:13:35.990882  1857 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.076613 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:35.967020  1715 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:35.849938  1936 consensus_queue.cc:1048] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:13:36.093721 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:36.040828  1975 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:36.040628  1972 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:36.103057 32190 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:13:36.103914 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:36.104529 32196 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:36.004393  1983 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:36.095752 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.056841  1855 raft_consensus.cc:697] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:35.982472  1750 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:36.107273 32195 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:13:36.113875 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:36.114612 32190 raft_consensus.cc:1275] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:36.115056 32195 raft_consensus.cc:2393] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 4: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:36.116183 32194 raft_consensus.cc:1240] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:36.107339 32198 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 8.
I20260709 13:13:36.111289 32192 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:36.096706  1857 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:36.128219 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:36.132735 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.133821 32192 raft_consensus.cc:2393] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 5: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:36.103264  1992 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:36.140820 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:36.143682 32267 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:13:36.146675 32198 raft_consensus.cc:1275] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:36.124099  1975 raft_consensus.cc:697] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:36.153546 32267 raft_consensus.cc:1240] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:36.158449 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.159621 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:36.160283 32194 raft_consensus.cc:2368] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4.
I20260709 13:13:36.151527  1992 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:36.201056  1764 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:36.113646  1972 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:13:36.209100  1984 log.cc:927] Time spent T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.153s	user 0.001s	sys 0.001s
I20260709 13:13:36.209722  1702 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:36.210203  1715 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:36.210343  1662 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:36.210950  1748 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:36.211650 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.254463  1972 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:36.255250 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:36.256116 32190 raft_consensus.cc:2368] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6.
I20260709 13:13:36.256959 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:36.211856 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.258291 32194 raft_consensus.cc:2368] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 4. Current term is 5.
I20260709 13:13:36.212381 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.212749 32195 raft_consensus.cc:3055] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:36.160266 32124 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:36.259064 32195 raft_consensus.cc:740] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:36.148146  1922 consensus_queue.cc:237] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:36.201001  1855 consensus_queue.cc:237] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:36.212823  1780 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:36.259948 32195 consensus_queue.cc:260] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:36.268800 32195 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:36.219134 32196 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
W20260709 13:13:36.219424  1988 log.cc:927] Time spent T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:13:36.219871  1846 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:36.220850  1983 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:36.221235  1741 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:36.221773  1924 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:36.222152  1750 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:36.222889  1682 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:36.223062  1987 log.cc:927] Time spent T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:13:36.286878  1932 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:36.213555  1977 log.cc:927] Time spent T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
I20260709 13:13:36.286969   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:36.288079  1975 consensus_queue.cc:237] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:36.285807  1780 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:36.293603  1983 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:36.294416 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.158919 32090 leader_election.cc:304] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:13:36.229357 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.217923 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:36.296924 32119 raft_consensus.cc:3060] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:36.293711  1857 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:36.241724  1686 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:13:36.243759  1978 log.cc:927] Time spent T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.492s	user 0.004s	sys 0.000s
I20260709 13:13:36.301038  1857 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:36.303653 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:36.304937  1656 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:36.307051 32264 raft_consensus.cc:1275] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:36.301026  1983 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:13:36.311218  1983 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:36.247365 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:36.253530 32115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 1135) took 1089 ms. Trace:
I20260709 13:13:36.259719 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.313506 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.314714 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.260540 32190 raft_consensus.cc:2410] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:13:36.317239 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.318491 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:36.319768 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:36.265035 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:36.266360 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:36.321128  1974 log.cc:927] Time spent T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.417s	user 0.002s	sys 0.001s
I20260709 13:13:36.267026 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:36.273767 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.325148 32264 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:13:36.321130 32270 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:36.316196 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.304543 32191 raft_consensus.cc:2393] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 6: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:36.275069 32195 raft_consensus.cc:1275] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:13:36.330701 32195 pending_rounds.cc:85] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 2
I20260709 13:13:36.331085 32195 pending_rounds.cc:107] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:13:36.331385 32195 raft_consensus.cc:2889] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:36.276244 32199 raft_consensus.cc:1275] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:36.332901 32119 raft_consensus.cc:2468] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:36.334640 32190 raft_consensus.cc:2393] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 5: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:36.312134 32115 rpcz_store.cc:276] 0709 13:13:35.164355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:35.164494 (+   139us) service_pool.cc:224] Handling call
0709 13:13:35.604921 (+440427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:35.634685 (+ 29764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:35.634723 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:35.669041 (+ 34318us) log.cc:844] Serialized 26 byte log entry
0709 13:13:35.851324 (+182283us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:35.851354 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:35.855329 (+  3975us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:36.253253 (+397924us) raft_consensus.cc:1685] finished
0709 13:13:36.253283 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:36.253446 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4265,"raft.queue_time_us":27687,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":8428,"thread_start_us":143555,"threads_started":1,"wal-append.queue_time_us":231268}
I20260709 13:13:36.336359 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.337862 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.342748 32195 raft_consensus.cc:2410] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:13:36.324265 32238 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:36.327261 32192 raft_consensus.cc:2376] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5. Re-sending same reply.
I20260709 13:13:36.332937 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.337472 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.345423 32199 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
W20260709 13:13:36.345662 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 186792us
I20260709 13:13:36.337162 32121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1544) took 1335 ms. Trace:
I20260709 13:13:36.341861 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.346447 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.345780 32194 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:36.344724 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.346781 32190 raft_consensus.cc:2393] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 4: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:36.346321 32121 rpcz_store.cc:276] 0709 13:13:35.002053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:35.002172 (+   119us) service_pool.cc:224] Handling call
0709 13:13:35.002518 (+   346us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:35.005902 (+  3384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:35.005929 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:35.025387 (+ 19458us) log.cc:844] Serialized 52 byte log entry
0709 13:13:35.339607 (+314220us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:35.339667 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:35.339787 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:36.320344 (+980557us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:13:36.323613 (+  3269us) raft_consensus.cc:1685] finished
0709 13:13:36.323653 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:36.337096 (+ 13443us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22280,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":22122,"spinlock_wait_cycles":5377280,"thread_start_us":271266,"threads_started":1,"wal-append.queue_time_us":778039}
I20260709 13:13:36.347658 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:36.355243 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.356137 32194 raft_consensus.cc:2393] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 5: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:36.356788 32192 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:36.352240 32120 raft_consensus.cc:1217] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Deduplicated request from leader. Original: 4.2->[7.3-7.3]   Dedup: 7.3->[]
I20260709 13:13:36.358668 32118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 1134) took 1198 ms. Trace:
I20260709 13:13:36.360306 32193 raft_consensus.cc:1275] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:13:36.375892 32193 pending_rounds.cc:85] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 4
I20260709 13:13:36.376088 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.361061 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.377080 32196 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:36.376286 32193 pending_rounds.cc:107] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:13:36.374912 32120 raft_consensus.cc:1240] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 13:13:36.377789 32193 raft_consensus.cc:2889] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:36.364802 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:36.374884 32118 rpcz_store.cc:276] 0709 13:13:35.160771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:35.161962 (+  1191us) service_pool.cc:224] Handling call
0709 13:13:35.783670 (+621708us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:35.812369 (+ 28699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:36.358368 (+545999us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b54003f48d0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff08ad 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:36.358576 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1394604800}
I20260709 13:13:36.381666 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.382095 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.383116 32194 raft_consensus.cc:2368] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8.
I20260709 13:13:36.341106  1686 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:36.362613 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:36.385648 32191 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:36.388268 32238 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:36.353211  1682 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.336879  1972 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:36.392629 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.392283 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:36.352074   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:36.353426  1741 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:36.404429 32238 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:36.408454 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.408253 32238 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:36.399822 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.398563 32194 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:36.409799 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:36.410951 32193 raft_consensus.cc:2368] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6.
I20260709 13:13:36.411164 32196 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:36.409829 32190 raft_consensus.cc:2368] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4.
I20260709 13:13:36.343497  1932 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:13:36.349654  1827 consensus_queue.cc:1048] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:13:36.399875 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.416501 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:36.416882 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.417253 32193 raft_consensus.cc:2368] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6.
I20260709 13:13:36.416240 32238 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:36.418427 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:36.417037 32195 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:36.361872  1950 consensus_queue.cc:1059] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:13:36.389811  1936 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:36.406594  1726 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:36.364084  1840 consensus_queue.cc:1048] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:13:36.415058  1741 raft_consensus.cc:697] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:36.403028  1998 consensus_queue.cc:1048] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:13:36.431051 32193 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:36.432142 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.432788 32193 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:36.433614 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.434330 32193 raft_consensus.cc:2368] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6.
I20260709 13:13:36.424898 32196 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:36.435101 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.419866  1379 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:36.438764  1992 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:36.414129  1819 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:13:36.440814  1656 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.440421  1741 consensus_queue.cc:237] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:36.441329  1656 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:36.443514  1656 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:36.447047 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.447918 32198 raft_consensus.cc:2368] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 6. Current term is 7.
W20260709 13:13:36.449287  2002 log.cc:927] Time spent T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:13:36.407209  1682 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:36.410872  1780 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:36.412388  1919 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:36.385574  1676 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:13:36.398835  1722 consensus_queue.cc:1048] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:13:36.422848 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.398327  1686 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:36.481848  1686 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:36.401510  1750 consensus_queue.cc:1048] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:13:36.430819  1983 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:36.454383 32191 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:13:36.456513 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.486670  1919 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.489061 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.454782  1379 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:36.490321  1379 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:36.459353  1726 raft_consensus.cc:697] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:36.461619 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:36.491883 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:36.491616  1726 consensus_queue.cc:237] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:36.407445  1972 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:36.492473 32268 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:36.494046 32268 raft_consensus.cc:1240] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:36.466219 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:36.495016 32271 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:13:36.469425 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:36.472952 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:36.501269 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.511441 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:36.475273 32194 raft_consensus.cc:2376] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7. Re-sending same reply.
W20260709 13:13:36.476722 32070 auto_rebalancer.cc:629] Failed to schedule move for tablet 7db983b299754e0eba1ba5726c892858: Illegal state: Replica 113b5461952d47e0944d463ea4e32801 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
W20260709 13:13:36.476684 32089 leader_election.cc:336] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.566s (SENT)
I20260709 13:13:36.484371 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.422380 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.517910 32197 raft_consensus.cc:2376] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9. Re-sending same reply.
I20260709 13:13:36.517071 32089 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:36.499310 32273 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:36.526827 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:13:36.526880 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 110688us
W20260709 13:13:36.530452 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.533273 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.533980 32191 raft_consensus.cc:2376] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4. Re-sending same reply.
W20260709 13:13:36.537241 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 60659.7us
I20260709 13:13:36.544471 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:36.546073 32194 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:36.547631 32194 raft_consensus.cc:3055] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:36.548087 32194 raft_consensus.cc:740] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:36.549319 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:36.549983 32271 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:36.550762 32194 consensus_queue.cc:260] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:36.552212 32194 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:36.552666 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 161922us
I20260709 13:13:36.525930  1656 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.525243  1919 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:36.524698  1950 consensus_queue.cc:1243] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer 6b3ed521ce8947db80c4b4828b355c06 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:13:36.555162 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:36.535743  1994 log.cc:927] Time spent T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.391s	user 0.003s	sys 0.001s
I20260709 13:13:36.565277  1972 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:36.558887 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:36.529853  1840 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:36.535698  1722 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:36.575860  1972 consensus_queue.cc:1048] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:36.581584 32239 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:36.527745  1983 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:36.545094  1676 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:36.553467  1961 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:36.589465 32239 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:36.595542 32191 raft_consensus.cc:1275] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:13:36.597916 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 47738.9us
I20260709 13:13:36.600641 32089 leader_election.cc:400] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4.
I20260709 13:13:36.600979 32089 leader_election.cc:403] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:13:36.571645  1722 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:36.558861  1780 consensus_queue.cc:1048] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:13:36.606963 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:13:36.610262   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 50284.1us
I20260709 13:13:36.611099 32194 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:13:36.611657 32194 pending_rounds.cc:85] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 3
I20260709 13:13:36.611737 32193 raft_consensus.cc:2410] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:36.612144 32194 pending_rounds.cc:107] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:13:36.612047 32239 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:36.614107 32194 raft_consensus.cc:2889] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:36.595217  1661 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:36.620784  1702 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.585253  1656 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:36.621483  1702 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:36.598304  1764 raft_consensus.cc:2749] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:36.623211  1656 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:36.614754 32165 leader_election.cc:400] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 3. Current term is 4.
I20260709 13:13:36.615859  1924 raft_consensus.cc:2804] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:36.616405 32191 raft_consensus.cc:1275] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:36.624643  1682 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:36.625495 32191 raft_consensus.cc:1275] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:36.601521  1822 consensus_queue.cc:1048] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:13:36.624027 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:36.627400 32265 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:36.627862  1822 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4.
I20260709 13:13:36.628332 32089 leader_election.cc:400] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6.
I20260709 13:13:36.628284 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:36.629475 32089 leader_election.cc:400] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 4. Current term is 5.
I20260709 13:13:36.629925 32089 leader_election.cc:403] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:36.599227  1676 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:36.631316 32089 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:36.629768 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:36.634783 32165 leader_election.cc:403] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:13:36.640851 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.624109  1702 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:36.611148  1722 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:36.581813  1840 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:36.606832  1662 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:36.669215 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.640298  1661 raft_consensus.cc:697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:13:36.672796 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 58164.1us
I20260709 13:13:36.682346 32089 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:36.642745  1820 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:36.607962  1686 consensus_queue.cc:1059] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 13:13:36.700767 32089 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:36.659750  1924 raft_consensus.cc:697] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:36.680003  1702 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:13:36.679800  1983 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:36.688476  1741 raft_consensus.cc:2749] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:36.706291 32089 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:36.707587 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:36.705066  1682 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:36.631824  1960 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 4. Current term is 5.
I20260709 13:13:36.711848 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:36.713603 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:36.695269  1662 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:36.725498 32190 raft_consensus.cc:3055] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:36.726652 32190 raft_consensus.cc:740] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:36.701622  1656 consensus_queue.cc:1059] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:13:36.727432 32190 consensus_queue.cc:260] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:36.735476 32190 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:36.728021 32089 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:36.709497  1990 consensus_queue.cc:1059] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:13:36.722283  2009 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:36.736730 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:36.738296 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:36.739455 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:36.744802  1661 consensus_queue.cc:237] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:36.718117  1676 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:36.740537 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:36.748399  1702 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 3. Current term is 4.
I20260709 13:13:36.780182 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:36.780341 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 52375.2us
I20260709 13:13:36.735518  1820 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
W20260709 13:13:36.783524 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.749140  1682 consensus_queue.cc:1048] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
W20260709 13:13:36.785024 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.785706 32193 raft_consensus.cc:1275] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:36.765877  1676 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:36.788486  1927 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.805449  1927 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:36.806077  1919 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:36.807231 32264 raft_consensus.cc:2368] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 7. Current term is 8.
I20260709 13:13:36.807577  1927 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:36.808022  1919 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:36.809736  1379 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:36.812021  1379 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:36.816476 32120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 1131) took 1666 ms. Trace:
I20260709 13:13:36.816926 32120 rpcz_store.cc:276] 0709 13:13:35.149863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:35.149975 (+   112us) service_pool.cc:224] Handling call
0709 13:13:36.324148 (+1174173us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:36.378095 (+ 53947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:36.816274 (+438179us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54002c88d0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff08ad 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:36.816412 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2699451136}
I20260709 13:13:36.777460  1924 consensus_queue.cc:237] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:36.829087 32089 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:36.837044 32265 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bdc1594189c43f49251261c5d073447"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:13:36.837882 32265 raft_consensus.cc:606] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:36.851320 32190 raft_consensus.cc:1275] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:13:36.852752 32190 pending_rounds.cc:85] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 2
I20260709 13:13:36.853067 32190 pending_rounds.cc:107] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:13:36.853356 32190 raft_consensus.cc:2889] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:36.868937  2021 log.cc:927] Time spent T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:13:36.968812 32116 raft_consensus.cc:1275] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:36.971264 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:36.971504 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:36.973222 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:36.973917 32115 raft_consensus.cc:1275] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:36.977753 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:36.980508 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 97986.4us
W20260709 13:13:36.982332 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 153357us
I20260709 13:13:36.981782 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:36.983275 32089 leader_election.cc:400] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8.
I20260709 13:13:36.983559 32089 leader_election.cc:403] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:36.867002  1682 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:36.985512 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:36.988274 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:36.988906 32121 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:36.991438 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:36.994410 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:36.996886 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:36.999722 32120 raft_consensus.cc:1275] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:37.002910 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:37.003835 32196 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:37.004405 32122 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:37.017079 32121 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:36.992219  1820 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.042153 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:37.044495 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 345035us
I20260709 13:13:37.073627 32196 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:37.077701 32165 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:37.079937 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:37.080358 32165 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:37.083302 32121 raft_consensus.cc:1275] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:37.042279  1950 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:13:37.085906 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 102724us
I20260709 13:13:37.041821  1820 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:37.090667 32089 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:37.093722 32198 raft_consensus.cc:1275] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:37.093978 32119 raft_consensus.cc:1275] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:37.113085 32089 leader_election.cc:400] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6.
I20260709 13:13:37.142266 32089 leader_election.cc:400] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 3 pre-election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 3. Current term is 4.
I20260709 13:13:37.143568 32089 leader_election.cc:400] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6.
I20260709 13:13:37.144018 32089 leader_election.cc:403] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:13:37.173442 32198 raft_consensus.cc:3055] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:37.175031 32198 raft_consensus.cc:740] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:37.093042  1662 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:37.095450  1656 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.100905  2010 raft_consensus.cc:2749] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:37.186794 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:37.187542 32121 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
W20260709 13:13:37.194023 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 50625.5us
I20260709 13:13:37.195827 32089 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:37.173380  1820 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:37.200250 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:37.202755 32089 leader_election.cc:400] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6.
I20260709 13:13:37.203438 32272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 1293) took 1387 ms. Trace:
I20260709 13:13:37.205160 32089 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:37.208792 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:13:37.192293  1974 log.cc:927] Time spent T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:13:37.212280 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:37.174396  1676 consensus_queue.cc:1048] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:13:37.216619 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:37.217928 32089 leader_election.cc:400] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 6. Current term is 7.
I20260709 13:13:37.218040 32124 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:13:37.204608 32272 rpcz_store.cc:276] 0709 13:13:35.803263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:35.818193 (+ 14930us) service_pool.cc:224] Handling call
0709 13:13:35.818529 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:36.002949 (+184420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:36.003013 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:36.075682 (+ 72669us) log.cc:844] Serialized 26 byte log entry
0709 13:13:36.261599 (+185917us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:36.261626 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:37.184912 (+923286us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b540014b754. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:37.184968 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:37.185015 (+    47us) raft_consensus.cc:1685] finished
0709 13:13:37.185028 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:37.190471 (+  5443us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6370,"raft.queue_time_us":12404,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":17803,"spinlock_wait_cycles":348486400,"thread_start_us":151004,"threads_started":1,"wal-append.queue_time_us":205779}
I20260709 13:13:37.206019 32198 consensus_queue.cc:260] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:37.223308 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:37.223625 32271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:13:37.224010 32124 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:37.207324  2009 raft_consensus.cc:2804] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:37.191288  2039 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6.
I20260709 13:13:37.207604  2029 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:37.232115 32198 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:37.189922  1656 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:37.214180  1990 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:13:37.237164  2022 log.cc:927] Time spent T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:13:37.221913  2010 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:37.250275 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:37.231403  2035 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:37.257112  2035 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:37.258625  2029 raft_consensus.cc:697] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:37.260026  2029 consensus_queue.cc:237] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:37.269022  2024 log.cc:927] Time spent T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 13:13:37.231539  2009 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.239598  1682 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:37.282079 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 201762us
I20260709 13:13:37.278522  2009 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:37.303228 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:37.277385  1990 raft_consensus.cc:697] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
W20260709 13:13:37.288929  2026 log.cc:927] Time spent T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:13:37.314363 32121 raft_consensus.cc:1240] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 8. Current term is 9. Ops: []
W20260709 13:13:37.297814  1722 consensus_meta.cc:287] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.611s	user 0.004s	sys 0.008s
I20260709 13:13:37.315863 32165 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:37.316190 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:37.321565 32118 raft_consensus.cc:1240] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:37.289407  1682 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:37.326450  2038 log.cc:927] Time spent T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:13:37.327368  1682 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:37.324101  1722 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:37.335790 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:37.344928 32165 leader_election.cc:400] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 3. Current term is 4.
I20260709 13:13:37.347739 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:37.349189 32190 raft_consensus.cc:1275] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:37.350335 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:37.350620  2019 log.cc:927] Time spent T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 13:13:37.347777 32198 raft_consensus.cc:1275] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:13:37.352314 32198 pending_rounds.cc:85] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 3
I20260709 13:13:37.334460  1722 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:37.357136 32198 pending_rounds.cc:107] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:13:37.356114 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:37.357455 32198 raft_consensus.cc:2889] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:37.358357 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:37.360910 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:37.361685 32118 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:37.359501 32165 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:37.366173 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:37.367303 32118 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:37.368760 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:37.430891 32165 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:37.372787  2050 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:37.461810 32165 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:37.467933 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:37.372989  1992 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:37.472507 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:37.369442  2036 consensus_queue.cc:1059] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.170s
W20260709 13:13:37.500186 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 63736.3us
I20260709 13:13:37.501094 32165 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:37.482816  1960 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:37.502044  1960 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:37.472745  2027 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:37.503048  2027 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:37.506244 32271 raft_consensus.cc:606] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:37.462220  1656 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:37.509776 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 80991.7us
I20260709 13:13:37.370270  1990 consensus_queue.cc:237] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:37.481112  1820 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:37.500486  2031 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:37.514446  1960 leader_election.cc:290] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:37.520113 32165 leader_election.cc:400] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 4. Current term is 5.
I20260709 13:13:37.520464 32165 leader_election.cc:403] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:37.520723 32194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1518) took 1187 ms. Trace:
I20260709 13:13:37.521045  2031 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 4. Current term is 5.
I20260709 13:13:37.521144 32194 rpcz_store.cc:276] 0709 13:13:36.333405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.615368 (+281963us) service_pool.cc:224] Handling call
0709 13:13:36.751054 (+135686us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:36.751244 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:36.751271 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:36.751312 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:36.751345 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:36.751400 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:37.520501 (+769101us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54002a7e50. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff08ad 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:37.520652 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":308463872}
I20260709 13:13:37.521770 32165 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:37.523670  1702 raft_consensus.cc:3055] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:37.524101  1702 raft_consensus.cc:740] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:37.524807 32165 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:37.524940  1702 consensus_queue.cc:260] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:37.526587  1702 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:37.526688 32165 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:37.527626  2045 consensus_queue.cc:1059] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:37.527904 32165 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:37.524768  2036 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:37.528492  2028 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:37.528972  2036 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:37.529290 32165 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:37.530429 32165 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:37.531562 32165 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:37.532660 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:37.533006  2037 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:37.533592 32165 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:13:37.533953  2042 log.cc:927] Time spent T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:13:37.534061  2037 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.534606  2037 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:37.536851  2036 consensus_queue.cc:1059] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:37.521799  2031 consensus_queue.cc:1059] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:13:37.539132  2027 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:37.539783  2027 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:37.540129  2027 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.540450  2027 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:37.515331  1992 raft_consensus.cc:3055] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:37.544253  1992 raft_consensus.cc:740] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:37.533625  1662 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:37.545229  1662 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:37.545126  1992 consensus_queue.cc:260] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:37.546536  1992 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:37.545639  1662 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.548295  1662 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:37.528577  2045 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:13:37.545231  2052 log.cc:927] Time spent T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:13:37.514839  2050 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:37.516624  1820 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:37.553977  2045 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:37.567006  1840 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:37.567833  1662 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:37.568775   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:37.569023  2037 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:37.572669  1950 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8.
I20260709 13:13:37.575160 32269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:13:37.595325 32269 raft_consensus.cc:606] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:37.581193 32270 raft_consensus.cc:1240] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:13:37.597661  2037 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:37.597692 32270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 1322) took 1028 ms. Trace:
I20260709 13:13:37.599596 32270 rpcz_store.cc:276] 0709 13:13:36.568975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.984345 (+415370us) service_pool.cc:224] Handling call
0709 13:13:37.580817 (+596472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:37.596625 (+ 15808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:37.597431 (+   806us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b54002fcbd0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff08ad 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:37.597631 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1368970496}
W20260709 13:13:37.600831  2051 log.cc:927] Time spent T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.092s	user 0.002s	sys 0.000s
I20260709 13:13:37.585920  2045 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:37.602085   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:37.602902 32273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50584 (request call id 88) took 1072 ms. Trace:
I20260709 13:13:37.603298 32273 rpcz_store.cc:276] 0709 13:13:36.530998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.531428 (+   430us) service_pool.cc:224] Handling call
0709 13:13:36.531723 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:36.699414 (+167691us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:36.699460 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:36.699517 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:36.699573 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:37.602696 (+903123us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b5400186fd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:37.602741 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:37.602850 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":385081728}
I20260709 13:13:37.602164 32191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1540) took 1041 ms. Trace:
I20260709 13:13:37.600749  1820 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:37.606019 32191 rpcz_store.cc:276] 0709 13:13:36.560338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:37.189718 (+629380us) service_pool.cc:224] Handling call
0709 13:13:37.211106 (+ 21388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:37.231634 (+ 20528us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:37.231672 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:37.238964 (+  7292us) log.cc:844] Serialized 26 byte log entry
0709 13:13:37.317334 (+ 78370us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:37.317377 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:37.317439 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:37.600274 (+282835us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:13:37.601877 (+  1603us) raft_consensus.cc:1685] finished
0709 13:13:37.601898 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:37.602105 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19825,"raft.queue_time_us":21461,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":10541,"spinlock_wait_cycles":4011264,"thread_start_us":77976,"threads_started":1,"wal-append.queue_time_us":222128}
I20260709 13:13:37.581977 32264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36080 (request call id 1122) took 1038 ms. Trace:
I20260709 13:13:37.608474 32264 rpcz_store.cc:276] 0709 13:13:36.544053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.544208 (+   155us) service_pool.cc:224] Handling call
0709 13:13:37.555915 (+1011707us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b54002fcbd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:37.581884 (+ 25969us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":602337024}
I20260709 13:13:37.625617 32273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d001b18973b4cbf86649781d9445577"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:13:37.626456 32273 raft_consensus.cc:606] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:37.551261  2009 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:13:37.635500 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:37.631310 32238 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:37.636253 32191 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:37.598395  1662 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:37.638652 32238 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:13:37.644742 32070 auto_rebalancer.cc:629] Failed to schedule move for tablet 314924e72a7f4efa9cbae136ba7cd259: Illegal state: Replica 6b3ed521ce8947db80c4b4828b355c06 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:37.648803  1726 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:37.649344  1726 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.649710  1726 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:37.650454  2045 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:37.653129  2045 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:37.654703 32264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:13:37.664480 32265 raft_consensus.cc:1275] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:37.665165 32265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 1320) took 1097 ms. Trace:
I20260709 13:13:37.665529 32265 rpcz_store.cc:276] 0709 13:13:36.568200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.979371 (+411171us) service_pool.cc:224] Handling call
0709 13:13:37.663929 (+684558us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b5800187898. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59becce9c 00007fb59becca5b 00007fb5a4de5c09 00007fb5a3f3fee0 00007fb5a40090ab 00007fb5a4009131 00007fb5a3fcafc0 00007fb5a3fb5929 00007fb5a3fb53d2 00007fb59d52cbd4
0709 13:13:37.664142 (+   213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:37.664897 (+   755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:37.665101 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6746240}
I20260709 13:13:37.669433  2035 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:37.642596 32238 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:37.672345 32121 raft_consensus.cc:2393] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 7: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:37.673439  2009 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:37.673874  1764 raft_consensus.cc:2804] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:37.634212  1748 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:37.674324  1764 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:37.674772  1764 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:37.674475  1748 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:37.641115  1927 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:37.676553 32197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1538) took 1130 ms. Trace:
I20260709 13:13:37.676993 32197 rpcz_store.cc:276] 0709 13:13:36.546393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:37.084721 (+538328us) service_pool.cc:224] Handling call
0709 13:13:37.096146 (+ 11425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:37.289253 (+193107us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:37.289284 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:37.298327 (+  9043us) log.cc:844] Serialized 26 byte log entry
0709 13:13:37.373429 (+ 75102us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:37.373489 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:37.676137 (+302648us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b5400113854. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:37.676183 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:37.676225 (+    42us) raft_consensus.cc:1685] finished
0709 13:13:37.676238 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:37.676484 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24800,"raft.queue_time_us":8319,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":22018,"spinlock_wait_cycles":424698112,"thread_start_us":47540,"threads_started":1,"wal-append.queue_time_us":212073}
I20260709 13:13:37.682261  1748 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:37.686234 32264 raft_consensus.cc:606] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:37.686883 32264 raft_consensus.cc:614] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:13:37.686653 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 43691us
I20260709 13:13:37.687484 32191 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:37.688117 32238 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:37.689417 32238 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:13:37.685702 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 150864us
I20260709 13:13:37.692847 32165 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:37.694278  1972 consensus_queue.cc:1048] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:37.694641 32238 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:37.695464  1998 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:37.695811 32089 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:37.697986  2009 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:37.698117  1661 consensus_queue.cc:1048] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:37.691488  1927 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:37.699211  1726 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:37.703859  1932 consensus_queue.cc:1048] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:37.705379  1726 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:37.708597  2030 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:13:37.710486 32265 raft_consensus.cc:1240] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:37.711663 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:37.714782 32273 raft_consensus.cc:1275] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:13:37.719126 32089 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:37.720335  2032 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:37.721398 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:37.697851  1722 consensus_queue.cc:1048] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:13:37.722039 32119 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
I20260709 13:13:37.726332 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:37.691689  1748 raft_consensus.cc:2804] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:37.732815 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:37.728616 32119 raft_consensus.cc:1240] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:37.734547 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:37.729264 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:37.729327 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:37.730368 32271 raft_consensus.cc:1240] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:37.731559 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:37.733698 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:37.741792 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:37.743203 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:37.745158 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:37.749014 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:37.749524 32267 raft_consensus.cc:1240] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:13:37.751184 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:37.752292 32089 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:37.691015  2027 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:37.755506 32193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1531) took 1222 ms. Trace:
I20260709 13:13:37.755707 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:37.756920 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:37.757758 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:37.732414  1748 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.772929 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:37.737999  1820 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:37.759162 32193 rpcz_store.cc:276] 0709 13:13:36.533093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.765607 (+232514us) service_pool.cc:224] Handling call
0709 13:13:36.771632 (+  6025us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:36.789266 (+ 17634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:37.755240 (+965974us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b54003a3c54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:37.755442 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31356800}
I20260709 13:13:37.820665 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:37.741513  1961 raft_consensus.cc:2749] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:37.823377 32192 raft_consensus.cc:1240] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:13:37.824666 32195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1535) took 1282 ms. Trace:
I20260709 13:13:37.825058 32195 rpcz_store.cc:276] 0709 13:13:36.542028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.980914 (+438886us) service_pool.cc:224] Handling call
0709 13:13:36.994564 (+ 13650us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:37.183773 (+189209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:37.183809 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:37.184286 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:13:37.683509 (+499223us) spinlock_profiling.cc:243] Waited 3.42 ms on lock 0x7b1800447340. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bee6e07 00007fb5a4d41ab9 00007fb59bf0369b 00007fb59bf0193f 00007fb59bf03c02 00007fb59eb8b20b 00007fb59eb90d23 00007fb59eb910d1 00007fb59efaca0f
0709 13:13:37.719378 (+ 35869us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:37.719419 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:37.719491 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:37.821662 (+102171us) raft_consensus.cc:1685] finished
0709 13:13:37.821682 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:37.824603 (+  2921us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10643,"raft.queue_time_us":195535,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":12726,"spinlock_wait_cycles":7874304,"thread_start_us":224342,"threads_started":2,"wal-append.queue_time_us":514447}
I20260709 13:13:37.827451 32117 raft_consensus.cc:3055] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:37.827930 32117 raft_consensus.cc:740] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:37.788869 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:13:37.803076  2033 log.cc:927] Time spent T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.736s	user 0.002s	sys 0.000s
I20260709 13:13:37.771178  1990 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.815442 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:37.777648 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:37.816344 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:37.815752 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:37.787195 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:37.829084 32117 consensus_queue.cc:260] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:37.756789  1960 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:37.816434 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 119511us
I20260709 13:13:37.774931  1748 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:37.750166  1927 raft_consensus.cc:697] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:37.774152 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:37.860823 32122 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:13:37.858146 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:37.816793 32197 raft_consensus.cc:2410] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:13:37.817850 32196 raft_consensus.cc:1240] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 4. Current term is 5. Ops: []
W20260709 13:13:37.789637   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 88122.6us
I20260709 13:13:37.820611  1998 raft_consensus.cc:697] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:37.821282 32265 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:37.822670 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:37.900838  1992 consensus_queue.cc:1059] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:13:37.903532 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:37.903853  1819 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.904094 32193 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:37.904358  1819 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:37.905618  2027 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:37.907323 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:37.909046 32195 raft_consensus.cc:1275] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:13:37.759009  1682 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:13:37.830610 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:37.845301 32117 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:37.841884  1961 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:37.846551 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:13:37.927292 32193 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:13:37.847275 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:37.854590 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:37.928740 32265 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:37.930739 32190 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:37.862144 32267 raft_consensus.cc:2393] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 6: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:37.862910 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:37.865027 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:37.877607 32165 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:37.931972 32197 raft_consensus.cc:2376] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9. Re-sending same reply.
I20260709 13:13:37.920137 32122 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:13:37.931953 32196 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
W20260709 13:13:37.932945 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 55427.3us
I20260709 13:13:37.934698 32165 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:37.820978 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 63722.9us
I20260709 13:13:37.854418  1990 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:37.957551 32089 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:37.956708   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 185659us
I20260709 13:13:37.959506 32165 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:37.842154  1820 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:37.937965  1656 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:37.964145 32117 raft_consensus.cc:1275] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:13:37.976562 32117 pending_rounds.cc:85] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d: Aborting all ops after (but not including) 3
I20260709 13:13:37.976960 32117 pending_rounds.cc:107] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:13:37.977419 32117 raft_consensus.cc:2889] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:37.973812 32165 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:37.979378 32165 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:37.982899 32192 raft_consensus.cc:1240] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:13:37.986253 32117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1576) took 1018 ms. Trace:
I20260709 13:13:38.004443 32117 rpcz_store.cc:276] 0709 13:13:36.967420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.967581 (+   161us) service_pool.cc:224] Handling call
0709 13:13:36.986824 (+ 19243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:37.827330 (+840506us) spinlock_profiling.cc:243] Waited 6.41 ms on lock 0x7b54000bbba0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59ef68dc0 00007fb59eff31c0 00007fb59eff4231 00007fb59eff0d8f 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c
0709 13:13:37.985911 (+158581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:37.986184 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14737280}
W20260709 13:13:38.007483 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 64836us
I20260709 13:13:37.940757  1840 consensus_queue.cc:1048] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:13:37.938155  1961 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:38.029488 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:38.030872 32122 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:37.944900  1855 consensus_queue.cc:1048] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:13:38.034243 32269 raft_consensus.cc:1240] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 4. Current term is 5. Ops: []
W20260709 13:13:38.021629  1959 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:13:37.981650  1992 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:37.981443  2036 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:38.032742 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:37.987720  1983 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:38.015009  2027 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:37.959720  1960 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 13:13:38.027405  1735 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:37.959892  2041 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
W20260709 13:13:38.061980 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 104507us
I20260709 13:13:37.973280  1927 consensus_queue.cc:237] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:38.042623  1983 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:38.067283 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 58837.5us
I20260709 13:13:38.068048 32238 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:38.072103  1992 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.073658  1992 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:38.074605 32117 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:38.076103  1992 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:38.083195 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:38.083913 32197 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:38.069481  1983 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:38.078723 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:38.085417 32117 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
I20260709 13:13:38.086020  1702 raft_consensus.cc:3055] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:38.086404  1702 raft_consensus.cc:740] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:38.079172 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:38.102442 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:38.103386  1927 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:38.103540 32190 raft_consensus.cc:2393] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 6: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:38.103924  1927 raft_consensus.cc:697] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:38.127069 32122 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:13:38.156236 32192 raft_consensus.cc:1275] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:13:38.156673 32192 pending_rounds.cc:85] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 3
I20260709 13:13:38.156912 32192 pending_rounds.cc:107] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:13:38.157160 32192 raft_consensus.cc:2889] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:38.029017  1998 consensus_queue.cc:237] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:38.159653 32269 raft_consensus.cc:1275] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:38.158401 32122 raft_consensus.cc:1240] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:13:38.161404 32197 raft_consensus.cc:1240] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:13:38.166091 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:38.166803 32117 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
W20260709 13:13:38.241381 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 173858us
I20260709 13:13:38.254541 32122 raft_consensus.cc:1275] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:38.258208 32089 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:38.265667  1741 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:38.270172  2072 log.cc:927] Time spent T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
W20260709 13:13:38.270516  2076 log.cc:927] Time spent T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 13:13:38.165647  1855 consensus_queue.cc:1048] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.091s
I20260709 13:13:38.290581 32089 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:38.296731  2041 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:38.297878 32089 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:38.297966  2041 consensus_queue.cc:1048] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:38.298863 32089 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:38.299682  2041 raft_consensus.cc:2804] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:38.299788 32089 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:38.300241  2041 raft_consensus.cc:697] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:38.300761  1682 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:38.302933 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:38.305902 32194 raft_consensus.cc:2468] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:38.306895 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:38.162976  1702 consensus_queue.cc:260] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:38.310319 32194 raft_consensus.cc:1240] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:13:38.310667 32165 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:38.310710 32268 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:38.261763  1656 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:38.262276   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 58476.5us
I20260709 13:13:38.209564  1927 consensus_queue.cc:237] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:38.272068  1960 consensus_queue.cc:1059] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:13:38.406347 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:38.334770  1764 consensus_meta.cc:287] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.660s	user 0.008s	sys 0.004s
I20260709 13:13:38.313463  1682 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.308477  1990 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:38.313936  1741 consensus_queue.cc:1059] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.096s
I20260709 13:13:38.407128  1702 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:38.413197  1682 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:38.445144  2074 log.cc:927] Time spent T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:13:38.340672  1656 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:38.462721 32123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1574) took 1497 ms. Trace:
I20260709 13:13:38.425987  1820 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:38.463387 32123 rpcz_store.cc:276] 0709 13:13:36.965814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.965947 (+   133us) service_pool.cc:224] Handling call
0709 13:13:36.966328 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:36.994509 (+ 28181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:36.994562 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:37.753419 (+758857us) spinlock_profiling.cc:243] Waited 4.58 ms on lock 0x7b2c000278a8. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59d8eaa11 00007fb59d8fa372 00007fb59f02ca01 00007fb59eff143a 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2
0709 13:13:37.773699 (+ 20280us) log.cc:844] Serialized 26 byte log entry
0709 13:13:38.005562 (+231863us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:38.005625 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:38.005725 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:38.448404 (+442679us) raft_consensus.cc:1685] finished
0709 13:13:38.448432 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:38.462637 (+ 14205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27679,"raft.queue_time_us":35824,"spinlock_wait_cycles":29376128,"thread_start_us":176480,"threads_started":1,"wal-append.queue_time_us":277907}
W20260709 13:13:38.439939  2075 log.cc:927] Time spent T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.360s	user 0.001s	sys 0.000s
I20260709 13:13:38.430738  2090 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:38.420234  1764 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:38.470170  1950 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
W20260709 13:13:38.484500  2091 log.cc:927] Time spent T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
W20260709 13:13:38.485882  2080 log.cc:927] Time spent T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 13:13:38.492300 32123 raft_consensus.cc:1275] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:38.499439 32121 raft_consensus.cc:1275] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:38.508289 32118 raft_consensus.cc:1240] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: []
W20260709 13:13:38.509388 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:38.510406 32239 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:38.471308  1960 raft_consensus.cc:3055] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:38.488544  2090 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.487340  1741 raft_consensus.cc:3055] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:38.474841  1820 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:38.515498 32239 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:38.506685  2081 log.cc:927] Time spent T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.342s	user 0.000s	sys 0.001s
I20260709 13:13:38.523416 32239 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:38.513506  1960 raft_consensus.cc:740] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:38.517354  1840 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:38.515048  2090 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:38.516019  1741 raft_consensus.cc:740] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:38.525002  2082 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:38.517617  1722 consensus_queue.cc:1048] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:13:38.525312  1726 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:38.517884 32089 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:38.545133 32239 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:38.520388  1846 consensus_queue.cc:1048] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:13:38.534411  2079 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.536192  1961 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:38.504696  2041 consensus_queue.cc:237] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
W20260709 13:13:38.610713 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 93170.4us
I20260709 13:13:38.520892  1820 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:38.525503  2089 consensus_queue.cc:1048] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
W20260709 13:13:38.613256 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 68264.3us
I20260709 13:13:38.615509  2107 raft_consensus.cc:2804] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:13:38.588960  2094 log.cc:927] Time spent T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:13:38.616997  2079 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:38.641819  2079 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:38.617939  1855 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:38.642503  1855 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.616288  1741 consensus_queue.cc:260] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:38.625560  1764 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:38.639596  2107 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.645238 32239 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:38.611724  1748 consensus_meta.cc:287] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.709s	user 0.010s	sys 0.002s
I20260709 13:13:38.650906  2107 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:38.651005 32239 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:38.655326  1741 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:38.651865  2087 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:38.657002  2087 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:38.658273  2087 consensus_queue.cc:1048] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:13:38.642745  2040 log.cc:927] Time spent T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 1.273s	user 0.011s	sys 0.000s
I20260709 13:13:38.645888  1855 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:38.669162  1656 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:38.670054  1722 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:38.670563  2028 raft_consensus.cc:3055] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:38.588902  2099 consensus_queue.cc:1048] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.125s
I20260709 13:13:38.672639  2107 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:38.632552  1983 consensus_meta.cc:287] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.547s	user 0.007s	sys 0.001s
I20260709 13:13:38.693128  1780 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:38.697872 32238 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:38.674636  1820 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:38.698850  1722 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:38.688797  2028 raft_consensus.cc:740] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
W20260709 13:13:38.710637  2034 log.cc:927] Time spent T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 1.359s	user 0.012s	sys 0.012s
I20260709 13:13:38.710986  2028 consensus_queue.cc:260] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:38.712299  2028 raft_consensus.cc:3060] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:38.713083  2107 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:38.684406  2079 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:13:38.720844 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 226554us
I20260709 13:13:38.658797  2100 consensus_queue.cc:1048] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:13:38.715759  2079 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:38.733059 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 421649us
I20260709 13:13:38.661204  1748 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:38.730171 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:38.737140 32090 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:38.736634 32121 raft_consensus.cc:1275] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:38.732414 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:38.739006 32118 raft_consensus.cc:1240] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:38.745244 32123 raft_consensus.cc:2393] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 6: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:38.727458  1379 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:38.754421 32120 raft_consensus.cc:1275] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:38.756193 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:38.705862  1960 consensus_queue.cc:260] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:38.756017  2082 consensus_queue.cc:1059] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:13:38.734457  1959 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.709092  1983 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:38.762892 32090 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:38.718117  1780 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:38.758708  1379 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:38.758713  2087 consensus_queue.cc:1059] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:13:38.765486  1764 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.782867  1764 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:38.759723  2110 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.767765  2041 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.785245  1748 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:38.772086  1379 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:38.787448 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 476834us
I20260709 13:13:38.768841 32193 raft_consensus.cc:1240] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:38.789693  1992 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:38.783946  2110 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:38.776206 32090 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:38.792755  1990 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:38.793341  1990 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:38.793844 32090 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:38.794171  2110 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:38.794670  2110 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:38.759864  1960 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:38.795255  2110 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:38.758035 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:38.803746 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:38.842723 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:13:38.822546 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:38.844698 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:13:38.768992  2063 log.cc:927] Time spent T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.989s	user 0.001s	sys 0.006s
I20260709 13:13:38.761242  2079 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:38.869685 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:38.776875  1820 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:38.872562 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 67367.7us
I20260709 13:13:38.782289  1722 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:38.941725 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 132484us
I20260709 13:13:38.740911  2109 consensus_queue.cc:1048] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.105s
I20260709 13:13:38.938064 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:38.758652  1972 consensus_queue.cc:1048] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.116s
I20260709 13:13:38.777529  1983 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:38.773787  2087 raft_consensus.cc:3055] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:38.771272  1780 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:38.760246  1961 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:38.795318  1990 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:38.948724 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 140298us
I20260709 13:13:38.756394  2093 consensus_queue.cc:1048] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.122s
I20260709 13:13:38.833554  1855 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:38.973762 32165 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:38.978837  1656 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:38.980737  2044 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:38.968266  2087 raft_consensus.cc:740] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:38.983036  2090 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:38.809214  1682 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:38.785251  2041 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:38.861111  1702 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:38.991098 32165 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:39.007462 32165 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:13:38.994367 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:38.965934  2030 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:39.020628 32165 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:38.942991  2114 consensus_queue.cc:1059] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:13:38.798589  1959 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.025985 32165 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:39.030622 32116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1589) took 2040 ms. Trace:
I20260709 13:13:38.996007  2029 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:39.031231 32116 rpcz_store.cc:276] 0709 13:13:36.990095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:37.002420 (+ 12325us) service_pool.cc:224] Handling call
0709 13:13:37.002727 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:37.083996 (+ 81269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:37.084025 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:37.574804 (+490779us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b2c000278a8. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59d8eaa11 00007fb59d8fa372 00007fb59f02ca01 00007fb59eff143a 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2
0709 13:13:37.575268 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:13:37.689663 (+114395us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:37.689723 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:37.689821 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:38.736374 (+1046553us) spinlock_profiling.cc:243] Waited 9.22 ms on lock 0x7b2400196718. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59bd8a9c4 00007fb59bd88acb 00007fb59bf43dc9 00007fb59bf43a55 00007fb59bf4309d 00007fb59eb7510e 00007fb59eb8c88c 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221
0709 13:13:39.030203 (+293829us) raft_consensus.cc:1685] finished
0709 13:13:39.030236 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:39.030432 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":36098,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":33956,"spinlock_wait_cycles":28051072,"thread_start_us":187761,"threads_started":2,"wal-append.queue_time_us":120978}
I20260709 13:13:39.035881 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:39.037674 32116 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:13:39.039238 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:39.040330 32116 raft_consensus.cc:2393] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 4: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:39.041635 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:39.042502 32119 raft_consensus.cc:2410] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:39.043530 32119 raft_consensus.cc:1275] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:39.002962  2036 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:39.007552  2100 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:39.028647  1990 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:39.028339  1983 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:39.057104 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:39.029945  2032 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:39.019812  1702 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:39.067188 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 124703us
I20260709 13:13:39.041803  2029 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:39.045240  2082 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:39.027333  1992 consensus_queue.cc:1048] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:13:39.051764  1840 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:39.092286 32090 leader_election.cc:304] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:39.146763 32121 raft_consensus.cc:1240] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:39.149307 32121 raft_consensus.cc:1240] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:13:39.152879 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:39.153165 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 61015.4us
I20260709 13:13:39.154217 32090 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:39.034243  2077 consensus_queue.cc:1059] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:13:39.065979  1983 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:39.005437  2044 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:39.150362  2112 log.cc:927] Time spent T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:13:39.078760  2029 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:39.081489  1656 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:39.067109  2107 consensus_queue.cc:1059] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 13:13:39.155791  1741 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:39.054904  2036 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.186843  1983 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:39.150539  2114 consensus_queue.cc:1048] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:13:39.064479  2100 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:39.237709 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:13:39.241350 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 215492us
I20260709 13:13:39.157816  1840 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.242689 32165 leader_election.cc:400] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 7. Current term is 8.
I20260709 13:13:39.243126 32165 leader_election.cc:403] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:39.244975 32165 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:39.153743  2010 consensus_queue.cc:1059] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:13:39.058358  2087 consensus_queue.cc:260] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.263804 32165 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:39.238472  2030 raft_consensus.cc:697] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 6 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:39.076116  2032 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:39.267269 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:39.247262  1990 raft_consensus.cc:697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:39.270452  1682 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:39.278716  2121 log.cc:927] Time spent T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:13:39.277562  2100 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:13:39.322525  1379 consensus_meta.cc:287] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.000s
I20260709 13:13:39.322743   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:39.323004  1379 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.324316 32197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 1275) took 1021 ms. Trace:
I20260709 13:13:39.324714 32197 rpcz_store.cc:276] 0709 13:13:38.303199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:38.304072 (+   873us) service_pool.cc:224] Handling call
0709 13:13:38.304406 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:38.786060 (+481654us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:38.786088 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:38.786571 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:13:38.966390 (+179819us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:38.966432 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:38.966507 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:39.324101 (+357594us) raft_consensus.cc:1685] finished
0709 13:13:39.324122 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:39.324243 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":481218,"raft.queue_time_us":484724,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"thread_start_us":179383,"threads_started":1,"wal-append.queue_time_us":240719}
I20260709 13:13:39.326499 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:39.326762  2079 raft_consensus.cc:3055] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:39.327226  2079 raft_consensus.cc:740] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:39.327529 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:39.327739  1983 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.328159 32197 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:13:39.276690  2113 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:39.279328  2127 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:39.379038  2127 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.381531  2127 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:39.381960 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:39.382566 32191 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:39.176301  2082 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.266785  1656 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:39.275494  2087 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:39.265210  1819 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:39.294804 32165 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:39.298192  1990 consensus_queue.cc:237] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.299010  1840 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:39.299611  2125 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:39.300273  2136 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 7. Current term is 8.
I20260709 13:13:39.302492 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:39.453692 32194 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:13:39.455953 32194 raft_consensus.cc:1275] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:39.303365  1959 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:39.304059  2134 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:39.303386  2123 log.cc:927] Time spent T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:13:39.308948  2067 raft_consensus.cc:993] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:13:39.311101  1855 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:39.312572  2044 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:39.277837  2119 log.cc:927] Time spent T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:13:39.330017 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:39.333658 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:39.333724 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:39.329684  1992 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:39.335587 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:39.335707 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:39.337575  2118 raft_consensus.cc:993] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:13:39.340960  2133 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:39.341763 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:39.341872 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:39.343101  1702 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:39.331244  2041 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:39.343562  2036 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:39.345284 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:39.347199 32124 raft_consensus.cc:1240] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:13:39.349439  1997 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:39.350303 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:39.351488 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:39.328200  2079 consensus_queue.cc:260] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:39.330489  2028 consensus_meta.cc:287] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.618s	user 0.002s	sys 0.009s
I20260709 13:13:39.352802  2029 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.354516  1379 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:39.363020  1983 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:39.363161 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:39.364632 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:39.512480 32118 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:39.355803   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:39.356274  2132 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:39.371820 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:39.515548 32193 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:39.516458 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:13:39.494357  1927 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.004s	sys 0.024s
W20260709 13:13:39.519935  1927 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.004s	sys 0.025s
I20260709 13:13:39.372399  2110 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:39.520565  2104 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.000s	sys 0.011s
W20260709 13:13:39.520977  2104 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.000s	sys 0.011s
I20260709 13:13:39.375167  2135 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.522104 32191 raft_consensus.cc:2468] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:39.521695  2135 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.523067 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:39.376956 32115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 1166) took 1632 ms. Trace:
I20260709 13:13:39.525715 32115 rpcz_store.cc:276] 0709 13:13:37.744281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:37.744421 (+   140us) service_pool.cc:224] Handling call
0709 13:13:37.744746 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:37.823733 (+ 78987us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:13:37.927851 (+104118us) log.cc:844] Serialized 14 byte log entry
0709 13:13:38.156073 (+228222us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:38.156125 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:38.156170 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:39.376746 (+1220576us) spinlock_profiling.cc:243] Waited 78.7 ms on lock 0x7b5400035cd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:39.376788 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:39.376903 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":241118,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":10157,"raft.queue_time_us":4419,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":36219,"spinlock_wait_cycles":181078912,"thread_start_us":331314,"threads_started":2,"wal-append.queue_time_us":552779,"wal-append.run_cpu_time_us":1076,"wal-append.run_wall_time_us":1003060}
W20260709 13:13:39.360646  1960 consensus_meta.cc:287] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.565s	user 0.009s	sys 0.001s
I20260709 13:13:39.387326 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:39.520629  2110 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.390177 32273 raft_consensus.cc:1240] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:39.391651 32270 raft_consensus.cc:1240] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:13:39.388630 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:39.441159 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 146529us
I20260709 13:13:39.446352 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:39.448287  2090 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:39.450174  2127 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:39.533766 32165 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:39.535393 32165 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:39.432101  1735 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:39.471081 32199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 1279) took 1164 ms. Trace:
I20260709 13:13:39.537693 32199 rpcz_store.cc:276] 0709 13:13:38.306289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:38.485258 (+178969us) service_pool.cc:224] Handling call
0709 13:13:38.485606 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:38.796784 (+311178us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:38.796814 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:38.797264 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:13:39.002376 (+205112us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:39.002436 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:39.002534 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:39.470822 (+468288us) raft_consensus.cc:1685] finished
0709 13:13:39.470848 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:39.471011 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":310770,"raft.queue_time_us":359963,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":7742,"thread_start_us":204791,"threads_started":1,"wal-append.queue_time_us":389785}
I20260709 13:13:39.539505 32117 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:39.471524  2067 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.540949  2067 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.464397  2134 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.547070  2134 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:39.472728 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:39.473133  2066 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:39.472941 32021 catalog_manager.cc:5697] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 2 to 4, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1), VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2), VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3), VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 6 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:39.474901 32198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 1260) took 1656 ms. Trace:
I20260709 13:13:39.464890  1959 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.548252  2066 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.548841  1959 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.550642  2066 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:39.550981  1959 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:39.472945  2089 raft_consensus.cc:1081] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:13:39.551496  2133 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:39.457412  1840 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.457448  2027 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:39.552735  2027 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.555603  2027 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:39.497567 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:39.484110 32090 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:39.507618 32190 raft_consensus.cc:2410] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:39.511288 32239 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:39.455330  1764 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:39.557216 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 73190us
I20260709 13:13:39.557446  1764 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:13:39.557621 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 46403.6us
I20260709 13:13:39.557878 32165 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:39.558301  2090 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:39.537014  1735 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:39.560847  2089 consensus_queue.cc:1048] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:39.552316  1840 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.565337  1840 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:39.566309  1840 consensus_queue.cc:1048] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:39.548357 32198 rpcz_store.cc:276] 0709 13:13:37.818816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:37.818935 (+   119us) service_pool.cc:224] Handling call
0709 13:13:37.819236 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:37.819581 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:37.819610 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:37.847590 (+ 27980us) log.cc:844] Serialized 26 byte log entry
0709 13:13:38.773510 (+925920us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b180023b0c0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bee6e07 00007fb5a4d41ab9 00007fb59bf0369b 00007fb59bf0193f 00007fb59bf03c02 00007fb59eb8b20b 00007fb59eb90d23 00007fb59eb910d1 00007fb59efaca0f
0709 13:13:38.958764 (+185254us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:38.994441 (+ 35677us) log.cc:844] Serialized 14 byte log entry
0709 13:13:38.994677 (+   236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:38.994778 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:39.474608 (+479830us) raft_consensus.cc:1685] finished
0709 13:13:39.474706 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:39.474838 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2428,"prepare.queue_time_us":19654,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":1097,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":23473,"spinlock_wait_cycles":8929664,"thread_start_us":184950,"threads_started":1,"wal-append.queue_time_us":1180484}
I20260709 13:13:39.481252  2118 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:39.540563 32199 raft_consensus.cc:1240] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:13:39.556273  2027 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:39.498718  2041 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:39.584352 32165 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:39.590178 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:39.512233  1961 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.601519 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:39.457855  2125 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.602206 32195 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:39.544368  2067 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:39.589833  2028 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:39.580801  2135 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:39.596156 32165 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:39.699036 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 103104us
I20260709 13:13:39.512408  1975 consensus_queue.cc:1048] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:13:39.604458 32238 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:39.584180  2118 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.637461  1972 consensus_queue.cc:1059] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:39.708438  1764 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:39.708518  1972 consensus_queue.cc:1243] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer fcfc3281929645969ecedbb0c0af759d log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:13:39.605176  1998 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:39.639698  2093 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:39.640317  1726 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:39.511991  2030 consensus_queue.cc:237] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.582922  2132 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.517633  1748 consensus_queue.cc:1059] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.084s
I20260709 13:13:39.651298 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:39.662777 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:39.662948  2029 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:39.583665  1379 consensus_queue.cc:1059] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 13:13:39.678701  2082 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:39.679488  2120 raft_consensus.cc:3055] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:39.483983  1997 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.598529  2066 consensus_queue.cc:1059] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 13:13:39.601696  2041 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.602917  2134 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:39.682827 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:39.751642 32192 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.024s	sys 0.063s
I20260709 13:13:39.605152  1961 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.610945  2032 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:39.684821  2142 consensus_queue.cc:1059] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:39.685909  1780 consensus_queue.cc:1059] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:13:39.688273 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:39.694027  1983 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:39.695293 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:39.577023  1959 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:39.700276 32194 raft_consensus.cc:1275] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:39.769387 32199 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:39.705480 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 101095us
I20260709 13:13:39.715286 32089 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:39.716962 32191 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:39.719079 32118 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:39.719326 32195 raft_consensus.cc:2410] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:13:39.721063  1998 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.779065  2132 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:39.779711  2132 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:39.779964  1998 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:39.703580  2027 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:39.707089  2136 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:39.745179 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:13:39.751986 32192 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.024s	sys 0.063s
I20260709 13:13:39.721829  2116 raft_consensus.cc:3055] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:39.718446  1855 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:39.723017  2135 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:13:39.789446 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:39.759292 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:39.723471  2028 raft_consensus.cc:697] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:39.770807 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:39.770990 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:39.740053  2120 raft_consensus.cc:740] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:39.746925  1702 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:39.771826  2142 raft_consensus.cc:3055] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:39.773190  2041 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:39.774562 32194 raft_consensus.cc:1240] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:13:39.751425  2044 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:39.774978  2029 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:13:39.775647 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 60487.9us
I20260709 13:13:39.776301  1997 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:39.776238  1961 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:39.777144  1780 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:39.777602  1960 raft_consensus.cc:3055] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:39.860800  1960 raft_consensus.cc:740] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:39.861637  1960 consensus_queue.cc:260] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.862825  1960 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:39.865181  2148 log.cc:927] Time spent T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:13:39.866050 32269 raft_consensus.cc:3055] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:39.866484 32269 raft_consensus.cc:740] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:39.867256 32269 consensus_queue.cc:260] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:13:39.868921 32121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1623) took 1128 ms. Trace:
I20260709 13:13:39.869333 32121 rpcz_store.cc:276] 0709 13:13:38.740286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.173133 (+432847us) service_pool.cc:224] Handling call
0709 13:13:39.173462 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:39.332666 (+159204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:39.332700 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:39.363757 (+ 31057us) log.cc:844] Serialized 26 byte log entry
0709 13:13:39.577982 (+214225us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:39.578020 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:39.578091 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:39.868678 (+290587us) raft_consensus.cc:1685] finished
0709 13:13:39.868702 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:39.868859 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75462,"raft.queue_time_us":66325,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":6075,"thread_start_us":340960,"threads_started":2,"wal-append.queue_time_us":354841}
I20260709 13:13:39.871150 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:39.877712 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:39.785943  1983 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.878926 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:39.879987 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:39.880436 32195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 1281) took 1076 ms. Trace:
I20260709 13:13:39.880873 32195 rpcz_store.cc:276] 0709 13:13:38.804331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.778760 (+974429us) service_pool.cc:224] Handling call
0709 13:13:39.779060 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:39.878973 (+ 99913us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:39.879003 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:39.879042 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:39.879079 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:39.880177 (+  1098us) spinlock_profiling.cc:243] Waited 99.7 ms on lock 0x7b54002a7454. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:39.880218 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:39.880362 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229267328}
I20260709 13:13:39.860443 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:39.835443  1822 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:39.882157 32124 raft_consensus.cc:2393] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 7: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:39.780664  2027 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:39.882951 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:39.883386 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:39.763442  1992 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.884094 32191 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:39.845896  2142 raft_consensus.cc:740] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:39.885078 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:39.884234  1992 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.887537  1992 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:39.725057  1726 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.888535  1922 raft_consensus.cc:3055] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:39.888950  1922 raft_consensus.cc:740] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:39.889510  1726 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:39.790827 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:39.889727  1922 consensus_queue.cc:260] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:39.835960 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 49918.7us
I20260709 13:13:39.891096 32264 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:13:39.891840 32238 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:39.725448  2147 consensus_queue.cc:1048] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:13:39.838897 32165 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:39.893256 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 54422.2us
I20260709 13:13:39.893558  2147 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:39.893935  2147 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:39.893960 32165 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:39.894447  2147 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:39.894719  2066 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:39.895141  2066 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:39.895251 32165 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:39.895547  2066 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:39.839699 32266 raft_consensus.cc:2393] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 7: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:39.896801  1990 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:39.897500  1990 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:39.897310  1932 consensus_queue.cc:1059] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:39.898458  1932 consensus_queue.cc:1048] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:39.841868  2036 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:39.900461  2036 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:39.901137  2157 log.cc:927] Time spent T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:13:39.902751  2036 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:39.857049  2029 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.907174  2029 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:39.756687 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:39.797369  1855 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.889525  2120 consensus_queue.cc:260] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.909252  1855 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:39.909948  2120 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:39.841392 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:39.911022 32116 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:39.911828 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:39.845054 32198 raft_consensus.cc:1240] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:39.842517 32199 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:13:39.890900  1922 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:39.913224 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:39.913815 32199 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:39.884260  2027 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:39.914624 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:39.882170 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:39.915442 32195 raft_consensus.cc:2468] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:39.915663 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:39.916074  2125 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:39.916380 32199 raft_consensus.cc:2393] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 4: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:39.785248  2134 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:39.785768  2031 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:39.785621  2116 raft_consensus.cc:740] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:39.786512  2032 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.780329  2132 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.858096  2044 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.852680  1950 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.858731  1735 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:39.880023  1983 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:39.882189  1822 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:39.885306  2142 consensus_queue.cc:260] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.890312 32273 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
I20260709 13:13:39.978245 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:39.722370  2093 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.851055  1702 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.916671  1656 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.916600 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:39.868451 32269 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:39.996065 32195 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:39.872278 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:39.996877 32121 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:13:39.997869 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:39.777011  1959 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.923806 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:39.924376 32264 raft_consensus.cc:1240] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:39.928220  1748 consensus_queue.cc:1048] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:13:40.002558 32195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 1288) took 1196 ms. Trace:
I20260709 13:13:39.924762 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:40.003970 32115 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:13:40.005018 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:40.005410 32117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56890 (request call id 1605) took 1278 ms. Trace:
I20260709 13:13:40.006002 32192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1564) took 1213 ms. Trace:
I20260709 13:13:40.005756 32117 rpcz_store.cc:276] 0709 13:13:38.727144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:38.730855 (+  3711us) service_pool.cc:224] Handling call
0709 13:13:40.005226 (+1274371us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b54000979d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:40.005328 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1581083008}
I20260709 13:13:40.007012 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:40.006439 32192 rpcz_store.cc:276] 0709 13:13:38.792730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:38.799190 (+  6460us) service_pool.cc:224] Handling call
0709 13:13:38.799473 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:38.875308 (+ 75835us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:38.875355 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:38.940471 (+ 65116us) log.cc:844] Serialized 26 byte log entry
0709 13:13:39.781149 (+840678us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:39.781196 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:39.781275 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:40.005788 (+224513us) raft_consensus.cc:1685] finished
0709 13:13:40.005807 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.005941 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75883,"raft.queue_time_us":137197,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":22862,"thread_start_us":788263,"threads_started":1,"wal-append.queue_time_us":868716}
I20260709 13:13:40.007622 32117 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:40.008432 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:40.008852  2116 consensus_queue.cc:260] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:40.009557 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:40.009963  2116 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:40.010236 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:40.003276 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:40.011471 32270 raft_consensus.cc:2393] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 5: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:39.836112 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:39.926280 32165 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:39.783202 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:39.926437 32089 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:39.942188  2134 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:40.002916 32195 rpcz_store.cc:276] 0709 13:13:38.806032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.001775 (+1195743us) service_pool.cc:224] Handling call
0709 13:13:40.002072 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.002252 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.002276 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.002315 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:40.002348 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.002397 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.002488 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:39.970219 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:39.979327 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:39.850838 32194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1578) took 1054 ms. Trace:
I20260709 13:13:40.018841 32194 rpcz_store.cc:276] 0709 13:13:38.796195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.774028 (+977833us) service_pool.cc:224] Handling call
0709 13:13:39.774337 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:39.849077 (+ 74740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:39.850636 (+  1559us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:39.999185 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:39.999760 32191 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:40.013361 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 86992.7us
I20260709 13:13:40.025403 32089 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:39.883538 32124 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:40.012955 32118 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:40.013268 32273 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
W20260709 13:13:40.030128 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 103914us
I20260709 13:13:40.031301 32165 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:39.942061  2031 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:39.995528  1735 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:39.965667  2032 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:40.008359 32192 raft_consensus.cc:1240] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:40.057349 32192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 1289) took 1251 ms. Trace:
I20260709 13:13:40.057938 32192 rpcz_store.cc:276] 0709 13:13:38.806262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.007922 (+1201660us) service_pool.cc:224] Handling call
0709 13:13:40.008179 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.056956 (+ 48777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.057270 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:39.973764  1950 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:40.029600  1961 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:40.043872  1780 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:40.065804  1780 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:40.066262  1780 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:40.067346  1764 raft_consensus.cc:3055] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:40.067829  1764 raft_consensus.cc:740] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:39.997195  2066 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:40.001456  1656 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:40.070389  2066 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:40.012933  2028 consensus_queue.cc:237] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:40.071893 32266 raft_consensus.cc:1240] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:40.410929  2044 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:40.443552 32022 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49550 (request call id 166) took 11536 ms (client timeout 15000 ms). Trace:
I20260709 13:13:40.392896  2127 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:40.459115  1702 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:40.156116  1950 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:40.092891  2110 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:40.168288 32199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 1285) took 1362 ms. Trace:
I20260709 13:13:40.252112 32269 raft_consensus.cc:1275] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:13:40.503854 32269 pending_rounds.cc:85] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06: Aborting all ops after (but not including) 3
I20260709 13:13:40.504160 32269 pending_rounds.cc:107] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:13:40.504406 32269 raft_consensus.cc:2889] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:40.504940 32199 rpcz_store.cc:276] 0709 13:13:38.805350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.943356 (+1138006us) service_pool.cc:224] Handling call
0709 13:13:39.966595 (+ 23239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.073092 (+106497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.073134 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.073211 (+    77us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:40.073256 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.167907 (+ 94651us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54001d47d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:40.167978 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.168203 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":244348288}
I20260709 13:13:40.083397  1735 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:40.486532 32165 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:40.491899 32123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1630) took 1151 ms. Trace:
I20260709 13:13:40.127490 32118 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
I20260709 13:13:40.143721  1764 consensus_queue.cc:260] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:40.506705 32123 rpcz_store.cc:276] 0709 13:13:39.340476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.513150 (+172674us) service_pool.cc:224] Handling call
0709 13:13:39.513425 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:39.515264 (+  1839us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:39.515295 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:39.515738 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 13:13:39.789227 (+273489us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:39.789286 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:39.789378 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:40.052712 (+263334us) raft_consensus.cc:1685] finished
0709 13:13:40.052738 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.491831 (+439093us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4968,"raft.queue_time_us":2176,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":12189,"thread_start_us":195514,"threads_started":1,"wal-append.queue_time_us":402070}
I20260709 13:13:40.508291   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:40.509455 32123 raft_consensus.cc:1275] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:40.495867  2118 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:40.130074 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 235878us
I20260709 13:13:40.039002  2135 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:40.155629 32116 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:40.251663  1961 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:13:40.180130 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.534741 32238 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:40.363430  2133 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:13:40.526849  1846 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:13:40.169281 32198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1572) took 1374 ms. Trace:
I20260709 13:13:40.092305  2132 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:40.133772 32191 raft_consensus.cc:2410] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:40.501170 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:40.505455 32269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 1356) took 1113 ms. Trace:
W20260709 13:13:40.491325 32022 rpcz_store.cc:269] 0709 13:13:28.870383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:28.900879 (+ 30496us) service_pool.cc:224] Handling call
0709 13:13:40.406410 (+11505531us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:34.288846 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:34.290380 (+  1534us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:34.290496 (+   116us) write_op.cc:435] Acquired schema lock
0709 13:13:34.290518 (+    22us) tablet.cc:662] Decoding operations
0709 13:13:34.294117 (+  3599us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:34.294317 (+   200us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:34.294377 (+    60us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:13:34.464799 (+170422us) tablet.cc:701] Row locks acquired
0709 13:13:34.464858 (+    59us) write_op.cc:260] PREPARE: finished
0709 13:13:34.465057 (+   199us) write_op.cc:270] Start()
0709 13:13:34.465210 (+   153us) write_op.cc:276] Timestamp: P: 1783602814464999 usec, L: 0
0709 13:13:34.465243 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:13:34.543679 (+ 78436us) log.cc:844] Serialized 5501 byte log entry
0709 13:13:34.894855 (+351176us) spinlock_profiling.cc:243] Waited 9.77 ms on lock 0x7b5400047c54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59efece28 00007fb5a2a27581 00007fb5a2a26d58 00007fb5a2a2b9f1 00007fb5a2a2b9a9 00007fb5a2a2b939 00007fb5a2a2b901 00007fb5a2a2ab2d 000000000038f354 000000000038f199
0709 13:13:35.480937 (+586082us) spinlock_profiling.cc:243] Waited 5.05 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:13:35.963810 (+482873us) op_driver.cc:464] REPLICATION: finished
0709 13:13:36.246392 (+282582us) write_op.cc:301] APPLY: starting
0709 13:13:36.246495 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:36.246804 (+   309us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:36.246841 (+    37us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:36.285411 (+ 38570us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:36.286807 (+  1396us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:13:36.286873 (+    66us) write_op.cc:312] APPLY: finished
0709 13:13:36.287331 (+   458us) log.cc:844] Serialized 100 byte log entry
0709 13:13:36.287563 (+   232us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:36.287732 (+   169us) write_op.cc:454] Released schema lock
0709 13:13:36.287806 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:36.290390 (+  2584us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:36.290428 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1289930,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":277717,"apply.run_cpu_time_us":4850,"apply.run_wall_time_us":43954,"num_ops":14,"prepare.queue_time_us":182605,"prepare.run_cpu_time_us":29587,"prepare.run_wall_time_us":606405,"raft.queue_time_us":287489,"raft.run_cpu_time_us":10607,"raft.run_wall_time_us":257843,"replication_time_us":1447931,"spinlock_wait_cycles":34085120,"thread_start_us":397428,"threads_started":4,"wal-append.queue_time_us":251227,"wal-append.run_cpu_time_us":29892,"wal-append.run_wall_time_us":2484675}]]}
I20260709 13:13:40.508515  1764 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:40.510272 32123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1633) took 1169 ms. Trace:
I20260709 13:13:40.555254 32123 rpcz_store.cc:276] 0709 13:13:39.341321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.508702 (+1167381us) service_pool.cc:224] Handling call
0709 13:13:40.509008 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.509931 (+   923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.510206 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.494457 32197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1566) took 1701 ms. Trace:
I20260709 13:13:40.550356 32269 rpcz_store.cc:276] 0709 13:13:39.391776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.655293 (+263517us) service_pool.cc:224] Handling call
0709 13:13:39.655634 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:39.865954 (+210320us) spinlock_profiling.cc:243] Waited 53.5 ms on lock 0x7b54003eeca0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59ef68dc0 00007fb59eff31c0 00007fb59eff4231 00007fb59eff0d8f 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c
0709 13:13:40.505083 (+639129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.505373 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123093248}
I20260709 13:13:40.500625 32190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56926 (request call id 101) took 1471 ms. Trace:
W20260709 13:13:40.493304 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:40.558856 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:40.496186 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:40.526340 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.532675  2041 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:13:40.101706  2158 log.cc:927] Time spent T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:13:40.530211 32118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1632) took 1189 ms. Trace:
I20260709 13:13:40.584972 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:40.585286 32118 rpcz_store.cc:276] 0709 13:13:39.341084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.507095 (+1166011us) service_pool.cc:224] Handling call
0709 13:13:40.510910 (+  3815us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.529853 (+ 18943us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.529885 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.529924 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:40.529955 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.530013 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.530142 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18584,"raft.queue_time_us":19644,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":9322}
I20260709 13:13:40.586045 32267 raft_consensus.cc:2393] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 5: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:40.531924 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:40.543671  1972 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.328338 32021 catalog_manager.cc:5697] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 5 to 6, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 6 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:40.491832  2127 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:40.598186 32021 catalog_manager.cc:5697] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:40.163833  2142 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:40.158201  2031 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:40.543830 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:40.157689  2134 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:40.510308  2079 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:40.510416  1702 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:40.545241 32198 rpcz_store.cc:276] 0709 13:13:38.794705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.568350 (+773645us) service_pool.cc:224] Handling call
0709 13:13:39.568825 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:39.912532 (+343707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.168945 (+256413us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b54001d29d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:40.169191 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":634628864}
I20260709 13:13:40.499941 32195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 1290) took 1693 ms. Trace:
I20260709 13:13:40.632764 32195 rpcz_store.cc:276] 0709 13:13:38.806533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.016562 (+1210029us) service_pool.cc:224] Handling call
0709 13:13:40.016856 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.017021 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.017045 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.017084 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:40.017113 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.017164 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.499884 (+482720us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.634617 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:40.546626 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:40.502801  2093 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:40.527001  2030 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:40.552574  1656 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:40.562059 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:40.043525  1983 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:40.563356 32117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1637) took 1214 ms. Trace:
I20260709 13:13:40.643422 32117 rpcz_store.cc:276] 0709 13:13:39.349412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.562618 (+1213206us) service_pool.cc:224] Handling call
0709 13:13:40.562872 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.563040 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.563066 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.563106 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:40.563134 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.563204 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.563301 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.558282 32190 rpcz_store.cc:276] 0709 13:13:39.029561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.174748 (+1145187us) service_pool.cc:224] Handling call
0709 13:13:40.500076 (+325328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.500308 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.500334 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.500374 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:40.500406 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.500460 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.500552 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.564442 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:40.535928 32238 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:40.565104 32123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55358 (request call id 79) took 1192 ms. Trace:
I20260709 13:13:40.646903 32123 rpcz_store.cc:276] 0709 13:13:39.372727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.564389 (+1191662us) service_pool.cc:224] Handling call
0709 13:13:40.564672 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.564832 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.564854 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.564892 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:40.564919 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.564969 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.565056 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.556236 32197 rpcz_store.cc:276] 0709 13:13:38.793296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.382806 (+589510us) service_pool.cc:224] Handling call
0709 13:13:39.383115 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:39.475653 (+ 92538us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:13:39.510305 (+ 34652us) log.cc:844] Serialized 14 byte log entry
0709 13:13:39.599513 (+ 89208us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:39.599579 (+    66us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:39.599623 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.170203 (+570580us) spinlock_profiling.cc:243] Waited 92.3 ms on lock 0x7b54002a6554. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:40.170266 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.494391 (+324125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10726,"prepare.queue_time_us":35029,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":7134,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":5456,"spinlock_wait_cycles":214174336,"thread_start_us":83425,"threads_started":1,"wal-append.queue_time_us":274985}
W20260709 13:13:40.569474 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:40.649005 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.497072  1780 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:40.586874 32120 raft_consensus.cc:2468] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:40.607406  1726 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.587754 32194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1579) took 1596 ms. Trace:
I20260709 13:13:40.653579 32194 rpcz_store.cc:276] 0709 13:13:38.991870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.034386 (+1042516us) service_pool.cc:224] Handling call
0709 13:13:40.587064 (+552678us) spinlock_profiling.cc:243] Waited 4.77 ms on lock 0x7b5800004298. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59beccb71 00007fb59becca22 00007fb5a4de5c09 00007fb5a3f3fee0 00007fb5a40090ab 00007fb5a4009131 00007fb5a3fcafc0 00007fb5a3fb5929 00007fb5a3fb53d2 00007fb59d52cbd4
0709 13:13:40.587270 (+   206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.587447 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.587470 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.587512 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:40.587543 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.587596 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.587701 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10976128}
W20260709 13:13:40.486392 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 461026us
I20260709 13:13:40.654963 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:40.605719 32118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55358 (request call id 80) took 1232 ms. Trace:
I20260709 13:13:40.655869 32118 rpcz_store.cc:276] 0709 13:13:39.373016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.586537 (+1213521us) service_pool.cc:224] Handling call
0709 13:13:40.605053 (+ 18516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.605281 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.605318 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.605373 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:40.605417 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.605485 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.605638 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.548369  2089 raft_consensus.cc:2804] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:40.598506 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:40.642387 32122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1639) took 1038 ms. Trace:
I20260709 13:13:40.657322 32089 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:40.642807  2030 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:40.636248 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:40.658906 32195 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:40.660233 32195 raft_consensus.cc:1275] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:40.606635  2163 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:40.583328 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:40.549600  2133 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:40.650852 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:40.638012  1822 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:40.587512 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:40.608343  2135 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:40.660948 32195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1586) took 1142 ms. Trace:
I20260709 13:13:40.674484 32195 rpcz_store.cc:276] 0709 13:13:39.518904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.659627 (+1140723us) service_pool.cc:224] Handling call
0709 13:13:40.659908 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.660717 (+   809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.660899 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.675612 32198 raft_consensus.cc:1240] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:40.543613  1961 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:40.661036 32089 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:40.678261 32089 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:40.657415 32122 rpcz_store.cc:276] 0709 13:13:39.604436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.641577 (+1037141us) service_pool.cc:224] Handling call
0709 13:13:40.641905 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.642077 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.642106 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.642144 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:40.642175 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.642221 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.642336 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.662919 32118 raft_consensus.cc:1240] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:13:40.679373 32190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1588) took 1107 ms. Trace:
I20260709 13:13:40.663431 32124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1638) took 1059 ms. Trace:
I20260709 13:13:40.665966 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:40.660032 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:40.652472 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:40.669121 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:40.673353 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 137491us
I20260709 13:13:40.673627 32116 raft_consensus.cc:1240] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:13:40.595816  2041 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:40.680395 32124 rpcz_store.cc:276] 0709 13:13:39.604123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.640079 (+1035956us) service_pool.cc:224] Handling call
0709 13:13:40.662936 (+ 22857us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.663092 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.663117 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.663156 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:40.663206 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.663258 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.663377 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.650349  1983 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:40.664952  2030 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:40.668507  2109 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:40.687837 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:40.676390 32198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1585) took 1157 ms. Trace:
I20260709 13:13:40.680023 32190 rpcz_store.cc:276] 0709 13:13:39.571658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.663082 (+1091424us) service_pool.cc:224] Handling call
0709 13:13:40.678641 (+ 15559us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.678859 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.678900 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.678962 (+    62us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:40.679011 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.679151 (+   140us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.679286 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.609859  1972 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:40.684919 32239 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.30.63.1:42339 timed out after 1.918s (SENT) [suppressed 34 similar messages]
I20260709 13:13:40.689885 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:40.667636  1950 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:40.694037 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:13:40.692080  1920 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.098s	user 0.029s	sys 0.029s
I20260709 13:13:40.659931  2089 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:40.700814 32198 rpcz_store.cc:276] 0709 13:13:39.518611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.658868 (+1140257us) service_pool.cc:224] Handling call
0709 13:13:40.675381 (+ 16513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.676101 (+   720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.676324 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.644170  1702 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:40.701452  1822 raft_consensus.cc:2804] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:40.687436 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:40.717514 32197 raft_consensus.cc:1240] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:40.722399 32190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1592) took 1121 ms. Trace:
I20260709 13:13:40.734468 32190 rpcz_store.cc:276] 0709 13:13:39.600770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.701328 (+1100558us) service_pool.cc:224] Handling call
0709 13:13:40.720805 (+ 19477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.721066 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.721105 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.721736 (+   631us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:40.721969 (+   233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.722087 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.722321 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.691417  1983 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:40.690439  1960 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:40.663997  1726 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:40.717885  1961 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:40.710847 32194 raft_consensus.cc:1275] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:13:40.732098 32270 raft_consensus.cc:1240] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:40.755695 32194 pending_rounds.cc:85] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 2
I20260709 13:13:40.756003 32194 pending_rounds.cc:107] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:13:40.756240 32194 raft_consensus.cc:2889] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:40.756927 32194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1591) took 1162 ms. Trace:
I20260709 13:13:40.757229 32194 rpcz_store.cc:276] 0709 13:13:39.594348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.688453 (+1094105us) service_pool.cc:224] Handling call
0709 13:13:40.710357 (+ 21904us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.756681 (+ 46324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.756874 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.689867  2135 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:40.751695 32198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1595) took 1078 ms. Trace:
I20260709 13:13:40.759980 32198 rpcz_store.cc:276] 0709 13:13:39.673133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.725856 (+1052723us) service_pool.cc:224] Handling call
0709 13:13:40.751017 (+ 25161us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.751263 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.751298 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.751355 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:40.751400 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.751470 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.751614 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.673413  2163 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:40.754160 32197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1594) took 1145 ms. Trace:
I20260709 13:13:40.731639  2089 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:40.691479  2162 consensus_queue.cc:1059] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:13:40.713676  1950 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:40.713819  2109 raft_consensus.cc:697] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:13:40.727435  1920 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.142s	user 0.029s	sys 0.029s
I20260709 13:13:40.862965 32271 raft_consensus.cc:2410] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:13:40.761533 32197 rpcz_store.cc:276] 0709 13:13:39.608699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.716133 (+1107434us) service_pool.cc:224] Handling call
0709 13:13:40.717254 (+  1121us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:40.753840 (+ 36586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.754073 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.765794 32190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1596) took 1073 ms. Trace:
I20260709 13:13:40.864338 32190 rpcz_store.cc:276] 0709 13:13:39.692242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.735974 (+1043732us) service_pool.cc:224] Handling call
0709 13:13:40.765137 (+ 29163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.765342 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.765380 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.765440 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:40.765487 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.765554 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.765717 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.784773 32272 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:13:40.791761 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 106874us
I20260709 13:13:40.868918 32239 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:40.870945 32239 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:40.798283  2159 log.cc:927] Time spent T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.407s	user 0.009s	sys 0.020s
I20260709 13:13:40.801908 32266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 1363) took 1359 ms. Trace:
I20260709 13:13:40.872371 32266 rpcz_store.cc:276] 0709 13:13:39.442675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.898559 (+455884us) service_pool.cc:224] Handling call
0709 13:13:39.898871 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.490937 (+592066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.801575 (+310638us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b5400296154. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:40.801820 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":397497216}
I20260709 13:13:40.805099  1959 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:40.805231 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:40.874490 32121 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:40.810130 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:40.812165 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:40.813090 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:40.815641 32124 raft_consensus.cc:1240] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:13:40.819953 32193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56926 (request call id 100) took 1790 ms. Trace:
I20260709 13:13:40.826489  2093 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:40.827145  2185 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.877929 32194 raft_consensus.cc:1240] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:40.877962 32193 rpcz_store.cc:276] 0709 13:13:39.029210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.102620 (+1073410us) service_pool.cc:224] Handling call
0709 13:13:40.103005 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.596516 (+493511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.596548 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.596618 (+    70us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:40.596657 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.819553 (+222896us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b54002418d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:40.819693 (+   140us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.819879 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1134403968}
I20260709 13:13:40.884621 32194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 1292) took 1105 ms. Trace:
I20260709 13:13:40.885025 32194 rpcz_store.cc:276] 0709 13:13:39.778923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.757971 (+979048us) service_pool.cc:224] Handling call
0709 13:13:40.877757 (+119786us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.884287 (+  6530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.884545 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.885725 32193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56926 (request call id 102) took 1103 ms. Trace:
I20260709 13:13:40.886252 32193 rpcz_store.cc:276] 0709 13:13:39.782183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.884694 (+1102511us) service_pool.cc:224] Handling call
0709 13:13:40.885067 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.885300 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.885338 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.885397 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:40.885442 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.885513 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.885654 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.759660  1735 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:40.893618 32190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 1299) took 1113 ms. Trace:
I20260709 13:13:40.894177 32190 rpcz_store.cc:276] 0709 13:13:39.787702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.865600 (+1077898us) service_pool.cc:224] Handling call
0709 13:13:40.892970 (+ 27370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.893202 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.893237 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.893289 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:40.893359 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.893427 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.893552 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.889047 32193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 1301) took 1100 ms. Trace:
I20260709 13:13:40.883263 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:40.758756  1822 raft_consensus.cc:697] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:40.896310 32193 rpcz_store.cc:276] 0709 13:13:39.788219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.887478 (+1099259us) service_pool.cc:224] Handling call
0709 13:13:40.887791 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.887961 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.887984 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.888022 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:40.888051 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.888100 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.888954 (+   854us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.907881 32193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 1303) took 1119 ms. Trace:
I20260709 13:13:40.894652  2093 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:40.857177  1950 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:40.909209 32239 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:40.908543 32193 rpcz_store.cc:276] 0709 13:13:39.788511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.906787 (+1118276us) service_pool.cc:224] Handling call
0709 13:13:40.907226 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.907462 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.907503 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.907564 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:40.907613 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.907691 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.907815 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.917447 32193 raft_consensus.cc:1275] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:40.922360 32193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 1306) took 1083 ms. Trace:
I20260709 13:13:40.923604  2162 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:40.924822 32195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1590) took 1344 ms. Trace:
I20260709 13:13:40.927182  2162 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:40.925057 32239 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:40.923870 32193 rpcz_store.cc:276] 0709 13:13:39.838477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.916475 (+1077998us) service_pool.cc:224] Handling call
0709 13:13:40.916961 (+   486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.921982 (+  5021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.922282 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:40.934679   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 221675us
W20260709 13:13:40.936026   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 272261us
I20260709 13:13:40.862435  2032 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:40.939592 32194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 1300) took 1151 ms. Trace:
I20260709 13:13:40.943033 32194 rpcz_store.cc:276] 0709 13:13:39.788037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.886052 (+1098015us) service_pool.cc:224] Handling call
0709 13:13:40.938892 (+ 52840us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.939199 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.939239 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.939289 (+    50us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:40.939341 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.939407 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.939527 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.939376 32195 rpcz_store.cc:276] 0709 13:13:39.580318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.675765 (+1095447us) service_pool.cc:224] Handling call
0709 13:13:40.676165 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.676743 (+   578us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:40.817722 (+140979us) spinlock_profiling.cc:243] Waited 3.77 ms on lock 0x7b18004465c0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bee6e07 00007fb5a4d41ab9 00007fb59bf0369b 00007fb59bf0193f 00007fb59bf01455 00007fb5a29e93c7 00007fb59effb9a7 00007fb59f00b0bf 00007fb59f00b038
0709 13:13:40.829174 (+ 11452us) log.cc:844] Serialized 14 byte log entry
0709 13:13:40.924214 (+ 95040us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.924300 (+    86us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:40.924400 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.924524 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.924743 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":142040,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":1586,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":4362,"spinlock_wait_cycles":8663808,"thread_start_us":105380,"threads_started":2}
I20260709 13:13:40.940204 32165 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:40.950841  2028 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:40.951287  2028 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:40.951666  2028 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:40.945549 32190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 1302) took 1157 ms. Trace:
I20260709 13:13:40.965014 32190 rpcz_store.cc:276] 0709 13:13:39.788364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.895460 (+1107096us) service_pool.cc:224] Handling call
0709 13:13:40.944959 (+ 49499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.945186 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.945222 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.945270 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:40.945303 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.945367 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.945489 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.966141 32199 raft_consensus.cc:1240] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
W20260709 13:13:40.977088 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.981348 32191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1295) took 1186 ms. Trace:
I20260709 13:13:40.941542  2162 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:13:40.990392 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.941200   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:40.891575  1960 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:40.990128 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:40.981817 32191 rpcz_store.cc:276] 0709 13:13:39.779686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.884869 (+105183us) service_pool.cc:224] Handling call
0709 13:13:40.965797 (+1080928us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54001d33d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:40.965982 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262289664}
I20260709 13:13:41.000976 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:41.002211 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:40.991496 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:41.004743 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:41.005662 32118 raft_consensus.cc:2393] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 5: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:40.934338  1959 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:41.003575 32193 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:41.050629 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:41.053998 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 56381.7us
I20260709 13:13:41.055051 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:41.055044 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:41.055999 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:41.056334 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:41.056488 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:41.057894 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:41.058983 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:41.068692 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:41.069295 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:41.070767 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:41.068292 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:41.075028 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.075523 32194 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3bdc1594189c43f49251261c5d073447"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:13:41.076207 32194 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:41.076623 32194 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:41.079653 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:41.080732 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 387891us
W20260709 13:13:41.084412 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.085929 32121 raft_consensus.cc:1275] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:41.086575 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:41.087138 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:41.087764 32121 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:13:41.088944 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:41.089807 32121 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:41.091120 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:41.002189  1656 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.933491  2185 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:41.001329  2132 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:41.088496 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:41.042770  2032 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:13:41.119294 32165 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:41.119552 32192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1580) took 2117 ms. Trace:
I20260709 13:13:41.125015 32192 rpcz_store.cc:276] 0709 13:13:39.002450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.058923 (+1056473us) service_pool.cc:224] Handling call
0709 13:13:40.524528 (+465605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.524809 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:40.879557 (+354748us) log.cc:844] Serialized 14 byte log entry
0709 13:13:41.119175 (+239618us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:41.119238 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:41.119291 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:41.119366 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:41.119494 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37693,"prepare.queue_time_us":293705,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"thread_start_us":542823,"threads_started":2}
W20260709 13:13:41.120746 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 188054us
I20260709 13:13:41.053468  2127 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:41.128304 32239 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:41.119827 32089 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:41.122443 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:41.135644 32190 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:40.985638  1950 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:41.138829 32239 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:41.140435 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:41.141921 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:41.143659 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:41.149636 32165 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:41.098496  2134 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:41.052726  1960 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:41.085446  1780 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:41.100555  2031 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:41.071993  1959 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:41.241192 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:41.183604 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.273203 32116 raft_consensus.cc:1240] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:41.115387  2195 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:41.335081 32265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 1365) took 1891 ms. Trace:
W20260709 13:13:41.338271 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 402525us
I20260709 13:13:41.338301 32272 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:41.331260 32194 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:41.338325 32265 rpcz_store.cc:276] 0709 13:13:39.443269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.900128 (+456859us) service_pool.cc:224] Handling call
0709 13:13:39.978940 (+ 78812us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:39.995312 (+ 16372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:39.995350 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:39.995920 (+   570us) log.cc:844] Serialized 52 byte log entry
0709 13:13:40.489742 (+493822us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:40.489807 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.489908 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:40.716723 (+226815us) raft_consensus.cc:1685] finished
0709 13:13:40.716752 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:41.303244 (+586492us) spinlock_profiling.cc:243] Waited 78.5 ms on lock 0x7b54001860d0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff08ad 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:41.335000 (+ 31756us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21202,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":11313,"spinlock_wait_cycles":180495104,"thread_start_us":450599,"threads_started":1,"wal-append.queue_time_us":591605}
I20260709 13:13:41.270094  2041 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:41.264858  2173 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:41.289727  1702 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:41.154894  2028 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:41.279368  2183 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:41.301537 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 112044us
I20260709 13:13:41.119161  2109 consensus_queue.cc:237] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:41.115195  2133 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:41.192178 32121 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:41.129973  2086 raft_consensus.cc:1081] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:13:41.350802 32118 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:41.124253  1822 consensus_queue.cc:237] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:41.315115 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 176373us
I20260709 13:13:41.284754   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:41.348151 32194 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:41.125459  1656 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:13:41.380535 32195 raft_consensus.cc:1240] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:13:41.260332  2162 raft_consensus.cc:697] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:13:41.371857  2166 log.cc:927] Time spent T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.469s	user 0.000s	sys 0.001s
I20260709 13:13:41.344328  2032 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:41.343766  2198 consensus_queue.cc:1059] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:13:41.352187  1959 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:41.131268  2132 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:41.392974  2190 consensus_queue.cc:1048] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:41.338830  1961 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:41.343698  2195 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:41.340340  1726 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:41.356943  2173 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:41.364897  2134 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:41.365443  1972 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:41.454672 32199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1584) took 2187 ms. Trace:
I20260709 13:13:41.466639 32199 rpcz_store.cc:276] 0709 13:13:39.267685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.506528 (+1238843us) service_pool.cc:224] Handling call
0709 13:13:40.965960 (+459432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.966582 (+   622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:41.454293 (+487711us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b54001d33d0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff08ad 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:41.454597 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1055834880}
I20260709 13:13:41.373226  2135 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:41.358675  1702 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:13:41.532974 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.393769  1960 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:41.344298  2031 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:41.353513  2127 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:41.565357 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 128850us
I20260709 13:13:41.363044  2133 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:41.415448  1656 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:41.594161 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.409564  2195 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:41.417001  2182 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:13:41.587795 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:41.600057 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 450522us
I20260709 13:13:41.604040 32165 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:41.358958  2028 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:41.454449  2171 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:41.584267  1922 consensus_meta.cc:287] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 1.671s	user 0.013s	sys 0.000s
I20260709 13:13:41.628206 32165 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:41.630043 32165 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:41.631362 32165 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:41.566565 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 208323us
I20260709 13:13:41.393672  2132 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:41.357650  2183 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:41.566252  2212 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:41.596215  2147 consensus_meta.cc:287] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 1.701s	user 0.014s	sys 0.000s
I20260709 13:13:41.569257  2135 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.641881 32269 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:41.593393  1972 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:13:41.646188 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.634397 32165 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:41.633215   368 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.009s	sys 0.026s
W20260709 13:13:41.653362 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 533549us
I20260709 13:13:41.602355  2182 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:13:41.658036   368 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.009s	sys 0.026s
W20260709 13:13:41.663928   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 725267us
I20260709 13:13:41.657895 32165 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:41.666008 32165 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:41.666813 32165 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:41.667790 32165 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:41.668900 32165 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:41.627977  2032 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:41.563138  1702 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:41.641216  2127 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:13:41.677924 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 45496.9us
I20260709 13:13:41.646209  2132 raft_consensus.cc:2749] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:41.646934  2028 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:41.659140  1972 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:41.658815 32089 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:13:41.728806 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 70080.7us
I20260709 13:13:41.729542 32089 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:41.730712 32089 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:41.731055 32198 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.121s	sys 0.276s
I20260709 13:13:41.603176  2133 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:41.654547  2185 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:41.662101  1656 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:41.671407  2182 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:41.697992  2191 consensus_queue.cc:1048] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:13:41.669672  1950 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:41.706398  1920 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:41.655263  2210 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.708272  2213 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:13:41.709261  2184 log.cc:927] Time spent T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 13:13:41.709908  2201 log.cc:927] Time spent T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.314s	user 0.001s	sys 0.000s
I20260709 13:13:41.709964  2207 raft_consensus.cc:2804] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:13:41.722433 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 152987us
W20260709 13:13:41.732949 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 393483us
I20260709 13:13:41.737524  2169 raft_consensus.cc:2749] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:41.760066  2169 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:41.655277  2197 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:41.760721  2169 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:41.760847  2197 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:41.762923  2169 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:41.763229  2197 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:41.746285  2175 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:41.764994  2175 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:41.765403  2175 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:41.767997  2079 consensus_meta.cc:287] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 1.127s	user 0.008s	sys 0.002s
I20260709 13:13:41.745885  2176 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:41.772821  2176 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:41.773203  2176 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:41.738327 32089 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:41.697752  2127 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:41.659983  2147 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:41.746806 32238 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:41.778020 32089 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:41.749140  2227 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:41.663345  2135 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:41.650105  2162 consensus_queue.cc:237] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:41.741071  1960 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:41.634442  2171 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:41.809191   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
W20260709 13:13:41.731832 32198 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.121s	sys 0.276s
W20260709 13:13:41.758306  2194 log.cc:927] Time spent T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.384s	user 0.000s	sys 0.001s
W20260709 13:13:41.760120  1764 consensus_meta.cc:287] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 1.177s	user 0.005s	sys 0.006s
I20260709 13:13:41.824658  2032 raft_consensus.cc:2804] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:41.826131  2031 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:41.827381  2118 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.827872  2147 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:41.828980  2134 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:41.830343  2116 consensus_meta.cc:287] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 1.820s	user 0.010s	sys 0.005s
I20260709 13:13:41.831107 32124 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:13:41.823376  2183 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:41.814061  2191 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:41.833014 32190 raft_consensus.cc:1240] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:41.833513 32122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1665) took 1025 ms. Trace:
I20260709 13:13:41.833881 32122 rpcz_store.cc:276] 0709 13:13:40.807659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.893379 (+ 85720us) service_pool.cc:224] Handling call
0709 13:13:40.893683 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:40.894012 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.894041 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:40.894512 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:13:41.128988 (+234476us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:41.129028 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:41.129093 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:41.833311 (+704218us) raft_consensus.cc:1685] finished
0709 13:13:41.833330 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:41.833457 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":205102,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":23870,"thread_start_us":87799,"threads_started":1,"wal-append.queue_time_us":339755}
I20260709 13:13:41.659075  2212 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:41.738847 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 70016.6us
I20260709 13:13:41.837476 32165 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:41.746924  2132 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:41.728879  1972 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:41.742374  2109 consensus_queue.cc:1059] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
W20260709 13:13:41.806682 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 49549.2us
W20260709 13:13:41.807140 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 60417.6us
I20260709 13:13:41.810449 32198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 1293) took 2031 ms. Trace:
I20260709 13:13:41.924779 32198 rpcz_store.cc:276] 0709 13:13:39.779202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.761152 (+981950us) service_pool.cc:224] Handling call
0709 13:13:40.862517 (+101365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.862816 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:40.895193 (+ 32377us) log.cc:844] Serialized 14 byte log entry
0709 13:13:41.810095 (+914902us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:41.810155 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:41.810203 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:41.810276 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:41.810392 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19488,"prepare.queue_time_us":31827,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":185999,"spinlock_wait_cycles":10396032,"thread_start_us":894048,"threads_started":2,"wal-append.queue_time_us":383953}
W20260709 13:13:41.812395 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 55036.4us
I20260709 13:13:41.927620 32090 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:41.756876  2207 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:41.813289  2185 raft_consensus.cc:2804] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:41.823345  2171 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:41.813915  1735 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:41.831804  2175 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:41.919330 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 112290us
W20260709 13:13:41.919881 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.777514  2127 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:41.836194 32120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 1183) took 2120 ms. Trace:
I20260709 13:13:41.752936  1920 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:41.968706 32238 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:41.944762 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 107379us
W20260709 13:13:41.809062  2189 log.cc:927] Time spent T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.413s	user 0.001s	sys 0.000s
I20260709 13:13:41.753944  1840 consensus_queue.cc:1048] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:13:41.809962  2221 consensus_queue.cc:1048] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:13:41.969542 32273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 1167) took 1317 ms. Trace:
I20260709 13:13:41.946182  2134 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:41.971623 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 44129.9us
I20260709 13:13:41.973694 32120 rpcz_store.cc:276] 0709 13:13:39.715401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.661004 (+945603us) service_pool.cc:224] Handling call
0709 13:13:40.681064 (+ 20060us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:40.931026 (+249962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.931113 (+    87us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:40.966824 (+ 35711us) log.cc:844] Serialized 26 byte log entry
0709 13:13:41.132502 (+165678us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:41.132565 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:41.132741 (+   176us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:41.835918 (+703177us) raft_consensus.cc:1685] finished
0709 13:13:41.835947 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:41.836132 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10435,"raft.queue_time_us":17637,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":16319,"thread_start_us":301350,"threads_started":2,"wal-append.queue_time_us":789455}
I20260709 13:13:41.779745  2093 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:41.944029  2207 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:41.981104  2177 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:41.982156  2212 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:41.827934  2118 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:41.986080  2175 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:41.964993  2191 consensus_queue.cc:1059] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:13:42.027036  2127 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.028700 32199 raft_consensus.cc:1240] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:42.030328  2032 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:42.031064  2032 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:41.756093  2213 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:41.994575  2110 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:41.996948  2198 consensus_queue.cc:1059] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:13:41.988334 32165 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:41.988451 32089 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:41.996101 32116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1660) took 1190 ms. Trace:
W20260709 13:13:41.999214 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:41.971408 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.999797 32273 rpcz_store.cc:276] 0709 13:13:40.652556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.697690 (+ 45134us) service_pool.cc:224] Handling call
0709 13:13:40.698047 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:40.698532 (+   485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.698561 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:40.793184 (+ 94623us) spinlock_profiling.cc:243] Waited 4.3 ms on lock 0x7b2c00139618. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59d8eaa11 00007fb59d8fa372 00007fb59f02ca01 00007fb59eff143a 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2
0709 13:13:40.794088 (+   904us) log.cc:844] Serialized 26 byte log entry
0709 13:13:40.898505 (+104417us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:40.898566 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.898678 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:41.945392 (+1046714us) raft_consensus.cc:1685] finished
0709 13:13:41.945418 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:41.969475 (+ 24057us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9201,"raft.queue_time_us":125,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":10707,"spinlock_wait_cycles":9900416,"thread_start_us":104018,"threads_started":1,"wal-append.queue_time_us":617229}
I20260709 13:13:42.001792 32090 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:41.946492  2185 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:41.754240  2210 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:41.970806  2135 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:41.970604  1656 raft_consensus.cc:697] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
W20260709 13:13:42.058591 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 55414.4us
I20260709 13:13:42.065491 32116 rpcz_store.cc:276] 0709 13:13:40.805892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.882261 (+ 76369us) service_pool.cc:224] Handling call
0709 13:13:40.882683 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:41.340363 (+457680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:41.995163 (+654800us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b54002c8dd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:41.995949 (+   786us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":897560960}
W20260709 13:13:42.059201 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 90690.1us
I20260709 13:13:42.113969 32238 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:42.060887 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 72494.4us
W20260709 13:13:42.060127 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 71852.9us
W20260709 13:13:42.068671 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 67004.1us
I20260709 13:13:42.116915 32165 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:42.056320  2186 log.cc:927] Time spent T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 1.196s	user 0.004s	sys 0.000s
W20260709 13:13:42.055716  2142 consensus_meta.cc:287] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 1.427s	user 0.011s	sys 0.000s
W20260709 13:13:42.049541  2030 consensus_meta.cc:287] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 1.340s	user 0.011s	sys 0.002s
I20260709 13:13:42.121855 32239 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:42.124697 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:42.128991 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:42.129882 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:42.118822 32165 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:42.036540  2213 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:42.049063  1920 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:42.127468 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:42.042323  2127 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:42.043205  1702 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:42.057782  2198 raft_consensus.cc:3055] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:42.068032  2041 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:42.138711 32239 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:42.140065 32165 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:42.049701  2133 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:42.056407  2110 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.070724  2185 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:42.110108  2177 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:42.144788 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:42.109705  2134 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:42.201442 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:42.201537 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:42.208706  2132 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:13:42.217489  2174 log.cc:927] Time spent T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
I20260709 13:13:42.118762  2209 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:42.114929  2195 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.120782   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:42.120733  2175 consensus_queue.cc:1059] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 13:13:42.222783  2198 raft_consensus.cc:740] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:42.120105  2135 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:42.226436 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 84813.7us
I20260709 13:13:42.141776  2030 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.143726  2231 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.122s
W20260709 13:13:42.226583 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 86573.5us
I20260709 13:13:42.144675  2028 raft_consensus.cc:2804] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:42.233393 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:42.231984  2213 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:13:42.210585  2089 consensus_meta.cc:287] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 1.347s	user 0.006s	sys 0.007s
I20260709 13:13:42.222941  1764 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:42.142113  2212 consensus_queue.cc:1059] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
W20260709 13:13:42.259029 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 120384us
I20260709 13:13:42.313859 32272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36080 (request call id 1177) took 1226 ms. Trace:
I20260709 13:13:42.220496  1972 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.232909  2205 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:42.255527 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:42.316395 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:42.317152 32265 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
W20260709 13:13:42.228446 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 114534us
I20260709 13:13:42.234845  1960 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:42.141229  1961 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.300633 32191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1620) took 1166 ms. Trace:
I20260709 13:13:42.302577 32165 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:42.301011 32266 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:42.232249  1702 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:42.236434  2116 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:42.314558 32239 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:42.225943  2041 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:42.231911  2190 consensus_queue.cc:1048] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:13:42.367823 32123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 1182) took 2652 ms. Trace:
I20260709 13:13:42.307085  1764 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:42.372572  2030 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:42.372792  1764 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:42.352195  1990 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:42.373538  1990 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:42.373654  2163 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:42.373960  1990 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:42.367946  2116 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.317987 32238 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:42.314292 32272 rpcz_store.cc:276] 0709 13:13:41.079125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.079341 (+   216us) service_pool.cc:224] Handling call
0709 13:13:42.305098 (+1225757us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b54002b7ad4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:42.305202 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":592808704}
W20260709 13:13:42.377381 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 59474.1us
I20260709 13:13:42.318928 32090 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:13:42.344559  1983 consensus_meta.cc:287] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 1.483s	user 0.010s	sys 0.004s
I20260709 13:13:42.303963  2044 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:42.300030  2216 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:42.389813 32265 raft_consensus.cc:1240] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:42.344806  1702 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:42.288141  2228 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:42.301189  2028 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:42.289749  2169 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:42.305337  2213 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:42.470007  2213 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:42.470386  1846 raft_consensus.cc:3055] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:13:42.364941 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 50460.7us
I20260709 13:13:42.268275  2134 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.257861  2132 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.368420 32123 rpcz_store.cc:276] 0709 13:13:39.714996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.653770 (+938774us) service_pool.cc:224] Handling call
0709 13:13:40.656649 (+  2879us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:40.657046 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.657079 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:40.657541 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:13:40.930125 (+272584us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:40.930192 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.930311 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:42.367542 (+1437231us) raft_consensus.cc:1685] finished
0709 13:13:42.367577 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:42.367761 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":725,"raft.queue_time_us":92,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":9026,"thread_start_us":272139,"threads_started":1,"wal-append.queue_time_us":1119205}
I20260709 13:13:42.270090 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:13:42.379002 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 60159.5us
I20260709 13:13:42.254582  2226 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:42.383827 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:42.456293  1702 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:42.342540  1961 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.466725  2028 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:42.548539 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:42.398705  2235 log.cc:927] Time spent T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:13:42.381283  2163 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.400116  1764 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.401971 32119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1629) took 3061 ms. Trace:
W20260709 13:13:42.400367  2172 log.cc:927] Time spent T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 1.121s	user 0.000s	sys 0.011s
W20260709 13:13:42.403431 32269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36080 (request call id 1174) took 1735 ms (client timeout 1517 ms). Trace:
I20260709 13:13:42.402029 32165 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:42.566256 32269 rpcz_store.cc:269] 0709 13:13:40.667710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.668878 (+  1168us) service_pool.cc:224] Handling call
0709 13:13:42.403248 (+1734370us) spinlock_profiling.cc:243] Waited 959 ms on lock 0x7b5400295c54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:42.403356 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2204960000}
I20260709 13:13:42.404340  1959 raft_consensus.cc:3055] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:42.409547 32199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1621) took 1222 ms. Trace:
I20260709 13:13:42.411756 32190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1618) took 1278 ms. Trace:
I20260709 13:13:42.414520 32195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1602) took 1410 ms. Trace:
I20260709 13:13:42.361392  2205 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.354259  2198 consensus_queue.cc:260] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:42.426368  2236 log.cc:927] Time spent T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:13:42.372598  2195 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:42.370396  2041 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:42.255551  1656 consensus_queue.cc:237] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.447649  2110 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:42.385053  2183 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:13:42.448770  2188 log.cc:927] Time spent T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 1.605s	user 0.004s	sys 0.003s
I20260709 13:13:42.449714  2210 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:42.369549  2127 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 13:13:42.450264 32117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1644) took 2842 ms. Trace:
I20260709 13:13:42.315971  2089 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.377753  1726 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:13:42.457430 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 65135.4us
I20260709 13:13:42.331923 32191 rpcz_store.cc:276] 0709 13:13:41.133731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.771885 (+638154us) service_pool.cc:224] Handling call
0709 13:13:41.772124 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:41.772309 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:13:41.963812 (+191503us) log.cc:844] Serialized 14 byte log entry
0709 13:13:42.300238 (+336426us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:42.300300 (+    62us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:42.300347 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.300420 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:42.300554 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12256,"prepare.queue_time_us":204614,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":16925,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":9113,"thread_start_us":514768,"threads_started":2}
I20260709 13:13:42.598057 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:42.598832 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:13:42.468954 32271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36084 (request call id 1382) took 1902 ms (client timeout 1865 ms). Trace:
I20260709 13:13:42.469391 32267 raft_consensus.cc:1275] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:13:42.599941 32196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1583) took 3367 ms. Trace:
I20260709 13:13:42.600282 32267 pending_rounds.cc:85] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06: Aborting all ops after (but not including) 4
I20260709 13:13:42.472232 32239 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:42.600778 32267 pending_rounds.cc:107] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06: Aborting uncommitted NO_OP operation due to leader change: 6.5
W20260709 13:13:42.403471  2224 log.cc:927] Time spent T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:13:42.470846  1846 raft_consensus.cc:740] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:42.481058 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:42.608759 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 128844us
I20260709 13:13:42.609225 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:42.481393 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:42.301012  2177 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:42.484130 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:42.566308  2163 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.616777 32268 raft_consensus.cc:1240] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:42.500372 32124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56884 (request call id 1203) took 1508 ms. Trace:
I20260709 13:13:42.542989  2226 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.397890  1735 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:42.548539 32265 raft_consensus.cc:1240] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:42.391017  1983 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:42.547516  2032 consensus_meta.cc:287] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.516s	user 0.009s	sys 0.002s
I20260709 13:13:42.629457  2032 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.629942 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:42.630579 32265 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:42.629971  2232 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:42.631735  2032 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:42.631579  2232 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:13:42.550575 32089 connection.cc:256] RPC call timeout handler was delayed by -1.0557725310000023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19990000000000002s for a response
I20260709 13:13:42.569808 32199 rpcz_store.cc:276] 0709 13:13:41.187004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.815975 (+628971us) service_pool.cc:224] Handling call
0709 13:13:41.816370 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.029250 (+212880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.409246 (+379996us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b5400374454. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:42.409477 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":487666560}
I20260709 13:13:42.633021 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:42.570371 32195 rpcz_store.cc:276] 0709 13:13:41.004168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.047226 (+ 43058us) service_pool.cc:224] Handling call
0709 13:13:41.047721 (+   495us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:41.381103 (+333382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.414231 (+1033128us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b54000f9454. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:42.414454 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":761023744}
I20260709 13:13:42.604084  1972 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:42.570210 32190 rpcz_store.cc:276] 0709 13:13:41.133183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.770182 (+636999us) service_pool.cc:224] Handling call
0709 13:13:41.770435 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:41.833397 (+ 62962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.411470 (+578073us) spinlock_profiling.cc:243] Waited 62.4 ms on lock 0x7b540043c1d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:42.411684 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143511808}
I20260709 13:13:42.467495  2228 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:42.557118  2238 log.cc:927] Time spent T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
W20260709 13:13:42.580000 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 178056us
I20260709 13:13:42.677878 32165 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:42.476464  2169 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.565979  2190 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:42.573836  2079 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:42.572911  1959 raft_consensus.cc:740] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:42.687885  1959 consensus_queue.cc:260] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.592087 32117 rpcz_store.cc:276] 0709 13:13:39.607695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.644708 (+1037013us) service_pool.cc:224] Handling call
0709 13:13:40.645056 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.708045 (+ 62989us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:40.938980 (+230935us) log.cc:844] Serialized 14 byte log entry
0709 13:13:41.303660 (+364680us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:41.303731 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:41.303800 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.415122 (+1111322us) spinlock_profiling.cc:243] Waited 62.7 ms on lock 0x7b5400411ed4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:42.450055 (+ 34933us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:42.450203 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18294,"prepare.queue_time_us":745409,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":58398,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":7099,"spinlock_wait_cycles":144119040,"thread_start_us":562790,"threads_started":2,"wal-append.queue_time_us":769476}
I20260709 13:13:42.341697  1960 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.601138 32267 raft_consensus.cc:2889] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:42.602020 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:42.622653  2216 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.600502 32196 rpcz_store.cc:276] 0709 13:13:39.228335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.176832 (+948497us) service_pool.cc:224] Handling call
0709 13:13:40.637506 (+460674us) spinlock_profiling.cc:243] Waited 5.37 ms on lock 0x7b5800004298. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59beccb71 00007fb59becca22 00007fb5a4de5c09 00007fb5a3f3fee0 00007fb5a40090ab 00007fb5a4009131 00007fb5a3fcafc0 00007fb5a3fb5929 00007fb5a3fb53d2 00007fb59d52cbd4
0709 13:13:40.637711 (+   205us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:40.640796 (+  3085us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.640824 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:40.643274 (+  2450us) log.cc:844] Serialized 26 byte log entry
0709 13:13:40.934106 (+290832us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:40.934168 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.934254 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:42.399818 (+1465564us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:13:42.595052 (+195234us) raft_consensus.cc:1685] finished
0709 13:13:42.595078 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:42.595309 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2417,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"spinlock_wait_cycles":18879616,"thread_start_us":290431,"threads_started":1,"wal-append.queue_time_us":486646}
W20260709 13:13:42.605409 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.696210 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:42.599979 32271 rpcz_store.cc:269] 0709 13:13:40.566837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.583041 (+ 16204us) service_pool.cc:224] Handling call
0709 13:13:42.468736 (+1885695us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54002b66d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:42.468885 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":455275264}
I20260709 13:13:42.698807 32266 raft_consensus.cc:2393] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 6: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:42.586176  2030 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:13:42.605526 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 133400us
I20260709 13:13:42.700325 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:42.701013 32239 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:42.701229 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:42.702030 32271 raft_consensus.cc:2410] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:42.635496  2086 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:42.609469 32090 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:42.496665 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:42.612541 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:13:42.703433 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 94047.4us
I20260709 13:13:42.704192 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:42.705322 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:42.705184  1990 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.706372 32191 raft_consensus.cc:2393] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 6: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:42.707229  1990 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:42.707989  2226 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:42.612095 32198 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 8.
I20260709 13:13:42.586112  2242 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:42.617498 32124 rpcz_store.cc:276] 0709 13:13:40.991954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.056238 (+ 64284us) service_pool.cc:224] Handling call
0709 13:13:42.500182 (+1443944us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b5400346a54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:42.500300 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1777951616}
W20260709 13:13:42.475314  2182 consensus_meta.cc:287] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.720s	user 0.009s	sys 0.003s
I20260709 13:13:42.546651 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:42.715152 32273 raft_consensus.cc:3055] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:42.715418 32273 raft_consensus.cc:740] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:42.715682 32196 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:42.716163 32273 consensus_queue.cc:260] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.602051  2116 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:42.567492 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:42.721421 32269 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
I20260709 13:13:42.722393 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:42.723505 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:42.634086 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:42.560142 32119 rpcz_store.cc:276] 0709 13:13:39.340225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.510039 (+169814us) service_pool.cc:224] Handling call
0709 13:13:39.510274 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:41.814431 (+2304157us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:41.825114 (+ 10683us) log.cc:844] Serialized 14 byte log entry
0709 13:13:41.994315 (+169201us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:41.994378 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:41.994436 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.401724 (+407288us) spinlock_profiling.cc:243] Waited 2.26 s on lock 0x7b54003f4dd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:42.401770 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:42.401885 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45596,"prepare.queue_time_us":12453,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":66580,"raft.run_cpu_time_us":467,"raft.run_wall_time_us":29373,"spinlock_wait_cycles":5193189120,"thread_start_us":168790,"threads_started":1,"wal-append.queue_time_us":385660}
I20260709 13:13:42.634982 32115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1659) took 1829 ms. Trace:
I20260709 13:13:42.678817 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:42.724802 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:42.680612 32265 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
I20260709 13:13:42.724519 32115 rpcz_store.cc:276] 0709 13:13:40.805486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.805645 (+   159us) service_pool.cc:224] Handling call
0709 13:13:40.805940 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:40.824798 (+ 18858us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.824828 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:40.825336 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:13:40.832796 (+  7460us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:40.832850 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.832948 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:42.416890 (+1583942us) spinlock_profiling.cc:243] Waited 44.3 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:13:42.617710 (+200820us) raft_consensus.cc:1685] finished
0709 13:13:42.617742 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:42.634919 (+ 17177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96241,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":28526,"spinlock_wait_cycles":101950336,"thread_start_us":25408,"threads_started":2,"wal-append.queue_time_us":17585}
I20260709 13:13:42.724906 32199 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:42.729926 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:42.682976 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:42.683228 32165 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:42.693248 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.693665 32197 raft_consensus.cc:1240] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:42.602622 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:42.627283  1735 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:42.623274  2214 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:42.714250  2207 consensus_meta.cc:287] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.664s	user 0.013s	sys 0.000s
I20260709 13:13:42.614375 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:42.751165 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:42.620864  2177 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:42.709812 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:42.708465 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:42.628229  2243 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:42.711587 32264 raft_consensus.cc:2393] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 8: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:42.712314 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:42.685925  2032 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:42.714582 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:42.593278  2110 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:42.717955  2192 consensus_queue.cc:1059] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:42.718452  1920 consensus_queue.cc:1059] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:42.719749  2185 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.731444 32199 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:42.706290 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:42.779291 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:42.780203 32199 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:42.746570 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 63430.8us
I20260709 13:13:42.731909 32269 raft_consensus.cc:1275] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:42.747131 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:42.747534 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:42.747954 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:42.747191 32190 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:42.786291 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:42.748546 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:42.787525 32117 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:42.746708 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:42.790591 32115 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
I20260709 13:13:42.749646 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:42.749845 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:42.792992 32116 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:42.752976 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:42.752935 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:42.754243 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:42.755111 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:42.794708 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:42.755729 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:42.796535 32118 raft_consensus.cc:2410] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:13:42.762950 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:42.696652  2079 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.777858 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:42.791628 32089 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:42.797569 32124 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:13:42.802703 32121 raft_consensus.cc:2393] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 8: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:42.803913 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:42.813446 32198 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:42.814028 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:42.813480 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:42.815356 32121 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:42.776882  2243 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.816960 32165 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:42.818298 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:42.818903 32089 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:42.820336 32089 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:42.729898  2241 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:42.729025  2210 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:42.847445 32119 raft_consensus.cc:2393] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 8: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:42.847585  2249 raft_consensus.cc:2749] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:42.858821 32121 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:13:42.848739 32193 raft_consensus.cc:1240] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:42.849089  2079 leader_election.cc:290] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:42.802327  2032 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:42.850255 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:42.851368 32195 raft_consensus.cc:2393] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 5: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:42.771690  2207 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.851943 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:42.853542  2169 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:42.693645  2190 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.750345  2030 raft_consensus.cc:2764] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:13:42.751276  2132 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:42.856720 32089 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:42.857091 32194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1608) took 1851 ms. Trace:
I20260709 13:13:42.857600 32124 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:42.859920 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:42.751828  1735 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:42.889420 32190 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 8.
I20260709 13:13:42.865227 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:42.798089 32238 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
W20260709 13:13:42.890959 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 92957.8us
W20260709 13:13:42.872471  2176 consensus_meta.cc:287] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 1.099s	user 0.013s	sys 0.000s
I20260709 13:13:42.899045 32191 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d001b18973b4cbf86649781d9445577"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:13:42.899706 32191 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:42.899706 32121 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:42.900216 32191 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:42.900826 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:42.901432 32121 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:13:42.902446 32195 raft_consensus.cc:1240] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:42.902500 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:42.858134  2241 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:42.903995 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:42.904743 32121 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:42.901278 32192 raft_consensus.cc:1240] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:13:42.788827  2110 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.909202  2110 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:42.917189  1983 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:42.919203  2207 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:42.922495 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:42.923153 32268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 1381) took 2356 ms. Trace:
I20260709 13:13:42.923537 32268 rpcz_store.cc:276] 0709 13:13:40.566570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.609604 (+ 43034us) service_pool.cc:224] Handling call
0709 13:13:40.630166 (+ 20562us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.617230 (+1987064us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.922878 (+305648us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b54002b70d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:42.923055 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4568288512}
I20260709 13:13:42.926312  2228 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:42.924243  2213 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.894351  1920 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:42.894171  2192 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.928498 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:42.934988 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:42.935856 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:42.935967 32119 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
I20260709 13:13:42.867249 32199 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
W20260709 13:13:42.868017 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 51146.2us
W20260709 13:13:42.868250 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 165225us
I20260709 13:13:42.698732  1846 consensus_queue.cc:260] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.704077  2216 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.721518  2182 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.887035  1822 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:42.883433 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:42.886399 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.862778 32117 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:42.964614 32271 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:13:42.817509 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:42.893407 32238 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:42.888566 32194 rpcz_store.cc:276] 0709 13:13:41.005826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.386601 (+380775us) service_pool.cc:224] Handling call
0709 13:13:41.431650 (+ 45049us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:41.432206 (+   556us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:41.432246 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:41.449147 (+ 16901us) log.cc:844] Serialized 52 byte log entry
0709 13:13:41.710363 (+261216us) spinlock_profiling.cc:243] Waited 3.62 ms on lock 0x7b1800402160. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bee6e07 00007fb5a4d41ab9 00007fb59bf0369b 00007fb59bf0193f 00007fb59bf03c02 00007fb59eb8b20b 00007fb59eb90d23 00007fb59eb910d1 00007fb59efaca0f
0709 13:13:42.132426 (+422063us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:42.210926 (+ 78500us) log.cc:844] Serialized 14 byte log entry
0709 13:13:42.211168 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.211243 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:42.804167 (+592924us) raft_consensus.cc:1685] finished
0709 13:13:42.856884 (+ 52717us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:42.857031 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3965,"prepare.queue_time_us":70734,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":2162,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":104146,"spinlock_wait_cycles":34880000,"thread_start_us":421855,"threads_started":1,"wal-append.queue_time_us":819550}
I20260709 13:13:42.879467  2237 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:42.986334  2237 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:42.986842  2237 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:42.987162  2216 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:42.933717  1960 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:42.933194  2163 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:42.950752 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:42.989763  2182 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:42.935250  2176 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.959970  1735 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.993692  2118 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:42.994725  1735 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:42.996812 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 103454us
I20260709 13:13:42.997186  2185 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:42.997722 32268 raft_consensus.cc:2393] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 5: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:42.999132 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:43.000487 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:13:42.951782 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 95175.7us
I20260709 13:13:43.001281 32121 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:43.002238 32089 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:42.864934  2142 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:43.010116 32124 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
I20260709 13:13:42.721661  2242 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.984369  2214 consensus_queue.cc:1059] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:42.712309  2086 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.933655  2192 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.933897  2241 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:42.883324  2032 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:42.952047 32199 raft_consensus.cc:1240] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 5. Current term is 6. Ops: []
W20260709 13:13:43.026685 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.962739 32165 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:13:43.029848 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 67171.1us
I20260709 13:13:42.960187  2205 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:43.014213 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:42.932925  2213 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:43.030689 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:42.963981  2110 raft_consensus.cc:2749] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:43.047672 32194 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
W20260709 13:13:43.048244 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 46200.2us
I20260709 13:13:43.030498 32165 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:43.023479 32238 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:43.037307 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:43.039762 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:42.992426  2176 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:43.022862 32191 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:43.027637 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:43.049026 32089 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:42.964275  1822 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:43.063961 32121 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
I20260709 13:13:43.059042 32122 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:13:43.062031 32089 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:43.066821 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:43.022028  2221 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:43.069340 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:43.070581 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 47189.8us
I20260709 13:13:43.075057 32118 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:43.071182 32271 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:43.076030 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:43.077665 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:43.078748 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:43.079795 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:43.099196 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:43.099551 32191 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:43.100531 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:43.101224 32191 raft_consensus.cc:2468] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:43.102849 32268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "002126350f9348faac039e490fafb4d7"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:13:43.103509 32268 raft_consensus.cc:606] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:43.106364 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:43.106794 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:43.107007 32271 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:13:43.107811 32121 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:43.108055 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:43.047923  2163 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:43.115514 32272 raft_consensus.cc:1240] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:43.117797 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:43.120733 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:43.063655  2185 raft_consensus.cc:2804] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:43.130908 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:43.064199  2079 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:43.069869  1822 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:43.063808  2205 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:43.135412 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:43.185849 32115 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:43.187090 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:43.142531 32116 raft_consensus.cc:2393] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 7: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:43.073077  2221 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:43.176532 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:43.182586 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:43.114279  2172 log.cc:927] Time spent T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:13:43.183043 32195 raft_consensus.cc:1240] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:43.114022  2163 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:43.137156  2175 raft_consensus.cc:2804] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:43.138209  2173 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:43.175891  2182 raft_consensus.cc:2804] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:43.136922  2185 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:13:43.211249 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 135706us
I20260709 13:13:43.184422  2205 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:43.213555 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:43.197882  2221 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:43.202414  2163 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:43.203955  2175 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:43.213809  2185 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:43.220479  2205 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:43.217672  2182 raft_consensus.cc:697] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:43.234823  2232 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:43.266741  2182 consensus_queue.cc:237] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:43.237607  2175 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:43.280668  2242 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:43.282585  2192 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:43.285403  2190 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:43.291214  2237 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:43.292689  2243 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:43.294579  2241 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:43.297535  2241 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:43.332875 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:43.334069 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.340736 32120 raft_consensus.cc:1240] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:43.342718 32118 raft_consensus.cc:1240] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:43.343689 32123 raft_consensus.cc:1240] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:43.346189 32121 raft_consensus.cc:1240] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:13:43.347473 32123 raft_consensus.cc:1240] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:13:43.351418 32121 raft_consensus.cc:1240] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 7. Current term is 8. Ops: []
W20260709 13:13:43.370518  1702 consensus_meta.cc:287] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.816s	user 0.000s	sys 0.012s
I20260709 13:13:43.371467  1702 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:43.373909 32198 raft_consensus.cc:2393] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 6: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:43.377209  1702 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:43.377744   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:43.378233 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:43.379994 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:43.381461 32194 raft_consensus.cc:1240] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:13:43.382606 32120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10940646da924abea9f371781da8acee"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:42262
I20260709 13:13:43.383544 32120 raft_consensus.cc:606] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:43.386425 32197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 1297) took 3606 ms. Trace:
I20260709 13:13:43.387080 32197 rpcz_store.cc:276] 0709 13:13:39.780176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.864416 (+1084240us) service_pool.cc:224] Handling call
0709 13:13:40.864803 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.757383 (+1892580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.385766 (+628383us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b540032b9d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:43.386126 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4205507840}
I20260709 13:13:43.392161 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:43.393567 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:43.395444 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:43.395737 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:43.376293 32239 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:43.393729 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:43.398093 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:43.398811 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:43.399529 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:43.388073 32238 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:43.409454 32268 raft_consensus.cc:1240] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:43.396522 32269 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:43.434122  2086 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:43.436261  2241 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.437507  2241 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:43.441763  2242 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:43.443025  2242 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:43.443969 32090 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:43.445551  2243 consensus_queue.cc:1059] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:43.448251  2212 raft_consensus.cc:3055] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:43.450100  2212 raft_consensus.cc:740] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:43.453249  2237 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:43.427668 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:43.451709  2212 consensus_queue.cc:260] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:43.297710  2221 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:43.680090 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.458261 32270 raft_consensus.cc:1240] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:43.625862  2242 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:43.560376 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.614570 32269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:13:43.579761 32271 raft_consensus.cc:1240] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:43.514309  2262 raft_consensus.cc:993] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:13:43.505061 32272 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:43.625317  1922 raft_consensus.cc:3055] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:43.525221  2243 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:43.679930  2217 raft_consensus.cc:3055] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:43.698410 32269 raft_consensus.cc:606] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:43.513520  2214 raft_consensus.cc:2804] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:43.629624  2134 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:43.509303  2077 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.492746  2245 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:43.459224  1764 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:43.675043 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 611826us
I20260709 13:13:43.700744  1922 raft_consensus.cc:740] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:43.705715  2217 raft_consensus.cc:740] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:43.506486  2177 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:43.709020  2214 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:43.736387  2262 raft_consensus.cc:1081] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:13:43.507104  1748 consensus_queue.cc:1059] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.234s
I20260709 13:13:43.740793  2142 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:43.741973  2142 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:43.742511  1748 raft_consensus.cc:3055] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:43.743251  1748 raft_consensus.cc:740] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:43.713824  1702 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:43.745579  2032 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:43.745380  1702 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:43.744874  1656 consensus_queue.cc:1059] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:13:43.752844  2171 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.753103  1983 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:43.753736  2171 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:43.753859  1983 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:43.754335 32165 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:43.757009 32267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 1171) took 3090 ms. Trace:
I20260709 13:13:43.757570 32267 rpcz_store.cc:276] 0709 13:13:40.666914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.712996 (+ 46082us) service_pool.cc:224] Handling call
0709 13:13:42.469036 (+1756040us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.692980 (+223944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.725708 (+1032728us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b54002b66d0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff08ad 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:43.756766 (+ 31058us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4037611264}
I20260709 13:13:43.758608  1983 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:43.758966  2207 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:43.759342  1983 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:43.759424  2207 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:43.770298  2207 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:43.770502  1922 consensus_queue.cc:260] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:43.772213  1922 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:43.773990 32271 raft_consensus.cc:1240] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:43.734879  2205 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:43.774422  2237 raft_consensus.cc:3055] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:43.745391   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:43.771610  1983 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:43.512482  2118 consensus_queue.cc:1059] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.217s
I20260709 13:13:43.769023 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:43.756404  2171 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:43.797914  1748 consensus_queue.cc:260] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:43.799852 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:43.777130  2214 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:43.801478  2041 consensus_meta.cc:287] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 1.211s	user 0.018s	sys 0.001s
I20260709 13:13:43.802026  2041 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:43.786657  1702 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:43.808399  2110 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:43.809212  2110 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:43.809701 32266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50584 (request call id 100) took 1186 ms. Trace:
I20260709 13:13:43.810101 32266 rpcz_store.cc:276] 0709 13:13:42.623772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.399802 (+776030us) service_pool.cc:224] Handling call
0709 13:13:43.423342 (+ 23540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:43.509344 (+ 86002us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:43.509375 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:43.509438 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:43.509467 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.509538 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:43.809506 (+299968us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b5400186fd0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff08ad 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:43.809640 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29843328}
I20260709 13:13:43.811573 32115 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:43.813544  2163 consensus_meta.cc:287] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.575s	user 0.000s	sys 0.017s
I20260709 13:13:43.814090  1983 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:43.814033  2163 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:43.815749  1961 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:43.823220  1959 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:43.824029  2163 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:43.816517  2185 consensus_meta.cc:287] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.551s	user 0.012s	sys 0.001s
I20260709 13:13:43.817323 32118 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:43.828800 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:43.829104  2217 consensus_queue.cc:260] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:43.830608  2217 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:43.831686  2198 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:43.830746 32118 raft_consensus.cc:1275] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:43.831916  2209 raft_consensus.cc:3055] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:43.832511  2209 raft_consensus.cc:740] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:43.819470   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
W20260709 13:13:43.833762  2274 log.cc:927] Time spent T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:13:43.834807 32118 raft_consensus.cc:1240] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:13:43.800062  1748 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:43.825613   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:43.783290  2237 raft_consensus.cc:740] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:43.826252 32165 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:43.824510 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:43.815964  2241 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:43.812377  2110 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:43.840452  2041 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:43.866945 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:43.854725 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:43.884518 32270 raft_consensus.cc:1275] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:13:43.891218 32116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 1232) took 1040 ms. Trace:
I20260709 13:13:43.893355  2142 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:43.900063 32196 raft_consensus.cc:1275] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:13:43.900516 32196 pending_rounds.cc:85] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 3
I20260709 13:13:43.900787 32196 pending_rounds.cc:107] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:13:43.901050 32196 raft_consensus.cc:2889] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:43.908458 32115 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:43.910066 32194 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:43.910315  1983 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:43.910650 32199 raft_consensus.cc:1240] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 8. Ops: []
W20260709 13:13:43.912051 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.912930 32197 raft_consensus.cc:2410] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:13:43.885043 32270 pending_rounds.cc:85] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06: Aborting all ops after (but not including) 2
I20260709 13:13:43.913830 32270 pending_rounds.cc:107] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:13:43.914062 32270 raft_consensus.cc:2889] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:43.916389 32272 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:43.917301  1983 raft_consensus.cc:697] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:43.918606  1983 consensus_queue.cc:237] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:43.835292  2245 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:43.787577  2077 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:43.870852  2241 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.836853  2185 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:43.932953  2185 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:43.933831 32121 raft_consensus.cc:1240] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:43.935647  2232 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:43.936645  2077 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:43.891746 32116 rpcz_store.cc:276] 0709 13:13:42.795701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.188750 (+393049us) service_pool.cc:224] Handling call
0709 13:13:43.189151 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:43.189414 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:13:43.336322 (+146908us) log.cc:844] Serialized 14 byte log entry
0709 13:13:43.777267 (+440945us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:43.784293 (+  7026us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:43.792746 (+  8453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.797053 (+  4307us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:43.836020 (+ 38967us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36184,"prepare.queue_time_us":237850,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":45653,"spinlock_wait_cycles":94699776,"thread_start_us":221235,"threads_started":1,"wal-append.queue_time_us":398743}
W20260709 13:13:43.945132  2028 consensus_meta.cc:287] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 1.384s	user 0.008s	sys 0.013s
I20260709 13:13:43.945632  2028 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:43.947836  2028 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:43.949097 32117 raft_consensus.cc:2410] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:13:43.951110 32117 pending_rounds.cc:85] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d: Aborting all ops after (but not including) 3
I20260709 13:13:43.951512 32117 pending_rounds.cc:107] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:13:43.951826 32117 raft_consensus.cc:2889] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:43.955869 32120 raft_consensus.cc:1240] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:43.912513  2221 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:43.833904  2209 consensus_queue.cc:260] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:43.957969  2209 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:43.973802  2205 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:43.985419  1822 consensus_meta.cc:287] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.789s	user 0.013s	sys 0.001s
I20260709 13:13:43.986027  1822 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:43.989297 32119 raft_consensus.cc:2393] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 9: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:43.990887 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:43.992189 32195 raft_consensus.cc:2393] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 10: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
W20260709 13:13:43.995709  2280 log.cc:927] Time spent T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:13:43.997076 32191 raft_consensus.cc:1240] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: []
W20260709 13:13:44.044572 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 256268us
I20260709 13:13:44.060883 32196 raft_consensus.cc:1240] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:44.067171 32196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "002126350f9348faac039e490fafb4d7"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:13:44.067377 32265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 1182) took 1585 ms. Trace:
I20260709 13:13:44.067934 32265 rpcz_store.cc:276] 0709 13:13:42.482043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.726067 (+244024us) service_pool.cc:224] Handling call
0709 13:13:42.726463 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:42.726881 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:42.726936 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:42.745284 (+ 18348us) log.cc:844] Serialized 26 byte log entry
0709 13:13:43.455017 (+709733us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b18000a3720. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bee6e07 00007fb5a4d41ab9 00007fb59bf0369b 00007fb59bf0193f 00007fb59bf03c02 00007fb59eb8b20b 00007fb59eb90d23 00007fb59eb910d1 00007fb59efaca0f
0709 13:13:43.789419 (+334402us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:43.792934 (+  3515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.795724 (+  2790us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:44.066924 (+271200us) raft_consensus.cc:1685] finished
0709 13:13:44.066945 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:44.067169 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":577,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":19155,"spinlock_wait_cycles":3788544,"thread_start_us":243951,"threads_started":1,"wal-append.queue_time_us":1104456}
I20260709 13:13:44.070444 32165 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:44.070263  2205 consensus_queue.cc:1048] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:44.071535  2028 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:44.071856 32124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56884 (request call id 1227) took 1314 ms. Trace:
I20260709 13:13:44.072340 32116 raft_consensus.cc:1240] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:44.073374  2205 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:44.074318  2205 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.074923  2207 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.077108  2207 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:44.076473  2205 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:44.079638 32121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1686) took 1059 ms. Trace:
I20260709 13:13:44.084977  2041 consensus_queue.cc:1059] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:44.085443 32268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 1401) took 1502 ms. Trace:
I20260709 13:13:44.086615 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:44.047698  2241 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.065796 32118 raft_consensus.cc:1240] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:44.095150 32268 rpcz_store.cc:276] 0709 13:13:42.582842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.112517 (+529675us) service_pool.cc:224] Handling call
0709 13:13:43.408775 (+296258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:43.410206 (+  1431us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.085180 (+674974us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b54001860d0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff08ad 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:44.085356 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":670911360}
I20260709 13:13:44.098120 32118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1692) took 1070 ms. Trace:
I20260709 13:13:44.072320 32124 rpcz_store.cc:276] 0709 13:13:42.756943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.813814 (+ 56871us) service_pool.cc:224] Handling call
0709 13:13:44.071456 (+1257642us) spinlock_profiling.cc:243] Waited 42.5 ms on lock 0x7b5400034dd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:44.071649 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97723648}
I20260709 13:13:44.078022  2237 consensus_queue.cc:260] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.093648 32121 rpcz_store.cc:276] 0709 13:13:43.020419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.354253 (+333834us) service_pool.cc:224] Handling call
0709 13:13:43.354784 (+   531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:43.934396 (+579612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.079354 (+144958us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b54000357d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:44.079560 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1331006848}
I20260709 13:13:44.098471 32118 rpcz_store.cc:276] 0709 13:13:43.027884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.870318 (+842434us) service_pool.cc:224] Handling call
0709 13:13:44.026602 (+156284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:44.097881 (+ 71279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.098067 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:44.104185 32196 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:44.108083 32196 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:44.121001  1822 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:44.146736 32197 raft_consensus.cc:1240] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 7. Current term is 8. Ops: []
W20260709 13:13:44.131735  2175 consensus_meta.cc:287] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.716s	user 0.006s	sys 0.008s
W20260709 13:13:44.166201 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.173730 32119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56884 (request call id 1235) took 1374 ms. Trace:
I20260709 13:13:44.174253 32119 rpcz_store.cc:276] 0709 13:13:42.799157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.936939 (+137782us) service_pool.cc:224] Handling call
0709 13:13:44.161115 (+1224176us) spinlock_profiling.cc:243] Waited 1e+03 ms on lock 0x7b5400411ed4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:44.173541 (+ 12426us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2299052416}
I20260709 13:13:44.166237 32196 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.177129 32196 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:44.178795 32195 raft_consensus.cc:1240] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:44.180356 32192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1614) took 3152 ms. Trace:
I20260709 13:13:44.180953 32192 rpcz_store.cc:276] 0709 13:13:41.007657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.721807 (+714150us) service_pool.cc:224] Handling call
0709 13:13:41.741971 (+ 20164us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:42.905587 (+1163616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.116493 (+1210906us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54002413d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:44.159556 (+ 43063us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2665586432}
I20260709 13:13:44.184239  2206 raft_consensus.cc:3055] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:44.184880  2206 raft_consensus.cc:740] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:44.159819  2041 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.169062 32090 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:44.197806  2243 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:44.197332  2206 consensus_queue.cc:260] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.205029 32190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 1328) took 1145 ms. Trace:
W20260709 13:13:44.209204 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.198378  2243 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:44.205519 32190 rpcz_store.cc:276] 0709 13:13:43.059714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.108767 (+ 49053us) service_pool.cc:224] Handling call
0709 13:13:43.113714 (+  4947us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:43.730155 (+616441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:43.735860 (+  5705us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:43.807631 (+ 71771us) log.cc:844] Serialized 26 byte log entry
0709 13:13:44.104083 (+296452us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:44.106007 (+  1924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.115020 (+  9013us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:44.202614 (+ 87594us) raft_consensus.cc:1685] finished
0709 13:13:44.202631 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:44.204835 (+  2204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":563139,"raft.queue_time_us":615715,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":14008,"thread_start_us":290415,"threads_started":1,"wal-append.queue_time_us":358299}
I20260709 13:13:44.229686  1846 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:44.168120  2175 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:44.237278 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 68266.4us
I20260709 13:13:44.217020  1822 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:44.198853  2041 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.242486 32165 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:13:44.244302 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.247805 32021 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59534 (request call id 45) took 10684 ms. Trace:
I20260709 13:13:44.248230 32021 rpcz_store.cc:276] 0709 13:13:33.505229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.505413 (+   184us) service_pool.cc:224] Handling call
0709 13:13:44.165795 (+10660382us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:40.853177 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:40.853957 (+   780us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:40.854002 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:13:40.854030 (+    28us) tablet.cc:662] Decoding operations
0709 13:13:40.963939 (+109909us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:40.985370 (+ 21431us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:41.000122 (+ 14752us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:13:41.138034 (+137912us) tablet.cc:701] Row locks acquired
0709 13:13:41.151136 (+ 13102us) write_op.cc:260] PREPARE: finished
0709 13:13:41.266169 (+115033us) write_op.cc:270] Start()
0709 13:13:41.279346 (+ 13177us) write_op.cc:276] Timestamp: P: 1783602821260643 usec, L: 0
0709 13:13:41.286111 (+  6765us) op_driver.cc:348] REPLICATION: starting
0709 13:13:41.558082 (+271971us) log.cc:844] Serialized 1344 byte log entry
0709 13:13:43.045670 (+1487588us) op_driver.cc:464] REPLICATION: finished
0709 13:13:43.078506 (+ 32836us) write_op.cc:301] APPLY: starting
0709 13:13:43.078590 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:43.078718 (+   128us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:43.078826 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:43.082331 (+  3505us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:43.082580 (+   249us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:13:43.082645 (+    65us) write_op.cc:312] APPLY: finished
0709 13:13:43.082921 (+   276us) log.cc:844] Serialized 34 byte log entry
0709 13:13:43.083124 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:43.083277 (+   153us) write_op.cc:454] Released schema lock
0709 13:13:43.083327 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:43.083754 (+   427us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:43.083792 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":225,"mutex_wait_us":3083018,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":32568,"apply.run_cpu_time_us":2367,"apply.run_wall_time_us":5213,"num_ops":3,"prepare.queue_time_us":222243,"prepare.run_cpu_time_us":11508,"prepare.run_wall_time_us":923246,"raft.queue_time_us":345625,"raft.run_cpu_time_us":10335,"raft.run_wall_time_us":34207,"replication_time_us":1759369,"thread_start_us":687258,"threads_started":4,"wal-append.queue_time_us":720709,"wal-append.run_cpu_time_us":122087,"wal-append.run_wall_time_us":1784093}]]}
I20260709 13:13:44.254468 32194 raft_consensus.cc:1240] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:44.256330 32123 raft_consensus.cc:1240] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:44.267572  2089 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:44.241580  2206 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:44.241060  1822 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:44.282810 32238 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:44.270290  1983 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:44.272694  2241 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:44.278198  1822 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:44.305634  2028 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:13:44.306432  2283 log.cc:927] Time spent T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:13:44.301285  2207 consensus_queue.cc:1059] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:13:44.308907 32238 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:44.309995 32238 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
W20260709 13:13:44.310949  2288 log.cc:927] Time spent T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:13:44.312530  2241 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.313175  2241 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.315492  2241 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:44.317167  1922 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:44.317714  2077 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:44.317782  1922 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:44.318542  1922 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:44.318674  2077 raft_consensus.cc:993] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:13:44.320001  2077 raft_consensus.cc:1081] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:13:44.323051  1726 raft_consensus.cc:2804] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:44.323695  1726 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.324088  1726 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:44.325222  1764 consensus_queue.cc:1048] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:44.325868  2217 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:13:44.326505  2290 log.cc:927] Time spent T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:13:44.295083  1983 raft_consensus.cc:697] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:44.328213  1983 consensus_queue.cc:237] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.329679  2217 consensus_queue.cc:1059] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:44.331214  1764 raft_consensus.cc:3055] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:44.331717  1764 raft_consensus.cc:740] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:44.332026 32117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1698) took 1283 ms. Trace:
I20260709 13:13:44.332937  1764 consensus_queue.cc:260] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.334900  1764 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:44.337090 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:44.337898 32272 raft_consensus.cc:2393] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 6: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:44.339162 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:44.340312 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:44.341172 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:44.343098  2262 consensus_queue.cc:1059] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:44.343441 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:44.344236 32268 raft_consensus.cc:2368] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6.
I20260709 13:13:44.344472  1748 raft_consensus.cc:3055] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:44.344846  1748 raft_consensus.cc:740] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:44.345543  1922 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.345729  1748 consensus_queue.cc:260] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.343101  2041 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:44.347519  1748 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:44.332463 32117 rpcz_store.cc:276] 0709 13:13:43.048652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.950159 (+901507us) service_pool.cc:224] Handling call
0709 13:13:43.950670 (+   511us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:44.048370 (+ 97700us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:44.048415 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:44.088348 (+ 39933us) log.cc:844] Serialized 26 byte log entry
0709 13:13:44.143622 (+ 55274us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:44.143666 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.143746 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:44.331807 (+188061us) raft_consensus.cc:1685] finished
0709 13:13:44.331827 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:44.331968 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":48688,"threads_started":1,"wal-append.queue_time_us":128991}
W20260709 13:13:44.356153  2287 log.cc:927] Time spent T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:13:44.359035 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.361636  1922 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:44.362106  2237 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:44.367417 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:44.372965  2185 raft_consensus.cc:3055] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:44.373477  2185 raft_consensus.cc:740] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:44.373582 32271 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:44.374516  2185 consensus_queue.cc:260] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.377147  2212 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:44.289189  2214 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:44.380476  2276 log.cc:927] Time spent T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.645s	user 0.000s	sys 0.002s
W20260709 13:13:44.401098 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 97108.6us
I20260709 13:13:44.402415  2207 raft_consensus.cc:3055] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:44.415699 32122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1685) took 1395 ms. Trace:
I20260709 13:13:44.415931  2207 raft_consensus.cc:740] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:44.416086 32122 rpcz_store.cc:276] 0709 13:13:43.020051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.351962 (+331911us) service_pool.cc:224] Handling call
0709 13:13:43.352770 (+   808us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:43.353344 (+   574us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:43.353382 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:43.355217 (+  1835us) log.cc:844] Serialized 26 byte log entry
0709 13:13:43.482858 (+127641us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:43.482905 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.556412 (+ 73507us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:44.379681 (+823269us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:13:44.415278 (+ 35597us) raft_consensus.cc:1685] finished
0709 13:13:44.415300 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:44.415520 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31632256,"thread_start_us":127010,"threads_started":1,"wal-append.queue_time_us":333534}
I20260709 13:13:44.416944  2207 consensus_queue.cc:260] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.418526  2207 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:44.389530  2245 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:44.418797  2190 consensus_queue.cc:1059] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:13:44.386189 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:44.420090 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.420147  2245 raft_consensus.cc:3055] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:44.420924  2245 raft_consensus.cc:740] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:44.422340  2245 consensus_queue.cc:260] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.385556 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:44.426836  2214 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:44.396878 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 97066.3us
I20260709 13:13:44.512925 32194 raft_consensus.cc:1240] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:44.403077  2205 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:44.514074  2205 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.401949  2028 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:13:44.439870 32115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56890 (request call id 1683) took 1428 ms. Trace:
I20260709 13:13:44.516819 32115 rpcz_store.cc:276] 0709 13:13:43.011337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.186756 (+175419us) service_pool.cc:224] Handling call
0709 13:13:44.439645 (+1252889us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b54000983d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:44.439801 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1434000768}
I20260709 13:13:44.518282 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:44.440972 32271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:13:44.520073 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:44.520552 32271 raft_consensus.cc:606] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:44.522217 32197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:13:44.522759 32197 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:44.523135 32197 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:44.524302  1726 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:44.445349 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 1.0466e+06us
I20260709 13:13:44.452808 32123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1693) took 1412 ms. Trace:
W20260709 13:13:44.456705 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.461862  1840 raft_consensus.cc:3055] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:44.464237 32273 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:44.472935  2185 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:44.477443  2183 raft_consensus.cc:3055] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:44.478314 32198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54182 (request call id 1634) took 1852 ms. Trace:
I20260709 13:13:44.476207 32116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1697) took 1434 ms. Trace:
I20260709 13:13:44.539721 32116 rpcz_store.cc:276] 0709 13:13:43.041984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.937882 (+895898us) service_pool.cc:224] Handling call
0709 13:13:44.072113 (+134231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:44.072889 (+   776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.475925 (+403036us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b5400034dd0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff08ad 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:44.476126 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":307579264}
I20260709 13:13:44.516463  2205 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:44.489951 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 71593.6us
I20260709 13:13:44.547076 32239 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:44.547487 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:44.548520 32239 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:44.549314 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:44.550061 32116 raft_consensus.cc:2393] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 5: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:44.409624 32270 raft_consensus.cc:2410] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:13:44.501155 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.504925  1972 consensus_queue.cc:1059] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:44.552140  1972 raft_consensus.cc:2749] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:44.552809  1972 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:44.506775   369 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:44.507252 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:44.489003  2175 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:44.508028 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:44.538179  2183 raft_consensus.cc:740] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:44.564554 32197 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:44.570960   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 64417.7us
I20260709 13:13:44.529724 32123 rpcz_store.cc:276] 0709 13:13:43.040623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.918092 (+877469us) service_pool.cc:224] Handling call
0709 13:13:43.918436 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:44.258949 (+340513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.452453 (+193504us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b5400164ed4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:44.452714 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":776525568}
I20260709 13:13:44.542199 32271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:13:44.538638 32198 rpcz_store.cc:276] 0709 13:13:42.626344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.816979 (+190635us) service_pool.cc:224] Handling call
0709 13:13:44.478080 (+1661101us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b54000b3954. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:44.478236 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":936165120}
I20260709 13:13:44.553475  1972 raft_consensus.cc:3055] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:44.492187  2245 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:44.370858  2243 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.535322  1840 raft_consensus.cc:740] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:44.571154 32195 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:44.549883 32239 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:44.575234 32194 raft_consensus.cc:1240] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:44.569697 32191 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:44.576886  1972 raft_consensus.cc:740] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:44.584410  1972 consensus_queue.cc:260] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.584928  1840 consensus_queue.cc:260] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.585793  1972 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:44.586321  1840 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:44.578982 32271 raft_consensus.cc:606] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:44.528359  1764 consensus_queue.cc:1059] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:13:44.591111 32197 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:44.591593 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:44.597003  2229 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:44.607348 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:44.512080 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:44.609509 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.623167 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:44.623931 32197 raft_consensus.cc:1275] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:13:44.623932 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:44.624924 32123 raft_consensus.cc:2393] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 5: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
W20260709 13:13:44.625342 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 75519.5us
I20260709 13:13:44.625487 32197 raft_consensus.cc:1240] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:44.626235 32239 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:44.626300  2214 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:44.627279  2214 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:44.627580 32239 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:44.627652  2214 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:44.628353  2214 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:44.628921  2191 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:44.629415 32090 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:44.630398 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:44.631055 32191 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:44.633061 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:44.633131  2183 consensus_queue.cc:260] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.633989 32194 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:44.634109  2175 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:44.634379  2183 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:44.634899  2175 raft_consensus.cc:697] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 6 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:44.636816 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:44.637766 32270 raft_consensus.cc:2410] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:44.635943  2175 consensus_queue.cc:237] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.640566 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:44.641711  2243 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:44.642540 32273 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:44.647985  2243 consensus_queue.cc:1048] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:44.648885 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:44.649165  2206 consensus_queue.cc:1059] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:44.650943 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:44.651252 32090 leader_election.cc:400] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6.
I20260709 13:13:44.654565 32090 leader_election.cc:403] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:13:44.654347 32239 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:44.657856 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.659009 32123 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:13:44.659149 32273 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36080 (request call id 1183) took 2174 ms (client timeout 1876 ms). Trace:
I20260709 13:13:44.663161 32195 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:44.667012 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:44.667819 32270 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:44.668927 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:44.663026 32273 rpcz_store.cc:269] 0709 13:13:42.483110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.546326 (+ 63216us) service_pool.cc:224] Handling call
0709 13:13:44.391919 (+1845593us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b1800053340. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59f02c646 00007fb59ef6658e 00007fb59efe7f9e 00007fb59efe97de 00007fb59eff527c 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c
0709 13:13:44.463860 (+ 71941us) spinlock_profiling.cc:243] Waited 70.2 ms on lock 0x7b58002165d0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59ef4d0aa 00007fb59efcf447 00007fb59efe7fe7 00007fb59efe97de 00007fb59eff527c 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c
0709 13:13:44.657267 (+193407us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2733845120}
I20260709 13:13:44.674377 32197 raft_consensus.cc:1240] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:44.675426 32090 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:44.662091  1764 raft_consensus.cc:2749] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:44.657903  1726 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:44.690459  2206 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:44.691015  2206 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.693225  2206 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:44.673436  2245 raft_consensus.cc:3055] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:44.676632  2243 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6.
I20260709 13:13:44.702847 32271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:13:44.703562 32271 raft_consensus.cc:606] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:44.703969 32271 raft_consensus.cc:614] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:44.706210 32123 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
I20260709 13:13:44.707176 32239 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:44.706243 32194 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:44.709400 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:44.711292 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:44.688156  1846 raft_consensus.cc:3055] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:44.716777  1780 raft_consensus.cc:2804] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:44.720743  1846 raft_consensus.cc:740] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:44.720942  1780 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.721421  1780 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:44.721688  1846 consensus_queue.cc:260] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.723021  1846 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:44.724881 32020 catalog_manager.cc:5697] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:44.726814 32020 catalog_manager.cc:5697] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:44.728794 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:44.729504 32266 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:44.730505 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:44.731411 32272 raft_consensus.cc:2410] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:44.695897  2245 raft_consensus.cc:740] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:44.739378 32270 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
I20260709 13:13:44.740679 32191 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:44.744050 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:44.689548  1822 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:44.751086  1822 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:44.751576  1780 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.742159  2217 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:44.754052  1780 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:44.710886  2190 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.757638   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:13:44.758045  2190 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.759303 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:13:44.760185  2190 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:44.757736 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 68296.8us
I20260709 13:13:44.762481 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:44.762773  2245 consensus_queue.cc:260] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.765635 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:44.770996 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:44.771699 32266 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:44.775907 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 417149us
I20260709 13:13:44.707542  2214 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:13:44.778264 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:44.780406 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:44.781311 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.781515 32270 raft_consensus.cc:1240] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:13:44.782197 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.780362  2198 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:44.785957 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.786851  2198 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.789332  2198 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:44.784921  2245 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:44.790393 32268 raft_consensus.cc:1240] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:44.771068  1846 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.792922  1846 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.795027  1846 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:44.798084 32266 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 8.
I20260709 13:13:44.812291 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:44.798699   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:13:44.800701  2214 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:44.806216 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:44.816426 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:44.806934 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:44.809839 32238 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:44.817286 32273 raft_consensus.cc:2393] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 6: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:44.818015 32270 raft_consensus.cc:2368] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 6. Current term is 7.
I20260709 13:13:44.818091 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:44.818426 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:44.808784  1780 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.810757 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:44.813927 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:44.809154  1846 consensus_queue.cc:1059] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:13:44.814951 32268 raft_consensus.cc:2393] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 6: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:44.814900 32264 raft_consensus.cc:1275] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:13:44.820802 32264 pending_rounds.cc:85] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06: Aborting all ops after (but not including) 4
I20260709 13:13:44.821038 32264 pending_rounds.cc:107] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:13:44.821267 32264 raft_consensus.cc:2889] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:44.819628  2241 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.815485 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:44.822049 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:44.815863  2118 raft_consensus.cc:993] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:13:44.816004 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:44.823069  2217 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:44.823237  2183 raft_consensus.cc:1081] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:13:44.823567  2217 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.806457  2173 consensus_queue.cc:1059] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:44.824041  1846 raft_consensus.cc:3055] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:44.818923 32118 raft_consensus.cc:2393] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 6: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:44.824735  2229 raft_consensus.cc:3055] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:44.819147 32271 raft_consensus.cc:2393] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 6: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:44.822685 32116 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:13:44.822055  2241 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.825260  1846 raft_consensus.cc:740] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:13:44.825978 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 45895us
I20260709 13:13:44.826207  1846 consensus_queue.cc:260] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.826839 32239 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:44.827049  2241 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:44.825130  2229 raft_consensus.cc:740] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:13:44.827508  1846 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:44.827657  2183 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:44.828198  2229 consensus_queue.cc:260] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:44.828725  1780 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.829857  2229 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:44.830391 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:44.832684 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:44.832976 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:44.833321 32123 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:13:44.834524 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:44.836395 32122 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:13:44.836992 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:44.837090  2183 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:44.838120  1780 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:44.823995  2217 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:44.814303 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:44.838907 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.840253 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:44.841675 32271 raft_consensus.cc:1240] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:44.842088 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:44.839980 32090 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:44.844041 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:44.844616 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:44.845268 32265 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:44.846628 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.844677 32268 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 8.
I20260709 13:13:44.847666 32089 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:44.852941 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:44.853407 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.854336 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:44.855161 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:44.856001 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:44.856012 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:44.857733 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:44.857988 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:44.858067 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:44.857729 32271 raft_consensus.cc:1240] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:13:44.859400 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:44.860373 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:44.860945 32123 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:44.852504  2175 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:44.862226 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:44.858174 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:44.863441 32124 raft_consensus.cc:1275] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:13:44.865262 32119 raft_consensus.cc:2393] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 4: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:44.854105  2198 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:44.861701  2175 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.873339 32090 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:44.879856 32090 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:44.874258 32118 raft_consensus.cc:1275] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:13:44.866387  2245 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:44.888654 32272 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
W20260709 13:13:44.893972 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.894603  2221 consensus_queue.cc:1059] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:44.895725  2221 raft_consensus.cc:3055] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:13:44.897102 32165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.873504  2241 consensus_queue.cc:1059] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:13:44.889223  1961 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:44.872685  1983 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.874106  2175 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:44.899597 32238 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:44.896662 32090 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:13:44.901091 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.885023  1780 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:44.881610  2198 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.907680 32265 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:13:44.872865  2214 consensus_queue.cc:1059] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.028s
W20260709 13:13:44.905920 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.909828 32123 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:13:44.896111  2221 raft_consensus.cc:740] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:13:44.902853  2303 log.cc:927] Time spent T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:13:44.907488 32268 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:13:44.913240  2207 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:44.903178  2028 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.911680 32090 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:44.898444  2118 consensus_queue.cc:1048] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:13:44.909695  1822 raft_consensus.cc:3055] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:44.916033  1726 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:44.921233 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:44.922842  1922 raft_consensus.cc:3055] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:44.923022  1748 raft_consensus.cc:993] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:13:44.923285  1922 raft_consensus.cc:740] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:44.912053  1972 consensus_queue.cc:1059] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:13:44.924144 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:44.924149  1922 consensus_queue.cc:260] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.925351  1922 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:44.910705  1780 raft_consensus.cc:697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 8 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:44.925949   402 consensus_queue.cc:237] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:44.926784  1780 consensus_queue.cc:237] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.913763  2206 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:44.929276 32265 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:44.931433 32273 raft_consensus.cc:1240] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:44.935096 32264 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:13:44.931808 32238 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:44.919345  2241 raft_consensus.cc:2804] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:44.909531  1983 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.919569  2183 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:44.920516  1822 raft_consensus.cc:740] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:44.939234  1764 raft_consensus.cc:1081] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:13:44.943984 32090 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:44.933646  2206 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.950495 32238 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:44.949087  1748 raft_consensus.cc:3055] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:44.939397  1726 raft_consensus.cc:697] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:44.951277  2183 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.951766  1972 raft_consensus.cc:2804] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:44.951952  2205 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:44.921335  2207 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.917907  2028 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.957574  1748 raft_consensus.cc:740] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:44.959028 32089 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:44.968221 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.957824  2206 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:44.949292  2241 raft_consensus.cc:697] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
W20260709 13:13:44.976400 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:44.977129 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.980453 32194 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:13:44.981122 32194 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:44.981410 32194 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:44.983405 32165 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:44.968844  1961 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:44.971204  1972 raft_consensus.cc:697] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:44.959614  2221 consensus_queue.cc:260] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:44.994078  2182 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:13:44.994448 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 44875.8us
I20260709 13:13:44.994689  2221 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:44.995486 32089 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:44.984920  2185 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:44.996798  2243 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:44.996690  1950 consensus_queue.cc:1059] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:13:44.998845  2183 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:44.968643  2205 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.000626 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:44.985785  1961 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.004518 32193 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:13:45.004199  1726 consensus_queue.cc:237] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.004730  1972 consensus_queue.cc:237] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.005131 32193 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:45.005944 32193 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:45.007826  1961 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:45.005087  2207 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:45.009032  2207 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:44.990281  1822 consensus_queue.cc:260] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.013844  2028 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:45.015952  2205 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:45.017704 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.018144 32266 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
I20260709 13:13:44.989956  2198 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:45.018373 32193 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.020977 32165 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:45.024251 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.028074 32193 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:45.001907  2182 raft_consensus.cc:697] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:45.026124  2205 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:45.038923 32165 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:45.039228 32194 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.041718 32239 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:45.037922  1822 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:45.040505  2252 consensus_queue.cc:1048] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:13:45.041752  2028 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:45.058938 32194 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:45.063755 32298 heartbeater.cc:646] Failed to heartbeat to 127.30.63.62:38793 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.30.63.62:38793 timed out after 15.000s (SENT)
I20260709 13:13:45.068966 32239 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:45.069559  2243 raft_consensus.cc:3055] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:45.080765  2309 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:45.108814  2243 raft_consensus.cc:740] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:45.109323  2309 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:45.109699  2243 consensus_queue.cc:260] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.042263  2182 consensus_queue.cc:237] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.110965  2243 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:45.114576  1961 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.040963  2241 consensus_queue.cc:237] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.118115 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:45.118669 32266 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:45.120874 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 62750.6us
I20260709 13:13:45.090250  2175 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.092128  1748 consensus_queue.cc:260] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.045894  2198 consensus_queue.cc:1059] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:13:45.097007  1983 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:45.097898  2217 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.100847 32165 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:45.151613 32266 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
W20260709 13:13:45.154989 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 54281.7us
I20260709 13:13:45.133033  2185 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:45.168198 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.168982 32239 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:45.164300 32090 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:45.140434  1961 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:45.170311 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:45.171149 32194 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 2.
I20260709 13:13:45.152638  1748 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:45.168282  1983 raft_consensus.cc:2804] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:45.164443  2190 raft_consensus.cc:3055] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:45.165861  1726 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.167650  2241 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:45.215443 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 49569.8us
I20260709 13:13:45.174073  2245 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:45.225329 32238 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:45.185199  2182 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:45.229103 32165 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:45.231086 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.179210  1983 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:45.185598  2190 raft_consensus.cc:740] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:45.214394  1780 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:45.175273  2185 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.219355  1726 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.260068  1780 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.261238  1726 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:45.261790 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 48553.1us
I20260709 13:13:45.262368  2185 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:45.262569 32165 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:45.263466  2311 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:45.263985  2311 raft_consensus.cc:697] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 6 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:45.264878  2311 consensus_queue.cc:237] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:45.265442 32089 leader_election.cc:336] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.999s (SENT)
I20260709 13:13:45.265944 32089 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:45.246701  1983 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:45.240731  2245 raft_consensus.cc:697] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:45.281642 32118 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:45.284869 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:45.284929 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:45.284967  2221 consensus_queue.cc:1059] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:45.285531 32116 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:45.285106 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:45.285753 32122 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:45.286093 32197 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:45.286211  2221 raft_consensus.cc:3055] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:45.287173  2221 raft_consensus.cc:740] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:45.288044  2221 consensus_queue.cc:260] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.288406 32123 raft_consensus.cc:1240] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:45.289517  2221 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:45.290515  2318 log.cc:927] Time spent T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:13:45.290984 32238 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:45.291652  2175 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:45.291944  1726 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:45.292374  1726 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.292726  1726 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:45.293377 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:45.295542 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:45.296384 32115 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:45.296736 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:13:45.297499  2319 log.cc:927] Time spent T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:13:45.298034  2217 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:45.298323 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:45.299594 32116 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:45.300089 32121 raft_consensus.cc:1240] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:13:45.301280  2190 consensus_queue.cc:260] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.302671  2190 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:45.251534  2077 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:45.304996  1822 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:13:45.305624  2314 log.cc:927] Time spent T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:13:45.246373  2241 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.306627  2307 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:45.307993  2241 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:45.310572 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.311029  2206 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.312628  2217 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.313205  2217 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.313295  2245 consensus_queue.cc:237] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.315080 32118 raft_consensus.cc:1240] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 7. Current term is 9. Ops: []
I20260709 13:13:45.315388  2217 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:45.318091  2028 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:45.318832  2118 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.319502  2214 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.326586 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:13:45.320637 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 63945.2us
I20260709 13:13:45.331339 32271 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:13:45.332020 32268 raft_consensus.cc:1275] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:45.304996  2077 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:45.295601 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:45.335494 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:45.335834 32117 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:45.325644 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 50628.2us
I20260709 13:13:45.328336 32264 raft_consensus.cc:1275] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:13:45.273093  1780 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:45.258535  2182 raft_consensus.cc:697] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:45.344352 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:45.345283 32122 raft_consensus.cc:2410] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:45.345402 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:45.345966 32197 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:45.346700 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:45.348881 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:45.352969 32165 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:45.351660 32123 raft_consensus.cc:1240] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:45.350593 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:45.357364 32115 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:45.364909  2183 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.341939  2077 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:45.369365 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:45.371927 32196 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
W20260709 13:13:45.378904 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.384445 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:45.385154 32165 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:45.385411 32118 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:45.365671  2183 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.345199  2173 consensus_queue.cc:1048] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:13:45.342896  2118 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.373515  2307 raft_consensus.cc:2764] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:13:45.350272  2214 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.420312 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:45.371256  1780 consensus_queue.cc:1048] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:13:45.410065  2028 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:45.436940 32197 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:45.437909 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:45.438009 32165 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:45.438582 32268 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:45.419436  2182 consensus_queue.cc:237] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.463477 32165 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:45.439371  2028 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:45.441413  2205 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:45.479329 32123 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
W20260709 13:13:45.485903 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.487071 32268 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:13:45.479096  2028 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:45.488775  2307 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:45.441213  1726 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.496621 32239 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:45.497692 32239 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:45.499020 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.494793 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:45.499706 32124 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:45.504432  1748 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:45.511526 32165 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:45.494436  2307 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:45.489133  1972 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
W20260709 13:13:45.526584 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.496099  1764 consensus_queue.cc:1059] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:13:45.509037  2217 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:45.521561  2205 raft_consensus.cc:2764] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:13:45.531463  2217 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.538550 32238 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:45.541611 32238 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:45.544251 32090 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:45.554179  1846 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:45.528293  2307 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:45.561271  2214 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:45.562119  2118 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:45.562839  1983 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.539075  2221 raft_consensus.cc:3055] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:45.564973  2221 raft_consensus.cc:740] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:45.566097  2221 consensus_queue.cc:260] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.566617 32165 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:45.568213 32117 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:45.572676  2206 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:45.554853  1846 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.540585  2217 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:45.599020  2336 raft_consensus.cc:2804] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:45.599068 32165 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:45.603166  2326 log.cc:927] Time spent T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:13:45.619182  2336 raft_consensus.cc:697] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:45.610409  2183 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:45.610656 32118 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:45.610405 32119 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:45.612447 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:45.620512 32196 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
W20260709 13:13:45.613289 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.556867  2309 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:45.621552  2309 raft_consensus.cc:697] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:45.622483 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:45.623214  1726 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:45.583251  1846 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:45.623808 32194 raft_consensus.cc:1275] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:45.614706 32271 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:13:45.582949  1822 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:45.622447  2309 consensus_queue.cc:237] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.634166  2028 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.636667  1822 raft_consensus.cc:697] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:45.637645  1822 consensus_queue.cc:237] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.639699 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:45.640533 32196 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:45.632665 32090 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:45.642648 32191 raft_consensus.cc:1275] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:13:45.645268 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:45.647011  1961 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:45.647567  1961 raft_consensus.cc:697] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:45.620062  2205 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:45.660331 32268 raft_consensus.cc:1275] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:13:45.660120  2077 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.661855 32270 raft_consensus.cc:1240] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:45.636435  2028 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:45.620318  2336 consensus_queue.cc:237] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.624404 32238 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:13:45.678231 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 53901.2us
W20260709 13:13:45.676399 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 178735us
I20260709 13:13:45.661623  1983 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:45.675105  2311 consensus_queue.cc:1059] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:13:45.673179  2328 log.cc:927] Time spent T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.170s	user 0.001s	sys 0.003s
I20260709 13:13:45.682986 32238 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:45.648460  1961 consensus_queue.cc:237] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.658890  2331 consensus_queue.cc:1048] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:13:45.707480  2217 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.689366  1922 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:45.721129  1922 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.721578  1922 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:45.722587  2217 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:45.723587  2221 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:45.686700  2332 consensus_queue.cc:1048] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:13:45.690303 32239 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:45.670328  2243 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:13:45.726482 32021 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59534 (request call id 46) took 1376 ms. Trace:
I20260709 13:13:45.726902 32021 rpcz_store.cc:276] 0709 13:13:44.349945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:44.350137 (+   192us) service_pool.cc:224] Handling call
0709 13:13:45.726388 (+1376251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":114827,"reported_tablets":1}
I20260709 13:13:45.727437 32199 raft_consensus.cc:1240] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:45.728554 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:45.713935  2077 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:45.714517 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.653447  2307 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.731419  2307 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:45.681897  1726 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:45.732132 32265 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:45.732370  1726 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.732842  1726 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:45.733688 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 44720.8us
I20260709 13:13:45.729212 32191 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:45.737351 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:13:45.755645 32089 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.704s (SENT) [suppressed 15 similar messages]
W20260709 13:13:45.769577 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.748133  2205 raft_consensus.cc:697] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:45.773535  2205 consensus_queue.cc:237] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:45.776940 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 156472us
I20260709 13:13:45.778137 32124 raft_consensus.cc:1275] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:45.738170  2311 consensus_queue.cc:1243] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer fcfc3281929645969ecedbb0c0af759d log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:13:45.782183 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:45.792649 32118 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:45.792760 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:45.793426 32122 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:45.727468  1748 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:45.783733 32123 raft_consensus.cc:1275] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:13:45.799456 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:45.801734 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:45.802594 32116 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:45.807788 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:45.808811 32119 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:13:45.770838  2206 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:13:45.824913  1983 raft_consensus.cc:3055] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:45.825613  1983 raft_consensus.cc:740] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:45.830968 32196 raft_consensus.cc:1275] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:45.768916  2185 consensus_queue.cc:1059] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:13:45.833825  2185 raft_consensus.cc:3055] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:45.834244  2185 raft_consensus.cc:740] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:45.835240  2185 consensus_queue.cc:260] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.836597  2185 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:45.857888  2329 raft_consensus.cc:2955] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 4 to 7, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:13:45.839545  1983 consensus_queue.cc:260] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.866664  1983 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:45.840090 32165 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:45.871062  2342 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:45.871692  2342 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:45.872195  2342 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:45.842374  2077 consensus_queue.cc:1048] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
W20260709 13:13:45.882139 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.821317 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:45.891474 32019 catalog_manager.cc:5697] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 3 to 4, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 4 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:45.919575 32019 catalog_manager.cc:5697] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 5 to 7, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 7 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.904276 32165 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:45.846529 32265 raft_consensus.cc:2955] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 4 to 7, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:13:45.840525  2339 consensus_queue.cc:1059] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 13:13:45.941555  2339 raft_consensus.cc:3055] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:45.942062  2339 raft_consensus.cc:740] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
W20260709 13:13:45.943186 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.855401 32191 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 3.
I20260709 13:13:45.945192 32238 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:45.946066  2191 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:45.946586  2191 raft_consensus.cc:697] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:45.947435  2191 consensus_queue.cc:237] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.943290  2339 consensus_queue.cc:260] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:45.953776  2339 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:45.959846  2340 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:45.960680  2340 raft_consensus.cc:697] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:45.961973  2340 consensus_queue.cc:237] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:45.968600 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 64441.8us
I20260709 13:13:45.844034 32122 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:13:45.993170 32271 raft_consensus.cc:1275] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:46.012655 32165 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:46.020627 32116 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:13:46.032784  2311 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:46.033504  2311 raft_consensus.cc:697] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:46.033319 32019 catalog_manager.cc:5697] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:46.034584  2311 consensus_queue.cc:237] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.035758  2077 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.036234  2077 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.047406 32019 catalog_manager.cc:5697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 7 to 9, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 9 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:46.052091  2077 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:45.818326  1846 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:46.059314 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 260545us
W20260709 13:13:46.070264 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.074157 32239 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:46.078163 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:46.078850 32193 raft_consensus.cc:2468] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:46.083403 32165 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:46.085155 32239 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:46.084829 32019 catalog_manager.cc:5697] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 5 to 7, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 7 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:46.086678 32019 catalog_manager.cc:5697] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 4 to 5, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 5 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:46.084115 32192 raft_consensus.cc:1275] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:13:46.089469 32165 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:46.091395 32239 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:46.085364 32190 raft_consensus.cc:2955] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 4 to 7, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:13:46.091032 32238 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:13:46.086143  2337 log.cc:927] Time spent T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:13:46.098344  1972 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:46.098558  2332 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:46.099148  2332 raft_consensus.cc:697] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:46.084853  1748 consensus_queue.cc:1048] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:13:46.100837 32119 raft_consensus.cc:1275] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:46.102763  2183 raft_consensus.cc:2804] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:46.103204  2183 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.103648  2183 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:46.103828  2252 consensus_queue.cc:1048] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:46.106325  1846 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:46.106869 32197 raft_consensus.cc:1275] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:46.082230  2309 consensus_queue.cc:1048] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:13:46.108722  1972 raft_consensus.cc:697] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:46.109709  2309 consensus_queue.cc:1048] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:46.109659  1972 consensus_queue.cc:237] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.111222  2309 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.112326 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:46.112934 32195 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:46.116819 32116 raft_consensus.cc:1275] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:46.118131 32195 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:46.097154 32019 catalog_manager.cc:5697] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:46.121044 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:13:46.121137 32020 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49556 (request call id 175) took 16206 ms (client timeout 15000 ms). Trace:
I20260709 13:13:46.121930 32122 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:46.122957 32165 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:46.072954  1822 consensus_queue.cc:1048] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:13:46.103436 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:46.123471 32238 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:46.055469  2342 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.093946  2221 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:46.094470  2307 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:46.075366  1922 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.126032 32121 raft_consensus.cc:2468] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:46.124158 32192 raft_consensus.cc:1240] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:46.126020 32117 raft_consensus.cc:1275] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:46.130659 32019 catalog_manager.cc:5697] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:46.135321 32165 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:46.152132 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.158665  2028 raft_consensus.cc:2749] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:46.161099  2205 consensus_queue.cc:1048] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:46.163256 32165 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:46.164319  2028 raft_consensus.cc:2764] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:13:46.111864  2309 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.168712 32122 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:46.170284 32196 raft_consensus.cc:1240] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:46.150895  2221 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.173564 32019 catalog_manager.cc:5697] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 5 to 7, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 7 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:46.155611  1846 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:46.154032  1748 consensus_queue.cc:1048] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:13:46.183269  2346 consensus_queue.cc:1059] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:13:46.154757  2307 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:46.155638  1983 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:46.186069  2221 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:46.192040 32193 raft_consensus.cc:1275] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:46.154170  2252 consensus_queue.cc:1048] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:13:46.190383 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:46.184834  2332 consensus_queue.cc:237] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.188289  2309 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:46.204949  2307 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:46.205371  2309 consensus_queue.cc:1048] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:46.205977  2346 raft_consensus.cc:3055] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:46.206331  2346 raft_consensus.cc:740] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:46.207501  2346 consensus_queue.cc:260] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.208005  1983 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:46.208431  1983 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:46.208868  2346 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:46.196493 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:13:46.184500  2356 log.cc:927] Time spent T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:13:46.210551 32191 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:46.121997 32020 rpcz_store.cc:269] 0709 13:13:29.917186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:29.920522 (+  3336us) service_pool.cc:224] Handling call
0709 13:13:30.739648 (+819126us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b5400047c54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5b090 00007fb59eff9f3a 00007fb5a4db01cc 00007fb5a4eae37e 00007fb5a336f2a4 00007fb5a336f232 00007fb5a336f161 00007fb5a336f0dc 00007fb5a336e392 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:46.121054 (+15381406us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:44.816234 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:44.845774 (+ 29540us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:44.845824 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:13:44.845841 (+    17us) tablet.cc:662] Decoding operations
0709 13:13:44.846254 (+   413us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:44.846342 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:44.846373 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:13:44.846797 (+   424us) tablet.cc:701] Row locks acquired
0709 13:13:44.846849 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:13:44.846999 (+   150us) write_op.cc:270] Start()
0709 13:13:44.847138 (+   139us) write_op.cc:276] Timestamp: P: 1783602824846936 usec, L: 0
0709 13:13:44.847177 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:13:44.899951 (+ 52774us) log.cc:844] Serialized 916 byte log entry
0709 13:13:45.277753 (+377802us) op_driver.cc:464] REPLICATION: finished
0709 13:13:45.519742 (+241989us) write_op.cc:301] APPLY: starting
0709 13:13:45.529178 (+  9436us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:45.577480 (+ 48302us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:45.600965 (+ 23485us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:45.601429 (+   464us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:45.601714 (+   285us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:13:45.601774 (+    60us) write_op.cc:312] APPLY: finished
0709 13:13:45.602041 (+   267us) log.cc:844] Serialized 28 byte log entry
0709 13:13:45.602244 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:45.602327 (+    83us) write_op.cc:454] Released schema lock
0709 13:13:45.602380 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:45.602771 (+   391us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:45.602798 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":198184,"reported_tablets":45,"spinlock_wait_cycles":514414336,"child_traces":[["op",{"apply.queue_time_us":185562,"apply.run_cpu_time_us":2508,"apply.run_wall_time_us":103674,"num_ops":2,"prepare.queue_time_us":62751,"prepare.run_cpu_time_us":28038,"prepare.run_wall_time_us":166408,"raft.queue_time_us":152906,"raft.run_cpu_time_us":62644,"raft.run_wall_time_us":196304,"replication_time_us":401858,"spinlock_wait_cycles":3968,"thread_start_us":294318,"threads_started":4,"wal-append.queue_time_us":117667}]]}
I20260709 13:13:46.171608  2311 consensus_queue.cc:1048] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:13:46.185950  2342 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:46.235136 32019 catalog_manager.cc:5697] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:46.190653  1922 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:46.241375  2329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:54182 (request call id 0) took 1318 ms. Trace:
I20260709 13:13:46.241832  2329 rpcz_store.cc:276] 0709 13:13:44.922977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:44.923108 (+   131us) service_pool.cc:224] Handling call
0709 13:13:44.983015 (+ 59907us) log.cc:844] Serialized 487 byte log entry
0709 13:13:45.514735 (+531720us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b5400316120. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59ef66dbe 00007fb59ef71930 00007fb59ef718d8 00007fb59ef71858 00007fb59ef71813 00007fb59ef70a9c 00007fb5a4e5c626 00007fb5a4e56dd8 00007fb59efad7cb 00007fb59efb02c0
0709 13:13:45.621952 (+107217us) spinlock_profiling.cc:243] Waited 86.9 ms on lock 0x7b5400316120. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59ef6a142 00007fb59ef4aeaa 00007fb59ef51d53 00007fb59ef51cd9 00007fb59ef51c69 00007fb59ef51c31 00007fb59ef50dfd 000000000038f354 000000000038f199 00007fb59bf04475
0709 13:13:46.241279 (+619327us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":241,"raft.queue_time_us":109989,"raft.run_cpu_time_us":4032,"raft.run_wall_time_us":324520,"spinlock_wait_cycles":238531200,"thread_start_us":232996,"threads_started":2,"wal-append.queue_time_us":182871}
I20260709 13:13:46.196815  1846 raft_consensus.cc:697] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:46.244324 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:46.264475 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:46.266120 32122 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:46.231838  2340 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:46.191095  1726 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.269194 32019 catalog_manager.cc:5697] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:46.270941 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.279162 32191 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:13:46.280508 32122 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:13:46.281363 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:46.287688 32124 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:46.281942 32239 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:46.284678 32019 catalog_manager.cc:5697] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:46.284668 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 120224us
I20260709 13:13:46.223927  2183 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.292928 32165 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:46.269330 32006 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f089b75ada024eb9bbf7e4b953063dd4 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:46.296705  2077 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:46.296904  2028 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:46.298593 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:46.263255  1780 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.300181 32190 raft_consensus.cc:1240] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
W20260709 13:13:46.305778 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.297681  2028 raft_consensus.cc:697] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 6 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:46.282266  2118 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.309046 32196 raft_consensus.cc:1240] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:46.273178  1840 consensus_queue.cc:1048] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:13:46.298854  2229 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.313969 32019 catalog_manager.cc:5697] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 3 to 5, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 5 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:46.323271 32019 catalog_manager.cc:5697] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 6 to 7, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 7 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
W20260709 13:13:46.326169 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.321512  2118 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.331519 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:46.331458 32019 catalog_manager.cc:5697] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 5 to 7, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 7 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:46.335999 32019 catalog_manager.cc:5697] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:46.337615 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:46.340485 32190 raft_consensus.cc:2368] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6.
I20260709 13:13:46.353710 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:46.309657  1780 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.358788 32019 catalog_manager.cc:5697] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 4 to 5, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 5 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:46.329957  1764 consensus_queue.cc:1059] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:13:46.339583  2243 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
W20260709 13:13:46.369701 32089 leader_election.cc:336] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.583s (SENT)
W20260709 13:13:46.354947  2353 log.cc:927] Time spent T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.183s	user 0.004s	sys 0.001s
I20260709 13:13:46.376976 32190 raft_consensus.cc:1240] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:46.379009 32089 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:46.308023  1846 consensus_queue.cc:237] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.379271 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:46.356812  1961 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:46.385047  1961 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.385278  2028 consensus_queue.cc:237] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.335368  2229 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:46.384318 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:46.368144 32019 catalog_manager.cc:5697] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:46.410980 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:13:46.423816 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.422086 32019 catalog_manager.cc:5697] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:46.433218 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:46.434510 32193 raft_consensus.cc:2393] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 5: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:46.441833 32197 raft_consensus.cc:1240] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:46.421604  1822 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:46.444433 32271 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:46.447767 32270 raft_consensus.cc:1275] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:46.392262  2243 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:46.444948 32019 catalog_manager.cc:5697] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 2 to 4, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 4 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:46.453418 32019 catalog_manager.cc:5697] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 1 to 2, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 2 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:46.436547  2077 raft_consensus.cc:697] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:46.457751  2369 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.458487  2369 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.458699 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:46.466747  2118 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:46.442899  1840 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.485323 32019 catalog_manager.cc:5697] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:46.490046 32197 raft_consensus.cc:1240] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:46.429925  2307 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.468194  2229 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:46.456956  1726 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:46.489001  1840 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.496367  1961 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:46.499557 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:46.500847 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 131161us
I20260709 13:13:46.502460 32194 raft_consensus.cc:1240] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:46.507237 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:46.493160  2367 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.507704  2214 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:46.573256 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.584721  2175 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.585368  2175 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.589402  2373 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.590166  2373 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:46.592635  2372 log.cc:927] Time spent T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:13:46.593465  2077 consensus_queue.cc:237] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.594432  1840 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:46.597522  2243 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:46.597278  2368 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.609448  2243 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.617653  2243 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.620010  2243 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:46.569720  1726 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.628206   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:46.631521 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:46.598338  1780 leader_election.cc:290] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:46.634793 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.568035  2367 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.622095  2368 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.644133  2307 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:46.633678  1726 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.648438 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:46.588524  2175 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:46.574863  2214 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:46.656348 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 214985us
I20260709 13:13:46.657696 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:46.658618 32194 raft_consensus.cc:2410] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:13:46.648986  2118 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.649519  2367 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:46.670274  2378 consensus_queue.cc:1048] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:46.670835  2309 raft_consensus.cc:3055] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:46.671185  2307 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.671739  2243 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:46.671787  2307 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.686077  2307 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:46.673768  2028 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:46.686743  2028 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.688843  2028 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:46.689005 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:46.689867 32124 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:46.688872 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:46.691274 32120 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:46.695662 32165 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:54172 dropped due to backpressure: service queue is full with 50 items
I20260709 13:13:46.675185 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:46.696985 32198 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:46.675845 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:46.676146  2214 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:46.674532 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:46.677772  2368 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:46.677937 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:46.698632 32190 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:46.680397  2183 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:46.671238  2309 raft_consensus.cc:740] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:46.680910 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:46.681528 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:46.681790  2221 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.682852 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:46.665249  2373 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:46.689980 32121 raft_consensus.cc:1275] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:46.677043  1726 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:46.702003 32120 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:13:46.732071 32239 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:46.721108  2028 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.735285 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:46.725939 32193 raft_consensus.cc:2393] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 7: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:46.682884  2118 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:46.680836  2339 consensus_meta.cc:287] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.726s	user 0.009s	sys 0.003s
I20260709 13:13:46.653249  1983 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.730168 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:46.741868 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:46.742430 32122 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:46.742522 32121 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:46.729218  2191 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:46.722411 32089 leader_election.cc:336] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.558s (SENT)
I20260709 13:13:46.748839 32089 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:46.735941 32115 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:46.747176 32196 raft_consensus.cc:2410] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:13:46.732604 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 63676.2us
I20260709 13:13:46.751765 32190 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
W20260709 13:13:46.741258  2346 consensus_meta.cc:287] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.004s
I20260709 13:13:46.695987 32165 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:54172 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1381)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1392)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1367)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1383)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1368)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1386)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1377)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1382)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1378)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1396)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1374)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1389)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1380)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1385)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1387)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1366)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1365)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1371)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1358)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1356)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1403)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1388)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1401)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1369)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1363)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1357)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1404)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1362)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1373)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1397)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1372)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1379)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1370)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1361)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 1360)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 1376)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 1384)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 1391)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 1395)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 1399)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 1402)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 1405)
W20260709 13:13:46.756966 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.735026  2183 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.746748  1748 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:46.770658 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:46.773036 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 50663.9us
I20260709 13:13:46.742089  2028 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.823639 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:46.778854 32124 raft_consensus.cc:2468] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:46.822611 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:46.828823 32195 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:46.830720 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:46.831398 32124 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:46.780937 32119 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:46.802990 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:46.846096 32191 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:46.813697 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.778278 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:46.859015 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:46.859813 32265 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 7.
W20260709 13:13:46.858178 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.861492 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:46.862313 32192 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:46.873051 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:46.873736 32123 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
W20260709 13:13:46.807471  2357 log.cc:927] Time spent T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.636s	user 0.003s	sys 0.020s
I20260709 13:13:46.880338 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:46.874657 32199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1721) took 1140 ms. Trace:
I20260709 13:13:46.881255 32115 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
W20260709 13:13:46.820140  2354 log.cc:927] Time spent T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.571s	user 0.001s	sys 0.008s
I20260709 13:13:46.875866 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:46.820546  2182 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.812513  2118 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:46.772570  2373 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:46.883473 32195 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:13:46.800613  2175 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.774223  1748 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.877311 32239 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:46.894003 32191 raft_consensus.cc:2410] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:13:46.756376  2191 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.846402  1780 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.881559 32199 rpcz_store.cc:276] 0709 13:13:45.734649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.735197 (+   548us) service_pool.cc:224] Handling call
0709 13:13:45.735546 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:45.735866 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:45.735896 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:45.736512 (+   616us) log.cc:844] Serialized 26 byte log entry
0709 13:13:46.830090 (+1093578us) spinlock_profiling.cc:243] Waited 8 ms on lock 0x7b5400091120. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5b090 00007fb59ef686b8 00007fb59eff192b 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c
0709 13:13:46.830147 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:46.830194 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:46.830259 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:46.830299 (+    40us) raft_consensus.cc:1685] finished
0709 13:13:46.830311 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:46.874568 (+ 44257us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6000,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":18935,"spinlock_wait_cycles":18406784,"thread_start_us":352609,"threads_started":1,"wal-append.queue_time_us":350556}
I20260709 13:13:46.899083  2252 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:46.899246  2118 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:46.872752  2214 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:46.904989 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:46.872717  2332 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.901490 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:46.902098 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:46.901829 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:46.906239 32195 raft_consensus.cc:2376] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7. Re-sending same reply.
I20260709 13:13:46.779904  2183 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.906009 32199 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:13:46.908994 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:46.760941  2309 consensus_queue.cc:260] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.902335 32239 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:46.911650 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:46.911576 32121 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:46.909395 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:46.900154  1748 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:46.896670  2383 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:46.911593 32089 leader_election.cc:336] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.660s (SENT)
I20260709 13:13:46.913794 32239 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:46.914455 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:46.992368 32089 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:46.992868 32192 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:46.992869 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 79132us
I20260709 13:13:46.994863 32239 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:46.914862 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:46.915020 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:46.927160  2183 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:46.915750  2221 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:46.928416  2028 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:46.897737  2182 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.904524  1780 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.900098  2175 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:46.939062 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.939062  1983 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:46.937853  2191 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:46.948457  2369 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:46.953510 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:47.021497 32190 raft_consensus.cc:2376] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7. Re-sending same reply.
I20260709 13:13:46.961612 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.022781 32194 raft_consensus.cc:2393] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 9: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
W20260709 13:13:46.966989 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.912412  2332 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:46.912456  2077 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:46.969646  2361 log.cc:927] Time spent T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:13:46.910665  2214 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:47.041146  2214 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:46.971910 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.042286 32193 raft_consensus.cc:2393] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 7: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:47.043267 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:47.044049 32193 raft_consensus.cc:2393] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 9: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:47.044845 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:47.045909 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.046449 32193 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:47.047253 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:47.047775 32193 raft_consensus.cc:2376] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5. Re-sending same reply.
I20260709 13:13:46.972954 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.048744  2077 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:47.049582 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.050612 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.050843  2077 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:47.051162 32197 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:47.051437  1983 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:47.051994 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.051913  1983 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:13:46.974237 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.053124 32198 raft_consensus.cc:2393] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 5: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:47.053915 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.054026  1983 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:47.054646  2390 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:47.055003 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.056058 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:46.974061  2383 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:47.057085 32115 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 7.
I20260709 13:13:47.057637  2309 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:47.058240  2383 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:13:46.977792 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 62235us
I20260709 13:13:47.059202 32165 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:47.060281 32165 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:47.061342 32165 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:47.062536  2311 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:47.063225  2311 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:47.063930  2311 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:47.065369 32165 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:47.066136  1780 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:46.917030 32195 raft_consensus.cc:2393] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 5: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:47.069031  1922 consensus_queue.cc:1059] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:47.069684 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.070317 32195 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 8.
I20260709 13:13:47.070544  1764 raft_consensus.cc:3055] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:46.998499 32239 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:47.004735 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:13:47.008319 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 102072us
I20260709 13:13:47.009593 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:47.016911   369 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:13:47.003502  2118 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:47.071130 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:47.087052 32195 raft_consensus.cc:2410] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:13:47.088260 32191 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
W20260709 13:13:47.090998 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.094024 32192 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:13:47.094549 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:47.027825 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:13:47.028599 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 117011us
I20260709 13:13:47.033193 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:47.035965  2332 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:47.038273  2175 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:47.039026  2375 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:47.067273 32165 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:46.918042  2367 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:47.067713  2182 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:47.067900 32197 raft_consensus.cc:2393] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 7: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:47.068085 32198 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:47.068383 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:13:47.100484 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.104213 32190 raft_consensus.cc:2376] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 8. Re-sending same reply.
I20260709 13:13:47.119057 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.119896 32190 raft_consensus.cc:2393] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 8: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:47.071038  1764 raft_consensus.cc:740] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:47.112952 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:47.114090 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:47.111182 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 112774us
I20260709 13:13:47.113314 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.117376 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.116288 32194 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:13:47.128234 32196 raft_consensus.cc:2376] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7. Re-sending same reply.
I20260709 13:13:47.128343 32239 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:47.113736 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:47.103863 32089 leader_election.cc:336] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.510s (SENT)
I20260709 13:13:47.116719 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:47.129633 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:47.130770 32195 raft_consensus.cc:2393] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 9: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:47.128818 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:47.131042 32269 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:13:47.131244 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.127962 32191 raft_consensus.cc:2393] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 4: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:47.131808 32192 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:47.121122 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.133167 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:47.133420 32089 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:47.133955 32196 raft_consensus.cc:2410] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:13:47.129227 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.117106 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.124886 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:13:47.105084   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 88252.3us
I20260709 13:13:47.085968  2252 raft_consensus.cc:697] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:47.140331 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:47.141062 32199 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:47.142760 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:47.144054 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.126272 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:47.110387 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:47.126361 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.145270 32272 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:47.082129  2028 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:47.149606 32198 raft_consensus.cc:1240] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 9. Ops: []
I20260709 13:13:47.148274 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.150254 32194 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:47.151718 32196 raft_consensus.cc:3055] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:13:47.146147 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 78838us
I20260709 13:13:47.146960 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.152937 32165 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:47.151015 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.153419 32192 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:47.048544 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:13:47.150265 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 46428.1us
W20260709 13:13:47.155460 32089 leader_election.cc:336] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.708s (SENT)
I20260709 13:13:47.155786 32192 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:47.155848 32089 leader_election.cc:304] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:47.154348 32194 raft_consensus.cc:1275] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:47.121234  2375 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.100805  2118 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.114272  2214 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.120978  2369 raft_consensus.cc:2804] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:47.114418  2390 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.155625 32193 raft_consensus.cc:2393] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 9: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:47.147689 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.152056 32196 raft_consensus.cc:740] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:47.156629  2340 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:47.273710 32191 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:47.280022 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.157621 32239 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:13:47.281540 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 123989us
I20260709 13:13:47.139736  2322 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:47.142057  2311 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:47.196750 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.127241  1983 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:47.233048 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.130213  2367 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.242184  2221 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.181197 32197 raft_consensus.cc:3055] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:47.294200 32197 raft_consensus.cc:740] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:47.241779   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:47.237121  2387 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:47.036105  1748 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:47.298038  2367 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:47.239148 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 86336.4us
I20260709 13:13:47.241442 32194 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:47.312197 32194 raft_consensus.cc:3055] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:47.312855 32194 raft_consensus.cc:740] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:47.240075  2339 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:47.262547 32270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:13:47.270524 32199 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:13:47.318483 32192 raft_consensus.cc:1275] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:47.284523 32191 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:47.271840  2395 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:47.282205 32239 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:47.274286 32196 consensus_queue.cc:260] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:47.272305  2375 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:47.291822  2369 raft_consensus.cc:697] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:47.156930  2190 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:47.271968  2118 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:47.300923 32193 raft_consensus.cc:3055] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:47.310647 32195 raft_consensus.cc:1240] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:47.292793  2322 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.289719  2214 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:47.337757  2395 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:47.272122 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 116686us
I20260709 13:13:47.299034  2221 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:47.317044 32270 raft_consensus.cc:606] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:47.330005 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.366935 32199 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
W20260709 13:13:47.367537 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.368093 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.330650 32190 raft_consensus.cc:1275] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:13:47.300523  2396 log.cc:927] Time spent T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:13:47.331836 32238 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:47.371294 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.372298 32195 raft_consensus.cc:2393] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 8: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:47.372113 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:47.373210 32272 raft_consensus.cc:2468] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:47.371542 32238 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:47.374078  1846 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:47.374468  1846 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.374784  1846 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:47.376753  1840 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:47.338047  2339 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:47.377202  1840 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.377568  1840 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:47.378835  2339 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:47.333307 32194 consensus_queue.cc:260] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:47.295200 32197 consensus_queue.cc:260] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:47.382953 32197 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:47.258157  2252 consensus_queue.cc:237] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:47.385844  2369 consensus_queue.cc:237] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:47.338042 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 55923.5us
I20260709 13:13:47.390268  2214 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:47.390498 32239 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:47.392797 32268 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:13:47.393386 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:47.393702 32090 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:47.393973 32116 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:47.394598 32090 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:47.395908 32090 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:47.396055  2214 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:47.396469  2214 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.396835  2214 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:47.396865 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:47.397706 32115 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:47.399132  1961 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:47.310534  2374 raft_consensus.cc:2804] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:47.402853 32194 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:47.346552 32196 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:47.280300  2390 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:47.323414 32165 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:47.339244  1748 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:47.296109  2311 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:47.346259  2191 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:47.428728 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:47.429384 32122 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:47.429503 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:47.430337 32124 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:47.396898 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:47.429402 32120 raft_consensus.cc:1275] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:13:47.400857 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:47.432662 32272 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:13:47.412298 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:47.332512 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.434604 32191 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:47.344128  2340 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:47.414323 32089 leader_election.cc:336] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.915s (SENT)
I20260709 13:13:47.401341  2175 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:47.361907 32193 raft_consensus.cc:740] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:47.423096 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:47.365500  2395 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:47.418697  2206 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:47.426532 32197 raft_consensus.cc:1275] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:13:47.482247 32197 pending_rounds.cc:85] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 3
I20260709 13:13:47.482709 32197 pending_rounds.cc:107] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:13:47.483028 32197 raft_consensus.cc:2889] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:47.427460 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:47.484822 32115 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:47.363503  2322 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:47.436743 32089 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:47.420039 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 96743.9us
I20260709 13:13:47.491454 32165 leader_election.cc:400] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 6. Current term is 7.
I20260709 13:13:47.401649  2374 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.441135 32118 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:47.442461 32193 consensus_queue.cc:260] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:47.497637 32196 raft_consensus.cc:1275] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:13:47.497991 32193 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:47.422437 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:47.500072 32121 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
W20260709 13:13:47.457581 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.425163  2339 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:47.436383  2191 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.444545  2175 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.515708 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:47.522907 32116 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:13:47.523422 32119 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
W20260709 13:13:47.520648 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 106343us
W20260709 13:13:47.521054 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 82993.2us
I20260709 13:13:47.482179  2206 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.530867 32165 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:47.528072 32090 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:47.527725 32115 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
W20260709 13:13:47.557446 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.639688  2339 consensus_queue.cc:1048] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:47.508666  2374 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:47.521478  2191 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:47.526898  2175 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:47.445763  2340 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:47.643570  2373 raft_consensus.cc:2804] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:47.633422  2028 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:47.675460 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.653873  2252 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.658697  2217 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.660036  2373 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.698045  2340 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:47.698239  1846 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:47.698542  1840 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:47.691963  1764 consensus_queue.cc:260] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:47.701669  1764 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:47.703023  1840 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:47.527272 32089 leader_election.cc:336] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.642s (SENT)
I20260709 13:13:47.702966  2118 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:47.703836 32089 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:47.551900 32165 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:47.700809  2221 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:47.682476 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 280296us
W20260709 13:13:47.715968 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 164172us
I20260709 13:13:47.543941 32090 leader_election.cc:304] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:47.717303 32165 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:47.718585 32165 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:47.722342 32165 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:47.723593 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 196329us
I20260709 13:13:47.727999  1961 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:47.730068 32089 leader_election.cc:336] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.772s (SENT)
I20260709 13:13:47.730535 32089 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:47.731462  1780 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:47.528829  2378 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:47.708983  2373 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:47.762203 32192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 1402) took 1068 ms. Trace:
I20260709 13:13:47.762770 32192 rpcz_store.cc:276] 0709 13:13:46.693760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.184778 (+491018us) service_pool.cc:224] Handling call
0709 13:13:47.318031 (+133253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:47.318923 (+   892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:47.744326 (+425403us) spinlock_profiling.cc:243] Waited 84.6 ms on lock 0x7b54001a3450. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff08ad 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:47.762114 (+ 17788us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194650368}
I20260709 13:13:47.740701 32165 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:47.539587  2206 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:47.733361  2340 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:47.736912  2028 raft_consensus.cc:2804] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:13:47.766150 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 54011.7us
I20260709 13:13:47.700495  1846 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:47.733412  1983 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:47.708267  2217 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:47.779986  2339 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:47.772094 32238 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:47.685302  2252 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:47.788726 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 244888us
I20260709 13:13:47.764302  2403 raft_consensus.cc:2804] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:47.765022  2175 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:47.796706  2311 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:47.811077 32089 leader_election.cc:336] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.522s (SENT)
I20260709 13:13:47.795234  2339 raft_consensus.cc:697] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
W20260709 13:13:47.817032 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:47.817543 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:47.817775 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.819350  2339 consensus_queue.cc:237] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:47.823086 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:47.799407  2118 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:47.802835  2403 raft_consensus.cc:697] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:47.830168 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:47.831305 32118 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:47.833285 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:47.821908  2206 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:47.829061 32089 leader_election.cc:336] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.877s (SENT)
I20260709 13:13:47.838521 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.847950 32089 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:47.839124 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:47.849370 32193 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:47.850834 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:47.851455 32191 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:47.852936 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:47.853219  2419 raft_consensus.cc:2749] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:47.853542 32199 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:47.839731 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:47.840411 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:47.823640  2369 raft_consensus.cc:2804] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:47.840552  2214 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:47.843379  2175 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:47.840479 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:47.887216 32119 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:47.893730 32118 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:13:47.847002  2375 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:47.898103 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:13:47.862061 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.864804 32191 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
W20260709 13:13:47.901906 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 92013.7us
I20260709 13:13:47.902894 32239 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:47.903532 32193 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
W20260709 13:13:47.862409 32089 leader_election.cc:336] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.966s (SENT)
I20260709 13:13:47.904035 32239 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:47.896894 32122 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:13:47.905572 32266 raft_consensus.cc:1217] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 5.4->[7.5-7.5]   Dedup: 7.5->[]
I20260709 13:13:47.906088 32266 raft_consensus.cc:1240] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:13:47.907258 32273 raft_consensus.cc:1240] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:47.904422 32089 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:47.908942 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:47.910054 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:47.910754 32265 raft_consensus.cc:2368] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 9. Current term is 10.
I20260709 13:13:47.911710 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:47.854573  2411 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.906463 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:47.923403 32195 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:47.898346 32190 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:13:47.917595 32199 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:47.855119 32197 raft_consensus.cc:1275] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:13:47.920512 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 130842us
I20260709 13:13:47.925202 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:47.889256  2369 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.952884  2369 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:47.953117 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:47.891216  2420 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:47.929425  2332 raft_consensus.cc:2804] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:47.956230  2420 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.956509  2332 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.956758  2420 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:47.957003  2332 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:47.957552  2406 log.cc:927] Time spent T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:13:47.930014 32123 raft_consensus.cc:2368] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9.
I20260709 13:13:47.928081 32271 raft_consensus.cc:2368] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6.
I20260709 13:13:47.927453 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:47.965142 32124 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:47.966127 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:47.919986  2175 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:47.966832 32124 raft_consensus.cc:2393] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 9: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:47.931505 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:47.970393 32116 raft_consensus.cc:2393] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 7: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:47.827708  2028 raft_consensus.cc:697] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 4 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:47.979889  2390 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:47.979590  2028 consensus_queue.cc:237] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:47.981040  2403 consensus_queue.cc:237] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:47.983594 32090 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:47.984414  2378 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:47.984820  2378 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.985188  2378 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:47.995419  2217 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:48.000662 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:13:48.001350 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.001597 32124 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:48.002188 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.003091  2311 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.003770  2311 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:47.929224  2411 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:47.913599  2400 log.cc:927] Time spent T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:13:48.005414 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:48.005965  2311 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:48.006745 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:47.920799  2417 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:48.007156 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:48.007467  2417 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.007861  2417 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:48.010052 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:48.011230 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:48.011910 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:47.928855  2221 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.012995 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:48.013473  2221 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.014328 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:48.015759  2373 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:47.932548 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:47.952423  2405 log.cc:927] Time spent T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:13:47.951150  2252 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:47.933477 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 71126.6us
I20260709 13:13:48.003044  2340 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:48.006014  2411 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:48.016252  2221 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:48.018425  2369 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.030254  2214 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:48.055711  2340 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:47.926847  2381 consensus_queue.cc:1048] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.130s
I20260709 13:13:48.017875  2375 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:48.058161  2340 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:48.024062 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:48.060204 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:48.060741 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:48.060971 32268 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:48.015777 32272 raft_consensus.cc:1240] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:47.936740 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:48.061507 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:47.996243 32195 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
W20260709 13:13:48.061839 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 111532us
I20260709 13:13:48.043184  2206 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:48.034480  2420 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.063506 32273 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
I20260709 13:13:48.013514 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:48.104449 32267 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
W20260709 13:13:48.040518 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.124192 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:48.126101 32197 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:48.127197 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:48.125239 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:48.128394 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:48.129006 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:48.129398 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:48.130028 32193 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:48.130452 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:48.130753 32118 raft_consensus.cc:2368] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 6. Current term is 7.
I20260709 13:13:48.130811 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:48.131707 32193 raft_consensus.cc:2410] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:13:48.118294 32119 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
I20260709 13:13:48.124505 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:48.124900 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:48.031316 32124 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:13:48.132977 32191 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 3.
I20260709 13:13:48.135118 32197 raft_consensus.cc:2393] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 7: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:48.134521 32199 raft_consensus.cc:2468] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:48.135565 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:48.135736 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:48.108803 32266 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
I20260709 13:13:48.136488 32191 raft_consensus.cc:2376] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7. Re-sending same reply.
W20260709 13:13:48.105909 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 201913us
I20260709 13:13:48.138160 32239 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:48.139222 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:48.140209 32239 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:48.140525 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:48.141187 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:48.142067 32124 raft_consensus.cc:2368] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 7. Current term is 8.
I20260709 13:13:48.142182 32193 raft_consensus.cc:2368] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10.
I20260709 13:13:48.143070 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:48.045959  2322 consensus_meta.cc:287] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.000s
I20260709 13:13:48.155570  2322 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:48.158129   402 raft_consensus.cc:2393] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 8: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:13:48.158244  2322 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:48.161929  2378 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:48.162585 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:48.163235 32120 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:13:48.163730  2369 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:48.164122 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:48.144752 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:48.151520  2221 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:47.973826  2395 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.168877  2214 raft_consensus.cc:2804] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:48.168886  2190 consensus_queue.cc:1059] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:13:48.170536  2332 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:47.940143 32122 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:48.176050 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:48.134299  2340 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.036682  2373 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:48.199301 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:48.200009 32120 raft_consensus.cc:2368] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 6. Current term is 7.
I20260709 13:13:48.177666 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:48.175719 32089 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:48.177023 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:48.164345  2378 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:48.207683 32120 raft_consensus.cc:1240] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:13:48.210942   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:13:48.212863 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:48.181555 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:48.182193 32115 raft_consensus.cc:1240] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:48.183017 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:48.184358 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:48.180156 32124 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
I20260709 13:13:48.213658 32266 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:13:48.026490  2191 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.146687 32165 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:13:48.193177 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 354326us
W20260709 13:13:48.222056 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 75459.1us
I20260709 13:13:48.222461 32119 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:13:48.223834 32165 leader_election.cc:400] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 6. Current term is 7.
I20260709 13:13:48.193528 32116 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:48.224143 32165 leader_election.cc:403] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:13:48.224491 32118 raft_consensus.cc:1240] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:48.224838 32165 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:13:48.194829 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 52440.9us
W20260709 13:13:48.139900  2367 consensus_meta.cc:287] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.831s	user 0.004s	sys 0.009s
I20260709 13:13:48.202224 32190 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 8.
I20260709 13:13:48.226962 32118 raft_consensus.cc:1275] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:48.226382 32239 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:48.206393 32122 raft_consensus.cc:1240] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 8 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:48.214830 32121 raft_consensus.cc:1240] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:48.038568  2374 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.181200  2214 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.220901 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:48.231051 32124 raft_consensus.cc:1275] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:13:48.232792 32120 raft_consensus.cc:1240] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 13:13:48.233949 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.244220 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:48.245057 32119 raft_consensus.cc:2393] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 8: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:48.234175 32265 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:48.211586  2221 raft_consensus.cc:697] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:48.236666 32238 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:48.242448 32272 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:13:48.250240 32273 raft_consensus.cc:2393] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 7: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:48.221131  2378 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:13:48.146564 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.261497 32238 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:48.261711  2381 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:48.261860  2252 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:48.261019 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:48.299304 32116 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
I20260709 13:13:48.267156 32266 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:13:48.243059  2410 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:13:48.242933  2411 consensus_queue.cc:1059] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:13:48.274503 32269 raft_consensus.cc:2393] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 6: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:48.243052  1983 raft_consensus.cc:2764] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:13:48.214542  2340 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.235473  2311 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:48.239259  2367 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.242465  2214 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:48.229781  2373 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:48.278191  2420 leader_election.cc:290] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:48.279731  2332 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:48.287038 32238 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:48.295117  2370 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:13:48.296528  2423 log.cc:927] Time spent T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:13:48.301162 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:48.281142  2378 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.297590  2381 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:48.313443 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 88673.2us
I20260709 13:13:48.303103  2206 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:13:48.323120 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.324081 32238 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:48.330551 32264 raft_consensus.cc:2393] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 8: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
W20260709 13:13:48.315542 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 139891us
I20260709 13:13:48.336651  2381 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:48.341204  2395 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:48.342612 32089 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:48.343339  2426 raft_consensus.cc:3055] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:48.343437  2420 raft_consensus.cc:2804] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:48.343839  2426 raft_consensus.cc:740] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:48.344071  2420 raft_consensus.cc:697] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:48.333822 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:48.344836  2426 consensus_queue.cc:260] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.345062  2420 consensus_queue.cc:237] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.346105  2426 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:48.335947 32165 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:48.347177  2028 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:48.347631  2028 raft_consensus.cc:697] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:48.348511  2028 consensus_queue.cc:237] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.347685 32165 leader_election.cc:400] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 7. Current term is 8.
I20260709 13:13:48.349738 32165 leader_election.cc:403] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:48.350351  2421 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 7. Current term is 8.
I20260709 13:13:48.350406 32165 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:48.337091  2370 raft_consensus.cc:697] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:48.351212  1983 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:48.351653  1983 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.352010  1983 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:48.351816  2370 consensus_queue.cc:237] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.354092 32165 leader_election.cc:400] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 6. Current term is 7.
I20260709 13:13:48.354518 32165 leader_election.cc:403] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:48.312068  2252 raft_consensus.cc:697] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:48.357848 32089 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:48.339206 32238 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:48.367431 32265 raft_consensus.cc:2468] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:13:48.328676 32090 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:48.355080  2421 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:13:48.373999 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:48.374248 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:48.374639 32190 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:48.376142 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:48.376557 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:48.376852 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:48.377427  2190 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:48.378036  2190 raft_consensus.cc:697] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
W20260709 13:13:48.377347 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 56845.1us
I20260709 13:13:48.379002 32090 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:48.379045  2190 consensus_queue.cc:237] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.379593 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:48.384472 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:48.336036  2378 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:48.278206  2221 consensus_queue.cc:237] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.374815 32192 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:13:48.336242  2375 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:48.392032 32197 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:48.392956 32190 pending_rounds.cc:85] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 5
I20260709 13:13:48.401257 32190 pending_rounds.cc:107] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:13:48.401587 32190 raft_consensus.cc:2889] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:48.394942  1961 raft_consensus.cc:2804] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:48.393896 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:48.395620 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:48.337337  2374 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:48.382561  2411 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:48.318591  2373 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.425582  2373 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:48.427176  2367 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:48.426985  1983 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.366123  1726 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:48.365149  2206 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.432901  1726 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:48.433360  1726 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:48.434525  2206 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:48.416726  2375 raft_consensus.cc:697] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:48.436044  2375 consensus_queue.cc:237] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.370165  2175 raft_consensus.cc:2764] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:13:48.390023  2339 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.000s	sys 0.011s
W20260709 13:13:48.438357  2339 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.000s	sys 0.011s
I20260709 13:13:48.390501  2191 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:48.414004 32198 raft_consensus.cc:1275] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:48.414731 32193 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:48.414764 32191 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:48.414832 32270 raft_consensus.cc:1240] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 4. Current term is 6. Ops: []
I20260709 13:13:48.396909 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:48.417943 32195 pending_rounds.cc:85] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 4
I20260709 13:13:48.445156 32195 pending_rounds.cc:107] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:13:48.381791  2311 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 6. Current term is 7.
W20260709 13:13:48.420902 32271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36084 (request call id 1498) took 1321 ms (client timeout 1754 ms). Trace:
I20260709 13:13:48.423386  2411 raft_consensus.cc:697] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:48.387547 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:48.455713 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:48.457736 32197 raft_consensus.cc:1275] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:48.456892 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:48.423611  2340 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:48.445544 32195 raft_consensus.cc:2889] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:48.453066 32271 rpcz_store.cc:269] 0709 13:13:47.093004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.093969 (+   965us) service_pool.cc:224] Handling call
0709 13:13:48.414487 (+1320518us) spinlock_profiling.cc:243] Waited 832 ms on lock 0x7b54001ba3d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:48.414668 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1914473728}
I20260709 13:13:48.389362  2407 consensus_queue.cc:1048] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:13:48.480811 32090 leader_election.cc:400] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6.
I20260709 13:13:48.481261 32090 leader_election.cc:403] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:13:48.445515 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.415352  2422 raft_consensus.cc:3055] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:48.473351 32191 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:48.476763 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:48.486352 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:48.487308 32271 raft_consensus.cc:2368] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 6. Current term is 7.
I20260709 13:13:48.490474 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:48.498960 32089 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:48.501793 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:48.505429 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:48.483045  2340 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.507311  2381 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.507428  2340 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.442901  1961 raft_consensus.cc:697] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
W20260709 13:13:48.518090 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.509766  2381 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:48.416486  2437 consensus_queue.cc:1059] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.114s
I20260709 13:13:48.513026  2390 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:48.526728  2411 consensus_queue.cc:237] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.439312  2417 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.510238 32266 raft_consensus.cc:2393] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 11: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:48.503142  2420 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:13:48.514261 32089 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:48.483388  2422 raft_consensus.cc:740] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:48.541009 32089 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:48.509804  2340 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:48.479492  2252 consensus_queue.cc:237] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.550469 32193 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:48.553552 32123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56890 (request call id 1786) took 1141 ms. Trace:
I20260709 13:13:48.554143 32123 rpcz_store.cc:276] 0709 13:13:47.411943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.412060 (+   117us) service_pool.cc:224] Handling call
0709 13:13:48.553244 (+1141184us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b54000974d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:48.553470 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1136681216}
I20260709 13:13:48.545406  1983 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:48.555540  2416 log.cc:927] Time spent T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.567s	user 0.002s	sys 0.002s
I20260709 13:13:48.562764 32265 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
I20260709 13:13:48.544171  2390 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:48.506721 32271 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:48.567351 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 211485us
I20260709 13:13:48.568753 32165 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:48.569747 32089 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:48.579051 32117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1784) took 1167 ms. Trace:
I20260709 13:13:48.580008 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:48.579558 32117 rpcz_store.cc:276] 0709 13:13:47.411352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.412334 (+   982us) service_pool.cc:224] Handling call
0709 13:13:47.437124 (+ 24790us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:47.440003 (+  2879us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:47.440033 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:47.445783 (+  5750us) log.cc:844] Serialized 26 byte log entry
0709 13:13:47.782812 (+337029us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:47.782857 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:47.982090 (+199233us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b54004119d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:47.982135 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:48.554965 (+572830us) spinlock_profiling.cc:243] Waited 34.9 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:13:48.578802 (+ 23837us) raft_consensus.cc:1685] finished
0709 13:13:48.578826 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:48.578986 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17396,"raft.queue_time_us":3744,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":40302,"spinlock_wait_cycles":85915136,"thread_start_us":255974,"threads_started":1,"wal-append.queue_time_us":413406}
I20260709 13:13:48.581741 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:48.570390  2435 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:48.588413 32089 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:48.584739  2438 log.cc:927] Time spent T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:13:48.582631  2028 raft_consensus.cc:2764] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:13:48.595234 32165 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:48.595577 32271 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 8.
W20260709 13:13:48.596304 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.585026  2175 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:48.600479 32273 raft_consensus.cc:1240] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:48.600857 32271 raft_consensus.cc:1240] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:48.603302 32273 raft_consensus.cc:1240] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:48.587939  2437 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:48.604400 32089 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:48.592176  1961 consensus_queue.cc:237] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.616886  2417 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:48.617273  2448 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:48.598145  2435 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:48.626748  2434 log.cc:927] Time spent T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:13:48.627784  1726 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.631963  2421 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 6. Current term is 7.
I20260709 13:13:48.597289  2339 consensus_queue.cc:1048] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:13:48.582311  2422 consensus_queue.cc:260] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.633167  2422 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:48.593639  1983 consensus_queue.cc:1059] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:13:48.634070  1983 raft_consensus.cc:3055] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:48.634438  1983 raft_consensus.cc:740] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:48.635208  1983 consensus_queue.cc:260] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.645305 32089 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:48.636417  1983 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:48.636660  2443 log.cc:927] Time spent T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.114s	user 0.000s	sys 0.002s
I20260709 13:13:48.606106  2437 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.598374  2446 consensus_queue.cc:1048] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:13:48.647831  2190 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:48.661670 32089 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:48.670542 32266 raft_consensus.cc:1240] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:48.626047  2340 consensus_queue.cc:1059] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:13:48.673388 32266 raft_consensus.cc:1240] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:48.631963  2378 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.656549  2437 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:48.673060  2448 raft_consensus.cc:697] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:48.686875  2448 consensus_queue.cc:237] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.689567  2445 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:13:48.650306  2435 consensus_queue.cc:1048] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:13:48.668372  2387 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:13:48.726411 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 125203us
I20260709 13:13:48.669080  1780 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:13:48.710242  2450 log.cc:927] Time spent T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 13:13:48.711412   402 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38184 (request call id 52) took 1564 ms (client timeout 1962 ms). Trace:
W20260709 13:13:48.713573  2440 log.cc:927] Time spent T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 13:13:48.715808 32264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36084 (request call id 1500) took 1622 ms (client timeout 1576 ms). Trace:
W20260709 13:13:48.718484 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 456372us
I20260709 13:13:48.720101 32269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36084 (request call id 1512) took 1330 ms. Trace:
I20260709 13:13:48.745795 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:48.720212 32267 raft_consensus.cc:1240] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:48.743057 32269 rpcz_store.cc:276] 0709 13:13:47.389234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.396668 (+  7434us) service_pool.cc:224] Handling call
0709 13:13:48.719757 (+1323089us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b54002fc6d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:48.720007 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1891531648}
W20260709 13:13:48.741631 32264 rpcz_store.cc:269] 0709 13:13:47.093716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.113483 (+ 19767us) service_pool.cc:224] Handling call
0709 13:13:48.715481 (+1601998us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54000f1254. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:48.715709 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2760020352}
I20260709 13:13:48.753315 32239 leader_election.cc:400] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9.
I20260709 13:13:48.728837 32165 leader_election.cc:400] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 9. Current term is 10.
I20260709 13:13:48.755162 32239 leader_election.cc:403] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:48.732038 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:48.680920  2190 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:48.747089 32191 raft_consensus.cc:2393] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 8: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:48.759166 32273 raft_consensus.cc:2393] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 8: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:48.727952  2435 consensus_queue.cc:1243] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer 113b5461952d47e0944d463ea4e32801 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:13:48.754377 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 84390.6us
I20260709 13:13:48.674279  2175 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:13:48.755872 32165 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:48.759413 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:48.757066 32238 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:13:48.668254  2419 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.006s	sys 0.017s
I20260709 13:13:48.761947 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:13:48.762192 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.762846 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:48.765007 32165 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:48.769196 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:48.773941 32120 raft_consensus.cc:1275] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:48.769106 32090 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:48.770025 32123 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:13:48.776795 32165 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:48.778101 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:48.778864 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:48.778980 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:48.779778 32122 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:48.779682 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:48.780942 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:48.781584 32120 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:48.784070 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:13:48.757871  2442 log.cc:927] Time spent T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.231s	user 0.003s	sys 0.000s
I20260709 13:13:48.788152 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:48.802448 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:48.802882 32124 raft_consensus.cc:2393] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 11: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:48.803058 32119 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:48.787062 32238 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:13:48.774425  2419 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.006s	sys 0.017s
W20260709 13:13:48.845258 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 67934.1us
I20260709 13:13:48.845423 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:48.846215 32119 raft_consensus.cc:2393] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 8: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:48.759804  1748 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9.
I20260709 13:13:48.854120 32194 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:48.846859 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:48.857748 32119 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:48.833806 32165 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:48.856631 32122 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:48.785007  2190 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:48.882929 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 74413.7us
I20260709 13:13:48.884030 32165 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:48.784801  1780 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:48.876046 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:48.782699  2446 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:48.801692  2395 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:48.782781  2339 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:48.894606 32122 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:48.884056 32119 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
W20260709 13:13:48.738070   402 rpcz_store.cc:269] 0709 13:13:47.147442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.147621 (+   179us) service_pool.cc:224] Handling call
0709 13:13:48.711027 (+1563406us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b540051b8d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:48.711284 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1977393024}
W20260709 13:13:48.895464 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 112817us
I20260709 13:13:48.843041  2415 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:48.896608 32165 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:48.904484 32123 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
W20260709 13:13:48.893873  2214 consensus_meta.cc:287] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.571s	user 0.010s	sys 0.003s
I20260709 13:13:48.908975 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:48.917634 32119 raft_consensus.cc:2393] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 7: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:48.920944  2214 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.922094 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:48.922320  2452 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:48.922698 32119 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:13:48.885198  2448 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:48.897317  2454 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:48.860978  2252 consensus_queue.cc:1048] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:13:48.929963 32122 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:48.932634  2190 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:48.933682  2311 raft_consensus.cc:3055] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:48.934201  2420 raft_consensus.cc:2749] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6.
I20260709 13:13:48.924484  2373 consensus_queue.cc:1059] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:13:48.974030  2373 raft_consensus.cc:3055] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:48.974515  2373 raft_consensus.cc:740] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:48.898777  2395 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.979748  2395 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:48.985010  2448 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.987830  2448 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:48.902829  2028 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:13:48.943809  2449 log.cc:927] Time spent T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.338s	user 0.002s	sys 0.000s
I20260709 13:13:48.909083  2415 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.923216  2214 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:48.948638  2454 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.969022 32119 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
W20260709 13:13:48.969211 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.973345  2311 raft_consensus.cc:740] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:49.039474  2311 consensus_queue.cc:260] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:49.040998  2311 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:49.043524  2395 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.937052  2403 raft_consensus.cc:3055] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:49.045271  2403 raft_consensus.cc:740] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:49.046403  2403 consensus_queue.cc:260] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:49.047820  2403 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:48.975798  2378 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:48.975643  2373 consensus_queue.cc:260] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:48.939620  2390 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:49.003404 32117 raft_consensus.cc:1275] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:13:48.945268  2453 log.cc:927] Time spent T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:13:48.906944  1780 raft_consensus.cc:697] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 8 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
W20260709 13:13:49.089455 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 281155us
W20260709 13:13:49.092423 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:49.093202 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.009835  2415 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:49.127091 32121 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:49.135403 32238 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:49.136746 32238 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:49.145713 32238 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:49.133772  2373 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:49.140532  2411 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.001s	sys 0.014s
I20260709 13:13:49.068179  2454 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:49.148953  2191 raft_consensus.cc:2804] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:13:49.127864  2221 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.000s	sys 0.024s
I20260709 13:13:49.162617 32197 raft_consensus.cc:1275] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:49.163201 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:49.140326  2426 consensus_queue.cc:1048] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.017s
W20260709 13:13:49.166425 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 269923us
W20260709 13:13:49.149735  2441 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.003s	sys 0.011s
I20260709 13:13:49.167320 32165 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:49.165692  2221 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.000s	sys 0.025s
W20260709 13:13:49.177433 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 49655.8us
W20260709 13:13:49.155094  2411 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.002s	sys 0.014s
W20260709 13:13:49.179443 32089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.009s	sys 0.011s
W20260709 13:13:49.189224 32089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.009s	sys 0.011s
I20260709 13:13:49.180008 32165 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:49.189442 32198 raft_consensus.cc:1275] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:13:49.189776 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 525936us
W20260709 13:13:49.183359 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 274185us
I20260709 13:13:49.191430 32165 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:49.191598 32271 raft_consensus.cc:1240] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:13:49.179469 32239 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:49.198480 32165 leader_election.cc:400] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 6. Current term is 7.
I20260709 13:13:49.200485 32165 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:49.201668 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:49.182852  2441 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.003s	sys 0.011s
I20260709 13:13:49.204959 32165 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:49.205607 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:49.205730 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.209941 32273 raft_consensus.cc:2393] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 8: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:49.186559  2448 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:49.183378  2191 raft_consensus.cc:697] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:49.217021 32239 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:49.202471  2447 log.cc:927] Time spent T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.596s	user 0.004s	sys 0.000s
I20260709 13:13:49.194801  2339 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:49.249408  2339 consensus_queue.cc:1059] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:49.224481  2445 consensus_queue.cc:1048] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:49.251482   369 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:49.253304 32121 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:49.253420  2329 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:49.254413  2395 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:49.210276  2452 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:49.231141  2456 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:49.231696  2466 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:49.158896  1780 consensus_queue.cc:237] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:49.209056  2028 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:49.237717  2454 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:49.210186  2446 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:49.243100 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:49.389160 32266 raft_consensus.cc:2393] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 8: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
W20260709 13:13:49.244382 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.215399 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:49.242269  2340 consensus_queue.cc:1059] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:13:49.390321 32267 raft_consensus.cc:2393] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 9: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:49.245211  1748 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:13:49.246709  2460 log.cc:927] Time spent T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:13:49.247200  2463 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:49.212033  2367 consensus_queue.cc:1048] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:13:49.226521  2420 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:49.376274  2369 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:49.243251  2214 raft_consensus.cc:2749] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:49.254838  2370 consensus_queue.cc:1048] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:13:49.366745 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 158243us
I20260709 13:13:49.407969 32165 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:49.255977  2191 consensus_queue.cc:237] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:49.368076 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.369060  2390 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:49.371229  2473 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:49.409271  2390 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:49.367273  2448 raft_consensus.cc:697] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
W20260709 13:13:49.397758 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 177988us
I20260709 13:13:49.399722 32190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1793) took 1008 ms. Trace:
I20260709 13:13:49.254434  2411 consensus_queue.cc:1048] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:13:49.409373  2473 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:49.371966  1983 consensus_meta.cc:287] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.717s	user 0.017s	sys 0.006s
I20260709 13:13:49.392882  1748 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.436942  1748 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:49.437449  2446 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:49.438109  2446 raft_consensus.cc:697] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:49.439028  2446 consensus_queue.cc:237] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:49.412401 32190 rpcz_store.cc:276] 0709 13:13:48.391568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.392453 (+   885us) service_pool.cc:224] Handling call
0709 13:13:48.392787 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:48.402190 (+  9403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:48.402231 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:48.402744 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:13:48.515772 (+113028us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:48.515821 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:48.515902 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:49.124747 (+608845us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:13:49.394396 (+269649us) raft_consensus.cc:1685] finished
0709 13:13:49.394416 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:49.399641 (+  5225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29059456,"thread_start_us":112698,"threads_started":1,"wal-append.queue_time_us":179578}
I20260709 13:13:49.391004  2466 raft_consensus.cc:697] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:49.415066 32089 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:49.416231  2470 raft_consensus.cc:3055] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:49.418797  2482 raft_consensus.cc:3055] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:13:49.421128  2437 consensus_meta.cc:287] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.723s	user 0.021s	sys 0.000s
I20260709 13:13:49.442298 32192 raft_consensus.cc:1275] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:13:49.441816 32165 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:49.405227  2463 raft_consensus.cc:697] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:49.458493  2454 consensus_queue.cc:1059] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:49.440757  2340 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:49.459139  2473 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:49.458869  2463 consensus_queue.cc:237] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:49.459745  2473 raft_consensus.cc:2764] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:13:49.456275 32192 pending_rounds.cc:85] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 4
I20260709 13:13:49.460438 32192 pending_rounds.cc:107] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 8.5
W20260709 13:13:49.459035 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 44062.6us
I20260709 13:13:49.449267  2028 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.461736  2028 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:49.457969  2421 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:49.469138  2421 raft_consensus.cc:697] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:49.462739  2448 consensus_queue.cc:237] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:49.470266  2028 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:49.470177  2421 consensus_queue.cc:237] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:49.460858 32192 raft_consensus.cc:2889] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:49.459429  2340 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:49.454560 32239 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:49.472422  2381 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:49.459424  2454 raft_consensus.cc:3055] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:49.473104 32239 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:49.473734  2454 raft_consensus.cc:740] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:49.474278  2381 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:49.474020  2437 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:49.474548  2454 consensus_queue.cc:260] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:49.475700  2454 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:49.477689 32239 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:49.476363  2437 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:49.482352 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:49.483493 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:49.495466 32190 raft_consensus.cc:2393] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 7: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:49.496399 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:49.497195 32120 raft_consensus.cc:1275] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:13:49.498003 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:49.498672 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:49.499110 32197 raft_consensus.cc:2410] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:13:49.484272 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:49.485214 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:49.501801 32239 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:49.501873 32124 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:49.494565 32122 raft_consensus.cc:1275] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:49.500301 32198 raft_consensus.cc:2376] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7. Re-sending same reply.
I20260709 13:13:49.506019 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:49.506114 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:49.506281 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:49.506842 32190 raft_consensus.cc:2393] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 8: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:49.506714 32239 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:49.473069  2340 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:49.508630 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:49.513192 32122 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:13:49.509472 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:49.407218  2369 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:49.452697  2470 raft_consensus.cc:740] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:49.511134 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:49.452186  2482 raft_consensus.cc:740] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:49.510855 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:49.532814 32197 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 8.
I20260709 13:13:49.533463 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:49.533121  2482 consensus_queue.cc:260] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:49.533682 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:49.534178 32120 raft_consensus.cc:2393] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 8: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:49.534246  2482 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:49.514824 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:49.516238 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:49.518857 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:49.513413 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:49.521238 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:49.508575  2375 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:49.524040 32124 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
W20260709 13:13:49.528146  2477 log.cc:927] Time spent T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:13:49.529481  2369 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:49.553892 32124 raft_consensus.cc:1275] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:13:49.555245 32197 raft_consensus.cc:1240] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:49.531385 32089 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:49.532121  2471 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.556517 32198 raft_consensus.cc:2410] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:13:49.550079 32195 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:49.533165 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:49.551005 32165 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:49.536080 32123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "375545897daf43fa925e7b181b2a634b"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:42262
I20260709 13:13:49.558106 32122 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:13:49.553712 32119 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:49.450122  2311 consensus_queue.cc:1059] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:13:49.554533  2484 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.504892  2390 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:49.558637 32123 raft_consensus.cc:606] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:49.535226 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:49.516885  2370 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:49.589707 32119 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
I20260709 13:13:49.521272 32239 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:49.528074  2470 consensus_queue.cc:260] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:49.578258 32190 raft_consensus.cc:1275] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:49.580193 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:49.520167  2487 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:13:49.601962 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 70670us
I20260709 13:13:49.606457 32089 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:49.607681 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:13:49.603068 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 81857.4us
I20260709 13:13:49.579807  2437 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:49.614626 32089 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:49.616739 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.620375 32089 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:49.625038 32089 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:49.629047 32118 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:13:49.597362  2370 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.634665 32089 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:49.636053  2420 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:49.636624  2420 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:49.637076  2420 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:49.652734  2420 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:49.654352 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 46775.1us
I20260709 13:13:49.660692 32089 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:49.598160  2375 raft_consensus.cc:697] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:49.611845  2390 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:49.662794 32239 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:49.665212 32118 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:49.616329  2470 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:49.670926 32089 leader_election.cc:400] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10.
I20260709 13:13:49.664948 32165 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:49.536144  2415 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:49.621886  2175 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:49.623775  2437 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.666141 32195 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:13:49.673444 32089 leader_election.cc:403] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:49.622646  2340 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.623951  2373 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:49.631083  1764 raft_consensus.cc:2804] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:49.657765  1780 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:49.709040 32197 raft_consensus.cc:1275] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:13:49.709578 32089 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:49.719331 32089 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:49.661940  2369 consensus_queue.cc:1048] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:13:49.711413 32118 raft_consensus.cc:1275] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:13:49.712777 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 50063.7us
I20260709 13:13:49.724349 32115 raft_consensus.cc:1240] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:49.664389  2370 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:49.654203  2487 raft_consensus.cc:697] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:49.663412  1983 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:49.715425 32124 raft_consensus.cc:1240] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:49.536731  2466 consensus_queue.cc:237] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:49.734493  2499 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:49.736028  2499 consensus_queue.cc:1059] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:49.682466  2415 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:49.655594  2483 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:49.596915  2484 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:49.674799  2190 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:49.722086 32089 leader_election.cc:304] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:49.718688  2463 raft_consensus.cc:2804] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:49.738159  2190 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:49.739459 32089 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:49.740707  2484 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:49.740798  2373 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:49.684779 32123 raft_consensus.cc:1240] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:49.743613 32089 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:49.597522  2471 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:49.744762  2190 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:49.745229  2190 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:49.745596  2190 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:49.746434  2471 leader_election.cc:290] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:49.708455  2311 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:49.746793  2373 raft_consensus.cc:993] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
W20260709 13:13:49.715165  2486 log.cc:927] Time spent T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:13:49.747426  2373 raft_consensus.cc:1081] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:13:49.750097 32089 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:49.751065  2471 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:49.683605  2214 consensus_queue.cc:1048] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:13:49.754717 32117 raft_consensus.cc:2410] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:49.755297  2462 consensus_queue.cc:1048] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:13:49.713312  2437 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:49.731057 32115 raft_consensus.cc:1240] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:13:49.717077  2419 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:49.734544  2487 consensus_queue.cc:237] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:49.737121  2499 raft_consensus.cc:3055] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:49.772819  2499 raft_consensus.cc:740] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:49.773766  2375 consensus_queue.cc:237] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:49.773886  2499 consensus_queue.cc:260] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:49.775507  2499 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:49.718264  1780 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:13:49.737293  2467 log.cc:927] Time spent T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:13:49.763598 32239 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:49.723809  2390 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:49.779460 32115 raft_consensus.cc:1240] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:13:49.725939  2445 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:49.785650 32193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1799) took 1042 ms. Trace:
I20260709 13:13:49.819427 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:49.796497  2374 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:49.747064  2311 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.828088  2311 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:49.828740  1726 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:49.837035 32165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.782639  1983 raft_consensus.cc:697] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:49.804487  2437 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:49.805913  2483 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:49.806203 32118 raft_consensus.cc:1240] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 4. Current term is 6. Ops: []
I20260709 13:13:49.779742  2463 raft_consensus.cc:697] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:49.716521  2340 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:49.808334 32266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:13:49.782446  1764 raft_consensus.cc:697] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:49.812942 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:49.823365 32115 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:49.777138  2472 log.cc:927] Time spent T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:13:49.757187  2411 consensus_queue.cc:1048] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:13:49.821874 32193 rpcz_store.cc:276] 0709 13:13:48.743400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.743551 (+   151us) service_pool.cc:224] Handling call
0709 13:13:48.743967 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:48.758465 (+ 14498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:48.758495 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:48.801651 (+ 43156us) log.cc:844] Serialized 26 byte log entry
0709 13:13:49.123358 (+321707us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:49.123406 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:49.123487 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:49.785419 (+661932us) raft_consensus.cc:1685] finished
0709 13:13:49.785444 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:49.785588 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7324,"raft.queue_time_us":7969,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":30747,"thread_start_us":189650,"threads_started":1,"wal-append.queue_time_us":709984}
I20260709 13:13:49.855456 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:49.827384  2374 raft_consensus.cc:697] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:49.780853  1780 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:49.777896  2420 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:49.846304 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:49.758879  2471 consensus_queue.cc:1048] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 13:13:49.857677 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:49.915588 32193 raft_consensus.cc:2468] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:49.898429 32266 raft_consensus.cc:606] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:49.911433 32118 raft_consensus.cc:1240] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:13:49.919757 32193 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "375545897daf43fa925e7b181b2a634b"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54172
I20260709 13:13:49.913655 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:49.894896 32115 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:13:49.920332 32193 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:49.920945 32193 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:49.851925  2483 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:49.924250 32118 raft_consensus.cc:1275] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:49.916977  2190 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:49.923242  1764 consensus_queue.cc:237] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:49.914878  1983 consensus_queue.cc:237] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:49.928567  2190 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:49.929533  1748 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:49.962231  1748 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:49.967228 32089 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:49.968446  2437 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:49.969836  2340 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:49.970218 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:49.970800 32194 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:49.971272 32121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56890 (request call id 1814) took 1192 ms. Trace:
I20260709 13:13:49.971643 32121 rpcz_store.cc:276] 0709 13:13:48.778868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.779450 (+   582us) service_pool.cc:224] Handling call
0709 13:13:49.971093 (+1191643us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b5400098dd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:49.971219 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":796976512}
W20260709 13:13:49.972731  2479 log.cc:927] Time spent T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
W20260709 13:13:49.976706 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.979583 32193 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:49.977455 32115 raft_consensus.cc:1240] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:49.996562 32194 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
W20260709 13:13:50.000805 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:49.986668  2508 log.cc:927] Time spent T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.052s	user 0.002s	sys 0.000s
I20260709 13:13:50.001480 32193 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:49.976545  2378 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.930591  2374 consensus_queue.cc:237] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.003845  2378 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.006951  2378 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:49.968474  2420 raft_consensus.cc:2804] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:50.007707  2420 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.008240  2420 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:50.018148  2420 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.022042  2483 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:50.056813 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:49.918251  2463 consensus_queue.cc:237] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.055053 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:50.027258  2497 log.cc:927] Time spent T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:13:50.030202  1780 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.033069 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:50.063287 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:50.036764 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:50.064230 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:50.046275 32090 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:50.051551  2419 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10.
I20260709 13:13:50.057655 32268 raft_consensus.cc:1240] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:50.059953 32265 raft_consensus.cc:1240] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:50.066672 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:50.067206 32268 raft_consensus.cc:1275] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:50.067627 32265 raft_consensus.cc:2393] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 8: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:50.025490 32089 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:50.068890 32268 raft_consensus.cc:1240] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:13:49.996757  2448 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.077240 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:50.077348 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:50.079742 32090 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:50.074642 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:50.082244 32190 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:50.085330 32197 raft_consensus.cc:2410] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:13:50.086230 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:50.087095 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:50.087982 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:50.088449 32273 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:50.089241 32265 raft_consensus.cc:2393] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 5: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:50.089480 32268 raft_consensus.cc:1240] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 4. Current term is 6. Ops: []
I20260709 13:13:50.074978  2420 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:50.090831 32265 raft_consensus.cc:1275] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:50.076045 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:50.057669  2454 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.096125  2484 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:50.096827 32121 raft_consensus.cc:1275] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:13:50.094117   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 117688us
I20260709 13:13:50.100756 32118 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:50.101866 32269 raft_consensus.cc:2393] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 8: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:50.095548 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:50.102412 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:50.107035 32190 raft_consensus.cc:2468] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:13:50.110970 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:50.103907 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:50.112243 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:50.053331  2378 consensus_queue.cc:1048] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:13:50.084769  2445 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:50.118101 32268 raft_consensus.cc:1240] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:50.099566  2471 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:50.099766  2448 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.122433  2448 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:50.099954  2311 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.113125  2370 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.125005  2311 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:50.125600  2370 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:50.126302 32267 raft_consensus.cc:1240] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:50.126953  1780 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:50.113528  2454 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.131201  2454 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:50.132118  2484 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.132663  2484 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.134843  2484 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:50.135670  2445 raft_consensus.cc:697] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:50.136819  2445 consensus_queue.cc:237] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.132143 32267 raft_consensus.cc:1275] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:13:50.142838 32273 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:13:50.144066 32264 raft_consensus.cc:1240] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:50.149590 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:50.147835 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:50.153028 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:50.154309 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:50.157528 32270 raft_consensus.cc:1240] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:50.147708  2466 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:50.171335 32192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1807) took 1009 ms. Trace:
I20260709 13:13:50.171236  2466 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.172145 32192 rpcz_store.cc:276] 0709 13:13:49.161682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:49.161821 (+   139us) service_pool.cc:224] Handling call
0709 13:13:49.164707 (+  2886us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:49.471301 (+306594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:50.171013 (+699712us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b5400374454. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:50.171255 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":637505280}
I20260709 13:13:50.146560  2425 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:50.176301  2425 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:50.177201 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:50.146896  2462 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:50.178694 32271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 1252) took 2128 ms. Trace:
I20260709 13:13:50.179157  2462 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:13:50.179291 32271 rpcz_store.cc:276] 0709 13:13:48.050635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.602779 (+552144us) service_pool.cc:224] Handling call
0709 13:13:48.603107 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:49.192105 (+588998us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:50.178324 (+986219us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b5400305554. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:50.178613 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1352761088}
I20260709 13:13:50.183876 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:50.190742 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:50.179189  2456 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.210582 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:50.221513 32090 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:50.224061  2484 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:50.224923  2445 consensus_queue.cc:1048] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:50.224020  2028 raft_consensus.cc:3055] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:50.226852  2028 raft_consensus.cc:740] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:50.226940 32090 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:50.227751  2028 consensus_queue.cc:260] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.228684 32090 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:50.228835  2028 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:13:50.229808 32090 leader_election.cc:304] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:50.229926  2419 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:50.230644  2419 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:50.230792 32165 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:50.232456 32089 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:50.233238  2514 raft_consensus.cc:2804] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:50.228170  1780 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:50.239953 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:50.203255  2466 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:50.240821 32271 raft_consensus.cc:1275] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:50.241084 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:50.246976 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:50.199441  2456 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.254607 32165 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:50.248360  2498 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:50.258671  2448 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:50.255119  1983 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:50.259402  1983 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.261068  2462 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:50.262012  1983 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:50.267925 32165 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:50.269629 32165 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:50.234514  2514 raft_consensus.cc:697] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:50.251367  2483 consensus_queue.cc:1059] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:13:50.248674  2311 consensus_queue.cc:1059] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:13:50.265233  2419 consensus_queue.cc:1048] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:13:50.310099  2498 consensus_queue.cc:1059] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:13:50.318256  2437 raft_consensus.cc:3055] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:13:50.310096  2518 log.cc:927] Time spent T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:13:50.252941  2482 consensus_queue.cc:1048] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:13:50.284284  2488 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:50.248488  2454 consensus_queue.cc:1059] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:13:50.321561  2454 raft_consensus.cc:3055] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:50.321938  2454 raft_consensus.cc:740] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:50.322814  2454 consensus_queue.cc:260] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.324069  2454 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:50.317569  2311 raft_consensus.cc:3055] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:50.326825  2425 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:50.338132 32239 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:50.316808 32272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:13:50.355842 32239 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
W20260709 13:13:50.356618 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:50.287855 32165 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:50.360428  2483 consensus_queue.cc:1243] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer 6b3ed521ce8947db80c4b4828b355c06 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:13:50.369611 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 81816.2us
I20260709 13:13:50.360786  2425 raft_consensus.cc:2804] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:50.361868  2462 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:50.366888 32272 raft_consensus.cc:606] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:50.374826 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:50.373051 32198 raft_consensus.cc:1275] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:13:50.375907 32198 pending_rounds.cc:85] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 4
I20260709 13:13:50.376145 32198 pending_rounds.cc:107] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:13:50.318735  2437 raft_consensus.cc:740] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:50.373610 32118 raft_consensus.cc:1275] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:50.376358 32115 raft_consensus.cc:1240] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:50.320300  2456 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:50.377080 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:50.377691 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:50.384948 32123 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:13:50.385054 32120 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
I20260709 13:13:50.378033 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:50.378759 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:50.385875 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:50.386025 32121 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:50.386173 32119 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:13:50.333478   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:50.390195 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:50.390818 32117 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:50.393265 32165 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:50.382313 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:50.285463  2339 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:13:50.383308 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 136019us
I20260709 13:13:50.396549 32120 raft_consensus.cc:1275] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:50.383255 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:50.396840 32090 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:50.397214 32193 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:13:50.376374 32198 raft_consensus.cc:2889] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:50.283545  2448 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:50.310405  2340 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.334980  2484 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:50.394259 32115 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:50.395192 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:50.280860  1983 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:50.380172  2374 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.415249 32194 raft_consensus.cc:1240] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:50.399322 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:50.416056 32124 raft_consensus.cc:3055] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:50.416381 32124 raft_consensus.cc:740] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:50.404039 32120 raft_consensus.cc:1240] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:50.418607 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:50.333930  2311 raft_consensus.cc:740] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:50.339013  2482 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.382589  2452 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:50.320300  2488 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:50.423414 32122 raft_consensus.cc:1275] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:50.424170 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:50.417062 32124 consensus_queue.cc:260] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.434664 32124 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:50.396188  2462 raft_consensus.cc:697] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:50.427219 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:50.430744 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:50.445381 32193 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:50.435720 32115 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:50.371790  2252 consensus_queue.cc:1059] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:13:50.371457  2410 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:13:50.401062  2403 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:50.435833 32117 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
I20260709 13:13:50.459724 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:50.460494 32117 raft_consensus.cc:2393] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 10: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:50.461228 32087 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:50.461642 32117 raft_consensus.cc:1240] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:50.427590 32121 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:13:50.463505 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:50.386500  2421 consensus_queue.cc:1048] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:13:50.310974  2514 consensus_queue.cc:237] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.409230  2340 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.431803  2448 consensus_queue.cc:1059] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:13:50.436108  2446 consensus_queue.cc:1048] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:13:50.458591 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:50.465430 32121 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:50.466064 32118 raft_consensus.cc:1240] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:13:50.432250  2466 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.433671  2484 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:50.460036  2422 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.434552  2482 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.444417  2452 raft_consensus.cc:697] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 6 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:50.539913  2487 raft_consensus.cc:993] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:13:50.540380  2487 raft_consensus.cc:1081] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:13:50.441395  2463 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.435778  2498 consensus_queue.cc:1059] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:13:50.488112  2526 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:50.547199  2498 raft_consensus.cc:3055] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:50.547637  2498 raft_consensus.cc:740] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:50.548461  2498 consensus_queue.cc:260] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.549750  2498 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:50.427249  2375 consensus_queue.cc:1048] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:13:50.423259  1983 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.477384 32196 raft_consensus.cc:1240] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:13:50.448889 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:50.504246 32124 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:13:50.506959 32193 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
W20260709 13:13:50.526552 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 129780us
I20260709 13:13:50.506567 32121 raft_consensus.cc:1275] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:13:50.525787 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 100605us
I20260709 13:13:50.535470 32190 raft_consensus.cc:1240] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:13:50.646415 32165 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:50.646952 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:50.647517 32165 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:50.647563 32090 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:50.648167 32190 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:50.648726 32165 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:50.649411 32190 raft_consensus.cc:1275] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:50.427521  2374 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:50.537142 32238 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:50.537837  1840 consensus_queue.cc:1048] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:50.533284  2448 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:50.649653 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:50.559345  2488 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:50.565989  2340 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:50.567742  2482 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:50.542279  2422 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.539929  2452 consensus_queue.cc:237] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.557730  2463 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.656224  2454 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:50.669859  2454 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:50.670295  2454 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:50.569952  2462 consensus_queue.cc:237] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.581034  1983 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:50.529516  2531 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:50.674001  2531 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:50.535069  2466 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.594771 32199 raft_consensus.cc:2410] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:13:50.600085 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:50.605391  2311 consensus_queue.cc:260] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.614063 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:50.621790   402 raft_consensus.cc:1275] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:13:50.623944  2378 raft_consensus.cc:3055] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:13:50.624257 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 204398us
I20260709 13:13:50.624536  2425 raft_consensus.cc:697] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:50.634783 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:13:50.649781 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 243352us
I20260709 13:13:50.650465 32165 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:50.695304 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 44918.3us
I20260709 13:13:50.696262 32165 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:50.653930 32190 raft_consensus.cc:1275] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:50.554227 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:13:50.655450 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 118376us
I20260709 13:13:50.656914 32123 raft_consensus.cc:1240] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:13:50.699152 32238 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:50.664837  2482 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.714393  2311 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:50.714573  2482 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.716833  2482 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:50.663713  2448 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.717614  2466 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:50.663014  2373 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:50.718479  2425 consensus_queue.cc:237] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.719991  2374 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:50.641960  2190 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.720851  2190 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.687016  2378 raft_consensus.cc:740] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:50.722342  2378 consensus_queue.cc:260] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.723062  2190 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:50.723562  2378 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:50.666567  2422 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:50.733618  2531 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:50.734139  2375 consensus_queue.cc:1048] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:50.734724  2531 raft_consensus.cc:2749] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:50.656482  2339 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:50.735168 32089 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:50.735605  2339 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.736066  2339 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:50.741902  2454 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.744055  2454 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:50.708199 32118 raft_consensus.cc:1275] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:50.710294 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:50.745354 32116 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
W20260709 13:13:50.746109 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 45138.1us
I20260709 13:13:50.685487  2340 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:50.746737  2340 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.748724  2340 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:50.713069 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:50.713639  2498 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:50.719008  2448 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:50.682967 32197 raft_consensus.cc:2368] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 10. Current term is 11.
I20260709 13:13:50.662537  2367 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:50.694159 32198 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:50.646085  2483 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.745870  2190 consensus_queue.cc:1048] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:13:50.712371 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:50.809348 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:50.686177  1983 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:50.779840 32116 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:50.818760 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:50.820937 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:50.830962 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:50.822497 32267 raft_consensus.cc:1275] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:50.822661 32271 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:50.823704 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:50.824621 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 69862us
I20260709 13:13:50.841008 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:50.841727 32121 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
I20260709 13:13:50.849010 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:50.854391 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:50.855060 32266 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
I20260709 13:13:50.829921  2403 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:50.833624  2421 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:50.858763 32198 pending_rounds.cc:85] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 2
I20260709 13:13:50.861096 32197 raft_consensus.cc:1240] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:50.817703  2454 consensus_queue.cc:1048] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:13:50.889009  2403 raft_consensus.cc:697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 11 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:50.892273  2403 consensus_queue.cc:237] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:50.893023  2523 log.cc:927] Time spent T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.560s	user 0.005s	sys 0.001s
I20260709 13:13:50.856933  2387 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:50.897198  2387 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:50.897647  2387 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:50.899366 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:50.896162 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:50.902760 32118 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
W20260709 13:13:50.903678  2506 log.cc:927] Time spent T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.575s	user 0.006s	sys 0.000s
I20260709 13:13:50.903946 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:50.905177 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:50.905473 32191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 1447) took 1402 ms. Trace:
I20260709 13:13:50.905965 32191 rpcz_store.cc:276] 0709 13:13:49.502865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:49.712442 (+209577us) service_pool.cc:224] Handling call
0709 13:13:49.721502 (+  9060us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:49.731671 (+ 10169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:49.731712 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:49.762268 (+ 30556us) log.cc:844] Serialized 26 byte log entry
0709 13:13:49.911945 (+149677us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:49.914677 (+  2732us) log.cc:844] Serialized 14 byte log entry
0709 13:13:49.920440 (+  5763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:49.920534 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:50.328311 (+407777us) spinlock_profiling.cc:243] Waited 988 us on lock 0x7b1800456160. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bf043f3 00007fb59bf067c1 00007fb59bf06779 00007fb59bf06709 00007fb59bf066d1 00007fb59bf059cd 000000000038f354 000000000038f199 00007fb59bee783a
0709 13:13:50.903064 (+574753us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:13:50.905195 (+  2131us) raft_consensus.cc:1685] finished
0709 13:13:50.905213 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:50.905415 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13839,"prepare.queue_time_us":1261,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":16299,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":8773,"spinlock_wait_cycles":65905408,"thread_start_us":149348,"threads_started":1,"wal-append.queue_time_us":171956}
I20260709 13:13:50.906534 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:50.908701 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:50.851174  2463 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:50.917420 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:50.885382 32198 pending_rounds.cc:107] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:13:50.847697  2470 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:50.860531 32165 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:50.838551  2483 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.862586  2499 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.899245  2419 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.861640 32192 raft_consensus.cc:1240] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 6 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:50.913692 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:50.917289 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:50.919554 32198 raft_consensus.cc:2889] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:50.921564 32271 raft_consensus.cc:3055] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:50.860942 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:50.934087 32271 raft_consensus.cc:740] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:50.934614 32193 raft_consensus.cc:2410] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:13:50.889035 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:13:50.928121 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 67643.9us
I20260709 13:13:50.844815  1983 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.852226  2533 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.860129 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:50.855083  2340 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.856714  2448 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:50.927260  2482 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:50.925407  2470 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.935040 32271 consensus_queue.cc:260] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.935981 32165 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:50.954490 32271 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:50.936983  1780 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.976902  1780 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.932047  2421 raft_consensus.cc:697] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:50.978773  2421 consensus_queue.cc:237] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.951529  2448 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.958025  1983 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:50.965875  2470 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:50.936941  2499 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.945492  2533 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.982263  2448 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:50.982698  2533 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:50.983824  2339 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.986032  1748 raft_consensus.cc:3055] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:50.986166  2339 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:50.986548  1748 raft_consensus.cc:740] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:50.987474  1748 consensus_queue.cc:260] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.992715 32165 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:50.994103  2456 consensus_queue.cc:1048] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:50.946314  2340 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:50.995592  2456 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:50.982530  2499 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:51.007191 32271 raft_consensus.cc:1275] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:13:50.992409  1748 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:50.992847  2452 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:50.940374  2419 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:51.005338  2482 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:51.052830 32120 raft_consensus.cc:1275] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:13:51.057070 32120 pending_rounds.cc:85] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d: Aborting all ops after (but not including) 3
I20260709 13:13:51.057384 32120 pending_rounds.cc:107] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:13:51.057608 32120 raft_consensus.cc:2889] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:51.061239 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 68634.2us
I20260709 13:13:51.056995  2482 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:51.066569 32269 raft_consensus.cc:1240] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:51.024184  2532 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:13:51.068567 32089 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:51.061163  2417 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.004s	sys 0.015s
I20260709 13:13:51.064882  1780 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:51.087069  2445 raft_consensus.cc:2749] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:51.088231  2437 consensus_queue.cc:260] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:51.097786  2419 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:51.098130  2437 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:51.068748  2482 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:51.098692  2417 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.005s	sys 0.015s
I20260709 13:13:51.102789  2387 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:51.105955 32195 raft_consensus.cc:2410] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:13:51.105024  2483 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:51.112561 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:51.113592 32089 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:51.112682 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:51.116493 32194 raft_consensus.cc:1275] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:13:51.117130 32190 raft_consensus.cc:2410] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:13:51.117398 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 363743us
I20260709 13:13:51.119709 32239 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:51.123562  2426 consensus_queue.cc:1048] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:51.124393  2387 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:51.127466 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:51.130362   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:51.131408  2498 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:51.131896  2498 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:51.132532 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:51.129691 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:51.133345 32196 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:51.124337  2466 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:51.133932 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:51.134356  2466 raft_consensus.cc:697] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:51.135217  2466 consensus_queue.cc:237] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:51.137004 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:51.138293 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:51.139389 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:51.140949 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:51.141973 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:51.142753 32198 raft_consensus.cc:2393] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 8: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:51.144272 32267 raft_consensus.cc:1240] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:13:51.147285 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:51.150012 32268 raft_consensus.cc:3055] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:51.150456 32268 raft_consensus.cc:740] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:51.156854 32165 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:51.158389 32165 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:51.159500 32165 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:51.160679 32165 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:51.182068 32165 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:51.191246 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:51.185604 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:51.195369 32117 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:13:51.187088 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:51.195712 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:51.186089 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:51.122956  2437 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
W20260709 13:13:51.169754 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 415455us
I20260709 13:13:51.129644  2483 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:51.142392  2421 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:51.195814 32165 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:51.198653 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:51.211536 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:51.212576 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:51.216284 32273 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:51.217038 32090 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:51.217344 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:51.217896 32165 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:51.221230 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:51.175884 32089 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:51.197400  2028 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:13:51.227473 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 51711.9us
I20260709 13:13:51.170228  2456 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:51.182744  2446 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:51.166399   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:51.227226 32165 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:51.184162  2452 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:51.205585 32268 consensus_queue.cc:260] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:51.243602 32268 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:51.197011  2425 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:51.246912 32165 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:51.249122 32165 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:51.169013  2532 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
W20260709 13:13:51.255191 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 91399.4us
I20260709 13:13:51.164263  2488 consensus_queue.cc:1059] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:13:51.218550  2533 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:51.226449  2190 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:13:51.234874  2556 log.cc:927] Time spent T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:13:51.258265 32165 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:51.234524  2470 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:51.230290  2446 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:51.235004  2526 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:51.267805 32268 raft_consensus.cc:1275] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:13:51.222527  2555 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:51.275027 32165 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:51.250146  1983 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:51.280745  2526 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:51.279958 32268 pending_rounds.cc:85] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06: Aborting all ops after (but not including) 3
I20260709 13:13:51.276263  2470 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:51.222572  2448 consensus_queue.cc:1048] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:13:51.255149  2454 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:51.259858  2028 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:51.225112  2421 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:51.285866 32268 pending_rounds.cc:107] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:13:51.297865 32268 raft_consensus.cc:2889] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:51.288075 32238 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:51.280234  2452 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:51.259008  2367 consensus_queue.cc:1059] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:13:51.254240  2425 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:51.280133  2446 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:51.303609  2555 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.289027  2526 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:51.313908  2549 log.cc:927] Time spent T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:13:51.269685  2417 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:13:51.281783  2422 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.285375  2533 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:51.290293  2470 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:51.297592  1780 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.348259 32238 leader_election.cc:400] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 10. Current term is 11.
I20260709 13:13:51.383759 32238 leader_election.cc:403] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:51.383817  1780 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:51.384899  2488 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:13:51.386184  1780 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:51.297216  2252 consensus_queue.cc:1048] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:13:51.356742  1840 consensus_queue.cc:1048] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:51.357540  2367 raft_consensus.cc:3055] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:51.372723  2374 consensus_queue.cc:1059] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:13:51.393198 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 52517.8us
I20260709 13:13:51.397969 32238 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:51.393457  2340 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:51.341992  2555 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:51.389322  2422 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:51.336306  2531 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:51.398766 32267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
W20260709 13:13:51.407416 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:51.407002 32238 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:51.412457 32267 raft_consensus.cc:606] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:51.413008 32267 raft_consensus.cc:614] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:51.395994  2367 raft_consensus.cc:740] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:51.412112  2252 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:51.411093  2340 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.423578 32090 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:51.427008 32267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:13:51.427862 32267 raft_consensus.cc:606] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:51.428318 32267 raft_consensus.cc:614] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:51.413674  1840 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:51.430907 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:51.444308 32122 raft_consensus.cc:2393] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 4: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:51.436964 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:13:51.439287 32090 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:51.445415  2435 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:13:51.432669 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:51.452006 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 195494us
I20260709 13:13:51.460654 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:51.441784  2387 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:51.471841 32267 raft_consensus.cc:1275] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:13:51.474864 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:51.447786  1840 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:51.446448  2435 consensus_queue.cc:1048] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:13:51.438189  2340 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:51.482100  1840 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:51.464514  2367 consensus_queue.cc:260] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:51.492983  2367 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:51.478034  2419 consensus_queue.cc:1048] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:13:51.481006  2425 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:51.501823  1840 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:51.503268 32272 raft_consensus.cc:1240] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:51.478621  2421 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:51.510454 32239 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:51.516242  1840 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:51.514237  2482 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:51.519519  2482 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:51.520239  2463 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:51.526473  2340 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:51.526929  2463 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:51.527479  2463 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:51.515838  2487 consensus_queue.cc:1048] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:13:51.529273  2488 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 10. Current term is 11.
I20260709 13:13:51.538357 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:51.543769 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:51.546495 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:51.553802 32115 raft_consensus.cc:1240] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:51.555833 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:51.504069  2498 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:51.549772  2555 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:51.600742 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:51.596979  1840 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.601854  1840 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:51.599249 32121 raft_consensus.cc:1275] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:51.593557  2422 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:51.669216 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 80122us
I20260709 13:13:51.670531 32239 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:51.634915  2529 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.684137  2566 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:51.646562  1780 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:51.685387  2448 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:13:51.694824  2572 log.cc:927] Time spent T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
W20260709 13:13:51.695415  2575 log.cc:927] Time spent T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
W20260709 13:13:51.695942  2573 log.cc:927] Time spent T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:13:51.650079  2526 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:51.713474   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
W20260709 13:13:51.734072 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:51.714758  2028 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.779799  2028 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:51.781316  2448 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:51.782054  2028 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:51.734598  2530 raft_consensus.cc:3055] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:51.782864  2530 raft_consensus.cc:740] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:51.744782 32120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1872) took 1046 ms. Trace:
I20260709 13:13:51.748807  2446 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:51.784039  2448 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:51.786017 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:51.783764 32120 rpcz_store.cc:276] 0709 13:13:50.698414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.700223 (+  1809us) service_pool.cc:224] Handling call
0709 13:13:50.700507 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:51.058036 (+357529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.726876 (+668840us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b5400164ed4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:51.744707 (+ 17831us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":809225088}
I20260709 13:13:51.749028 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:51.790169 32191 raft_consensus.cc:1240] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:51.791312 32191 raft_consensus.cc:1240] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:51.743292  2470 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:51.750236 32193 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:13:51.792364 32193 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:51.750379  2498 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:51.693002  2370 consensus_queue.cc:1059] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:13:51.689328  2529 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:51.792775 32193 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:51.793596  2470 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:51.794907  2529 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:51.764232 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:51.769780 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:51.797199  2526 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:51.743974  2463 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:51.748740  2339 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.773960  1780 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:51.775570  2559 log.cc:927] Time spent T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.494s	user 0.004s	sys 0.000s
I20260709 13:13:51.779253  1840 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:51.792783 32194 raft_consensus.cc:1240] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:51.798035 32020 catalog_manager.cc:5697] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 4 to 7, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New cstate: current_term: 6 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:51.797355 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:51.804617 32193 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:51.832561 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 50745.7us
I20260709 13:13:51.837044 32193 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:51.845767 32190 raft_consensus.cc:1240] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:13:51.845683 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:51.848712 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:51.849534 32191 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:51.851015 32195 raft_consensus.cc:1275] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:13:51.851429 32195 pending_rounds.cc:85] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 3
I20260709 13:13:51.845968 32193 raft_consensus.cc:1240] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:13:51.851768 32195 pending_rounds.cc:107] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:13:51.852090 32195 raft_consensus.cc:2889] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:51.853722 32193 raft_consensus.cc:1275] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:51.855857 32193 raft_consensus.cc:1275] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:13:51.851140 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:51.857663 32191 raft_consensus.cc:1275] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:13:51.858076 32191 pending_rounds.cc:85] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 3
I20260709 13:13:51.858372 32191 pending_rounds.cc:107] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:13:51.858814 32191 raft_consensus.cc:2889] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:51.860798 32193 pending_rounds.cc:85] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 5
I20260709 13:13:51.861171 32193 pending_rounds.cc:107] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:13:51.861480 32193 raft_consensus.cc:2889] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:51.834141  2446 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:51.860482 32191 raft_consensus.cc:1240] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:51.863708 32195 raft_consensus.cc:1275] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
W20260709 13:13:51.864833 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:51.864737 32193 raft_consensus.cc:1275] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:13:51.865481 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 192880us
I20260709 13:13:51.881932 32195 pending_rounds.cc:85] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 4
I20260709 13:13:51.886121 32195 pending_rounds.cc:107] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:13:51.829176  2339 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:51.887305 32195 raft_consensus.cc:2889] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:51.905083 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:51.905623 32272 raft_consensus.cc:1275] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:13:51.906056 32269 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:51.912014 32271 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:13:51.913223 32190 raft_consensus.cc:1275] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:13:51.913587 32190 pending_rounds.cc:85] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 4
I20260709 13:13:51.913642 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:51.913861 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:51.914291 32271 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:51.913890 32190 pending_rounds.cc:107] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:13:51.915385 32190 raft_consensus.cc:2889] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:51.907764  2601 log.cc:927] Time spent T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:13:51.917253 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:51.917523 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:51.903301  2190 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:51.918787 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:51.919469 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:51.937352 32193 raft_consensus.cc:1275] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:51.920986  2339 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:51.921497  2597 log.cc:927] Time spent T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:13:51.922144  2583 log.cc:927] Time spent T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:13:51.922029 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:51.922310 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:51.934141 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:51.917814 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:51.941022 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:51.942523 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:51.886317  2529 consensus_queue.cc:1059] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:13:51.946028 32267 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:13:51.948870 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:51.950057 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:51.950727 32191 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:51.946374 32193 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:13:51.950891 32165 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:51.946048 32271 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:13:51.951781 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:51.952263 32193 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:13:51.957067  2463 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:51.934576  2498 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:51.932875  2448 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:51.959142  2498 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:51.959363  2448 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:51.961575  2498 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:51.934419  2446 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:51.962639  2446 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:51.965191  2446 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:51.966710  2339 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:51.961594  2448 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:51.982880 32238 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:51.984756 32238 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:51.985918 32165 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:51.967837  1780 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:51.944937  2190 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:52.002552 32238 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:52.002717 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:52.007165 32266 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:52.004271 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:51.994158 32191 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:13:52.016323 32266 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:13:52.019387 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:51.995462  2463 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:52.068938 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 47620.2us
W20260709 13:13:52.070583 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 52315.7us
I20260709 13:13:52.078293 32271 raft_consensus.cc:1275] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:13:52.229526 32271 pending_rounds.cc:85] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06: Aborting all ops after (but not including) 3
I20260709 13:13:52.229871 32271 pending_rounds.cc:107] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:13:52.230170 32271 raft_consensus.cc:2889] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:51.995361  2499 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:52.009513  2462 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:51.994016  2470 consensus_queue.cc:1048] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 13:13:51.997416  2448 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.126s
I20260709 13:13:52.010686  2367 consensus_queue.cc:1059] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.143s
I20260709 13:13:52.228266 32272 raft_consensus.cc:1240] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:52.231000 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:52.011618  2369 consensus_queue.cc:1059] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.071s
W20260709 13:13:52.231490 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 160939us
I20260709 13:13:52.233310 32165 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:52.070266  2426 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:52.237813  2592 log.cc:927] Time spent T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.257s	user 0.001s	sys 0.004s
I20260709 13:13:52.227756 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:52.239064 32090 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:52.228104 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:52.239771  2422 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:52.295040 32117 raft_consensus.cc:1275] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:13:52.270514 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:52.295851 32115 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:13:52.296036 32118 raft_consensus.cc:1275] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:52.296279 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:52.269999 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:52.245536  2369 consensus_queue.cc:1243] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer 113b5461952d47e0944d463ea4e32801 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:13:52.301262 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:13:52.300421 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 61470.4us
I20260709 13:13:52.297303 32120 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:52.271517 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:52.272259 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:52.302066 32117 raft_consensus.cc:2393] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 7: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:52.269438 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:52.304380 32116 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:52.234181  2499 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:52.272625 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:13:52.307704 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 59106.4us
I20260709 13:13:52.308388 32119 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:52.303483 32123 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
I20260709 13:13:52.310261 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:52.312480 32121 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:13:52.311017 32124 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
I20260709 13:13:52.316220 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:52.297698  2598 log.cc:927] Time spent T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:13:52.317461 32120 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
I20260709 13:13:52.263228  2452 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.247517  2190 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:52.338402 32238 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:52.339745 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:52.339277 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:52.306437  2387 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.343783 32268 raft_consensus.cc:1240] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:52.343892 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:52.350049 32116 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:13:52.351890 32119 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:13:52.397291 32119 raft_consensus.cc:1275] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:13:52.399183 32121 raft_consensus.cc:1275] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:52.263496  2471 consensus_queue.cc:1048] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 13:13:52.263284  2446 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.306885  2499 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:52.348969 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:52.341744  2437 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:52.407596 32118 raft_consensus.cc:1275] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:13:52.304834  2422 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:52.374969  2571 log.cc:927] Time spent T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:13:52.414855 32119 raft_consensus.cc:1240] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:52.340508 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:52.402673  2190 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:52.406704  2498 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:13:52.451798 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 113737us
I20260709 13:13:52.479759  2190 raft_consensus.cc:697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:52.341961  2452 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:52.474969  1780 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.483351  2390 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:52.381601  2387 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:52.374765  2252 consensus_queue.cc:1059] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:13:52.567986  2252 raft_consensus.cc:3055] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:52.568363  2252 raft_consensus.cc:740] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:52.569193  2252 consensus_queue.cc:260] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:52.570415  2252 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:52.413594  2568 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.572901  2568 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:52.575134  2568 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:52.487648 32238 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:13:52.575907 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 88337.2us
I20260709 13:13:52.577447 32238 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:52.492547 32121 raft_consensus.cc:1275] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:52.497107 32123 raft_consensus.cc:1275] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:52.421897  2437 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.410815  2206 consensus_queue.cc:1059] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
W20260709 13:13:52.493350 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 260100us
I20260709 13:13:52.514571  1780 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:52.520076  2603 log.cc:927] Time spent T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 13:13:52.520915  2602 log.cc:927] Time spent T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:13:52.477718  2370 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:13:52.588356 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 341200us
I20260709 13:13:52.555907  2589 raft_consensus.cc:3055] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:13:52.563390  2594 log.cc:927] Time spent T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.643s	user 0.007s	sys 0.003s
I20260709 13:13:52.567128  2466 raft_consensus.cc:3055] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:13:52.545754  2600 log.cc:927] Time spent T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.560s	user 0.005s	sys 0.007s
I20260709 13:13:52.582311 32165 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:52.582492  1840 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:13:52.602833  1748 consensus_queue.cc:1175] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fcfc3281929645969ecedbb0c0af759d" responder_term: 7 status { last_received { term: 7 index: 5 } last_committed_idx: 3 last_received_current_leader { term: 7 index: 5 } }
I20260709 13:13:52.590283 32123 raft_consensus.cc:1275] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:52.618554 32115 raft_consensus.cc:1240] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:52.421933  2446 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:52.447011  2566 consensus_queue.cc:1048] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.140s
W20260709 13:13:52.580533  2578 log.cc:927] Time spent T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.853s	user 0.007s	sys 0.000s
I20260709 13:13:52.626298 32122 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:52.672983  1840 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.682885  2554 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:52.636286 32089 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:52.612862  2589 raft_consensus.cc:740] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:52.683508  2446 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:52.495347  2498 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:52.608500  2390 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:52.684894  1840 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:52.608203  2462 consensus_queue.cc:1048] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.097s
I20260709 13:13:52.624188  2568 consensus_queue.cc:1059] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 13:13:52.516141  2463 consensus_queue.cc:1048] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.189s
I20260709 13:13:52.673777  2466 raft_consensus.cc:740] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:52.581605  2437 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:52.706453  2190 consensus_queue.cc:237] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:52.713312 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 131089us
I20260709 13:13:52.584087  1780 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:52.728555 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 92379.9us
I20260709 13:13:52.758459 32089 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:52.713924  2370 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:52.713726  2028 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:52.760121 32089 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:52.766799 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:52.779418 32089 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:52.781457  2206 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:52.781912  2206 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.782305  2206 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:52.712903  2375 consensus_queue.cc:1048] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:13:52.735692  2435 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:52.782070  2483 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:52.787266 32198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1854) took 1021 ms. Trace:
I20260709 13:13:52.788252 32194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1849) took 1033 ms. Trace:
I20260709 13:13:52.744845  2448 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:52.739568  2446 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.803835  2446 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:52.806525  2446 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:52.787729  2028 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:52.798296 32194 rpcz_store.cc:276] 0709 13:13:51.755237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.755410 (+   173us) service_pool.cc:224] Handling call
0709 13:13:51.761846 (+  6436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:51.830698 (+ 68852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.788007 (+957309us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b54002a6554. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:52.788194 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70654848}
I20260709 13:13:52.800696  2445 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.806571  2498 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:52.802875  1780 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:52.815768  1780 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:52.797770  1840 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:52.798163 32198 rpcz_store.cc:276] 0709 13:13:51.766007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.787323 (+ 21316us) service_pool.cc:224] Handling call
0709 13:13:51.787726 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:51.788112 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:51.788140 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:51.800112 (+ 11972us) log.cc:844] Serialized 26 byte log entry
0709 13:13:51.916242 (+116130us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:51.944980 (+ 28738us) log.cc:844] Serialized 14 byte log entry
0709 13:13:51.949844 (+  4864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.949916 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:52.783764 (+833848us) spinlock_profiling.cc:243] Waited 6.09 ms on lock 0x7b1800374740. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bed22a6 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bf043f3 00007fb59bf067c1
0709 13:13:52.785166 (+  1402us) spinlock_profiling.cc:243] Waited 5.42 ms on lock 0x7b1800374740. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bf043f3 00007fb59bf067c1 00007fb59bf06779 00007fb59bf06709 00007fb59bf066d1 00007fb59bf059cd 000000000038f354 000000000038f199 00007fb59bee783a
0709 13:13:52.787045 (+  1879us) raft_consensus.cc:1685] finished
0709 13:13:52.787066 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:52.787206 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4596,"prepare.queue_time_us":30623,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":11290,"raft.queue_time_us":11815,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":178,"spinlock_wait_cycles":26471040,"thread_start_us":77569,"threads_started":1,"wal-append.queue_time_us":154259}
I20260709 13:13:52.738179  2554 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:52.787845  2607 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:52.809731  2483 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.837340  1840 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:52.837787  1780 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:52.815629  2422 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:52.843107  2606 log.cc:927] Time spent T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:13:52.854095  1780 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.857376  1780 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:52.836164  2435 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.841821  2483 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:52.861225  2435 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:52.842492  2610 consensus_queue.cc:1048] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:13:52.864812  2452 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:52.866555 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:52.843854  2028 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:52.818598  2445 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:52.813746  2589 consensus_queue.cc:260] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:52.878800  2589 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:52.880765  2387 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:52.851303  2422 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.892993  2422 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:52.896652  2554 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:52.840914  2446 consensus_queue.cc:1059] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:13:52.905308  2446 raft_consensus.cc:3055] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:52.905915  2446 raft_consensus.cc:740] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:52.907459  2446 consensus_queue.cc:260] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:52.867390 32123 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
W20260709 13:13:52.932973 32090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.022s	sys 0.020s
W20260709 13:13:52.933410 32090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.022s	sys 0.020s
I20260709 13:13:52.836076  2466 consensus_queue.cc:260] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:52.943827 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:52.945015 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:52.946144 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:52.951437 32269 raft_consensus.cc:2393] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 9: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:52.947530 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:52.960104  2609 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:52.960906  2609 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:52.961844  2466 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:52.950570  2554 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:52.966185  2554 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:52.968557  2607 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:52.969389  2607 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:52.971737 32195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 1487) took 1036 ms. Trace:
I20260709 13:13:52.972209 32195 rpcz_store.cc:276] 0709 13:13:51.935506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.935656 (+   150us) service_pool.cc:224] Handling call
0709 13:13:51.935945 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:51.936248 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:51.936275 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:51.936908 (+   633us) log.cc:844] Serialized 26 byte log entry
0709 13:13:52.377633 (+440725us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:52.377693 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.377790 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:52.971460 (+593670us) raft_consensus.cc:1685] finished
0709 13:13:52.971481 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:52.971660 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":826,"raft.queue_time_us":1781,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":7984,"thread_start_us":440387,"threads_started":1,"wal-append.queue_time_us":670357}
W20260709 13:13:52.977453 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 466366us
I20260709 13:13:52.991529 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:52.992498 32116 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:52.993979 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:13:52.997453 32267 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.022s	sys 0.047s
W20260709 13:13:52.998059 32267 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.022s	sys 0.047s
I20260709 13:13:53.018785  1840 consensus_queue.cc:1048] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:52.965524  2609 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:53.031598  1840 consensus_queue.cc:1048] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:13:53.023440  2484 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.099s	user 0.008s	sys 0.046s
I20260709 13:13:53.045048  1840 consensus_queue.cc:1048] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:13:53.024421 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 446998us
I20260709 13:13:53.049743  1840 consensus_queue.cc:1048] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:13:53.052486  2614 log.cc:927] Time spent T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:13:53.053567  2607 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:53.053510  2568 consensus_queue.cc:1048] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:53.056097  2607 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:53.062356  2566 consensus_queue.cc:1048] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:53.063829  2530 consensus_queue.cc:260] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:53.046361  2484 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.122s	user 0.009s	sys 0.046s
I20260709 13:13:53.064977  2530 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:53.067785  2499 consensus_meta.cc:287] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.622s	user 0.013s	sys 0.000s
I20260709 13:13:53.067823  2466 consensus_queue.cc:1048] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:53.068701  2463 consensus_queue.cc:1048] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:53.073187 32118 raft_consensus.cc:1240] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: []
W20260709 13:13:53.076947   367 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.008s	sys 0.035s
W20260709 13:13:53.077323   367 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.008s	sys 0.035s
W20260709 13:13:53.081571  2587 log.cc:927] Time spent T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 1.171s	user 0.005s	sys 0.003s
I20260709 13:13:53.068404  2499 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:53.045264  2623 consensus_queue.cc:1048] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:13:53.086611  2206 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:53.100931  2499 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:53.102035  2252 consensus_meta.cc:287] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.531s	user 0.010s	sys 0.007s
I20260709 13:13:53.103164  2554 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:53.049036  2533 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.000s	sys 0.029s
I20260709 13:13:53.106726 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:53.100244  2206 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:53.060177  2437 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:53.137342 32199 raft_consensus.cc:1240] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:53.138893 32165 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:53.144294 32165 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:53.136313  2533 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.000s	sys 0.030s
I20260709 13:13:53.095745  2607 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:53.095458  2586 consensus_queue.cc:1048] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:13:53.167011 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:53.103766  2589 consensus_queue.cc:1048] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:13:53.132339  2252 consensus_queue.cc:1059] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:13:53.166479 32165 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:53.143688  2499 raft_consensus.cc:2804] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:53.144539  2554 consensus_queue.cc:1048] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:13:53.145906  2448 raft_consensus.cc:697] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 12 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:53.174957 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:53.207671 32191 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:53.175407  2445 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:53.178766  2390 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:53.181996 32192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1852) took 1416 ms. Trace:
I20260709 13:13:53.249130 32192 rpcz_store.cc:276] 0709 13:13:51.765191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.765347 (+   156us) service_pool.cc:224] Handling call
0709 13:13:51.770495 (+  5148us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:51.770956 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:51.770996 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:51.771550 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 13:13:51.834128 (+ 62578us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:51.834543 (+   415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.834619 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:53.181051 (+1346432us) spinlock_profiling.cc:243] Waited 5.7 ms on lock 0x7b24000d94d8. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59bd8a9c4 00007fb59bd88acb 00007fb59bf43dc9 00007fb59bf43a55 00007fb59bf42fb0 00007fb59ebb9488 00007fb59ebb9be8 00007fb59eb91398 00007fb59eb8c76a 00007fb59eb8bbb6
0709 13:13:53.181723 (+   672us) raft_consensus.cc:1685] finished
0709 13:13:53.181748 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:53.181937 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":129,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":7969,"spinlock_wait_cycles":13112576,"thread_start_us":62242,"threads_started":1,"wal-append.queue_time_us":86436}
I20260709 13:13:53.184821  2437 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:53.185657 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:53.251744 32119 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:53.146936  2611 consensus_queue.cc:1048] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:13:53.186820  2422 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:53.160496  2498 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:53.200147 32165 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:53.196733  2252 consensus_queue.cc:1243] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer 113b5461952d47e0944d463ea4e32801 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:13:53.235816 32239 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:53.267100 32121 raft_consensus.cc:1240] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:13:53.237751  2471 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.206971  2499 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.206593  2028 raft_consensus.cc:2804] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:13:53.273921 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 73891.2us
I20260709 13:13:53.242738  2634 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:53.271757 32119 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:13:53.222995 32191 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:13:53.276250 32165 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:53.298338 32165 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:53.299707 32165 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:53.279260  2554 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:53.274432  2422 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:53.300977  2452 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:53.301016  2422 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:53.301524  2452 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:53.301905  2452 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:53.289068 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:53.303191 32269 raft_consensus.cc:2393] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 9: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:53.303438  2422 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:53.304771  2533 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:53.306972  1780 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:53.307228  2610 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:53.307849 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:53.308240  2470 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:53.308171 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:53.309554 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:53.310954 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:53.306219  2533 raft_consensus.cc:2804] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:53.018544 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:53.330526  2437 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:53.330824  2533 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.331267  2533 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:53.331185  2437 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:53.333806  2437 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:53.316251 32165 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:53.337131  2437 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:53.337631 32165 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:53.337862  2437 raft_consensus.cc:697] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:53.338514  2624 raft_consensus.cc:2749] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:53.338977 32165 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:53.339869  2624 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:53.317519 32268 raft_consensus.cc:2410] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 8 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:53.340309 32165 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:13:53.343185 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.319561 32239 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:53.331279 32273 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:13:53.292567  2589 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:53.361316 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:53.367394 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:53.368217 32196 raft_consensus.cc:2393] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 10: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
W20260709 13:13:53.365864 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 69940.9us
I20260709 13:13:53.289844  2028 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.289448  2499 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:53.316705  2426 raft_consensus.cc:3055] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:53.366698 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:53.372910 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:13:53.373641 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 54289.1us
I20260709 13:13:53.371490 32198 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:53.317556  2419 raft_consensus.cc:3055] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:53.375075 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:53.378454 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:53.368243 32191 raft_consensus.cc:2410] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:13:53.317647  2633 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:53.385097 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:53.386338 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:53.386957 32196 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:13:53.288964  2471 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:53.392318 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:53.400122 32196 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:13:53.372120  2589 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:13:53.405265 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 45582.3us
I20260709 13:13:53.402360 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:53.370705  2028 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:53.403196 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:53.371039  2426 raft_consensus.cc:740] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:53.260874  2448 consensus_queue.cc:237] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:53.348868  2466 consensus_queue.cc:1059] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:13:53.385744  2568 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:53.377341  2419 raft_consensus.cc:740] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:53.346822  2470 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:53.398934  2607 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:53.403234  2630 log.cc:927] Time spent T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:13:53.385918  2610 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:53.352240  2452 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:53.317560  2634 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:53.408953  2589 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:53.413968 32198 raft_consensus.cc:2393] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 9: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
W20260709 13:13:53.419788  2483 consensus_meta.cc:287] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.006s
I20260709 13:13:53.481124 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:53.482055 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:53.482729 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:53.495280 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:13:53.513691 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 45509.9us
I20260709 13:13:53.464884  2554 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:53.520759 32191 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:53.465265  2624 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:53.471838  2611 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.517752  1780 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:53.535983  1780 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:53.469219  2532 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:53.389356  2633 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:53.472095  2498 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:53.493166  2568 raft_consensus.cc:697] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:53.533161 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:53.544471 32115 raft_consensus.cc:2393] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 4: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:53.534144 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:53.517987  2639 log.cc:927] Time spent T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:13:53.530728 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:53.548750 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:53.542165 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 167857us
I20260709 13:13:53.400099  2437 consensus_queue.cc:237] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:53.517407  2484 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:53.559554 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:53.526757  2483 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:53.519130  2636 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:53.556463  1780 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:53.562587 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:53.570530 32119 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:13:53.564030 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:53.561218 32089 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:53.572530 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 195434us
I20260709 13:13:53.580288 32119 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
I20260709 13:13:53.579411 32089 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:53.516023  2610 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:53.571151  2626 log.cc:927] Time spent T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.280s	user 0.000s	sys 0.001s
I20260709 13:13:53.585078 32116 raft_consensus.cc:1240] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:13:53.552353 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:53.517674  2426 consensus_queue.cc:260] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:53.537268  2554 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:53.580392 32238 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:53.800381  2634 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:53.582186  2642 log.cc:927] Time spent T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:13:53.787593 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 185094us
I20260709 13:13:53.789839  2471 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:53.798434  2452 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:53.548404  2419 consensus_queue.cc:260] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:53.812739  2632 log.cc:927] Time spent T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.343s	user 0.000s	sys 0.001s
I20260709 13:13:53.786963  2500 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:13:53.813100  2641 log.cc:927] Time spent T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.324s	user 0.000s	sys 0.001s
W20260709 13:13:53.813468  2638 log.cc:927] Time spent T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.415s	user 0.001s	sys 0.000s
W20260709 13:13:53.789471  2637 log.cc:927] Time spent T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
W20260709 13:13:53.787998  2643 log.cc:927] Time spent T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.242s	user 0.000s	sys 0.000s
W20260709 13:13:53.790194  2648 log.cc:927] Time spent T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.218s	user 0.000s	sys 0.000s
I20260709 13:13:53.884534  2624 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:53.590353  2370 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:53.885071  2624 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:53.884793  2658 consensus_queue.cc:1175] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "113b5461952d47e0944d463ea4e32801" responder_term: 10 status { last_received { term: 9 index: 5 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:13:53.885567  2533 consensus_meta.cc:287] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.554s	user 0.008s	sys 0.002s
I20260709 13:13:53.885474  2370 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:53.886071  2533 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:53.887843  2370 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:53.543360  2532 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:53.690608  2568 consensus_queue.cc:237] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:53.888845  2633 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:53.589773  2627 log.cc:927] Time spent T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 13:13:53.889303  2435 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:53.545264  2611 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:53.890028  2554 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:53.888235  2533 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:53.581399  2615 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:53.833685 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:53.837393  2640 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:53.574937  2636 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:53.856489 32267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 1606) took 1513 ms. Trace:
W20260709 13:13:53.871901 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 291582us
I20260709 13:13:53.838198  2390 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.875567  2466 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:53.875715  2367 raft_consensus.cc:3055] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:53.871364  2500 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:13:53.879159 32273 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36080 (request call id 1318) took 1957 ms (client timeout 1901 ms). Trace:
W20260709 13:13:53.906858 32273 rpcz_store.cc:269] 0709 13:13:51.921969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.922078 (+   109us) service_pool.cc:224] Handling call
0709 13:13:53.878987 (+1956909us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400068e54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:53.879098 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3160665472}
I20260709 13:13:53.880803  2661 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:53.881165  2470 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:53.884063  2646 log.cc:927] Time spent T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 13:13:53.912325  2500 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:53.914345  2532 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:53.906358  2390 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:53.904258  2367 raft_consensus.cc:740] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:53.896967  2640 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.917625  2640 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:53.917703  2367 consensus_queue.cc:260] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:53.919234  2367 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:53.920830  2661 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:53.923098  2661 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:53.554085  2498 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:53.567152  2484 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:53.888232  2651 log.cc:927] Time spent T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.341s	user 0.000s	sys 0.001s
I20260709 13:13:53.894381  2370 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.891551  2419 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:53.908159  2611 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:53.910157  2483 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:53.955617  2615 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:53.956317  2640 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:53.959583  2645 log.cc:927] Time spent T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.374s	user 0.008s	sys 0.000s
I20260709 13:13:53.959348  2640 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:53.964049  2652 log.cc:927] Time spent T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:13:54.001554 32118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1917) took 1016 ms. Trace:
I20260709 13:13:54.005237 32122 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:54.006531 32165 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:54.002640 32118 rpcz_store.cc:276] 0709 13:13:52.985053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.074076 (+ 89023us) service_pool.cc:224] Handling call
0709 13:13:53.074405 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:53.074757 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:53.074787 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:53.075246 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:13:53.342524 (+267278us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:53.345084 (+  2560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.345155 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:54.000886 (+655731us) raft_consensus.cc:1685] finished
0709 13:13:54.000931 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:54.001255 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2020,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":266954,"threads_started":1,"wal-append.queue_time_us":401551}
I20260709 13:13:54.017966 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:54.030503 32194 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:13:54.032296  1780 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:54.033098  2190 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:54.034231  2190 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.039950  2378 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:54.033625  1780 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:53.937202  2370 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.042629  2462 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:54.043082  2466 raft_consensus.cc:697] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:13:54.024243 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:54.025192 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 124986us
I20260709 13:13:53.891623 32265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 1326) took 1135 ms. Trace:
I20260709 13:13:54.066787  2498 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:53.897787 32267 rpcz_store.cc:276] 0709 13:13:52.342821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.343088 (+   267us) service_pool.cc:224] Handling call
0709 13:13:52.416255 (+ 73167us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:52.416524 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:13:52.998528 (+582004us) log.cc:844] Serialized 14 byte log entry
0709 13:13:53.853791 (+855263us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:53.853865 (+    74us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:53.853937 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.854028 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:53.855852 (+  1824us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":102633,"prepare.queue_time_us":121533,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":113893,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":46881,"thread_start_us":1327458,"threads_started":3,"wal-append.queue_time_us":401227}
I20260709 13:13:54.044646  2462 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:13:54.243031 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.066900 32265 rpcz_store.cc:276] 0709 13:13:52.756319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.756505 (+   186us) service_pool.cc:224] Handling call
0709 13:13:52.756849 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:52.757313 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:52.757357 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:52.757934 (+   577us) log.cc:844] Serialized 26 byte log entry
0709 13:13:53.170411 (+412477us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:53.170562 (+   151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.170634 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:53.891428 (+720794us) raft_consensus.cc:1685] finished
0709 13:13:53.891451 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:53.891566 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1027,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":2290,"thread_start_us":388726,"threads_started":1,"wal-append.queue_time_us":468274}
I20260709 13:13:54.278930  2590 raft_consensus.cc:3055] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:54.279636  2590 raft_consensus.cc:740] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:54.282618  2586 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.283609  2586 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.072448  1780 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:54.090636  2378 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:54.303794 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.305892  2378 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:54.236012  2498 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:54.301163  2677 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:54.310290 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:54.314584 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.316104 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.317368 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.325521  2677 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.319427 32266 raft_consensus.cc:1240] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:54.334782   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:54.319494 32090 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:54.322249  2498 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.326740 32273 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 4.
I20260709 13:13:54.319180  2387 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:54.070567  2190 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:54.173530  2484 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:54.122313  2636 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:54.070948  2462 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:54.087015  2663 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:54.095872  2611 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:54.340698  2378 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:54.176677  2664 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.356786 32192 raft_consensus.cc:1240] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:13:54.357108 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:54.357976 32120 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:13:54.360332  2390 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:54.360342  2611 raft_consensus.cc:697] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 11 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:54.360416  2663 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.361617 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:54.362362  2611 consensus_queue.cc:237] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.364810 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:54.356298 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:54.366405 32121 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:54.364832  2498 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:54.369668  2387 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.371012 32122 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:54.373276  2387 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:54.377826 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.378192 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.378859 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.380195 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.380798 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:13:54.382167  2028 consensus_meta.cc:287] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.916s	user 0.016s	sys 0.004s
I20260709 13:13:54.090922  2466 consensus_queue.cc:237] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.382746  2028 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.385253  2426 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:54.399330 32192 raft_consensus.cc:1240] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:13:54.385787 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:54.385798 32194 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:54.386430 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:54.402987 32197 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 8.
I20260709 13:13:54.389195  2370 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:54.389891  2664 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.380252 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.411847  2339 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.412516 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:54.413523  2624 consensus_meta.cc:287] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.007s
I20260709 13:13:54.414348 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.414738 32121 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:13:54.416692 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.388734   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:54.418309 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:54.429150 32165 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.30.63.3:36651 timed out after 1.901s (SENT) [suppressed 22 similar messages]
I20260709 13:13:54.441931 32269 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 4.
I20260709 13:13:54.446389 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:13:54.449620 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.412575  2339 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.419123  2624 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.447291  2028 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:54.466233 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 45888.7us
I20260709 13:13:54.466475  2655 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:54.466781  1840 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.467321  2655 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:54.467521  1840 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.471710  1840 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:54.471881  2664 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:54.477880 32265 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:13:54.472836 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 153640us
I20260709 13:13:54.472884 32266 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:54.483426 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.483613 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.483757 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:54.484889 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.485051 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.485059 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:54.487848  2629 log.cc:927] Time spent T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 1.232s	user 0.012s	sys 0.010s
I20260709 13:13:54.495118 32191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 1510) took 1132 ms. Trace:
I20260709 13:13:54.495507 32191 rpcz_store.cc:276] 0709 13:13:53.362999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.384833 (+ 21834us) service_pool.cc:224] Handling call
0709 13:13:54.494800 (+1109967us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54001dfbd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:54.494969 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":310356864}
I20260709 13:13:54.498399 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:54.504735 32089 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:54.506296 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 61141us
W20260709 13:13:54.466244  2499 consensus_meta.cc:287] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 1.017s	user 0.021s	sys 0.000s
I20260709 13:13:54.508689  2499 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.481329  2586 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:54.513007 32190 raft_consensus.cc:1240] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:13:54.513988  2623 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:54.514290 32196 raft_consensus.cc:1240] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:13:54.514766  2623 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:13:54.515997 32190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 1886) took 1352 ms. Trace:
I20260709 13:13:54.517699  2623 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:54.521569  2663 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:54.522855 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:54.524247  2624 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:54.526003  2589 consensus_meta.cc:287] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.989s	user 0.016s	sys 0.002s
I20260709 13:13:54.526561  2589 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.516059  2677 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:54.516531 32190 rpcz_store.cc:276] 0709 13:13:53.163427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.163758 (+   331us) service_pool.cc:224] Handling call
0709 13:13:53.164129 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:54.513484 (+1349355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.515677 (+  2193us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54001121d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:54.515929 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3100910848}
W20260709 13:13:54.534018 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 111727us
I20260709 13:13:54.535188 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:54.540012 32089 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:54.533239  2387 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:54.533046  2028 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:54.546212 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.546516  2028 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.546940 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.547370 32264 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 8.
I20260709 13:13:54.556857  2498 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.557783  2498 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.565347 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.570405  2387 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:54.591091 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 46565.9us
I20260709 13:13:54.560406  2498 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:54.590062 32270 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:13:54.597129 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:54.691526 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 43920us
W20260709 13:13:54.678287 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.691370 32124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 1378) took 1205 ms. Trace:
I20260709 13:13:54.566581  2589 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:54.699437   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
W20260709 13:13:54.701889 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 172692us
W20260709 13:13:54.669394  2649 log.cc:927] Time spent T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 1.070s	user 0.006s	sys 0.006s
I20260709 13:13:54.690306  2655 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:54.711910  2410 consensus_queue.cc:1059] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:54.713145  2410 raft_consensus.cc:3055] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:54.713541  2410 raft_consensus.cc:740] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:54.714655  2410 consensus_queue.cc:260] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.716099  2410 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:54.700919  2663 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:54.717161  2663 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:54.717660  2568 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.002s	sys 0.016s
W20260709 13:13:54.718080  2568 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.002s	sys 0.017s
I20260709 13:13:54.719704  2663 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:54.709511  2687 log.cc:927] Time spent T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.109s	user 0.002s	sys 0.000s
I20260709 13:13:54.709898  2610 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:54.704613 32165 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:54.729267 32266 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
I20260709 13:13:54.591431  2624 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:54.730491 32089 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:54.733165  2410 consensus_queue.cc:1059] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:54.697168 32124 rpcz_store.cc:276] 0709 13:13:53.485958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.806883 (+320925us) service_pool.cc:224] Handling call
0709 13:13:53.807257 (+   374us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:53.838016 (+ 30759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:53.838046 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:53.838649 (+   603us) log.cc:844] Serialized 52 byte log entry
0709 13:13:54.368860 (+530211us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:54.368979 (+   119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.369136 (+   157us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:54.579373 (+210237us) raft_consensus.cc:1685] finished
0709 13:13:54.579401 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:54.691154 (+111753us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":259451,"raft.queue_time_us":35789,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":11206,"thread_start_us":342450,"threads_started":1,"wal-append.queue_time_us":605223}
I20260709 13:13:54.738027  2659 consensus_queue.cc:1059] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:54.740433 32119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1929) took 1188 ms. Trace:
I20260709 13:13:54.743157 32197 raft_consensus.cc:1240] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:54.702773  2028 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:54.751677  2589 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:54.751717 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:54.752766  2410 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:54.752008 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:54.754184  2664 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.754662  2446 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:54.754928  2568 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.755105 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:54.755784  2653 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.880s	user 0.029s	sys 0.049s
I20260709 13:13:54.756281  2657 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:54.756278 32116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1916) took 1771 ms. Trace:
I20260709 13:13:54.756654 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:54.759321  2685 log.cc:927] Time spent T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.160s	user 0.002s	sys 0.000s
I20260709 13:13:54.759533  2591 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:54.762092  2619 raft_consensus.cc:3055] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:54.762377 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.763526 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:54.764158   369 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:13:54.769799  2610 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:54.765259 32119 rpcz_store.cc:276] 0709 13:13:53.551423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.001474 (+450051us) service_pool.cc:224] Handling call
0709 13:13:54.091474 (+ 90000us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:54.091787 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:54.091819 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:54.091903 (+    84us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:54.091951 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.092037 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:54.740137 (+648100us) spinlock_profiling.cc:243] Waited 89.4 ms on lock 0x7b54000339d0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff08ad 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:54.740264 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205641600}
I20260709 13:13:54.773455 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:54.773526 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:54.774536 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:54.774715 32116 rpcz_store.cc:276] 0709 13:13:52.984460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.995127 (+ 10667us) service_pool.cc:224] Handling call
0709 13:13:52.995469 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:53.830834 (+835365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.755824 (+924990us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b5400206054. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:54.756087 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1355438976}
I20260709 13:13:54.784971 32265 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:54.785416  2657 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.787009  2672 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.787551  2672 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:54.774372  2653 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.030s	sys 0.049s
I20260709 13:13:54.775972  2387 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:54.779656  2664 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.782126 32120 raft_consensus.cc:1275] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:13:54.778379  2568 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.778440 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.782356  2591 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.777097  2586 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.783205 32271 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:13:54.783601 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:54.766481 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 108545us
I20260709 13:13:54.793642  2662 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:54.789299  2610 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:54.788691 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:54.793594 32115 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:13:54.799650  2589 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.802333  2657 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:54.803056 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.840044 32191 raft_consensus.cc:1240] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:54.814417  2387 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:54.805143 32123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 1920) took 1539 ms. Trace:
I20260709 13:13:54.844225 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:54.809473 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 79142.1us
I20260709 13:13:54.809700  2499 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:54.770709  2624 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.811843 32265 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 5.
I20260709 13:13:54.815028 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:54.824996  2373 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:54.780681  2619 raft_consensus.cc:740] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:54.852633  2373 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.853142  2619 consensus_queue.cc:260] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.854278  2619 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:54.854826  2589 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:54.855711 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.856487 32268 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 8.
I20260709 13:13:54.826041 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.836082  2633 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:54.836758 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:54.839210  2568 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:54.779043  2611 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:54.846554  2387 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:54.841660 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:54.810326  2410 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.843544 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:54.851877 32194 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:54.854948  2373 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:54.835531  2529 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:54.833189  2610 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:54.861661 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.883688 32265 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 8.
W20260709 13:13:54.862123   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 68074.6us
I20260709 13:13:54.827359  2662 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:54.887516  2662 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:54.887734 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:54.888094  2611 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.888684 32196 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:54.829241 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:54.882869 32089 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:54.869614 32193 raft_consensus.cc:1240] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:13:54.892794 32089 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:54.869872 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:54.893685  2484 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:54.893849 32089 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:54.894462  2484 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:54.894510 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.870163 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.895877 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:54.870728 32267 raft_consensus.cc:1240] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:54.875676 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.877303 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.865355  2190 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:13:54.881191 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.843274  2586 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.896554 32272 raft_consensus.cc:2376] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7. Re-sending same reply.
I20260709 13:13:54.844036 32123 rpcz_store.cc:276] 0709 13:13:53.265464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.266316 (+   852us) service_pool.cc:224] Handling call
0709 13:13:53.266720 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:53.270027 (+  3307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:53.270076 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:53.279516 (+  9440us) log.cc:844] Serialized 26 byte log entry
0709 13:13:53.389718 (+110202us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:53.389778 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.389871 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:54.647651 (+1257780us) spinlock_profiling.cc:243] Waited 6.6 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:13:54.804654 (+157003us) raft_consensus.cc:1685] finished
0709 13:13:54.804673 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:54.804937 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23190,"raft.queue_time_us":5538,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":42389,"spinlock_wait_cycles":15186304,"thread_start_us":109751,"threads_started":1,"wal-append.queue_time_us":242768}
I20260709 13:13:54.897943 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.886562  2206 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:54.894917  2675 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:54.896008 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.897549 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:54.869899 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:54.896333 32089 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:54.884373  2633 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.913822 32266 raft_consensus.cc:1275] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:13:54.916128 32271 raft_consensus.cc:1275] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:13:54.917662 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.917908  2664 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:54.918013  2586 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:54.895022  2484 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.885030 32198 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:54.919010  2484 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:54.923964 32268 raft_consensus.cc:2410] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:13:54.924933  2591 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:54.927791  2675 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:54.916060  2633 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:54.932868  2452 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:54.924854  2529 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.933787  2452 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.932937 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:54.942579 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:54.951251 32197 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:54.912729 32239 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:54.906206  2655 consensus_queue.cc:1059] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:13:54.974314 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:54.977233 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:54.979442 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:54.913172  2369 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:13:54.982758   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 73593.3us
I20260709 13:13:54.982969 32165 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:54.980124 32192 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:54.995584 32272 raft_consensus.cc:1275] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:13:54.972026  2677 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:54.997957 32198 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:54.982383  2663 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:55.006675 32090 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:13:55.005404 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 120478us
I20260709 13:13:54.959745  2466 consensus_queue.cc:1059] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
W20260709 13:13:55.015276 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 119003us
I20260709 13:13:55.016098 32090 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:55.005560  2419 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:54.992539  2624 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:55.021643 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:55.018529 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:55.025169  2530 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:55.025053  2677 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.025852  2530 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:55.026432  2530 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:55.027611  2677 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:55.005628  2410 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:55.033612  2463 raft_consensus.cc:3055] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:55.034186  2463 raft_consensus.cc:740] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:55.034592  2674 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:55.001603  2190 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:55.034940  2663 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.035490  2419 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.035861  2190 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.036628  2665 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:55.037075 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:55.037441  2663 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:55.037834  2419 leader_election.cc:290] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:55.023788 32196 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
W20260709 13:13:55.041695 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 80832.3us
I20260709 13:13:54.897980  2590 consensus_queue.cc:260] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:54.980635  2206 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.050339 32089 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:55.051456 32165 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:55.052062  2206 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:55.053216 32165 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:54.997211  2369 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.058835  2675 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:55.056317 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:55.058941  2369 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:55.060253 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 85880.8us
I20260709 13:13:55.080040 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:55.080897 32196 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:55.086992 32165 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:55.088538 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:55.038451  2529 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:55.098356 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 48149us
I20260709 13:13:55.062788  2674 raft_consensus.cc:697] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
W20260709 13:13:55.106961 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 83564.8us
I20260709 13:13:55.090222  2677 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:55.091868  2590 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:55.112771 32238 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:55.080298  2624 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:55.104651 32090 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:55.091107  2499 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:55.096159  2665 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:55.119520 32267 raft_consensus.cc:2410] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:13:55.096499  2378 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:55.106621  2369 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.130461 32238 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:55.035462  2463 consensus_queue.cc:260] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.110219  2667 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:55.139258 32090 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:55.140242  2378 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:55.140687  2378 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.141045  2378 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:55.147101 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:55.110824  2677 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:13:55.151693 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 73847.1us
I20260709 13:13:55.152069 32196 raft_consensus.cc:1240] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:55.150082 32238 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:55.155694 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:55.156520  2674 consensus_queue.cc:237] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.123881  2452 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:55.137001  2619 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:55.162849 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:55.168299 32124 raft_consensus.cc:1240] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:13:55.169193 32165 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:55.159763 32238 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:55.163208 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:55.149916 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:55.151528  2586 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:55.154225  2677 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:55.151913  2373 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:55.154279  2410 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:55.129310  2499 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:13:55.181732 32199 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:55.199282 32238 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:55.171799  2619 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:55.188148  2028 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:55.190651  2586 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:55.213408 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 54763.4us
I20260709 13:13:55.154433  2369 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.198027  2655 raft_consensus.cc:2764] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:13:55.157928  2530 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.199868  2663 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:55.216181 32089 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:55.162678  2466 consensus_queue.cc:1059] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:13:55.218647 32238 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:55.168272  2662 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:55.210994  2619 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:55.250193 32165 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:55.206405  2589 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:13:55.254382 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:55.268532 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:55.271416 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:55.277562 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 61538.9us
I20260709 13:13:55.278271  2530 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:55.227172  2586 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:55.278620 32089 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:55.277568  2252 raft_consensus.cc:3055] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:55.280376  2252 raft_consensus.cc:740] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:55.281672  2252 consensus_queue.cc:260] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.283038  2252 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:55.285409  2672 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:55.244133  2610 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:55.284554 32019 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49534 (request call id 171) took 18868 ms (client timeout 15000 ms). Trace:
I20260709 13:13:55.235783  2190 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:55.265867  2373 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:55.287622 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:55.330032 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:55.330680 32120 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:13:55.331755 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:55.332788 32122 raft_consensus.cc:1240] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:55.228127  2484 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.295428 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:55.340533 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:55.343042 32115 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:55.266507  2589 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.342257 32264 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:13:55.352576 32020 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59534 (request call id 47) took 8308 ms. Trace:
I20260709 13:13:55.267493  2659 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:55.362795 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:55.307457  2706 log.cc:927] Time spent T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:13:55.294603  2390 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.396773  2466 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:55.397183  2390 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.397627  2466 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.399746  2390 leader_election.cc:290] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:55.310586  2462 raft_consensus.cc:3055] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:55.400527  2462 raft_consensus.cc:740] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:55.400624  2623 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.401270  2623 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.401806  2462 consensus_queue.cc:260] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.403229  2462 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:55.403759  2623 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:55.406317 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 172904us
I20260709 13:13:55.407526 32165 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:55.411839  2452 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:55.297533 32019 rpcz_store.cc:269] 0709 13:13:36.423653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.427081 (+  3428us) service_pool.cc:224] Handling call
0709 13:13:55.281348 (+18854267us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:47.191753 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:47.364547 (+172794us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:47.365403 (+   856us) write_op.cc:435] Acquired schema lock
0709 13:13:47.370643 (+  5240us) tablet.cc:662] Decoding operations
0709 13:13:47.704995 (+334352us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:47.705096 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:47.705129 (+    33us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:13:47.706883 (+  1754us) tablet.cc:701] Row locks acquired
0709 13:13:47.706909 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:13:47.707097 (+   188us) write_op.cc:270] Start()
0709 13:13:47.707229 (+   132us) write_op.cc:276] Timestamp: P: 1783602827707043 usec, L: 0
0709 13:13:47.707267 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:13:47.786364 (+ 79097us) log.cc:844] Serialized 8553 byte log entry
0709 13:13:48.531849 (+745485us) op_driver.cc:464] REPLICATION: finished
0709 13:13:48.717267 (+185418us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59bee70ac 00007fb5a4d41ab9 00007fb59bf0369b 00007fb59bf0193f 00007fb59bf03c02 00007fb5a2a27ef0
0709 13:13:49.239736 (+522469us) write_op.cc:301] APPLY: starting
0709 13:13:49.239815 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:49.240230 (+   415us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:49.240248 (+    18us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:49.242768 (+  2520us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:49.273103 (+ 30335us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0709 13:13:49.273192 (+    89us) write_op.cc:312] APPLY: finished
0709 13:13:49.273905 (+   713us) log.cc:844] Serialized 151 byte log entry
0709 13:13:49.377042 (+103137us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:49.388880 (+ 11838us) write_op.cc:454] Released schema lock
0709 13:13:49.397914 (+  9034us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:49.417950 (+ 20036us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:49.417993 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":94716,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":707604,"apply.run_cpu_time_us":15090,"apply.run_wall_time_us":178148,"num_ops":22,"prepare.queue_time_us":245002,"prepare.run_cpu_time_us":32897,"prepare.run_wall_time_us":970750,"raft.queue_time_us":129298,"raft.run_cpu_time_us":16067,"raft.run_wall_time_us":726616,"replication_time_us":803483,"spinlock_wait_cycles":25494912,"thread_start_us":1083045,"threads_started":4,"wal-append.queue_time_us":388606,"wal-append.run_cpu_time_us":8839,"wal-append.run_wall_time_us":2185449}]]}
I20260709 13:13:55.298563  2664 raft_consensus.cc:3055] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:55.385680 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:55.325414 32110 tablet_service.cc:1558] Processing DeleteTablet for tablet f089b75ada024eb9bbf7e4b953063dd4 with delete_type TABLET_DATA_TOMBSTONED (TS fcfc3281929645969ecedbb0c0af759d not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:56870
W20260709 13:13:55.390751 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 112230us
I20260709 13:13:55.389966 32022 catalog_manager.cc:5697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 5 to 7, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 7 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:55.391775  2609 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.306223  2387 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.392771 32195 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:13:55.307570  2028 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.395023  2484 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:55.289618  2675 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.387216 32090 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:55.427103 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:55.360119 32020 rpcz_store.cc:276] 0709 13:13:47.024040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.031377 (+  7337us) service_pool.cc:224] Handling call
0709 13:13:55.316509 (+8285132us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:53.836095 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:53.836716 (+   621us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:53.836748 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:13:53.836765 (+    17us) tablet.cc:662] Decoding operations
0709 13:13:53.837581 (+   816us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:53.837647 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:53.837681 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:13:53.852036 (+ 14355us) tablet.cc:701] Row locks acquired
0709 13:13:53.854730 (+  2694us) write_op.cc:260] PREPARE: finished
0709 13:13:53.874496 (+ 19766us) write_op.cc:270] Start()
0709 13:13:53.874624 (+   128us) write_op.cc:276] Timestamp: P: 1783602833874432 usec, L: 0
0709 13:13:53.874646 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:13:53.875334 (+   688us) log.cc:844] Serialized 529 byte log entry
0709 13:13:54.532886 (+657552us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59bee70ac 00007fb5a4d41ab9 00007fb59bf0369b 00007fb59bf0193f 00007fb59bf03c02 00007fb59eb8b20b
0709 13:13:54.940155 (+407269us) op_driver.cc:464] REPLICATION: finished
0709 13:13:55.308651 (+368496us) write_op.cc:301] APPLY: starting
0709 13:13:55.308798 (+   147us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:55.309045 (+   247us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:55.309105 (+    60us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:55.309697 (+   592us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:55.310030 (+   333us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:13:55.310112 (+    82us) write_op.cc:312] APPLY: finished
0709 13:13:55.310515 (+   403us) log.cc:844] Serialized 22 byte log entry
0709 13:13:55.311981 (+  1466us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:55.312101 (+   120us) write_op.cc:454] Released schema lock
0709 13:13:55.312158 (+    57us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":3076444,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":368081,"apply.run_cpu_time_us":2828,"apply.run_wall_time_us":4056,"num_ops":1,"prepare.queue_time_us":314080,"prepare.run_cpu_time_us":81803,"prepare.run_wall_time_us":1013308,"raft.queue_time_us":93847,"raft.run_cpu_time_us":35357,"raft.run_wall_time_us":211543,"replication_time_us":1065234,"spinlock_wait_cycles":49548672,"thread_start_us":1378132,"threads_started":4,"wal-append.queue_time_us":928669}]]}
I20260709 13:13:55.301667  2369 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:55.465868 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.293401  2499 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:55.326058  2662 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:55.322916  2339 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:55.291997  2611 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:55.308197  2610 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:55.353410  2663 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:55.359658  2529 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:55.467923  2609 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.441715 32022 catalog_manager.cc:5697] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:55.452860  2387 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:55.453538 32119 raft_consensus.cc:1240] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:55.455190  2028 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:55.457638 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 70526.6us
I20260709 13:13:55.456274  2675 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.486436 32022 catalog_manager.cc:5697] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 5 to 10, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 10 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:55.487326  2609 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:55.487759  2675 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:55.461756  2701 log.cc:927] Time spent T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.249s	user 0.000s	sys 0.002s
I20260709 13:13:55.468026 32115 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:55.488910 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:55.497238 32089 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:55.497135 32267 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:13:55.468851 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:55.371066  2659 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:55.498982  2659 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:55.309566  2586 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.502350  2586 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:55.399773  2466 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:55.419596  2378 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.470197 32165 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:55.449885  2498 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.431051  2664 raft_consensus.cc:740] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:55.508208 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:55.509243 32273 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:13:55.358964  2589 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:55.483596 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:55.483877 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:55.485256 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:55.504456 32022 catalog_manager.cc:5697] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 7 to 8, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 8 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:55.508293 32120 raft_consensus.cc:2393] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 9: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:55.467797  2463 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:55.512337 32272 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:55.512941 32122 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:55.512516 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:55.513545 32090 leader_election.cc:304] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:13:55.518353 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:55.519047 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.517283 32090 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:55.521124 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:55.525334 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 74574.4us
I20260709 13:13:55.527611 32089 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:55.512351  2387 raft_consensus.cc:2804] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:55.533020 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:55.523082  2663 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:55.539911  2378 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:55.543833 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:55.523097  2373 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:55.545128 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:55.548933 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:55.549703 32264 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:55.510835  2498 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.552706 32190 raft_consensus.cc:1240] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:13:55.526469  2390 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:55.540449 32022 catalog_manager.cc:5697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 3 to 4, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 4 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:55.557163 32120 raft_consensus.cc:1240] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:55.561323 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:55.562147 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:55.561645 32238 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:55.566898 32238 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:55.570731 32120 raft_consensus.cc:1275] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:55.537415  2387 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:55.573607 32238 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:13:55.575039 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 47533.4us
W20260709 13:13:55.583395 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 45714.7us
I20260709 13:13:55.553493  2373 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.587375 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:55.561645  2390 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.589031 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:55.590916 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:55.599104 32194 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:55.580997  2387 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:55.574393  2663 raft_consensus.cc:697] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 4 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:55.575973  2623 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:55.609066 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:55.582919  2369 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:55.612990 32199 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:55.588549  2373 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:55.619712 32089 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:55.613722 32022 catalog_manager.cc:5697] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:55.598655  2568 raft_consensus.cc:2804] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:55.598187  2390 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:55.637641  2712 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:13:55.640822  2703 log.cc:927] Time spent T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:13:55.643716 32238 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:55.655005 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:55.655746 32121 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:55.617496  2623 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:55.618242  2369 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:13:55.660418 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.632839  2568 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:55.588153  2664 consensus_queue.cc:260] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.619925  2529 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:13:55.654695  2591 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:55.662606  2369 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:55.658874 32022 catalog_manager.cc:5697] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 8 to 9, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 9 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:55.655160  2712 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:55.660789  2623 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:55.673799  2568 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:55.678798 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 59184.5us
I20260709 13:13:55.692158 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:55.693130 32199 raft_consensus.cc:1275] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:13:55.695914 32089 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:55.700138  2190 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:55.700613  2190 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:55.701017  2190 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:55.708986 32121 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:13:55.708501 32022 catalog_manager.cc:5697] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 4 to 7, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 7 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } }
I20260709 13:13:55.712023 32124 raft_consensus.cc:2410] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for term 12 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:13:55.688308  2591 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:55.691885  2484 raft_consensus.cc:2804] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:55.689906  2712 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:55.685094  2466 consensus_queue.cc:1059] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:13:55.718955 32022 catalog_manager.cc:5697] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 2 to 5, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 5 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:55.707343  2252 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:55.713871  2677 consensus_meta.cc:287] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.002s
I20260709 13:13:55.725868 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:55.728874 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:55.717343  2591 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:55.720649  2712 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:55.733736  2720 tablet_replica.cc:333] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:13:55.750667 32121 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:13:55.755645 32115 raft_consensus.cc:1275] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:13:55.755015 32022 catalog_manager.cc:5697] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 3 to 5, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 5 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:55.755890 32165 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:13:55.763595  2719 log.cc:927] Time spent T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:13:55.766944  2498 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:55.771615 32272 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 8.
I20260709 13:13:55.773180  2369 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.773547  2720 raft_consensus.cc:2243] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.730126  2252 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.730396  2677 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.779192 32022 catalog_manager.cc:5697] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:55.777845 32090 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:55.783520  2028 consensus_queue.cc:1059] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:55.784435  2028 raft_consensus.cc:3055] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:55.784787  2028 raft_consensus.cc:740] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:55.785597  2028 consensus_queue.cc:260] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.788209 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:55.789412  2720 raft_consensus.cc:2272] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.788615 32264 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 9.
I20260709 13:13:55.790807 32193 raft_consensus.cc:1275] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:55.793952 32117 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
W20260709 13:13:55.794165 32195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54182 (request call id 1879) took 2684 ms (client timeout 1690 ms). Trace:
I20260709 13:13:55.792631 32022 catalog_manager.cc:5697] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:55.794649 32115 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:55.794685   369 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:55.796626 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:55.749116  2663 consensus_queue.cc:237] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.787622  2674 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:55.798933 32165 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:55.801578  2500 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:55.762617  2619 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.814343 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:55.794557 32195 rpcz_store.cc:269] 0709 13:13:53.106012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.106373 (+   361us) service_pool.cc:224] Handling call
0709 13:13:55.783144 (+2676771us) spinlock_profiling.cc:243] Waited 2.04 s on lock 0x7b54002166d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:13:55.790509 (+  7365us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4687181056}
I20260709 13:13:55.807296 32268 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:13:55.809161  2659 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.792064  2498 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:55.804234 32022 catalog_manager.cc:5697] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 7 to 8, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 8 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:55.816198 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:55.795492  2028 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:55.821617 32194 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:13:55.823004 32120 raft_consensus.cc:1240] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:55.814613  2675 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.824052 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:55.825757 32022 catalog_manager.cc:5697] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:55.826694 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:55.830011 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:55.825364  2500 raft_consensus.cc:697] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 9 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:13:55.831698 32022 catalog_manager.cc:5697] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 4 to 6, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 6 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:55.835251 32265 raft_consensus.cc:1240] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:55.838402  2659 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:55.839625  2369 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:55.827755  2675 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.822830  2498 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.840977  2498 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:55.841217 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:55.842417 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:55.843103 32123 raft_consensus.cc:2393] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 8: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:55.841300  2500 consensus_queue.cc:237] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:55.849560 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:55.849303 32022 catalog_manager.cc:5697] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:55.844054 32123 raft_consensus.cc:1240] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:55.850178 32239 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:55.821682  2674 raft_consensus.cc:697] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 8 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:55.855091 32022 catalog_manager.cc:5697] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 5 to 7, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 7 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:55.856796 32239 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:55.857388 32124 raft_consensus.cc:2393] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 9: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:55.844014  2623 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:55.868479 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 85452.4us
I20260709 13:13:55.853071  2633 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:55.879320  2367 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:55.879242  2609 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:55.880038  2675 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:55.880787  2610 consensus_queue.cc:1048] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:55.828208  2589 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.831163  2373 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.885234 32022 catalog_manager.cc:5697] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:55.860211  2463 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:55.895869 32022 catalog_manager.cc:5697] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:55.896471  2568 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.897914 32118 raft_consensus.cc:2393] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 13: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:55.887581  2610 consensus_queue.cc:1243] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer 6b3ed521ce8947db80c4b4828b355c06 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:13:55.892263  2589 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:55.892999 32269 raft_consensus.cc:2393] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 9: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:55.898968  2720 ts_tablet_manager.cc:1916] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:13:55.890867  2723 log.cc:927] Time spent T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:13:55.901667 32239 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:55.904279 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:55.908717 32264 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
W20260709 13:13:55.906201 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:55.909911 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.914794 32267 raft_consensus.cc:1240] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:55.911100 32090 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:55.917699   400 raft_consensus.cc:1240] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 9 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:55.919649 32165 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:55.921703 32239 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:55.900490  2666 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:55.926205 32239 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:55.905478  2633 raft_consensus.cc:697] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:55.883709  2190 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.894124  2387 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.929513  2529 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:55.940850 32165 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:55.908501  2463 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:55.928115  2367 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:55.934527  2623 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:55.948071 32122 raft_consensus.cc:1240] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:55.928865  2252 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:55.936441  2611 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:55.936930  2589 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:55.937740 32239 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:55.930459  2657 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:55.921531  2609 consensus_queue.cc:1048] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:13:55.935719  2633 consensus_queue.cc:237] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:55.949729 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.940675  2529 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.928802  2666 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:55.961862 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.952327  2339 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:55.953621  2252 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:55.930882  2674 consensus_queue.cc:237] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.952657  2657 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.953910  2619 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:55.992311 32195 raft_consensus.cc:1240] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:55.973877  2529 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:55.983753  2387 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:55.984253  2586 consensus_queue.cc:1059] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:55.979802  2589 raft_consensus.cc:697] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:55.981854  2252 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.985289  2712 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.956948  2659 consensus_queue.cc:1059] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:13:55.994134 32165 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:55.954234  2390 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:55.999447 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:56.003547 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:55.991183  2657 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:56.002818 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:55.948467  2463 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.004954 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:56.041679 32199 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:56.004952 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:56.006845 32190 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:56.043556 32195 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:56.006790 32194 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:56.008092 32165 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:56.008834 32191 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:56.044510  2664 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:56.045190  2611 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:56.004864 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:56.002897  2252 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:56.009306  2339 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:56.009599  2659 raft_consensus.cc:3055] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:56.052867  2339 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:56.052979  2659 raft_consensus.cc:740] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:56.053393  2339 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:56.010066 32238 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:13:56.054418 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 44446.8us
I20260709 13:13:56.054183  2659 consensus_queue.cc:260] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.055737  2619 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:56.055941 32238 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:56.056300  2619 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.056780  2619 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:56.010710  2484 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:56.057881  2586 consensus_queue.cc:1048] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:56.058152  2484 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:56.058079  2466 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:56.059818  1764 consensus_queue.cc:1048] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:56.011590  2675 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:56.061465  2373 leader_election.cc:290] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:56.059696  2466 raft_consensus.cc:697] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:56.061903  2675 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.013353  2666 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:56.013738 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.014958  2390 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:56.062742  2466 consensus_queue.cc:237] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.026824  2677 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:56.033890  2724 log.cc:927] Time spent T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.162s	user 0.002s	sys 0.000s
I20260709 13:13:56.034638  2378 consensus_queue.cc:1059] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:56.066973  2378 consensus_queue.cc:1243] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer 94085cf341634eb686a95983b6b7f7e6 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:13:56.067538  2378 raft_consensus.cc:3055] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:56.067895  2378 raft_consensus.cc:740] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:56.068948  2378 consensus_queue.cc:260] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:56.070629  2378 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:56.073844  2586 consensus_queue.cc:1059] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:56.074646  2677 consensus_queue.cc:1059] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:56.075666  2666 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:56.076028  2623 raft_consensus.cc:3055] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:56.076207  2666 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.076503  2623 raft_consensus.cc:740] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:56.075678  2390 raft_consensus.cc:3055] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:56.077723  2623 consensus_queue.cc:260] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.078508  2390 raft_consensus.cc:740] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:56.079134  2623 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:56.034291  2387 consensus_queue.cc:1059] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:56.037707 32119 raft_consensus.cc:1240] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:56.079591  2390 consensus_queue.cc:260] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:56.040710 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.084096 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:56.084810 32192 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:13:56.009953  2589 consensus_queue.cc:237] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.108330 32238 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:56.118849 32090 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:13:56.123494 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:56.127135 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 144636us
I20260709 13:13:56.130707 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:13:56.131381 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 123355us
I20260709 13:13:56.132151 32165 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:56.134898 32271 raft_consensus.cc:1240] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:56.134665  2369 consensus_queue.cc:1048] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:13:56.138149 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:56.138935 32268 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:56.139427 32195 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:56.137701 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:56.120345  2659 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:56.122195  2367 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:56.137197 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:56.146392 32194 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:13:56.130476  2677 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:56.157076  2666 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:56.130939  2390 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:56.125581  2498 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.169816  2387 consensus_queue.cc:1059] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:56.170933  2387 raft_consensus.cc:3055] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:56.171285  2387 raft_consensus.cc:740] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:56.147032  2190 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:56.146842  2367 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:13:56.176465 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 44395.6us
I20260709 13:13:56.154294  2633 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:56.154844  2568 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:56.155663  2677 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:56.174777  2387 consensus_queue.cc:260] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.187366 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:13:56.194936 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 65627.6us
I20260709 13:13:56.188263 32268 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:13:56.188678 32165 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:56.168231  2463 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:56.202010  2028 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:56.205799 32239 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:56.185071  2367 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:56.212744  2463 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:56.213311  2463 raft_consensus.cc:697] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:56.214190  2463 consensus_queue.cc:237] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.215981 32239 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:56.217096  2568 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:56.219524 32239 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:56.228641 32239 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:56.234328 32090 leader_election.cc:304] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:56.236558 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:56.195865  2677 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:56.239509 32165 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:56.242218 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 89612.5us
I20260709 13:13:56.245930  2732 consensus_queue.cc:1048] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:56.248034 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:56.201547  2369 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.210147  2633 raft_consensus.cc:697] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:56.219738  2675 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:56.241602  2589 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:56.247071  2387 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:56.267079 32165 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:56.257557  2369 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.270421  2369 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:56.280815  2725 log.cc:927] Time spent T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:13:56.283980 32199 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:13:56.284427  2028 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:56.286309  2633 consensus_queue.cc:237] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.286912  2609 consensus_queue.cc:1048] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:56.288362 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:56.289882  2712 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:56.290110  2733 log.cc:927] Time spent T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
W20260709 13:13:56.292819  2729 log.cc:927] Time spent T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:13:56.263499  2462 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:56.292086  1764 consensus_queue.cc:1059] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:56.305325  2568 raft_consensus.cc:3055] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:56.305724  2568 raft_consensus.cc:740] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:56.306591  2568 consensus_queue.cc:260] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.263587  2589 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:56.263818  2611 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:56.280416  2367 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.304172  2498 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:56.309136 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 58033.9us
I20260709 13:13:56.311708 32190 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:13:56.266014  2675 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:13:56.297531  2591 consensus_meta.cc:287] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.547s	user 0.009s	sys 0.002s
I20260709 13:13:56.317584 32165 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:56.335032 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:56.335945 32165 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:56.332913 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:56.340330 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:56.341109 32121 raft_consensus.cc:2393] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 9: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:56.318315  2589 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:56.341993 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:56.334273  2675 raft_consensus.cc:697] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 13 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:56.337229  2498 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:56.347131 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:56.347841 32122 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:13:56.350150 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:56.357170 32191 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:56.302951  2252 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:56.368098 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.368958 32264 raft_consensus.cc:2393] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 8: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:56.369009  2529 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.362054 32165 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:56.366315  2463 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:56.370342  2463 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.372315  2463 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:56.367157  2675 consensus_queue.cc:237] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.379916  2529 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:56.381644 32165 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:56.433109 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 51537.9us
I20260709 13:13:56.366832  2484 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.385946  2367 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:56.337133  2462 consensus_queue.cc:1059] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:13:56.390769  2568 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:56.390933  2339 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.391548  2373 raft_consensus.cc:3055] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:56.342655  2591 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.396708  2663 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:56.400184  2738 log.cc:927] Time spent T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.154s	user 0.005s	sys 0.000s
I20260709 13:13:56.363215  2611 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:13:56.416635 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.420814  2252 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:56.427695 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:56.428442 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:56.430120  2737 log.cc:927] Time spent T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:13:56.443367 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:56.444912 32165 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:56.451675 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:56.460549 32122 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
W20260709 13:13:56.453089 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 208768us
I20260709 13:13:56.447187  2619 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.457091 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:56.444142  2498 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:56.462080 32238 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:56.442987  2657 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:56.463806 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 229597us
I20260709 13:13:56.464530 32119 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:13:56.465075  2028 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:56.465178 32165 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:56.453182  2666 raft_consensus.cc:3055] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:56.448182  2373 raft_consensus.cc:740] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:56.466651 32273 raft_consensus.cc:1240] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:56.471980 32165 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:56.470223 32238 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:56.475538  2339 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:56.475935  2591 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:56.476167  2664 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:56.469003  2666 raft_consensus.cc:740] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:56.476655  2609 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:56.483682  2028 consensus_queue.cc:1059] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:56.484700  2028 raft_consensus.cc:3055] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:56.485072  2028 raft_consensus.cc:740] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:56.485621  2367 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:56.485875  2028 consensus_queue.cc:260] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.483124  2664 raft_consensus.cc:697] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:56.481092  2633 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:56.487015  2028 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:56.487321  2664 consensus_queue.cc:237] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.487609  2373 consensus_queue.cc:260] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.488858  2373 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:56.485083  2484 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:56.488932 32165 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:56.493510 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.494103 32272 raft_consensus.cc:1240] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:56.494386 32238 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:56.496080 32119 raft_consensus.cc:1275] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:13:56.497951 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:56.498533 32273 raft_consensus.cc:1240] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:56.499141 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:56.509617  2028 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:56.510012 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:56.510334 32264 raft_consensus.cc:1275] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:56.500164 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:56.500794 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:56.500949  2663 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:56.501580 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:56.502156 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:56.514856 32271 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:56.502660  2367 raft_consensus.cc:697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:56.517961 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:56.505122 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:56.518565 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:56.519054 32122 raft_consensus.cc:2393] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 8: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:56.507002 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:56.508200 32238 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:56.508781  2252 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:56.513025 32269 raft_consensus.cc:2393] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 5: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:56.517033  2028 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.520066 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:56.520941 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:56.521596 32264 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
I20260709 13:13:56.522120 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:56.522396 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:56.522617 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:56.522785 32238 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:56.523185 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:56.522161  2484 consensus_queue.cc:1059] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:13:56.525086  2206 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.525173  2657 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:56.525334  2484 raft_consensus.cc:3055] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:56.525856  2484 raft_consensus.cc:740] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:56.525938  2657 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:56.526604  2657 raft_consensus.cc:697] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:56.526755 32124 raft_consensus.cc:1240] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:56.526898  2484 consensus_queue.cc:260] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.527506  2657 consensus_queue.cc:237] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.528873  2252 raft_consensus.cc:697] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:56.529978  2252 consensus_queue.cc:237] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.520135 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:56.525650  2206 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.539676 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:56.540886 32269 raft_consensus.cc:2393] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 9: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:56.523350 32264 raft_consensus.cc:2368] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 7. Current term is 8.
I20260709 13:13:56.561517 32199 raft_consensus.cc:1240] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:56.562721  2662 consensus_queue.cc:1048] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:56.562808  2367 consensus_queue.cc:237] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.477267  2666 consensus_queue.cc:260] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.566236  2666 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:56.569196  2028 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:56.596510  2677 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.603873 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:56.520902 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:56.603814 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 89926us
I20260709 13:13:56.607013 32239 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:13:56.611970 32116 raft_consensus.cc:1275] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:13:56.614046 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:13:56.616194 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 93483.8us
I20260709 13:13:56.617916 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:56.618943 32268 raft_consensus.cc:1240] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:56.624328 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:56.616411 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:56.625408 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:56.624123 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:56.626479 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:56.627013 32199 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:56.627595 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:56.628440 32123 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:56.630967 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:56.632982 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:56.635154 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:56.642534 32195 raft_consensus.cc:2393] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 11: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:56.635780 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:56.644701 32119 raft_consensus.cc:2393] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 11: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:56.645741 32197 raft_consensus.cc:1240] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:56.635061 32192 raft_consensus.cc:2393] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 9: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:56.651539 32197 raft_consensus.cc:1240] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:56.633038 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:56.660749 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:56.661954 32272 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:13:56.662560 32268 raft_consensus.cc:1240] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 13:13:56.662503 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:56.665871 32116 raft_consensus.cc:2368] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 7. Current term is 8.
I20260709 13:13:56.613379  2484 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:56.670051 32239 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:56.671120 32239 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:56.668278 32199 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:56.668185 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:56.673331 32199 raft_consensus.cc:1240] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:56.617033  2746 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:56.678423 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:56.674527 32272 raft_consensus.cc:1240] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 13:13:56.679435 32119 raft_consensus.cc:2410] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:13:56.676520 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:56.684734 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:56.634409  2734 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:56.688208  2466 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:56.688691  2727 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.691306  2720 ts_tablet_manager.cc:1929] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.6
I20260709 13:13:56.688575 32265 raft_consensus.cc:1240] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:56.705461 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:56.688621  2740 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:56.694188 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:56.709837 32198 raft_consensus.cc:2368] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 8. Current term is 9.
I20260709 13:13:56.706485 32193 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 4.
I20260709 13:13:56.701036 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:56.680444  2746 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.718976 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:56.719669 32195 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:56.721148 32192 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:13:56.725564 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:56.733958 32124 raft_consensus.cc:1240] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 13 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 13:13:56.737248 32271 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:13:56.738631 32269 raft_consensus.cc:1240] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12. Ops: [9.5-11.6]
I20260709 13:13:56.745342 32124 raft_consensus.cc:1240] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 8 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:56.746688 32124 raft_consensus.cc:1240] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:56.699909  2466 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.758697  2466 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:56.758555  2589 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.696349  2677 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:56.763347 32273 raft_consensus.cc:1240] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:56.710546  2619 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:56.771713  2206 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:56.773900  2750 log.cc:927] Time spent T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.153s	user 0.002s	sys 0.000s
I20260709 13:13:56.748747 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:13:56.751456 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.753743 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:13:56.756031  2390 consensus_meta.cc:287] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.007s
I20260709 13:13:56.757727 32198 raft_consensus.cc:1275] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:13:56.708412  2727 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:56.781607 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.785387 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:56.785964 32192 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:56.716907  2740 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:56.733553  2746 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:56.791538 32199 raft_consensus.cc:2393] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 6: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:56.791328 32090 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:56.811991 32090 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:56.795724 32195 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:56.721503  2734 raft_consensus.cc:697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:56.812088 32273 raft_consensus.cc:1240] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:56.807618 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:56.821631 32271 raft_consensus.cc:1275] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:56.826289 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:56.827171 32124 raft_consensus.cc:2393] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 7: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:56.788537  2720 log.cc:1199] T f089b75ada024eb9bbf7e4b953063dd4 P fcfc3281929645969ecedbb0c0af759d: Deleting WAL directory at /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-0-root/wals/f089b75ada024eb9bbf7e4b953063dd4
I20260709 13:13:56.828629  1764 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.826077  2730 consensus_queue.cc:1059] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
W20260709 13:13:56.828234  2750 log.cc:927] Time spent T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.053s	user 0.002s	sys 0.000s
I20260709 13:13:56.835157 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:56.835268  2387 consensus_queue.cc:1059] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:56.793623  2590 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.853947  2590 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.830542  2390 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:56.810532  2740 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:56.824506  2206 raft_consensus.cc:2804] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:56.782914  2190 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:13:56.827610  2498 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:56.868815  2206 raft_consensus.cc:697] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:56.869984  2206 consensus_queue.cc:237] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.875308 32118 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:56.878376 32270 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:13:56.855355 32117 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:13:56.848292 32269 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:13:56.836140  1764 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.782694  2675 consensus_queue.cc:1059] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:13:56.885241  2675 raft_consensus.cc:3055] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:56.885406  1764 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:56.885659  2675 raft_consensus.cc:740] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:56.886284  2734 consensus_queue.cc:237] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.886509  2675 consensus_queue.cc:260] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.887651  2675 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:56.860728 32123 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
I20260709 13:13:56.862211 32264 raft_consensus.cc:1275] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:13:56.864450 32238 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:56.868435 32196 raft_consensus.cc:2410] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:13:56.866255  2387 raft_consensus.cc:3055] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:56.831638 32265 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:13:56.899729 32265 raft_consensus.cc:606] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:56.900185 32265 raft_consensus.cc:614] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:56.867390  2720 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56870 (request call id 60) took 1543 ms. Trace:
W20260709 13:13:56.893177 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.902146  1764 consensus_queue.cc:1059] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:56.910012 32238 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:56.858371  2589 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:56.864384  2730 consensus_queue.cc:1243] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer 6b3ed521ce8947db80c4b4828b355c06 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:13:56.914186 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:56.915892 32199 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
W20260709 13:13:56.916044 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.855458  2674 consensus_queue.cc:1048] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:13:56.917945 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:56.918434  1764 raft_consensus.cc:2804] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:13:56.917958 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.919019 32238 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:56.899075  2586 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:56.898612  2390 raft_consensus.cc:697] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:56.899255  2387 raft_consensus.cc:740] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:56.930436 32238 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:56.923421  2369 raft_consensus.cc:3055] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:56.931887 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:56.932327  1764 raft_consensus.cc:697] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:56.940397 32199 raft_consensus.cc:2393] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 6: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:56.931318  2664 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:56.945551 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:56.946949 32116 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:13:56.948550 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:56.943158 32122 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:56.944443 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:56.950942 32123 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:56.952220 32198 raft_consensus.cc:2393] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 7: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:56.939087  2369 raft_consensus.cc:740] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:56.970750  2369 consensus_queue.cc:260] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.972025  2369 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:56.974048  2590 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:56.954682  2390 consensus_queue.cc:237] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.957599 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:56.984092 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:56.957943 32194 raft_consensus.cc:1240] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:56.984724 32116 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
W20260709 13:13:56.950106  2751 log.cc:927] Time spent T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.328s	user 0.003s	sys 0.000s
I20260709 13:13:56.985877 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:56.958460 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:56.987622 32197 raft_consensus.cc:2393] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 9: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:56.959530 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:56.960474  2657 raft_consensus.cc:2804] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:56.965365  2387 consensus_queue.cc:260] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.968250 32090 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:56.968493 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:56.904491  2720 rpcz_store.cc:276] 0709 13:13:55.324081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.325079 (+   998us) service_pool.cc:224] Handling call
0709 13:13:55.692698 (+367619us) ts_tablet_manager.cc:1151] Deleting tablet f089b75ada024eb9bbf7e4b953063dd4
0709 13:13:55.713102 (+ 20404us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:13:56.327563 (+614461us) tablet_metadata.cc:665] Metadata flushed
0709 13:13:56.691154 (+363591us) tablet_metadata.cc:665] Metadata flushed
0709 13:13:56.867261 (+176107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":233587,"thread_start_us":150625,"threads_started":1}
I20260709 13:13:56.954849 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:56.975286 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:56.950593 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:56.975917 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:56.953780  1764 consensus_queue.cc:237] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.989923 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:56.992115 32270 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:13:56.993463 32193 raft_consensus.cc:2393] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 8: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:56.976560 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:56.990548 32123 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:13:56.995337 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:56.999521 32199 raft_consensus.cc:2393] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 9: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:56.999718 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:57.000385 32193 raft_consensus.cc:2393] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 8: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:57.000459 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:57.001350 32193 raft_consensus.cc:1240] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:13:57.001596 32194 raft_consensus.cc:2393] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 9: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:57.002022 32199 raft_consensus.cc:3055] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:57.002465 32199 raft_consensus.cc:740] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:57.007302 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:57.007910 32116 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:57.008496 32239 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:57.015574 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:57.006366 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:57.017102 32197 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:56.982857  2677 raft_consensus.cc:3055] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:57.003130 32199 consensus_queue.cc:260] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:57.040421 32239 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:57.021106 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:57.041837  2589 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:57.042462  2589 raft_consensus.cc:697] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:13:57.042732  2761 log.cc:927] Time spent T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:13:57.043529  2589 consensus_queue.cc:237] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:57.006917  2206 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:57.046365 32124 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:57.046687  2206 raft_consensus.cc:697] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:57.046986 32123 raft_consensus.cc:1240] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:57.047740 32124 raft_consensus.cc:1275] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:13:57.029735  2677 raft_consensus.cc:740] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:57.049000  2677 consensus_queue.cc:260] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:57.050007  2339 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:57.050266  2677 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:57.050554  2339 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:57.052644  2759 log.cc:927] Time spent T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 13:13:57.024374  2590 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:57.054369  2590 raft_consensus.cc:697] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:57.055322  2727 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:57.055280  2590 consensus_queue.cc:237] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:56.994956  2657 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:57.060886  2657 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:57.061012  2568 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.061573  2568 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:57.063544  2568 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:57.032691 32199 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:57.065122 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.066671 32191 raft_consensus.cc:2368] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 8. Current term is 9.
I20260709 13:13:57.067355 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:57.067464 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:57.068439 32195 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:57.025913 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:57.085294 32197 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:13:57.087518 32192 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:57.096114 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:13:57.078128  2733 log.cc:927] Time spent T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:13:57.096951 32121 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:57.098021 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:57.059161  2466 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:57.065723  2339 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:57.078832  2387 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:57.094848 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:57.109758 32196 raft_consensus.cc:1275] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:57.118026 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:57.126281 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:57.127051 32197 raft_consensus.cc:2393] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 9: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:57.126777 32124 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:57.118570 32195 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:13:57.130117 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:57.131211 32195 raft_consensus.cc:2393] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 9: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:57.133066 32199 raft_consensus.cc:1275] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:13:57.133596 32199 pending_rounds.cc:85] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 3
I20260709 13:13:57.142517 32268 raft_consensus.cc:2393] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 11: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:57.090998  2732 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:13:57.047770  2206 consensus_queue.cc:237] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:57.146571  2765 log.cc:927] Time spent T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:13:57.133893 32199 pending_rounds.cc:107] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:13:57.162323 32199 raft_consensus.cc:2889] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:57.100044  2716 consensus_queue.cc:1048] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:13:57.166569  2746 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:57.169373  2746 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:57.178844 32118 raft_consensus.cc:1275] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:57.179111 32197 raft_consensus.cc:3055] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:13:57.158639  2373 consensus_meta.cc:287] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.669s	user 0.011s	sys 0.004s
I20260709 13:13:57.179417 32197 raft_consensus.cc:740] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:57.180483 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:57.182865 32199 raft_consensus.cc:3055] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:57.184764 32199 raft_consensus.cc:740] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:57.186311 32199 consensus_queue.cc:260] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:57.188608 32199 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:57.188139 32197 consensus_queue.cc:260] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:57.197243 32120 raft_consensus.cc:2410] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:13:57.199627 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:13:57.197152 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 202347us
I20260709 13:13:57.200277 32124 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:57.201470 32197 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:57.203758 32165 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:57.204700  2028 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:57.205178  2028 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:57.205516  2028 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:57.210497 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.207480 32090 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:57.216992 32197 raft_consensus.cc:1275] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 13:13:57.217695 32197 pending_rounds.cc:85] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 5
I20260709 13:13:57.218091 32197 pending_rounds.cc:107] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:13:57.218477 32197 raft_consensus.cc:2889] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:57.218977 32197 pending_rounds.cc:107] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:13:57.219365 32197 raft_consensus.cc:2889] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:57.221671  2466 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:57.226379  2657 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:57.228803 32269 raft_consensus.cc:1240] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:57.239090 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:57.256685 32123 raft_consensus.cc:1275] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:13:57.258730 32121 raft_consensus.cc:1275] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:13:57.260557 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:57.241283  2666 consensus_meta.cc:287] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.675s	user 0.011s	sys 0.008s
I20260709 13:13:57.262858 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:57.264809 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.224098  2740 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:57.267051  2740 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:57.244177 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:57.268062 32165 leader_election.cc:400] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 7. Current term is 8.
I20260709 13:13:57.268347 32272 raft_consensus.cc:1240] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:57.268550 32165 leader_election.cc:403] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:57.269189 32266 raft_consensus.cc:1240] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 7. Current term is 8. Ops: []
W20260709 13:13:57.269301 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 60800.5us
I20260709 13:13:57.270088  2339 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 7. Current term is 8.
I20260709 13:13:57.271926 32116 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:57.246488 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:57.287232 32117 raft_consensus.cc:2393] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 11: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:57.246881  2657 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:57.249379 32089 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:57.253675 32124 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:13:57.254199  2028 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:57.228463 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:57.280912 32199 raft_consensus.cc:1275] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:13:57.271889  2339 consensus_queue.cc:1059] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:57.283061 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:57.300202  2498 consensus_queue.cc:1059] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:57.283366 32239 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:57.285514 32122 raft_consensus.cc:1275] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:13:57.286219 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 78828.1us
I20260709 13:13:57.272687 32269 raft_consensus.cc:1240] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:57.298169 32199 pending_rounds.cc:85] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 4
I20260709 13:13:57.304441  2028 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:57.305905 32199 pending_rounds.cc:107] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:13:57.306197 32199 raft_consensus.cc:2889] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:57.308869 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.309357 32272 raft_consensus.cc:1240] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:57.309862 32268 raft_consensus.cc:1275] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:13:57.312171  2028 consensus_queue.cc:1059] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:13:57.312188 32239 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:57.319063 32239 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:57.302615  2730 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:57.321635 32165 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:57.320925  2369 raft_consensus.cc:2804] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:57.321403  2373 consensus_queue.cc:1059] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
W20260709 13:13:57.326377 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 77089.4us
I20260709 13:13:57.311426  2778 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:57.329101  2369 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.341501  2369 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:57.341068 32089 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:57.330168  2373 raft_consensus.cc:3055] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:57.344995  2373 raft_consensus.cc:740] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:57.345554  2775 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:57.345105 32089 leader_election.cc:400] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 8. Current term is 9.
I20260709 13:13:57.345976  2373 consensus_queue.cc:260] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:57.346942 32089 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:57.347426  2373 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:57.347744  2775 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:57.322219  2730 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.350553  2730 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:57.325281  2589 raft_consensus.cc:2804] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:57.352957  2589 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.353451  2589 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:57.355703 32089 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:57.324867  2740 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:57.357110  2740 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.357503  2740 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:57.360107  2529 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:57.326305  2773 consensus_queue.cc:1048] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:13:57.362164 32089 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:57.363205  2773 raft_consensus.cc:2764] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:13:57.366735 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 436349us
I20260709 13:13:57.368238 32089 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:57.370573 32089 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:57.378307 32089 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:57.377948  2778 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:57.382567  2787 raft_consensus.cc:3055] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:57.383119  2787 raft_consensus.cc:740] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:57.385607 32089 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:57.385747  2339 consensus_queue.cc:1243] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer 6b3ed521ce8947db80c4b4828b355c06 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:13:57.389281  2339 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:57.389823  2339 raft_consensus.cc:697] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 6 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:57.390975  2466 consensus_queue.cc:1048] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:57.393683  2387 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:13:57.396802 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.397989  2367 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:57.398597 32239 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:57.400101  2367 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:57.400341  2768 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:57.381322  2773 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:57.406037  2657 consensus_queue.cc:1048] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:57.390762  2339 consensus_queue.cc:237] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:57.409008 32238 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:57.415637 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 94116.1us
I20260709 13:13:57.378793  2206 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:57.424861  2028 raft_consensus.cc:3055] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:57.425303  2028 raft_consensus.cc:740] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:57.385658  2775 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:57.432812  2028 consensus_queue.cc:260] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:57.439323  2028 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:57.437237 32089 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:57.444913 32165 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:57.446059  2795 consensus_queue.cc:1059] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:57.452737 32165 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:57.458237 32165 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:57.458422  2369 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:57.440062  2367 raft_consensus.cc:697] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:57.467460  2367 consensus_queue.cc:237] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:57.467643  2730 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:57.468781  2206 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:57.469951  2788 raft_consensus.cc:3055] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:57.468128 32089 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:57.472077 32089 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:57.481956 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.483976  2028 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:57.487551 32089 leader_election.cc:304] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:57.491088 32165 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:57.490795  2028 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:57.492894 32165 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:57.493026  2028 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:57.494930  2028 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:57.499009 32165 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:57.422971  2727 consensus_queue.cc:1048] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:13:57.502007 32165 leader_election.cc:400] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 7. Current term is 8.
I20260709 13:13:57.502806 32089 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:57.503906 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 95040.9us
I20260709 13:13:57.505975 32238 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:57.507455 32089 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:57.384646  2787 consensus_queue.cc:260] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:57.470412  2788 raft_consensus.cc:740] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:57.452642  2797 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:57.498489  2775 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:57.530715 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:57.513466 32165 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:57.520129  2730 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:57.522310  2666 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:57.505726  2498 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:57.525171 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:57.508896  2773 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:57.510378  2675 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:57.523666 32238 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:57.506600  2484 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:57.553767 32266 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:57.554867 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 47497.4us
I20260709 13:13:57.561290 32089 leader_election.cc:400] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 8. Current term is 9.
I20260709 13:13:57.561667 32089 leader_election.cc:403] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:13:57.555238  2028 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:13:57.542207  2795 consensus_queue.cc:1175] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fcfc3281929645969ecedbb0c0af759d" responder_term: 12 status { last_received { term: 9 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:13:57.514343  2742 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:57.594588  2028 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:57.596554 32089 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:57.600152 32089 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:57.602001 32089 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:57.603137 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:57.604532 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 80937us
I20260709 13:13:57.608778  2462 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:57.609532  2462 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:57.611100  2462 consensus_queue.cc:1048] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:57.545089  2387 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:57.616734 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:57.617668 32197 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:13:57.545348  2716 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.545926  2778 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:57.621084 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:13:57.615942 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 102630us
I20260709 13:13:57.624856 32197 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:57.628404 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:57.629244 32190 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:57.631036 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:57.631698 32191 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:57.631946 32194 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:57.632697 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:57.633414 32190 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:57.592983  2666 raft_consensus.cc:697] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:57.558133  2787 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:57.634770 32197 raft_consensus.cc:1275] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:13:57.623096 32266 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:13:57.637787  2028 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:57.640857 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:57.641692 32191 raft_consensus.cc:2393] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 11: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:13:57.641332  2666 consensus_queue.cc:237] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:57.639986  2463 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.642699  2463 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:57.613430  2775 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 8. Current term is 9.
I20260709 13:13:57.644438 32117 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:57.680893 32165 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:57.639247  2742 raft_consensus.cc:697] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:57.615914  2730 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:57.684434 32165 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:57.685873 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:57.634474  2206 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:57.630548  2712 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:57.630133  2797 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:57.687422 32238 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:57.695348  2589 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:57.700191   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 75943.8us
I20260709 13:13:57.647262 32197 raft_consensus.cc:1275] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:13:57.699959 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:13:57.701846 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 98135.6us
W20260709 13:13:57.703969 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 82756.4us
I20260709 13:13:57.685367  2339 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:57.712891 32090 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:57.711166 32190 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:13:57.713986 32165 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:57.717005 32117 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:57.630716  2716 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:57.719571 32165 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:57.720356  2028 raft_consensus.cc:2749] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:57.683880  2373 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:13:57.693305  2801 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:57.700471  2590 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:57.724315 32116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "375545897daf43fa925e7b181b2a634b"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:42262
I20260709 13:13:57.725144 32165 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:57.726352 32116 raft_consensus.cc:606] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:57.723484  2795 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:57.726871 32116 raft_consensus.cc:614] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:57.702625  2712 raft_consensus.cc:697] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:57.721230  2775 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:13:57.736141  2792 log.cc:927] Time spent T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:13:57.735903  2712 consensus_queue.cc:237] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:57.740219  2798 log.cc:927] Time spent T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:13:57.749850 32197 raft_consensus.cc:1275] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:57.726163  2590 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:57.755405 32197 raft_consensus.cc:1275] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:13:57.755781 32197 pending_rounds.cc:85] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 5
I20260709 13:13:57.756004 32197 pending_rounds.cc:107] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:13:57.756237 32197 raft_consensus.cc:2889] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:57.754271  2590 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:57.730813  2339 consensus_queue.cc:1048] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:13:57.753181  2775 raft_consensus.cc:697] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:57.734123  2707 consensus_queue.cc:1048] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:13:57.759202  2797 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:57.761263  2801 raft_consensus.cc:697] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 11 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:57.771391  2589 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:57.808661 32272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:13:57.809566 32272 raft_consensus.cc:606] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:57.810021 32272 raft_consensus.cc:614] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:57.775017  2568 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:13:57.750293  2742 consensus_queue.cc:237] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:57.831076 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 106006us
I20260709 13:13:57.834317 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:57.835376 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:57.836238 32272 raft_consensus.cc:1240] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:57.836498 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:57.836809 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:13:57.838172 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 70191.9us
I20260709 13:13:57.839394 32192 raft_consensus.cc:1275] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:57.844692  2716 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:57.825555  2463 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:57.849839  2795 consensus_queue.cc:1059] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:57.853003  2805 consensus_queue.cc:1048] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:13:57.855748 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:57.844696 32270 raft_consensus.cc:1240] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:57.842002  2712 consensus_queue.cc:1048] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:13:57.841635  2775 consensus_queue.cc:237] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:57.857553  2740 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:57.824452  2801 consensus_queue.cc:237] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:57.854882  2190 consensus_queue.cc:1048] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:57.867609 32116 raft_consensus.cc:2368] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12.
I20260709 13:13:57.867192 32238 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:13:57.873037 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 125439us
I20260709 13:13:57.882179 32238 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:57.883522  2664 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.885456  2664 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:57.886229  2498 consensus_queue.cc:1059] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:57.887439  2740 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:57.883204  2795 raft_consensus.cc:3055] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:57.889037  2795 raft_consensus.cc:740] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:57.887486  2664 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:57.890103  2664 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:57.890075  2795 consensus_queue.cc:260] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:57.891036  2664 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:13:57.937067 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 52628.7us
I20260709 13:13:57.868055  2623 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:13:57.884631  2463 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:57.891677  2795 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:57.998821  2619 consensus_queue.cc:1048] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:58.001394 32118 raft_consensus.cc:1240] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:13:57.995460  2797 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.006724 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:58.009675 32197 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:58.010661 32195 raft_consensus.cc:1275] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:13:58.011847 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:58.008302 32193 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:13:58.013387 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:58.013976 32193 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:58.008482 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:58.015057 32198 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:58.016546 32197 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:58.004508  2390 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:58.003062  2590 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:58.020247  2590 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:58.002727  2619 consensus_queue.cc:1243] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer 113b5461952d47e0944d463ea4e32801 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:13:58.012431 32195 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:13:58.028155  2797 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:58.045660 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:58.049665 32238 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:58.051251 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:58.051847 32190 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:58.058164 32190 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:58.049320 32197 pending_rounds.cc:85] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 4
I20260709 13:13:58.059623 32197 pending_rounds.cc:107] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:13:58.059923 32197 raft_consensus.cc:2889] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:58.061549 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:58.064241 32119 raft_consensus.cc:1275] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:13:58.030222  2816 consensus_queue.cc:1048] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:13:58.065393 32117 raft_consensus.cc:1275] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:13:58.066897  2816 consensus_queue.cc:1243] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer 113b5461952d47e0944d463ea4e32801 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:13:58.059093  2814 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:13:58.059247  2619 consensus_queue.cc:1048] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:13:58.083292 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:58.085345 32122 raft_consensus.cc:1275] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:13:58.088825 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:58.089087 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:58.089613 32118 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:58.090158 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:58.091820 32119 raft_consensus.cc:1275] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:58.093145 32116 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:13:58.095043 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:58.095675 32115 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:58.043228  2797 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:58.096733 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 48198.6us
I20260709 13:13:58.097394 32238 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:58.098495  2740 raft_consensus.cc:2804] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:58.098989  2740 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.099391  2740 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:58.099622  2788 consensus_queue.cc:260] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:58.100987  2568 raft_consensus.cc:2804] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:58.101632  2568 raft_consensus.cc:697] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:58.102546  2568 consensus_queue.cc:237] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:58.105480  2727 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:58.106006  2727 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:58.108232 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:58.098511 32238 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:58.109850 32267 raft_consensus.cc:2410] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:13:58.115399 32118 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:13:58.119136  2339 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:58.119755  2339 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:58.120740  2788 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:58.121905  2727 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:58.114964  2498 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.122720  2498 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:58.123338 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:58.124044 32270 raft_consensus.cc:2393] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 10: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:58.127120 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:58.134680 32238 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:58.135613  2028 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:58.136289  2028 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:58.148849 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:58.151587 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:58.152211 32115 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:13:58.124701  2590 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:58.121905  2339 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:58.164295 32193 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:13:58.151484  2772 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:58.152312  2787 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.157928  2590 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.200057 32120 raft_consensus.cc:1275] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:58.204434 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:58.205546 32190 raft_consensus.cc:1240] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:13:58.207693 32238 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:58.213384 32193 raft_consensus.cc:1275] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:58.204939  2590 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:58.204802  2787 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:58.226575  2787 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:58.223624  2740 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:58.229732 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:58.230376 32115 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:58.204773  2772 raft_consensus.cc:697] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:58.211692  2814 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:58.233616  2814 raft_consensus.cc:697] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:58.233299  2772 consensus_queue.cc:237] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:58.237355  2740 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:58.248818 32115 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:58.234608  2814 consensus_queue.cc:237] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:58.258405 32193 raft_consensus.cc:1275] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:13:58.258795 32193 pending_rounds.cc:85] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 5
I20260709 13:13:58.259040 32193 pending_rounds.cc:107] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:13:58.259245 32193 raft_consensus.cc:2889] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:58.262138 32199 raft_consensus.cc:1217] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 4.3->[6.4-11.6]   Dedup: 6.4->[9.5-11.6]
I20260709 13:13:58.262611 32199 pending_rounds.cc:85] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 4
I20260709 13:13:58.262825 32199 pending_rounds.cc:107] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:13:58.263052 32199 raft_consensus.cc:2889] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:58.266274  2831 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:58.281229  2831 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:58.284049  2831 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:58.285658  2028 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:58.285845 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.286665  2498 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:58.309923 32123 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:58.310325 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:58.311138 32120 raft_consensus.cc:2393] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 9: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:13:58.319664 32191 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:13:58.321084 32123 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:58.326975 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:58.332181 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:58.319659  2390 consensus_queue.cc:1059] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
W20260709 13:13:58.343909  2813 log.cc:927] Time spent T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.455s	user 0.000s	sys 0.003s
I20260709 13:13:58.326184  2675 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:13:58.327646  2778 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:58.324968  2773 consensus_queue.cc:1048] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:13:58.346755  2786 raft_consensus.cc:3055] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:58.325565  2590 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:58.354938  2369 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:58.372918 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:58.373814 32196 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:13:58.351826  2786 raft_consensus.cc:740] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:58.377163 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:58.378000 32195 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:58.377676  2786 consensus_queue.cc:260] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:58.395211 32239 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:58.350881  2778 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:58.417635  2484 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.417812  2568 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:58.433319  2778 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:58.434804 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:13:58.435387 32191 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:58.435318 32238 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:58.437018  2462 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:58.437531  2462 raft_consensus.cc:697] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:58.438426  2462 consensus_queue.cc:237] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:58.418152  2772 consensus_queue.cc:1048] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:58.419867  2814 raft_consensus.cc:2804] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:58.447638  2814 raft_consensus.cc:697] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:58.432193  2484 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:58.450906  2484 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:58.451783  2814 consensus_queue.cc:237] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:58.425714  2841 log.cc:927] Time spent T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:13:58.427810  2590 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:13:58.429845  2839 log.cc:927] Time spent T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.160s	user 0.003s	sys 0.000s
I20260709 13:13:58.429674  1764 consensus_queue.cc:1048] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:58.463665 32196 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:13:58.467875 32196 raft_consensus.cc:1275] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:58.465421 32191 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:13:58.468343 32238 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:13:58.472333 32195 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:58.476060  1764 consensus_queue.cc:1048] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:13:58.481737  2829 log.cc:927] Time spent T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.210s	user 0.002s	sys 0.000s
I20260709 13:13:58.492868  1764 consensus_queue.cc:1048] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:58.499678 32196 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:58.483595  2740 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:58.487520  2768 raft_consensus.cc:2804] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:58.503134  2788 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:58.490041  2664 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:13:58.513633  2768 raft_consensus.cc:697] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:58.508774  2740 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:13:58.546541 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 66243us
I20260709 13:13:58.548377 32239 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:58.522439  2788 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:58.554415 32268 raft_consensus.cc:1275] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:13:58.559135 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:58.559983 32264 raft_consensus.cc:2393] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 12: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:58.560514 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:58.560508 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:58.560828 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:58.562062 32268 raft_consensus.cc:1275] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:58.562841 32270 raft_consensus.cc:1275] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:58.551050  2666 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:58.568310 32194 raft_consensus.cc:1275] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:13:58.566856  2825 log.cc:927] Time spent T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.539s	user 0.000s	sys 0.002s
I20260709 13:13:58.575045 32123 raft_consensus.cc:1275] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:13:58.573553 32165 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:58.580683   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:58.574570  2498 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:58.582969  2498 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:58.585947 32165 leader_election.cc:400] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12.
I20260709 13:13:58.586237 32165 leader_election.cc:403] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:13:58.595146  2800 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12.
I20260709 13:13:58.595422  2824 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:58.587841  2840 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:58.597283  2373 consensus_queue.cc:1048] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:13:58.599032  2832 log.cc:927] Time spent T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.329s	user 0.002s	sys 0.001s
I20260709 13:13:58.597474  2675 consensus_queue.cc:1048] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:58.600611 32165 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:58.603535  2788 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:58.605396 32165 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:13:58.600014  2853 log.cc:927] Time spent T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:13:58.589677 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:58.607908 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:58.608212 32264 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
I20260709 13:13:58.605842  2788 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:58.609885  2795 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:58.610394  2795 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:58.610765  2795 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:58.611019  2740 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:58.612836 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:58.565474  2768 consensus_queue.cc:237] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:58.618290 32236 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:58.623421  2463 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:58.612788  2840 consensus_queue.cc:1048] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:58.627909 32264 raft_consensus.cc:1240] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:58.587747  2498 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:58.652181 32124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 2054) took 1122 ms. Trace:
I20260709 13:13:58.630237 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:58.631907 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:58.633070   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:58.633994 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:58.635749 32269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a75997deb5a741f998b671928aad3637"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:13:58.652854 32124 rpcz_store.cc:276] 0709 13:13:57.529390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.529515 (+   125us) service_pool.cc:224] Handling call
0709 13:13:57.529812 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:58.412675 (+882863us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:58.412722 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:58.412784 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:58.412830 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:58.651824 (+238994us) spinlock_profiling.cc:243] Waited 882 ms on lock 0x7b5400034dd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:13:58.651904 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:58.652099 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2029663616}
I20260709 13:13:58.654058 32269 raft_consensus.cc:606] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:58.635890  2788 consensus_queue.cc:1048] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:58.659159 32269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:13:58.659967 32269 raft_consensus.cc:606] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:58.660387 32269 raft_consensus.cc:614] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:58.663946  2206 raft_consensus.cc:3055] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:58.664384  2206 raft_consensus.cc:740] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:58.665205  2206 consensus_queue.cc:260] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:58.666057  2795 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:58.666385  2206 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:58.674455 32264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:13:58.675093 32264 raft_consensus.cc:606] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:13:58.675441 32264 raft_consensus.cc:614] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:58.680282 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:58.690042 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:58.691113 32264 raft_consensus.cc:2393] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 5: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:13:58.692070 32118 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:58.692915 32117 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:58.694721 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:58.697058 32265 raft_consensus.cc:1275] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:58.681337 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:13:58.699925 32265 raft_consensus.cc:1240] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:58.694506 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:58.696872 32089 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:58.705626 32267 raft_consensus.cc:1275] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:13:58.739708 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 143185us
I20260709 13:13:58.757436  2778 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.758163  2778 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:58.759953 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 63184.1us
I20260709 13:13:58.769805 32119 raft_consensus.cc:1275] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:58.772923 32117 raft_consensus.cc:1275] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:58.778937  2778 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:58.779646  2786 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:58.774369  2740 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:13:58.828631  2727 consensus_queue.cc:1048] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:58.829980  2727 consensus_queue.cc:1048] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:58.830659  2858 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.831198  2858 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:58.832551 32165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.833238 32165 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:58.834336 32165 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:58.835199 32238 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:58.841202 32117 raft_consensus.cc:1275] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:58.840277 32165 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:58.844336 32165 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:58.843115  2390 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:58.850865 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:58.848127 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:57.330312 32009 catalog_manager.cc:5028] TS fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): tablet f089b75ada024eb9bbf7e4b953063dd4 (table test-workload [id=9b9dc20f98e547b59efac9c530f28125]) successfully deleted
I20260709 13:13:58.851800 32019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59534 (request call id 48) took 3316 ms. Trace:
W20260709 13:13:58.852247 32009 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 1.5302e+06us
I20260709 13:13:58.852195 32019 rpcz_store.cc:276] 0709 13:13:55.629220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.640916 (+ 11696us) service_pool.cc:224] Handling call
0709 13:13:58.851714 (+3210798us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1635808,"reported_tablets":2}
I20260709 13:13:58.851552  2840 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:58.854004  2834 consensus_queue.cc:1048] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:58.854552  2840 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:58.854983  2840 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:58.859974  2787 consensus_queue.cc:1048] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:58.864394 32165 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:58.851531  2803 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:58.872413 32165 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:13:58.839300  2339 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:58.840372  2857 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.843565  2788 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:58.865187  2814 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:58.882275  2787 raft_consensus.cc:2804] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:58.888557  2797 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:13:58.915258 32070 auto_rebalancer.cc:629] Failed to schedule move for tablet 4124d037f0614ab8969bf0e130edd483: Illegal state: Replica 113b5461952d47e0944d463ea4e32801 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:13:58.894918  2857 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:58.907548  2814 raft_consensus.cc:697] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:13:58.901085  2787 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:58.918422  2814 consensus_queue.cc:237] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:58.919255  2787 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:58.927976 32192 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:13:58.930682 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:58.931324 32194 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 8.
I20260709 13:13:58.933426 32194 raft_consensus.cc:1240] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:58.951889 32199 raft_consensus.cc:1275] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:13:58.952468 32199 pending_rounds.cc:85] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 5
I20260709 13:13:58.952800 32199 pending_rounds.cc:107] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:13:58.953294 32199 raft_consensus.cc:2889] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:58.967881 32265 raft_consensus.cc:1275] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:13:58.951381  2591 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:58.950515  2863 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:58.982376  2858 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:58.988796  2857 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:59.004735  2591 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:59.006742  2863 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:59.010913  2795 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:59.013602  2740 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:59.019049 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:59.019299  2666 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:13:59.019781  2666 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:59.021274 32070 auto_rebalancer.cc:629] Failed to schedule move for tablet d3a2e596cd6e4340bfea0e5a0e0609d7: Illegal state: Replica 113b5461952d47e0944d463ea4e32801 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
W20260709 13:13:59.025035 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 56666.9us
I20260709 13:13:59.027334  2742 consensus_queue.cc:1048] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:59.027815 32238 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:13:59.028944 32089 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:59.029927  2824 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:59.030283  2824 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:59.030635  2824 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:59.071151  2773 consensus_queue.cc:1059] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 13:13:59.039683 32119 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:13:59.225745 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:59.226941 32271 raft_consensus.cc:2393] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 10: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
W20260709 13:13:59.227658 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 192839us
W20260709 13:13:59.226133 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 194714us
W20260709 13:13:59.226886 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 199167us
I20260709 13:13:59.232441  2623 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:59.254874  2390 consensus_queue.cc:1048] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
W20260709 13:13:59.271660  2881 log.cc:927] Time spent T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.229s	user 0.000s	sys 0.012s
I20260709 13:13:59.285970  2788 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:59.350051 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 93491.8us
I20260709 13:13:59.325708  2874 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.345139  2773 raft_consensus.cc:3055] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:59.409076 32192 raft_consensus.cc:1275] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:59.409057  2787 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:59.411361 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:59.412073 32194 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:13:59.412999 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:13:59.413616 32193 raft_consensus.cc:1275] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:59.414299 32195 raft_consensus.cc:1275] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:13:59.415159 32199 raft_consensus.cc:1275] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:59.413638 32191 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:13:59.390381  2773 raft_consensus.cc:740] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:13:59.369606  2788 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:59.412214  2657 consensus_queue.cc:1048] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:13:59.411324  2787 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:59.468562 32193 raft_consensus.cc:1275] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:13:59.474270 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 244243us
W20260709 13:13:59.476997 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 67537.9us
W20260709 13:13:59.489408   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 93691.7us
I20260709 13:13:59.495108 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:59.495991 32121 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
W20260709 13:13:59.498258  2883 log.cc:927] Time spent T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.213s	user 0.001s	sys 0.001s
I20260709 13:13:59.521175 32119 raft_consensus.cc:1275] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:13:59.529796 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:59.536845 32121 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:13:59.543900  2390 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:13:59.544529  2390 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:59.487687  2773 consensus_queue.cc:260] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:59.546753  2390 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:59.547075  2773 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:59.556195  2888 log.cc:927] Time spent T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
W20260709 13:13:59.574805  2886 log.cc:927] Time spent T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
W20260709 13:13:59.575040  2884 log.cc:927] Time spent T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:13:59.391671  2874 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:13:59.578500  2840 consensus_meta.cc:287] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.723s	user 0.008s	sys 0.005s
I20260709 13:13:59.579545  2788 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:59.552918  2873 consensus_queue.cc:1048] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 13:13:59.561908  2872 log.cc:927] Time spent T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
W20260709 13:13:59.585238  2877 log.cc:927] Time spent T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:13:59.532269  2484 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:13:59.589161 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:59.586741  2824 consensus_meta.cc:287] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.556s	user 0.010s	sys 0.003s
I20260709 13:13:59.615846  2897 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.621157  2897 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:59.623618  2897 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:59.627825  2874 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:59.631029  2824 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:59.633828  2824 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:59.634625  2484 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:59.637303  2484 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:59.638808 32124 raft_consensus.cc:1275] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:59.606295  2840 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:59.642901  2840 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:59.654842 32119 raft_consensus.cc:1275] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:59.656286 32118 raft_consensus.cc:1240] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:59.659816 32118 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:59.658494 32239 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:59.662246 32116 raft_consensus.cc:1275] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:59.669674 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:59.671290 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:59.671949 32268 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:13:59.673276 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:59.674820 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:13:59.676216 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:13:59.680158 32269 raft_consensus.cc:1240] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:59.693485  2619 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.694043  2619 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:59.697422  2619 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:59.698192  2619 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.701189  2619 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:59.703363  2619 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:59.709405 32118 raft_consensus.cc:1275] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:13:59.704521  2899 log.cc:927] Time spent T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.130s	user 0.000s	sys 0.002s
I20260709 13:13:59.715319  2591 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:59.718520 32090 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:59.725159 32120 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:13:59.824882 32120 pending_rounds.cc:85] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d: Aborting all ops after (but not including) 6
I20260709 13:13:59.825289 32120 pending_rounds.cc:107] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:13:59.825584 32120 raft_consensus.cc:2889] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:59.826110 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 108637us
I20260709 13:13:59.832113 32122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 2092) took 1142 ms. Trace:
I20260709 13:13:59.831056  2840 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.832564 32122 rpcz_store.cc:276] 0709 13:13:58.689294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:58.689447 (+   153us) service_pool.cc:224] Handling call
0709 13:13:58.689867 (+   420us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:58.704748 (+ 14881us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:58.704782 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:58.705392 (+   610us) log.cc:844] Serialized 52 byte log entry
0709 13:13:58.821255 (+115863us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b18003db9a0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59eb994bc 00007fb59bee748b 00007fb5a4d41ab9 00007fb59bf0369b 00007fb59bf0193f 00007fb59bf03c02 00007fb59eb8b20b 00007fb59eb90d23 00007fb59eb910d1
0709 13:13:58.821489 (+   234us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:58.821548 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:58.821655 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:59.032934 (+211279us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b18003db9a0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bf04522 00007fb59bf067c1 00007fb59bf06779 00007fb59bf06709 00007fb59bf066d1 00007fb59bf059cd 000000000038f354 000000000038f199 00007fb59bee783a
0709 13:13:59.713175 (+680241us) spinlock_profiling.cc:243] Waited 6.02 ms on lock 0x7b18003db9a0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bf043f3 00007fb59bf067c1 00007fb59bf06779 00007fb59bf06709 00007fb59bf066d1 00007fb59bf059cd 000000000038f354 000000000038f199 00007fb59bee783a
0709 13:13:59.831875 (+118700us) raft_consensus.cc:1685] finished
0709 13:13:59.831900 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:59.832051 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15391,"raft.queue_time_us":50916,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":5263,"spinlock_wait_cycles":67494784,"thread_start_us":49838,"threads_started":1,"wal-append.queue_time_us":49581}
I20260709 13:13:59.835336  2840 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:59.838176  2840 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:13:59.839893  2906 log.cc:927] Time spent T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:13:59.850808  2772 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:59.851317  2772 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:59.851691  2772 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:59.845372  2882 log.cc:927] Time spent T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:13:59.848014  2590 raft_consensus.cc:993] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
W20260709 13:13:59.855540 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 138741us
I20260709 13:13:59.857648 32239 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:59.856498  2840 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:59.830531  2904 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:59.870438  2905 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:13:59.867218  2912 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:13:59.865793  2904 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:59.864012  2840 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:59.891317  2896 raft_consensus.cc:1081] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:13:59.885401  2904 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:59.873754  2905 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:13:59.912604  2863 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:59.915797 32267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 1742) took 1067 ms. Trace:
I20260709 13:13:59.916718  2905 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:13:59.919263   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:13:59.916339 32267 rpcz_store.cc:276] 0709 13:13:58.848530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:58.849552 (+  1022us) service_pool.cc:224] Handling call
0709 13:13:58.853560 (+  4008us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:58.873769 (+ 20209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:58.873787 (+    18us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:58.875285 (+  1498us) log.cc:844] Serialized 52 byte log entry
0709 13:13:59.143334 (+268049us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:59.345962 (+202628us) log.cc:844] Serialized 14 byte log entry
0709 13:13:59.372702 (+ 26740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:59.372782 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:59.915531 (+542749us) raft_consensus.cc:1685] finished
0709 13:13:59.915551 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:59.915689 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39864,"prepare.queue_time_us":46297,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":5372,"raft.queue_time_us":67788,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":10753,"thread_start_us":316645,"threads_started":2,"wal-append.queue_time_us":760944}
I20260709 13:13:59.922637  2863 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:13:59.923007 32165 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:13:59.923305  2863 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:59.923941  2788 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:59.929157  2909 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:59.929715  2909 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:59.927968  2863 leader_election.cc:290] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:13:59.932010  2788 raft_consensus.cc:697] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:13:59.930250  2909 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:59.942292 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:59.942070 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:59.943606 32089 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:13:59.946290 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:13:59.946647 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:13:59.948485 32116 raft_consensus.cc:2410] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:13:59.930138  2900 log.cc:927] Time spent T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
W20260709 13:13:59.916769  2887 log.cc:927] Time spent T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.517s	user 0.000s	sys 0.001s
I20260709 13:13:59.956785 32122 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:13:59.954356  2206 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:59.957090  2786 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.976516  2788 consensus_queue.cc:237] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:59.978206  2838 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.974462 32264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 1407) took 1072 ms. Trace:
I20260709 13:13:59.985575  2666 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:59.985874 32264 rpcz_store.cc:276] 0709 13:13:58.902256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:58.902428 (+   172us) service_pool.cc:224] Handling call
0709 13:13:58.902927 (+   499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:58.909426 (+  6499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:58.909474 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:58.922132 (+ 12658us) log.cc:844] Serialized 26 byte log entry
0709 13:13:59.217702 (+295570us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:59.217766 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:59.217858 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:59.916020 (+698162us) spinlock_profiling.cc:243] Waited 9.41 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:13:59.974091 (+ 58071us) raft_consensus.cc:1685] finished
0709 13:13:59.974119 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:59.974382 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17683,"raft.queue_time_us":1730,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":9649,"spinlock_wait_cycles":21654272,"thread_start_us":262183,"threads_started":1,"wal-append.queue_time_us":393261}
I20260709 13:13:59.989789  2795 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:13:59.989934 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 108999us
I20260709 13:13:59.990698  2795 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:59.964998  2206 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:00.007869  2912 consensus_queue.cc:1059] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:00.007906 32117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 2115) took 1168 ms. Trace:
I20260709 13:14:00.002182  2206 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:00.009517 32117 rpcz_store.cc:276] 0709 13:13:58.840752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:58.911766 (+ 71014us) service_pool.cc:224] Handling call
0709 13:13:58.912158 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:58.925412 (+ 13254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:58.925442 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:58.929062 (+  3620us) log.cc:844] Serialized 26 byte log entry
0709 13:13:59.845851 (+916789us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b18003dae00. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bee6e07 00007fb5a4d41ab9 00007fb59bf0369b 00007fb59bf0193f 00007fb59bf03c02 00007fb59eb8b20b 00007fb59eb90d23 00007fb59eb910d1 00007fb59efaca0f
0709 13:13:59.889839 (+ 43988us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:59.889882 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:59.889952 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:00.007570 (+117618us) raft_consensus.cc:1685] finished
0709 13:14:00.007594 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:00.007828 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22384,"raft.queue_time_us":15252,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":6893,"spinlock_wait_cycles":8240384,"thread_start_us":43788,"threads_started":1,"wal-append.queue_time_us":1030477}
I20260709 13:14:00.011729  2772 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.015527  2772 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:13:59.964701  2786 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.016870  2797 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:00.017382  2797 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.018256  2786 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:00.018796  2786 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:00.019317  2797 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:00.019212  2786 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:13:59.978797  2838 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.025359  2838 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:00.027551  2921 consensus_queue.cc:1048] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:59.870846 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:00.044672 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 52494.3us
I20260709 13:14:00.052892  2664 consensus_queue.cc:1048] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:00.056794  2589 raft_consensus.cc:3055] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:00.057324  2589 raft_consensus.cc:740] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:00.058362  2589 consensus_queue.cc:260] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.059916  2589 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:00.067212 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:00.068146 32264 raft_consensus.cc:2393] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 5: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:00.068202 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:00.068981 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:00.069073 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:00.070169 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:00.074661  2746 consensus_queue.cc:1048] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:00.080744 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:00.084174  2664 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:00.085050  2664 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:14:00.086746 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:00.087265 32268 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
I20260709 13:14:00.087399 32124 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:14:00.088050  2664 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:00.089622 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:00.091903 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:00.016122  2909 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.048157  2917 consensus_queue.cc:1048] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 13:14:00.139750  2909 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:00.139971  2917 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:00.121101  2795 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:00.153307  2840 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:00.133322  2834 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:00.178236 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:00.179008 32122 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:00.129069  2786 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:00.175967 32020 catalog_manager.cc:5697] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 2 to 7, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 7 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:00.192003 32165 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:00.192616 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:00.159669  2787 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:00.205814 32122 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:14:00.222278 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:00.222620 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:00.222939 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:00.223086 32199 raft_consensus.cc:2393] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 6: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:00.223155 32192 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:14:00.223587 32194 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 8.
I20260709 13:14:00.224282 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:00.224560 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:00.227564 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:00.175608  2206 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.230751  2915 consensus_queue.cc:1048] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:00.225287  2787 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.232626  2740 consensus_queue.cc:1048] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:00.233530 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:00.233680  2787 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:00.228734 32199 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:14:00.183979  2498 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:00.185307  2838 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:00.183427  2875 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:00.244203 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:00.199244  2788 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:00.170329  2917 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.199867  2795 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:00.200446  2786 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:00.249980 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:00.217690  2666 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:14:00.239682  2903 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.022s	sys 0.058s
I20260709 13:14:00.254787 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:00.258081 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:00.183676  2834 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.260866 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:00.237748  2787 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:00.239017  2742 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:14:00.238730  2921 consensus_queue.cc:1048] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:14:00.271576 32192 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:00.272360  2787 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.272854  2373 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:00.278620 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:00.280735 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:00.328339  2928 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:14:00.256264  2903 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.022s	sys 0.059s
I20260709 13:14:00.298813 32089 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:00.249738  2875 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.245313  2498 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.317292 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:00.254225  2788 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:00.327013 32070 auto_rebalancer.cc:629] Failed to schedule move for tablet 6021998dccdb415f9b8203cebee0292c: Illegal state: Replica 6b3ed521ce8947db80c4b4828b355c06 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:00.256052  2666 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.249050  2838 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.257854  2786 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.258008  2795 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.337181 32190 raft_consensus.cc:1275] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:14:00.337684 32196 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:00.271718  2904 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.362088 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:00.396740 32198 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:14:00.363456 32194 raft_consensus.cc:1275] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:14:00.242679  2814 consensus_queue.cc:1048] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:14:00.367692 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:00.367864 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:00.401260 32119 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:00.377837 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:14:00.380692 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 81977.1us
I20260709 13:14:00.354398  2937 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:00.372324 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:00.404660 32089 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:00.403317 32239 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:00.407212 32197 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:00.389695  2873 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:00.372956  2373 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.413379 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:00.411917 32165 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:00.389611  2935 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:00.414654 32118 raft_consensus.cc:2368] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 9. Current term is 10.
I20260709 13:14:00.418421 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:00.399025  2928 raft_consensus.cc:697] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:00.399415  2939 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:00.405375 32198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a75997deb5a741f998b671928aad3637"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:14:00.428479 32165 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:00.427466 32239 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:00.437881 32198 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:00.438297 32198 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:00.443223 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:00.444772 32197 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:00.420238  2924 log.cc:927] Time spent T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:14:00.450157 32273 consensus_queue.cc:237] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:00.411124  2921 raft_consensus.cc:2804] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:00.412935  2873 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.415139  2840 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:00.456967 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:00.461328 32119 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:00.411047  2529 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:00.448706  2939 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.453823  2746 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:14:00.469331  2929 log.cc:927] Time spent T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
W20260709 13:14:00.470482  2944 log.cc:927] Time spent T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:14:00.471091  2834 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:00.503104 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:00.473295  2666 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:00.473295 32197 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:14:00.474118  2927 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:00.475456  2206 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:00.480367  2788 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:00.482003  2838 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:00.482820  2933 log.cc:927] Time spent T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:14:00.484530  2786 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:00.486081  2498 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:00.449286  2797 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.490921  2921 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.523947 32198 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.493034  2873 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:00.412703  2937 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.545619 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:14:00.552695 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 109986us
W20260709 13:14:00.557626 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 67787.7us
I20260709 13:14:00.558710 32165 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:00.568244 32198 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:00.541749  2904 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:00.571719  2870 log.cc:927] Time spent T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:14:00.554901  2921 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:00.544049  2206 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:00.550487  2945 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:00.501149  2926 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.131s
I20260709 13:14:00.502777  2840 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:00.553355 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 148730us
I20260709 13:14:00.585176 32089 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:00.574312  2863 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:00.590425  2863 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.591846  2937 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:00.490744  2935 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.598603  2863 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:00.592926  2787 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:00.580135  2373 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:00.554415  2797 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.576936  2666 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:00.607949 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:00.608551 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:00.606460 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:00.609325 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:00.610035 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:00.609354 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 50242us
I20260709 13:14:00.612118 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:00.599093  2950 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:00.612994 32265 raft_consensus.cc:3055] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:00.583223  2927 raft_consensus.cc:2804] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:00.613488 32265 raft_consensus.cc:740] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:00.614317 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:00.612251 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:00.583662  2746 raft_consensus.cc:697] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:00.614593 32265 consensus_queue.cc:260] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.629426 32265 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:00.629942 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:00.617015 32264 raft_consensus.cc:2393] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 12: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:00.598619 32089 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:00.620814 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:00.624223 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:00.614144  2936 log.cc:927] Time spent T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 13:14:00.636690 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:14:00.637681 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.638470 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:00.639531 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:00.614507  2373 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:00.594588  2206 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.619164  2498 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.647145 32265 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
I20260709 13:14:00.643419 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:14:00.659073 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.655576 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:00.656073 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:00.659089 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:00.659946 32119 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:00.661321 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:00.665495 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:00.671231 32165 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:00.673308 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:00.676270 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:14:00.678112 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.639771  2927 raft_consensus.cc:697] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:00.679431 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:00.679133 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:00.680233 32265 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:00.680840 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:00.684428 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:00.681062 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:00.685829 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 87442us
I20260709 13:14:00.686537 32089 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:00.691027 32265 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:14:00.622596  2666 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.697417 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:00.714641 32089 leader_election.cc:304] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:00.622802  2950 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.725122 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:00.722276 32119 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
I20260709 13:14:00.727619 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:00.729048 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:00.727816 32239 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:00.658152  2498 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.705592  2373 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:14:00.707669  2930 log.cc:927] Time spent T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:14:00.743153 32121 raft_consensus.cc:1240] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:00.721796  2675 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:14:00.747052  2931 log.cc:927] Time spent T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:14:00.615407  2928 consensus_queue.cc:237] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.763330  2797 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:00.764276  2935 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:00.765874  2840 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:00.768496  2666 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:00.770781  2498 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:00.774885 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 47140.7us
W20260709 13:14:00.774344  2947 log.cc:927] Time spent T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:14:00.756108  2939 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:00.753685  2954 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:00.797379  2590 consensus_queue.cc:1048] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:00.725643  2746 consensus_queue.cc:237] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.831318 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:00.786018  2772 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:00.821295  2954 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:14:00.879282 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 162833us
I20260709 13:14:00.880505 32089 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:14:00.882969 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 101630us
I20260709 13:14:00.854691  2772 raft_consensus.cc:697] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:00.891222 32238 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:00.892855 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 160376us
I20260709 13:14:00.864780  2954 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:00.818576  2927 consensus_queue.cc:237] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.895223 32238 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:00.894071  2619 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:00.898428  2768 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:00.898819  2768 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.899165  2768 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:00.895323  2664 consensus_queue.cc:1048] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
W20260709 13:14:00.903126  2955 log.cc:927] Time spent T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:14:00.906199 32238 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:00.907302  2664 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:00.907568 32238 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:00.896853 32090 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:00.885231  2958 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:00.912570  2949 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:00.917712 32238 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:00.926743 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:00.917232  2962 log.cc:927] Time spent T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:14:00.912818  2664 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:00.915251  2949 raft_consensus.cc:697] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:00.896745  2589 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:14:00.921058  2958 raft_consensus.cc:697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:00.923969  2746 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:00.933698  2950 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:00.944705  2873 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.948810 32115 raft_consensus.cc:1240] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:14:00.914067  2768 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.955907 32238 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:00.958432  2949 consensus_queue.cc:237] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:00.949728  2772 consensus_queue.cc:237] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:01.002950  2463 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:01.019702  2917 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:01.021659  2873 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:01.003412 32238 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:01.004168  2768 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:00.960556  2958 consensus_queue.cc:237] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:01.008495 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:01.008993  2921 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:01.011224 32020 catalog_manager.cc:5697] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 7 to 10, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 10 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:01.036013  2954 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:01.053942 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:01.055711 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:01.059119 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:01.059911 32193 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:01.062472  2795 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:01.074894  2875 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:01.051033  2463 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:01.079856 32193 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:01.083142 32238 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:01.086879  2727 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:01.091883 32238 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:14:01.092968 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 421832us
I20260709 13:14:01.093539  2921 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:01.093760 32165 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:01.094573  2921 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:01.095017 32165 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:01.095293  2921 raft_consensus.cc:697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:01.097272  2921 consensus_queue.cc:237] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:01.088423 32190 raft_consensus.cc:1275] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:01.111430  2797 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:01.112425  2797 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:01.115410  2787 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:01.116024  2787 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:01.118305  2787 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:01.122233 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:01.110852 32165 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:01.123636 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:01.125464 32119 raft_consensus.cc:1275] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:01.130723 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:01.131600 32123 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:01.135656 32117 raft_consensus.cc:1240] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:01.148912  2498 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:01.160730  2498 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:01.162760  2960 log.cc:927] Time spent T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.279s	user 0.002s	sys 0.000s
I20260709 13:14:01.140607  2727 consensus_queue.cc:1048] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:14:01.142477  2935 raft_consensus.cc:2749] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:01.160138 32123 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
W20260709 13:14:01.178984 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 68187.8us
I20260709 13:14:01.179823 32165 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:01.181874 32165 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:01.183607 32165 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:01.162825  2498 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:01.180840  2939 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:01.183909  2952 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:01.193089  2952 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:14:01.196175 32236 consensus_peers.cc:597] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5708596452c34a319a19ae8a5b24b2df. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:01.198498  2657 consensus_queue.cc:1048] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:01.200084  2768 consensus_queue.cc:1059] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:01.189515  2788 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:01.205310 32239 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:01.207028 32165 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:01.212631 32165 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:01.213670  2952 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:01.215196 32165 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:01.188724  2938 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:01.218343  2938 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:01.219755  2498 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:01.221128  2954 leader_election.cc:290] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:01.221758 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:01.227108  2664 raft_consensus.cc:3055] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:01.227550  2664 raft_consensus.cc:740] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:01.217625 32165 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:01.246598 32165 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:01.249409 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:01.250929 32165 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:01.252954  2787 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:01.253777 32165 leader_election.cc:400] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 9. Current term is 10.
I20260709 13:14:01.253611  2937 consensus_queue.cc:1059] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:01.251116  2498 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:01.251196  2945 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:01.256246  2589 raft_consensus.cc:2804] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:01.254618  2943 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:01.272406 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:01.272778 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:01.274101 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:01.272873 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:01.261168  2787 raft_consensus.cc:3055] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:01.275353  2787 raft_consensus.cc:740] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:01.275622 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:01.276724 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:01.276535 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:01.228394  2664 consensus_queue.cc:260] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:01.276190  2787 consensus_queue.cc:260] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:01.281777 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:01.288770 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:01.289608  2787 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:01.290879  2589 raft_consensus.cc:697] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:01.291846  2589 consensus_queue.cc:237] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:01.293741  2664 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:01.300807 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:01.301545 32265 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
I20260709 13:14:01.303591 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:01.305295 32264 raft_consensus.cc:1240] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:01.306250 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:01.308120 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:01.281723  2498 raft_consensus.cc:697] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:01.313357  2498 consensus_queue.cc:237] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:01.308107 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:01.315560 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:01.319425 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:01.321062 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:01.324388 32119 raft_consensus.cc:2393] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 9: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:01.324424 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:01.329439 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:01.336059  2952 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:01.336474 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:01.342984 32165 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:01.343405 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:01.346527 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:01.347985 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:01.381588 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:01.146624 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:01.385793 32020 catalog_manager.cc:5697] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:01.388026 32020 catalog_manager.cc:5697] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:01.389926 32020 catalog_manager.cc:5697] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:01.395661 32270 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:14:01.391850 32020 catalog_manager.cc:5697] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 7 to 9, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 9 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:01.398844 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 47157us
I20260709 13:14:01.398844 32165 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:01.344384  2787 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:01.400542 32165 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:01.438555 32165 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:01.436364 32089 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:01.441710 32089 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:01.446125 32165 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:01.452359  2992 log.cc:927] Time spent T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:14:01.454677  2958 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:01.442448  2937 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:01.456564  2937 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:01.457039  2937 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:01.465109  2991 log.cc:927] Time spent T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:14:01.400570  2463 consensus_queue.cc:1059] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:14:01.478155 32089 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:01.443717  2954 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:01.479800 32124 raft_consensus.cc:1275] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:14:01.447153  2985 log.cc:927] Time spent T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:14:01.434005  2786 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:01.493520 32089 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:01.481432  2904 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:01.493471  2206 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:01.508805 32089 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:01.509654  2904 raft_consensus.cc:2749] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:01.510838  2938 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:01.515614 32269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:01.516489 32269 raft_consensus.cc:606] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:14:01.516850 32269 raft_consensus.cc:614] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:01.524907 32269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:01.526268 32269 raft_consensus.cc:606] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:14:01.526747 32269 raft_consensus.cc:614] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:01.527951  2666 raft_consensus.cc:3055] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:01.528044 32089 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:01.529060  2788 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:01.530031  2945 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:01.564682  2875 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:01.528548  2666 raft_consensus.cc:740] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:01.566190  2666 consensus_queue.cc:260] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:01.567981  2666 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:01.540913 32191 raft_consensus.cc:1275] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:14:01.541725  2989 log.cc:927] Time spent T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.109s	user 0.003s	sys 0.000s
W20260709 13:14:01.530124 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 84069.4us
I20260709 13:14:01.569510 32165 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:01.570133  2664 consensus_queue.cc:1048] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:01.552429  2373 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:01.571331  2945 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:01.571260 32165 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:01.574712  2945 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:01.577090 32124 raft_consensus.cc:1240] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:01.579730 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:14:01.585649 32022 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49550 (request call id 167) took 16687 ms (client timeout 15000 ms). Trace:
I20260709 13:14:01.589783 32165 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:01.591184 32165 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:01.592696 32020 catalog_manager.cc:5697] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 8 to 9, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 9 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:01.498939  2937 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:01.573276 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 78510.3us
I20260709 13:14:01.599318 32192 raft_consensus.cc:3055] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:01.599748 32192 raft_consensus.cc:740] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:01.595007 32020 catalog_manager.cc:5697] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:01.601905 32020 catalog_manager.cc:5697] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:01.601284  2786 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:01.606178  2921 consensus_queue.cc:1048] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:01.613247 32269 raft_consensus.cc:1240] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:01.614162 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:01.616055 32273 raft_consensus.cc:1240] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:01.619504 32090 leader_election.cc:304] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:01.600468 32192 consensus_queue.cc:260] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:01.620925 32192 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:01.614576 32020 catalog_manager.cc:5697] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:01.628757 32020 catalog_manager.cc:5697] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 3 to 8, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 8 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:01.586194 32022 rpcz_store.cc:269] 0709 13:13:44.898184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:44.905404 (+  7220us) service_pool.cc:224] Handling call
0709 13:14:01.585528 (+16680124us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:56.243886 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:56.346907 (+103021us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:56.346964 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:13:56.346984 (+    20us) tablet.cc:662] Decoding operations
0709 13:13:56.348722 (+  1738us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:56.348836 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:56.348863 (+    27us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:13:56.364226 (+ 15363us) tablet.cc:701] Row locks acquired
0709 13:13:56.364278 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:13:56.364449 (+   171us) write_op.cc:270] Start()
0709 13:13:56.364625 (+   176us) write_op.cc:276] Timestamp: P: 1783602836364382 usec, L: 0
0709 13:13:56.364648 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:13:56.365316 (+   668us) log.cc:844] Serialized 7407 byte log entry
0709 13:13:56.888868 (+523552us) op_driver.cc:464] REPLICATION: finished
0709 13:13:56.953704 (+ 64836us) write_op.cc:301] APPLY: starting
0709 13:13:56.974942 (+ 21238us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:57.044419 (+ 69477us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:57.044541 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:57.046572 (+  2031us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:57.046926 (+   354us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=19
0709 13:13:57.046971 (+    45us) write_op.cc:312] APPLY: finished
0709 13:13:57.047310 (+   339us) log.cc:844] Serialized 131 byte log entry
0709 13:13:57.047474 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:57.047637 (+   163us) write_op.cc:454] Released schema lock
0709 13:13:57.047691 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:57.048086 (+   395us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:57.048114 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":201234,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":42191,"apply.run_cpu_time_us":4442,"apply.run_wall_time_us":105885,"num_ops":19,"prepare.queue_time_us":12200,"prepare.run_cpu_time_us":14846,"prepare.run_wall_time_us":282384,"raft.queue_time_us":240665,"raft.run_cpu_time_us":1950,"raft.run_wall_time_us":56777,"replication_time_us":495727,"thread_start_us":210606,"threads_started":4,"wal-append.queue_time_us":214885,"wal-append.run_cpu_time_us":10878,"wal-append.run_wall_time_us":1456741}]]}
I20260709 13:14:01.632674 32020 catalog_manager.cc:5697] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 8 to 9, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 9 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:01.622242  2788 consensus_queue.cc:1175] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fcfc3281929645969ecedbb0c0af759d" responder_term: 10 status { last_received { term: 10 index: 6 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:14:01.638325  2206 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:01.639923 32165 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:01.645244 32124 raft_consensus.cc:1240] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:01.647019 32192 raft_consensus.cc:1275] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:14:01.642514  2952 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:01.635460 32020 catalog_manager.cc:5697] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 4 to 6, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 6 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:01.647805 32192 pending_rounds.cc:85] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 5
I20260709 13:14:01.652004 32192 pending_rounds.cc:107] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:14:01.653659 32192 raft_consensus.cc:2889] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:01.651224 32020 catalog_manager.cc:5697] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:01.666236 32124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:42262
I20260709 13:14:01.666908 32124 raft_consensus.cc:606] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:14:01.667238 32124 raft_consensus.cc:614] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:01.675463 32264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:01.676231 32264 raft_consensus.cc:606] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:14:01.644136  2788 consensus_queue.cc:1059] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:14:01.685320 32264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a75997deb5a741f998b671928aad3637"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:01.686127 32264 raft_consensus.cc:606] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:14:01.686542 32264 raft_consensus.cc:614] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:01.676338  2937 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:01.694020 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:01.698628 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:01.699116 32269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:01.699522 32115 raft_consensus.cc:2393] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 9: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:01.699728 32269 raft_consensus.cc:606] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:14:01.700162 32269 raft_consensus.cc:614] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:01.693646  2788 consensus_queue.cc:1243] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer 6b3ed521ce8947db80c4b4828b355c06 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:14:01.701149  2938 consensus_queue.cc:1059] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:01.711150 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:14:01.712493 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:01.660950 32020 catalog_manager.cc:5697] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 9 to 10, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 10 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:01.722465 32196 raft_consensus.cc:1275] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 13:14:01.723292 32196 pending_rounds.cc:85] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 4
I20260709 13:14:01.723531 32196 pending_rounds.cc:107] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:14:01.723803 32196 raft_consensus.cc:2889] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:01.727919 32199 raft_consensus.cc:1240] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:01.725641 32020 catalog_manager.cc:5697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 7 to 8, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 8 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:01.735303 32020 catalog_manager.cc:5697] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 5 to 7, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 7 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:01.742038 32020 catalog_manager.cc:5697] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 5 to 6, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 6 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:01.745273  2927 raft_consensus.cc:3055] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:01.737725  2911 consensus_queue.cc:1048] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:14:01.750623  2927 raft_consensus.cc:740] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:01.751664  2927 consensus_queue.cc:260] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:01.764186 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 126295us
I20260709 13:14:01.767840 32264 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
I20260709 13:14:01.754738 32020 catalog_manager.cc:5697] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 4 to 6, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 6 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:01.764357  2927 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:01.769115 32020 catalog_manager.cc:5697] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 7 to 8, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 8 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:01.770141 32020 catalog_manager.cc:5697] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:01.769644  2742 raft_consensus.cc:2955] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:01.771137 32020 catalog_manager.cc:5697] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:01.773437 32165 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:01.756932  2206 raft_consensus.cc:697] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:01.772100 32020 catalog_manager.cc:5697] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 5 to 9, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 9 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:01.782011 32269 raft_consensus.cc:1275] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:01.784085 32020 catalog_manager.cc:5697] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:01.785372 32020 catalog_manager.cc:5697] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:01.786870 32020 catalog_manager.cc:5697] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 5 to 6, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 6 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:01.777156  2788 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:01.792477 32020 catalog_manager.cc:5697] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 3 to 7, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 7 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:01.779402  2945 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:01.796173 32020 catalog_manager.cc:5697] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 7 to 8, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 8 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:01.775993  2484 consensus_queue.cc:1059] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:14:01.798260 32020 catalog_manager.cc:5697] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:01.802260  2788 raft_consensus.cc:697] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:01.787632 32116 raft_consensus.cc:2955] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:01.822219 32020 catalog_manager.cc:5697] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:01.823911 32020 catalog_manager.cc:5697] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 3 to 7, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 7 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:01.825382 32020 catalog_manager.cc:5697] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 2 to 3, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 3 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:01.826728 32020 catalog_manager.cc:5697] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:01.829628 32020 catalog_manager.cc:5697] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:01.831367 32123 raft_consensus.cc:1275] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:14:01.834585 32020 catalog_manager.cc:5697] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 5 to 7, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 7 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:01.836433  2999 ts_tablet_manager.cc:933] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:01.833472  2498 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:14:01.907961 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 119144us
I20260709 13:14:01.912057 32117 raft_consensus.cc:1275] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:14:01.869022  2788 consensus_queue.cc:237] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:01.872284  2206 consensus_queue.cc:237] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:01.883912  2498 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:01.960246 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 161044us
W20260709 13:14:01.961081 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:01.967301 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:01.977864 32190 raft_consensus.cc:1275] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:14:01.978719 32190 pending_rounds.cc:85] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 3
I20260709 13:14:01.979156 32190 pending_rounds.cc:107] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:14:01.979514 32190 raft_consensus.cc:2889] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:01.943717  2484 consensus_queue.cc:1243] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer 6b3ed521ce8947db80c4b4828b355c06 log is divergent from this leader: its last log entry 13.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:14:01.991890  2498 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:02.016983 32264 raft_consensus.cc:1275] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:02.016091 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:02.021445 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 55821.9us
I20260709 13:14:02.027930 32273 raft_consensus.cc:2393] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 10: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:02.028800  2937 consensus_queue.cc:1048] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:02.034423  3002 raft_consensus.cc:3055] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:02.034958  3002 raft_consensus.cc:740] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:02.032467  2958 consensus_queue.cc:1059] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:14:02.045078 32165 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:02.063627  2937 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:02.021811  2996 log.cc:927] Time spent T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:14:02.021374  2373 consensus_queue.cc:1048] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
W20260709 13:14:02.128242 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 105491us
W20260709 13:14:02.145725 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 192522us
I20260709 13:14:02.149470  3002 consensus_queue.cc:260] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:02.151309  3002 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:02.116742  3010 consensus_queue.cc:1048] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:14:02.162747  2937 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:14:02.195149 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 166577us
W20260709 13:14:02.257329 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 68996.5us
W20260709 13:14:02.261977 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 63922.8us
W20260709 13:14:02.276328  3017 log.cc:927] Time spent T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:14:02.286687 32266 raft_consensus.cc:1217] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Deduplicated request from leader. Original: 9.4->[11.5-12.6]   Dedup: 11.5->[12.6-12.6]
I20260709 13:14:02.287271 32266 raft_consensus.cc:1240] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 12. Current term is 13. Ops: [11.5-12.6]
I20260709 13:14:02.292773  2742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:50578 (request call id 6) took 1859 ms. Trace:
I20260709 13:14:02.293282  2742 rpcz_store.cc:276] 0709 13:14:00.420852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:00.420972 (+   120us) service_pool.cc:224] Handling call
0709 13:14:00.549635 (+128663us) log.cc:844] Serialized 492 byte log entry
0709 13:14:00.941433 (+391798us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b540017b9a0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59ef6a142 00007fb59ef4aeaa 00007fb59ef51d53 00007fb59ef51cd9 00007fb59ef51c69 00007fb59ef51c31 00007fb59ef50dfd 000000000038f354 000000000038f199 00007fb59bf04475
0709 13:14:01.032432 (+ 90999us) spinlock_profiling.cc:243] Waited 5.37 ms on lock 0x7b180040c480. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bed22a6 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59ef71b26 00007fb59ef6b49a 00007fb59ef6a714
0709 13:14:01.033009 (+   577us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b540017b9a0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59ef71b26 00007fb59ef6b49a 00007fb59ef6a714 00007fb59ef4aeaa 00007fb59ef51d53 00007fb59ef51cd9 00007fb59ef51c69 00007fb59ef51c31 00007fb59ef50dfd 000000000038f354
0709 13:14:02.280339 (+1247330us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109240,"raft.queue_time_us":115946,"raft.run_cpu_time_us":5036,"raft.run_wall_time_us":609334,"spinlock_wait_cycles":47074304,"thread_start_us":51852,"threads_started":1,"wal-append.queue_time_us":218361,"wal-append.run_cpu_time_us":2360,"wal-append.run_wall_time_us":1019513}
I20260709 13:14:02.261658  2916 consensus_queue.cc:1048] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:14:02.276691  2970 consensus_queue.cc:1048] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:14:02.305011  2666 raft_consensus.cc:993] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:02.309626  2740 consensus_queue.cc:1048] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:02.326452  2772 raft_consensus.cc:1081] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:02.247576  2999 tablet_copy_client.cc:323] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Beginning tablet copy session from remote peer at address 127.30.63.3:36651
I20260709 13:14:02.333599 32197 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:14:02.347460 32199 raft_consensus.cc:2955] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:02.395308 32196 raft_consensus.cc:1275] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:02.398512  2206 consensus_queue.cc:1048] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:14:02.466900 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 55579us
W20260709 13:14:02.473129  3020 log.cc:927] Time spent T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:14:02.477154  3019 log.cc:927] Time spent T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:14:02.487123 32123 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 13:14:02.487573 32123 pending_rounds.cc:85] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d: Aborting all ops after (but not including) 5
I20260709 13:14:02.487793 32123 pending_rounds.cc:107] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:14:02.488354 32123 raft_consensus.cc:2889] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:02.416227  3013 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:14:02.503160 32191 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:14:02.503929 32191 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:02.504416 32191 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:02.529155 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 53890.7us
I20260709 13:14:02.566143 32123 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:02.576346 32191 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:02.589322 32191 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:02.591451 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:02.592077 32123 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:02.575402  2787 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:14:02.607535 32123 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:02.609362 32165 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:02.650619 32270 raft_consensus.cc:1275] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:02.651938 32264 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:02.652165 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:02.652722 32266 raft_consensus.cc:3055] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:02.653028 32266 raft_consensus.cc:740] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:02.653702 32266 consensus_queue.cc:260] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:02.663172 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 116276us
I20260709 13:14:02.649075  2786 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:14:02.673619  3032 log.cc:927] Time spent T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:14:02.665663  2945 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:14:02.678933  2786 raft_consensus.cc:697] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:02.679886  2786 consensus_queue.cc:237] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:02.661679  2954 consensus_queue.cc:1048] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:14:02.708352 32266 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:02.708660 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 44612.3us
I20260709 13:14:02.714517 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:02.722838 32266 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
W20260709 13:14:02.758283  3021 log.cc:927] Time spent T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.269s	user 0.003s	sys 0.000s
I20260709 13:14:02.759487 32282 tablet_copy_service.cc:140] P 6b3ed521ce8947db80c4b4828b355c06: Received BeginTabletCopySession request for tablet 5708596452c34a319a19ae8a5b24b2df from peer 94085cf341634eb686a95983b6b7f7e6 ({username='slave'} at 127.0.0.1:50584)
I20260709 13:14:02.760125 32282 tablet_copy_service.cc:161] P 6b3ed521ce8947db80c4b4828b355c06: Beginning new tablet copy session on tablet 5708596452c34a319a19ae8a5b24b2df from peer 94085cf341634eb686a95983b6b7f7e6 at {username='slave'} at 127.0.0.1:50584: session id = 94085cf341634eb686a95983b6b7f7e6-5708596452c34a319a19ae8a5b24b2df
W20260709 13:14:02.770215 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 49767.4us
I20260709 13:14:02.796031 32191 raft_consensus.cc:1240] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:02.782898  3013 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:14:02.841703 32282 tablet_copy_source_session.cc:215] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:02.884934  2999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5708596452c34a319a19ae8a5b24b2df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:03.060850  2999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:38164 (request call id 131) took 1516 ms. Trace:
I20260709 13:14:03.061378  2999 rpcz_store.cc:276] 0709 13:14:01.544137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:01.544290 (+   153us) service_pool.cc:224] Handling call
0709 13:14:01.869833 (+325543us) ts_tablet_manager.cc:934] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
0709 13:14:02.102856 (+233023us) spinlock_profiling.cc:243] Waited 7.34 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59bee70ac 00007fb5a4d41ab9 00007fb59bf0369b 00007fb59bf00caa 00007fb59bf00bd2 00007fb5a3f65131
0709 13:14:02.883632 (+780776us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:14:03.004233 (+120601us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:03.004338 (+   105us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:14:03.035878 (+ 31540us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:14:03.036182 (+   304us) tablet_replica.cc:206] Creating consensus instance
0709 13:14:03.036504 (+   322us) ts_tablet_manager.cc:989] Replica registered.
0709 13:14:03.060702 (+ 24198us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":270,"spinlock_wait_cycles":16874240,"tablet-copy.queue_time_us":291526,"thread_start_us":472721,"threads_started":2}
I20260709 13:14:03.074479  2999 tablet_copy_client.cc:806] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:03.082371  2999 tablet_copy_client.cc:670] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:03.088796  2999 tablet_copy_client.cc:538] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:03.105926  2999 tablet_bootstrap.cc:492] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6: Bootstrap starting.
I20260709 13:14:03.142037 32019 catalog_manager.cc:5697] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:03.158533 32019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59534 (request call id 49) took 4297 ms. Trace:
I20260709 13:14:03.161548 32264 raft_consensus.cc:1275] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:03.163867  2927 consensus_queue.cc:1048] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:03.159142 32019 rpcz_store.cc:276] 0709 13:13:58.861237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:58.862766 (+  1529us) service_pool.cc:224] Handling call
0709 13:14:03.158455 (+4295689us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:03.149296 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:03.149884 (+   588us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:03.149951 (+    67us) write_op.cc:435] Acquired schema lock
0709 13:14:03.149979 (+    28us) tablet.cc:662] Decoding operations
0709 13:14:03.150354 (+   375us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:03.150411 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:03.150444 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:14:03.150640 (+   196us) tablet.cc:701] Row locks acquired
0709 13:14:03.150660 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:14:03.150813 (+   153us) write_op.cc:270] Start()
0709 13:14:03.150923 (+   110us) write_op.cc:276] Timestamp: P: 1783602843150764 usec, L: 0
0709 13:14:03.150949 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:14:03.151565 (+   616us) log.cc:844] Serialized 529 byte log entry
0709 13:14:03.153657 (+  2092us) op_driver.cc:464] REPLICATION: finished
0709 13:14:03.154086 (+   429us) write_op.cc:301] APPLY: starting
0709 13:14:03.154153 (+    67us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:03.154248 (+    95us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:03.154334 (+    86us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:03.154543 (+   209us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:03.154706 (+   163us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:14:03.154749 (+    43us) write_op.cc:312] APPLY: finished
0709 13:14:03.154922 (+   173us) log.cc:844] Serialized 22 byte log entry
0709 13:14:03.155735 (+   813us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:03.155823 (+    88us) write_op.cc:454] Released schema lock
0709 13:14:03.155865 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:03.156215 (+   350us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:03.156251 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":836715,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":227,"apply.run_cpu_time_us":1465,"apply.run_wall_time_us":2102,"num_ops":1,"prepare.queue_time_us":204,"prepare.run_cpu_time_us":2554,"prepare.run_wall_time_us":2554,"replication_time_us":2569}]]}
I20260709 13:14:03.237989 32123 raft_consensus.cc:1275] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:03.249948  2786 consensus_queue.cc:1048] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:03.289896  2814 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.290442  2814 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:03.302346 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:03.302814  2999 tablet_bootstrap.cc:492] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:03.303020 32191 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:14:03.303932  2999 tablet_bootstrap.cc:492] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6: Bootstrap complete.
I20260709 13:14:03.304327 32238 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:03.305506  2657 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:03.307999  2657 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:03.308427  2657 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:03.309573 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:03.314831 32123 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:14:03.324970  2999 ts_tablet_manager.cc:1403] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6: Time spent bootstrapping tablet: real 0.219s	user 0.036s	sys 0.013s
I20260709 13:14:03.333388 32020 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49556 (request call id 176) took 6645 ms. Trace:
I20260709 13:14:03.321372  2814 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:03.354596  2657 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:03.365836  2657 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:03.342002 32020 rpcz_store.cc:276] 0709 13:13:56.688046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:56.699437 (+ 11391us) service_pool.cc:224] Handling call
0709 13:14:03.333314 (+6633877us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:02.613185 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:02.613749 (+   564us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:02.613782 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:14:02.613800 (+    18us) tablet.cc:662] Decoding operations
0709 13:14:02.739198 (+125398us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:02.739252 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:02.739279 (+    27us) tablet.cc:685] Acquiring locks for 35 operations
0709 13:14:02.741696 (+  2417us) tablet.cc:701] Row locks acquired
0709 13:14:02.741711 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:14:02.741857 (+   146us) write_op.cc:270] Start()
0709 13:14:02.741969 (+   112us) write_op.cc:276] Timestamp: P: 1783602842741810 usec, L: 0
0709 13:14:02.741990 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:14:02.742703 (+   713us) log.cc:844] Serialized 13519 byte log entry
0709 13:14:03.053238 (+310535us) op_driver.cc:464] REPLICATION: finished
0709 13:14:03.109197 (+ 55959us) write_op.cc:301] APPLY: starting
0709 13:14:03.109284 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:03.109906 (+   622us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:03.110029 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:03.113433 (+  3404us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:03.113822 (+   389us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=35
0709 13:14:03.113867 (+    45us) write_op.cc:312] APPLY: finished
0709 13:14:03.114392 (+   525us) log.cc:844] Serialized 229 byte log entry
0709 13:14:03.132747 (+ 18355us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:03.133004 (+   257us) write_op.cc:454] Released schema lock
0709 13:14:03.133089 (+    85us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:03.133482 (+   393us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:03.133510 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1315488,"reported_tablets":57,"child_traces":[["op",{"apply.queue_time_us":55704,"apply.run_cpu_time_us":6099,"apply.run_wall_time_us":24253,"num_ops":35,"prepare.queue_time_us":355226,"prepare.run_cpu_time_us":30614,"prepare.run_wall_time_us":354524,"raft.queue_time_us":86054,"raft.run_cpu_time_us":15221,"raft.run_wall_time_us":57469,"replication_time_us":311103,"thread_start_us":520356,"threads_started":4,"wal-append.queue_time_us":221145}]]}
I20260709 13:14:03.367470 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:03.371099 32124 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:03.375269 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:03.375890 32197 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:14:03.367622  2999 raft_consensus.cc:359] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:03.376403  2999 raft_consensus.cc:740] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Initialized, Role: LEARNER
I20260709 13:14:03.377118  2999 consensus_queue.cc:260] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:03.382345 32124 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:14:03.364009 32021 catalog_manager.cc:5697] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 4 to 5, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 5 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:03.385432 32239 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:03.389189 32197 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:14:03.392153 32021 catalog_manager.cc:5697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 9 to 11, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 11 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:03.420658  2911 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:03.421343  2911 raft_consensus.cc:697] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:03.422227  2911 consensus_queue.cc:237] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:03.399405 32021 catalog_manager.cc:5697] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 10 to 13, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 13 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:03.446138 32021 catalog_manager.cc:5697] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 8 to 9, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 9 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:03.450280  2999 ts_tablet_manager.cc:1434] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6: Time spent starting tablet: real 0.125s	user 0.008s	sys 0.000s
I20260709 13:14:03.448273 32021 catalog_manager.cc:5697] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 9 to 10, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 10 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:03.480407 32021 catalog_manager.cc:5697] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 6 to 7, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 7 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:03.494531 32282 tablet_copy_service.cc:342] P 6b3ed521ce8947db80c4b4828b355c06: Request end of tablet copy session 94085cf341634eb686a95983b6b7f7e6-5708596452c34a319a19ae8a5b24b2df received from {username='slave'} at 127.0.0.1:50584
I20260709 13:14:03.498440 32282 tablet_copy_service.cc:434] P 6b3ed521ce8947db80c4b4828b355c06: ending tablet copy session 94085cf341634eb686a95983b6b7f7e6-5708596452c34a319a19ae8a5b24b2df on tablet 5708596452c34a319a19ae8a5b24b2df with peer 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:03.509992 32021 catalog_manager.cc:5697] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 5 to 7, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 7 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:03.521762 32021 catalog_manager.cc:5697] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 6 to 9, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 9 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:03.538388 32021 catalog_manager.cc:5697] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 6 to 8, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 8 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:03.560194 32021 catalog_manager.cc:5697] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:03.572904 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:03.571956 32021 catalog_manager.cc:5697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 8 to 9, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 9 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:03.582544 32021 catalog_manager.cc:5697] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:03.584148 32021 catalog_manager.cc:5697] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 3 to 5, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 5 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:03.586051 32021 catalog_manager.cc:5697] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:03.598294 32021 catalog_manager.cc:5697] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 8 to 12, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 12 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:03.599969 32021 catalog_manager.cc:5697] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:03.601749 32021 catalog_manager.cc:5697] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:03.650516 32020 catalog_manager.cc:5697] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index -1 to 4, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New cstate: current_term: 4 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:03.680624 32264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "002126350f9348faac039e490fafb4d7"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:03.681226 32264 raft_consensus.cc:606] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:14:03.691054 32264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:03.691663 32264 raft_consensus.cc:606] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:14:03.696969 32264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7594a5601f24445092c404115861232c"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:03.697500 32264 raft_consensus.cc:606] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:14:03.709275 32264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d002861120de41408d48712b6bd491e1"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:03.709849 32264 raft_consensus.cc:606] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:14:03.713052 32264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:03.713600 32264 raft_consensus.cc:606] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:14:03.713909 32264 raft_consensus.cc:614] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:03.714910 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:03.720779 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:03.721531 32019 catalog_manager.cc:5697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 4 to 8, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 8 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:03.738685 32019 catalog_manager.cc:5697] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:03.740201 32019 catalog_manager.cc:5697] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 7 to 9, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 9 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:03.741691 32019 catalog_manager.cc:5697] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:03.744171 32019 catalog_manager.cc:5697] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 9 to 10, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 10 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:03.746522 32019 catalog_manager.cc:5697] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 9 to 11, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 11 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:03.764616 32019 catalog_manager.cc:5697] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:03.766300 32019 catalog_manager.cc:5697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 11 to 13, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 13 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:03.768388 32019 catalog_manager.cc:5697] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 4 to 6, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 6 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:03.772679 32021 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49534 (request call id 172) took 5159 ms. Trace:
I20260709 13:14:03.773830 32021 rpcz_store.cc:276] 0709 13:13:58.613442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:58.616535 (+  3093us) service_pool.cc:224] Handling call
0709 13:14:03.636681 (+5020146us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:03.636709 (+    28us) write_op.cc:454] Released schema lock
0709 13:14:03.772621 (+135912us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:03.615081 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:03.615639 (+   558us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:03.615677 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:14:03.615713 (+    36us) tablet.cc:662] Decoding operations
0709 13:14:03.617177 (+  1464us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:03.617234 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:03.617266 (+    32us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:14:03.618543 (+  1277us) tablet.cc:701] Row locks acquired
0709 13:14:03.618559 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:14:03.618719 (+   160us) write_op.cc:270] Start()
0709 13:14:03.619187 (+   468us) write_op.cc:276] Timestamp: P: 1783602843618670 usec, L: 0
0709 13:14:03.619212 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:14:03.619928 (+   716us) log.cc:844] Serialized 6647 byte log entry
0709 13:14:03.623328 (+  3400us) op_driver.cc:464] REPLICATION: finished
0709 13:14:03.623711 (+   383us) write_op.cc:301] APPLY: starting
0709 13:14:03.623791 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:03.624112 (+   321us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:03.624208 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:03.630715 (+  6507us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:03.631033 (+   318us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 13:14:03.631089 (+    56us) write_op.cc:312] APPLY: finished
0709 13:14:03.631522 (+   433us) log.cc:844] Serialized 118 byte log entry
0709 13:14:03.632440 (+   918us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:03.632653 (+   213us) write_op.cc:454] Released schema lock
0709 13:14:03.632705 (+    52us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":77098,"reported_tablets":57,"child_traces":[["op",{"apply.queue_time_us":137,"apply.run_cpu_time_us":6517,"apply.run_wall_time_us":9289,"num_ops":17,"prepare.queue_time_us":115,"prepare.run_cpu_time_us":4800,"prepare.run_wall_time_us":7484,"replication_time_us":4001}]]}
I20260709 13:14:03.789245   400 raft_consensus.cc:1217] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 13:14:03.791793  2657 raft_consensus.cc:993] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:03.792273  2657 raft_consensus.cc:1081] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:03.801117 32198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d002861120de41408d48712b6bd491e1"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:14:03.801666 32198 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:03.771862 32019 catalog_manager.cc:5697] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 9 to 10, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 10 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:03.802179 32198 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:03.803202 32019 catalog_manager.cc:5697] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:03.805281 32019 catalog_manager.cc:5697] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 5 to 6, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 6 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:03.809253 32019 catalog_manager.cc:5697] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 4 to 5, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 5 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:03.814790 32019 catalog_manager.cc:5697] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:03.816352 32019 catalog_manager.cc:5697] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:03.817725 32019 catalog_manager.cc:5697] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 9 to 10, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 10 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:03.818962 32019 catalog_manager.cc:5697] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 6 to 10, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 10 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:03.820820 32019 catalog_manager.cc:5697] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 5 to 6, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 6 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:03.821976 32198 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:03.825166 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:03.825784 32123 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:03.835374 32123 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:14:03.834185 32019 catalog_manager.cc:5697] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:03.836622 32165 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:03.837560  2937 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:03.838068  2937 raft_consensus.cc:697] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 13 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:03.839054  2937 consensus_queue.cc:237] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:03.836881 32019 catalog_manager.cc:5697] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:03.840664 32019 catalog_manager.cc:5697] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 6 to 9, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 9 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:03.842417 32019 catalog_manager.cc:5697] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 9 to 11, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 11 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:03.846208 32019 catalog_manager.cc:5697] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 8 to 10, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 10 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:03.847594 32019 catalog_manager.cc:5697] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 10 to 11, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 11 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:03.848547 32198 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:03.849488 32019 catalog_manager.cc:5697] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 9 to 11, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 11 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:03.850528 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:03.851101 32270 raft_consensus.cc:3055] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:03.851380 32270 raft_consensus.cc:740] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:03.850803 32019 catalog_manager.cc:5697] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 7 to 9, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 9 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:03.852900 32019 catalog_manager.cc:5697] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 5 to 6, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 6 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:03.852212 32270 consensus_queue.cc:260] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:03.861717 32270 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:03.912173 32270 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:14:03.926405  2911 raft_consensus.cc:993] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:03.926920  2911 raft_consensus.cc:1081] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:03.934298 32197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:14:03.934895 32197 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:03.935274 32197 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:03.948159 32197 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:03.969791 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:03.973172 32117 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:03.973321 32197 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:03.971163  2814 raft_consensus.cc:993] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:04.010129 32117 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
W20260709 13:14:04.039836  3059 log.cc:927] Time spent T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:14:04.040010  3064 raft_consensus.cc:1081] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:04.088249 32165 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:04.089870 32123 raft_consensus.cc:1240] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:04.095304 32197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7594a5601f24445092c404115861232c"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:14:04.096071 32197 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:04.096508 32197 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:04.093787  3067 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:04.104998  3067 raft_consensus.cc:697] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:04.117075 32197 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:04.122890 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:04.123775 32123 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:04.105928  3067 consensus_queue.cc:237] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:04.127461 32197 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:04.140018 32123 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:14:04.146207 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:04.173578 32264 raft_consensus.cc:3055] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:04.173941 32264 raft_consensus.cc:740] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:04.174098 32165 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:04.189791  2937 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:04.190485  2937 raft_consensus.cc:697] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 12 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:04.191461  2937 consensus_queue.cc:237] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:04.174718 32264 consensus_queue.cc:260] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:04.199064 32264 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:04.200131 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:04.201062 32269 raft_consensus.cc:3055] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:04.201529 32269 raft_consensus.cc:740] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:04.203899 32269 consensus_queue.cc:260] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:04.208102 32269 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:04.289332 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 75784.5us
I20260709 13:14:04.301034  2657 raft_consensus.cc:993] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:04.304571  2657 raft_consensus.cc:1081] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
W20260709 13:14:04.324188 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 45952.1us
I20260709 13:14:04.344225  2916 raft_consensus.cc:1064] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:14:04.352545 32117 raft_consensus.cc:1275] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:04.352432 32264 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:14:04.355685  2916 consensus_queue.cc:237] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:14:04.382987   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 63530.9us
W20260709 13:14:04.388916 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 110413us
I20260709 13:14:04.400426 32197 raft_consensus.cc:1275] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:04.404981 32269 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:14:04.455483 32191 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "002126350f9348faac039e490fafb4d7"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:14:04.456549 32191 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:04.457113 32191 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:04.498031 32269 raft_consensus.cc:1275] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:04.510703 32119 raft_consensus.cc:1275] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:04.532202   400 raft_consensus.cc:1275] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 4 LEARNER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:14:04.534618  3080 consensus_queue.cc:1048] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:04.539587  2657 consensus_queue.cc:1048] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:04.543112  3086 consensus_queue.cc:1048] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:04.572257  2786 consensus_queue.cc:1048] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:04.626976 32123 raft_consensus.cc:1275] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:14:04.638115 32191 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:04.642524 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:04.643282 32264 raft_consensus.cc:3055] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:04.643610 32264 raft_consensus.cc:740] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:04.644568 32264 consensus_queue.cc:260] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:04.645814 32264 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:04.649199 32197 raft_consensus.cc:1275] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:14:04.655220 32197 raft_consensus.cc:1240] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:04.658526  3075 consensus_queue.cc:1048] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:04.667407  3075 consensus_queue.cc:1048] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:04.678408 32191 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:04.693576 32264 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
I20260709 13:14:04.699414 32165 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:04.705197 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:04.706598 32117 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:04.709285 32116 raft_consensus.cc:1275] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:14:04.716904  3067 raft_consensus.cc:2804] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:04.717532  3067 raft_consensus.cc:697] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:04.718627  3067 consensus_queue.cc:237] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:04.722251 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:04.741971 32117 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
I20260709 13:14:04.751274 32019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49556 (request call id 177) took 1193 ms. Trace:
I20260709 13:14:04.753545 32019 rpcz_store.cc:276] 0709 13:14:03.557839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:03.557990 (+   151us) service_pool.cc:224] Handling call
0709 13:14:04.751030 (+1193040us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:03.925949 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:03.926696 (+   747us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:03.926743 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:14:03.926769 (+    26us) tablet.cc:662] Decoding operations
0709 13:14:03.929703 (+  2934us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:03.929818 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:03.929916 (+    98us) tablet.cc:685] Acquiring locks for 27 operations
0709 13:14:04.105985 (+176069us) tablet.cc:701] Row locks acquired
0709 13:14:04.106009 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:14:04.106180 (+   171us) write_op.cc:270] Start()
0709 13:14:04.106301 (+   121us) write_op.cc:276] Timestamp: P: 1783602844106130 usec, L: 0
0709 13:14:04.106324 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:14:04.155357 (+ 49033us) log.cc:844] Serialized 10467 byte log entry
0709 13:14:04.185434 (+ 30077us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b5400047c54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59efece28 00007fb5a2a27581 00007fb5a2a26d58 00007fb5a2a2b9f1 00007fb5a2a2b9a9 00007fb5a2a2b939 00007fb5a2a2b901 00007fb5a2a2ab2d 000000000038f354 000000000038f199
0709 13:14:04.341871 (+156437us) op_driver.cc:464] REPLICATION: finished
0709 13:14:04.421084 (+ 79213us) write_op.cc:301] APPLY: starting
0709 13:14:04.421220 (+   136us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:04.421973 (+   753us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:04.422022 (+    49us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:04.475202 (+ 53180us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:04.475690 (+   488us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=27
0709 13:14:04.475761 (+    71us) write_op.cc:312] APPLY: finished
0709 13:14:04.476344 (+   583us) log.cc:844] Serialized 181 byte log entry
0709 13:14:04.511735 (+ 35391us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:04.512183 (+   448us) write_op.cc:454] Released schema lock
0709 13:14:04.512284 (+   101us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:04.512895 (+   611us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:04.512926 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6734,"reported_tablets":48,"spinlock_wait_cycles":2944,"child_traces":[["op",{"apply.queue_time_us":78752,"apply.run_cpu_time_us":7055,"apply.run_wall_time_us":91775,"num_ops":27,"prepare.queue_time_us":492,"prepare.run_cpu_time_us":12851,"prepare.run_wall_time_us":259715,"replication_time_us":235094,"spinlock_wait_cycles":6147968,"thread_start_us":40129,"threads_started":1}]]}
I20260709 13:14:04.774772  3075 consensus_queue.cc:1048] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:04.799352 32269 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:04.806849  3086 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:04.845253  3085 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:04.860602 32266 raft_consensus.cc:1275] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:14:04.862020  3085 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:04.899950 32118 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:04.904978  3067 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:04.923235 32019 catalog_manager.cc:5697] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 12 to 13, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 13 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:04.925388  3061 raft_consensus.cc:2955] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:04.935658   400 raft_consensus.cc:2955] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:04.978469 32123 raft_consensus.cc:2955] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:05.033385 32198 raft_consensus.cc:2955] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:05.134934 32264 raft_consensus.cc:1275] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:14:05.140195  3086 consensus_queue.cc:1048] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:05.140748 32022 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49550 (request call id 168) took 2991 ms. Trace:
I20260709 13:14:05.141202 32022 rpcz_store.cc:276] 0709 13:14:02.149118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.149306 (+   188us) service_pool.cc:224] Handling call
0709 13:14:05.140503 (+2991197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14921,"reported_tablets":56}
I20260709 13:14:05.154302 32123 raft_consensus.cc:1275] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:14:05.165493  3086 consensus_queue.cc:1048] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:05.262326 32020 catalog_manager.cc:5697] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 4 to 5, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:05.277194 32019 catalog_manager.cc:5697] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 11 to 12, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 12 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:05.278911 32019 catalog_manager.cc:5697] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 6 to 7, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 7 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:05.281355 32019 catalog_manager.cc:5697] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 7 to 8, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 8 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
W20260709 13:14:05.384642 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 44132.5us
W20260709 13:14:05.426512 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 45325.2us
I20260709 13:14:05.479041 32021 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49534 (request call id 173) took 1643 ms. Trace:
I20260709 13:14:05.479453 32021 rpcz_store.cc:276] 0709 13:14:03.835143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:03.836272 (+  1129us) service_pool.cc:224] Handling call
0709 13:14:05.478855 (+1642583us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76464,"reported_tablets":39}
I20260709 13:14:05.531709 32270 consensus_queue.cc:237] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:05.537820   400 raft_consensus.cc:1275] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:05.539904  2916 consensus_queue.cc:1048] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:05.554575 32199 raft_consensus.cc:1275] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:05.556188  3075 consensus_queue.cc:1048] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:05.558296  2657 raft_consensus.cc:2955] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:05.559834 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:05.564945   401 raft_consensus.cc:2955] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:05.579749 32199 raft_consensus.cc:2955] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:05.631712 32009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5708596452c34a319a19ae8a5b24b2df with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:05.632022 32021 catalog_manager.cc:5697] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 5 to 6, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New cstate: current_term: 4 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:05.650794 32110 tablet_service.cc:1558] Processing DeleteTablet for tablet 5708596452c34a319a19ae8a5b24b2df with delete_type TABLET_DATA_TOMBSTONED (TS fcfc3281929645969ecedbb0c0af759d not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:56870
I20260709 13:14:05.682550  3114 tablet_replica.cc:333] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:14:05.696470  3114 raft_consensus.cc:2243] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.697533  3114 raft_consensus.cc:2272] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.711719  3114 ts_tablet_manager.cc:1916] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:05.748493 32270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bdc1594189c43f49251261c5d073447"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:05.749269 32270 raft_consensus.cc:606] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:14:05.752280  3114 ts_tablet_manager.cc:1929] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 13:14:05.752715 32270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:05.753425 32270 raft_consensus.cc:606] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:05.753029  3114 log.cc:1199] T 5708596452c34a319a19ae8a5b24b2df P fcfc3281929645969ecedbb0c0af759d: Deleting WAL directory at /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-0-root/wals/5708596452c34a319a19ae8a5b24b2df
I20260709 13:14:05.756274 32270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:05.756917 32270 raft_consensus.cc:606] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:14:05.758870 32009 catalog_manager.cc:5028] TS fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): tablet 5708596452c34a319a19ae8a5b24b2df (table test-workload [id=9b9dc20f98e547b59efac9c530f28125]) successfully deleted
I20260709 13:14:05.761035 32270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6565a440fcf14a499c191f2835d21508"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:05.761772 32270 raft_consensus.cc:606] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:14:05.764662 32270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:05.765357 32270 raft_consensus.cc:606] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:14:05.766880 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:05.768689 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:05.824999  2657 raft_consensus.cc:993] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:05.825556  2657 raft_consensus.cc:1081] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:05.828943 32190 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:14:05.829555 32190 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:05.829926 32190 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:05.867192 32190 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:05.892431 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:05.893157 32115 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:05.893656 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:05.894430 32270 raft_consensus.cc:3055] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:05.894749 32270 raft_consensus.cc:740] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:05.895745 32270 consensus_queue.cc:260] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:05.897181 32270 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:05.902755 32115 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:05.908335 32165 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:05.909358  3085 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:05.909889  3085 raft_consensus.cc:697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:05.910856  3085 consensus_queue.cc:237] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:05.905632 32190 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:05.947280  2657 raft_consensus.cc:993] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:05.947755  2657 raft_consensus.cc:1081] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:05.952570 32197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3bdc1594189c43f49251261c5d073447"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:14:05.953177 32197 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:05.953539 32197 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:05.955509 32270 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:05.972684 32197 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:06.000136 32021 catalog_manager.cc:5697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 9 to 10, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 10 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:06.030316 32197 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:06.031684 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:06.032490 32117 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:06.038719 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:06.067539 32270 raft_consensus.cc:3055] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:06.067961 32270 raft_consensus.cc:740] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:06.069155 32270 consensus_queue.cc:260] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:06.073982  2657 raft_consensus.cc:993] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:06.109480  2657 raft_consensus.cc:1081] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:06.111865 32190 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6565a440fcf14a499c191f2835d21508"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:14:06.112488 32190 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:06.112885 32190 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:06.109550 32270 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:06.125777 32190 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:06.154978 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:06.155620 32266 raft_consensus.cc:3055] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:06.155923 32266 raft_consensus.cc:740] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:06.156418 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:06.157157 32123 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:06.156790 32266 consensus_queue.cc:260] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:06.158108 32266 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:06.175179 32270 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
I20260709 13:14:06.176342 32190 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:06.178439 32117 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
I20260709 13:14:06.185087 32165 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:06.187269  2786 raft_consensus.cc:2804] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:06.187940  2786 raft_consensus.cc:697] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:06.189081  2786 consensus_queue.cc:237] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:06.206555 32123 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:06.216908 32165 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:06.218179  2786 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:06.225865 32021 catalog_manager.cc:5697] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 8 to 9, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 9 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:06.238511  2657 raft_consensus.cc:993] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:06.240453  3065 raft_consensus.cc:1081] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:06.221424  2786 raft_consensus.cc:697] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:06.242997  2786 consensus_queue.cc:237] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:06.244800 32197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:14:06.253103 32197 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:06.253728 32197 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:06.251268 32266 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:06.282902 32197 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:06.300812 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:06.300565 32021 catalog_manager.cc:5697] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 9 to 10, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 10 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:06.301575 32115 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:06.316602 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:06.317298 32266 raft_consensus.cc:3055] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:06.317643 32266 raft_consensus.cc:740] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:06.319368 32197 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:06.319010 32266 consensus_queue.cc:260] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:06.322444 32266 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:06.330417 32115 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:14:06.332741 32165 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:06.333654  2786 raft_consensus.cc:2804] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:06.334183  2786 raft_consensus.cc:697] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:06.335083  2786 consensus_queue.cc:237] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:06.342000 32266 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:14:06.356892  3074 raft_consensus.cc:993] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:14:06.357657  3075 raft_consensus.cc:1081] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Signalling peer fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:14:06.361240 32121 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:56890
I20260709 13:14:06.361856 32121 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:06.362258 32121 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:06.372663 32021 catalog_manager.cc:5697] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 6 to 7, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 7 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:06.369794 32121 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:06.380838 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:06.381438 32197 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:06.382835 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:06.383461 32266 raft_consensus.cc:3055] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:06.388280 32266 raft_consensus.cc:740] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:06.389461 32266 consensus_queue.cc:260] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:06.395823 32266 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:06.397946 32197 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:14:06.399618 32089 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:06.400714  3078 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:06.401240  3078 raft_consensus.cc:697] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:06.402235  3078 consensus_queue.cc:237] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:06.403039 32266 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:14:06.403952 32121 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:06.459712 32021 catalog_manager.cc:5697] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 6 to 7, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 7 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:06.472023 32266 raft_consensus.cc:1275] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:14:06.475708  2786 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:06.538020 32121 raft_consensus.cc:1275] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:14:06.540355  3118 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:06.613698 32266 raft_consensus.cc:1275] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:06.616175  2786 consensus_queue.cc:1048] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:06.657450 32123 raft_consensus.cc:1275] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:06.660296  3127 consensus_queue.cc:1048] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:06.702711 32121 raft_consensus.cc:1275] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:06.714833  3118 consensus_queue.cc:1048] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:06.769806 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:06.797240 32124 consensus_queue.cc:237] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:06.807567 32266 raft_consensus.cc:1275] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:14:06.818818  3085 consensus_queue.cc:1048] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:06.845615 32266 raft_consensus.cc:1275] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:14:06.889269  3002 consensus_queue.cc:1048] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:14:06.917094 32115 raft_consensus.cc:1275] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:14:06.917724 32266 raft_consensus.cc:1275] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:06.932937  3118 consensus_queue.cc:1048] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:06.958719 32270 raft_consensus.cc:1275] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:14:06.960569  3002 consensus_queue.cc:1048] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:06.970753 32197 raft_consensus.cc:1275] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:14:06.972656  3138 consensus_queue.cc:1048] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:06.984104 32197 raft_consensus.cc:1275] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:14:06.994446  3078 consensus_queue.cc:1048] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:07.016963  3118 consensus_queue.cc:1048] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:14:07.029902 32087 consensus_peers.cc:597] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 80b1d1e505fa4808b5b8fabb554df626. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:07.051357  3136 raft_consensus.cc:2955] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:07.061367 32270 raft_consensus.cc:2955] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:07.185925 32019 catalog_manager.cc:5697] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d reported cstate change: config changed from index -1 to 7, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New cstate: current_term: 9 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:07.193184 32124 consensus_queue.cc:237] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
W20260709 13:14:07.198381 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 95000.5us
I20260709 13:14:07.214509 32199 raft_consensus.cc:2955] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
W20260709 13:14:07.241364 32087 consensus_peers.cc:597] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: acd9953c536c4b5fa2ebab1015a61b53. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:07.242920 32270 raft_consensus.cc:1275] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:07.249684  3136 consensus_queue.cc:1048] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:07.260020 32190 raft_consensus.cc:1275] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:07.304545  3136 consensus_queue.cc:1048] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:07.306766  3002 raft_consensus.cc:2955] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Committing config change with OpId 11.7: config changed from index -1 to 7, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:07.314296 32270 raft_consensus.cc:2955] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Committing config change with OpId 11.7: config changed from index -1 to 7, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:07.353427 32124 consensus_queue.cc:237] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:07.362071 32190 raft_consensus.cc:2955] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Committing config change with OpId 11.7: config changed from index -1 to 7, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
W20260709 13:14:07.381938 32087 consensus_peers.cc:597] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6021998dccdb415f9b8203cebee0292c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:07.387374  3153 ts_tablet_manager.cc:933] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339)
I20260709 13:14:07.390403 32192 raft_consensus.cc:1275] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:14:07.395191  3136 consensus_queue.cc:1048] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:07.403656 32019 catalog_manager.cc:5697] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: config changed from index -1 to 7, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New cstate: current_term: 11 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:07.407605 32270 raft_consensus.cc:1275] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:14:07.413434  3136 consensus_queue.cc:1048] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:07.431174  3153 tablet_copy_client.cc:323] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Beginning tablet copy session from remote peer at address 127.30.63.1:42339
I20260709 13:14:07.433380 32134 tablet_copy_service.cc:140] P fcfc3281929645969ecedbb0c0af759d: Received BeginTabletCopySession request for tablet 80b1d1e505fa4808b5b8fabb554df626 from peer 94085cf341634eb686a95983b6b7f7e6 ({username='slave'} at 127.0.0.1:55358)
I20260709 13:14:07.433982 32134 tablet_copy_service.cc:161] P fcfc3281929645969ecedbb0c0af759d: Beginning new tablet copy session on tablet 80b1d1e505fa4808b5b8fabb554df626 from peer 94085cf341634eb686a95983b6b7f7e6 at {username='slave'} at 127.0.0.1:55358: session id = 94085cf341634eb686a95983b6b7f7e6-80b1d1e505fa4808b5b8fabb554df626
I20260709 13:14:07.443363  3002 raft_consensus.cc:2955] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:07.444516 32134 tablet_copy_source_session.cc:215] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:07.451870  3153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80b1d1e505fa4808b5b8fabb554df626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:07.454572 32190 raft_consensus.cc:2955] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:07.472226 32199 consensus_queue.cc:237] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:07.508143 32266 raft_consensus.cc:1275] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:14:07.508435 32162 consensus_peers.cc:597] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d63bb58dbda1427191933eb8353d8d75. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:07.521354 32021 catalog_manager.cc:5697] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 reported cstate change: config changed from index -1 to 5, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New cstate: current_term: 7 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:07.532402 32121 raft_consensus.cc:1275] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:14:07.533617  3118 consensus_queue.cc:1048] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:07.536342  3085 consensus_queue.cc:1048] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:07.558575 32266 raft_consensus.cc:2955] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:07.556334 32121 raft_consensus.cc:2955] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index -1 to 7, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:07.551250  3150 raft_consensus.cc:2955] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index -1 to 7, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:07.572907 32269 raft_consensus.cc:2955] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index -1 to 7, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:07.587883  3153 tablet_copy_client.cc:806] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:07.609100  3153 tablet_copy_client.cc:670] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:07.620824 32021 catalog_manager.cc:5697] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d reported cstate change: config changed from index -1 to 7, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New cstate: current_term: 7 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:07.637333  3153 tablet_copy_client.cc:538] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:07.704234  3153 tablet_bootstrap.cc:492] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap starting.
I20260709 13:14:07.829172  3161 ts_tablet_manager.cc:933] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339)
I20260709 13:14:07.847150  3161 tablet_copy_client.cc:323] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Beginning tablet copy session from remote peer at address 127.30.63.1:42339
I20260709 13:14:07.849411 32134 tablet_copy_service.cc:140] P fcfc3281929645969ecedbb0c0af759d: Received BeginTabletCopySession request for tablet acd9953c536c4b5fa2ebab1015a61b53 from peer 94085cf341634eb686a95983b6b7f7e6 ({username='slave'} at 127.0.0.1:55358)
I20260709 13:14:07.850201 32134 tablet_copy_service.cc:161] P fcfc3281929645969ecedbb0c0af759d: Beginning new tablet copy session on tablet acd9953c536c4b5fa2ebab1015a61b53 from peer 94085cf341634eb686a95983b6b7f7e6 at {username='slave'} at 127.0.0.1:55358: session id = 94085cf341634eb686a95983b6b7f7e6-acd9953c536c4b5fa2ebab1015a61b53
I20260709 13:14:07.885741 32134 tablet_copy_source_session.cc:215] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:07.891808  3161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acd9953c536c4b5fa2ebab1015a61b53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:07.890977  3153 tablet_bootstrap.cc:492] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:07.893543  3153 tablet_bootstrap.cc:492] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap complete.
I20260709 13:14:07.894474  3153 ts_tablet_manager.cc:1403] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6: Time spent bootstrapping tablet: real 0.190s	user 0.043s	sys 0.009s
I20260709 13:14:07.903312 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:07.916760  3163 ts_tablet_manager.cc:933] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339)
I20260709 13:14:07.928887  3153 raft_consensus.cc:359] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:07.929675  3153 raft_consensus.cc:740] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Initialized, Role: LEARNER
I20260709 13:14:07.930240  3153 consensus_queue.cc:260] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:07.932983  3153 ts_tablet_manager.cc:1434] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:14:07.938580 32134 tablet_copy_service.cc:342] P fcfc3281929645969ecedbb0c0af759d: Request end of tablet copy session 94085cf341634eb686a95983b6b7f7e6-80b1d1e505fa4808b5b8fabb554df626 received from {username='slave'} at 127.0.0.1:55358
I20260709 13:14:07.939082 32134 tablet_copy_service.cc:434] P fcfc3281929645969ecedbb0c0af759d: ending tablet copy session 94085cf341634eb686a95983b6b7f7e6-80b1d1e505fa4808b5b8fabb554df626 on tablet 80b1d1e505fa4808b5b8fabb554df626 with peer 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:07.941912  3163 tablet_copy_client.cc:323] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Beginning tablet copy session from remote peer at address 127.30.63.1:42339
I20260709 13:14:07.943856 32134 tablet_copy_service.cc:140] P fcfc3281929645969ecedbb0c0af759d: Received BeginTabletCopySession request for tablet 6021998dccdb415f9b8203cebee0292c from peer 94085cf341634eb686a95983b6b7f7e6 ({username='slave'} at 127.0.0.1:55358)
I20260709 13:14:07.945117 32134 tablet_copy_service.cc:161] P fcfc3281929645969ecedbb0c0af759d: Beginning new tablet copy session on tablet 6021998dccdb415f9b8203cebee0292c from peer 94085cf341634eb686a95983b6b7f7e6 at {username='slave'} at 127.0.0.1:55358: session id = 94085cf341634eb686a95983b6b7f7e6-6021998dccdb415f9b8203cebee0292c
I20260709 13:14:07.966477 32134 tablet_copy_source_session.cc:215] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:07.970230  3163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6021998dccdb415f9b8203cebee0292c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:07.970440  3161 tablet_copy_client.cc:806] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:07.999051 32266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:07.999773 32266 raft_consensus.cc:606] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:14:08.000844  3161 tablet_copy_client.cc:670] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:08.006289 32266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:08.006975 32266 raft_consensus.cc:606] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:08.010113 32266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:08.010963 32266 raft_consensus.cc:606] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:08.017338 32269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:08.017976 32269 raft_consensus.cc:606] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:14:08.019109  3161 tablet_copy_client.cc:538] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:08.022243  3153 ts_tablet_manager.cc:933] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:08.037554 32266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:08.038290 32266 raft_consensus.cc:606] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:08.040620 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:08.042327 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:08.043126  3153 tablet_copy_client.cc:323] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Beginning tablet copy session from remote peer at address 127.30.63.2:44517
I20260709 13:14:08.045403 32209 tablet_copy_service.cc:140] P 113b5461952d47e0944d463ea4e32801: Received BeginTabletCopySession request for tablet d63bb58dbda1427191933eb8353d8d75 from peer 94085cf341634eb686a95983b6b7f7e6 ({username='slave'} at 127.0.0.1:56926)
I20260709 13:14:08.046061 32209 tablet_copy_service.cc:161] P 113b5461952d47e0944d463ea4e32801: Beginning new tablet copy session on tablet d63bb58dbda1427191933eb8353d8d75 from peer 94085cf341634eb686a95983b6b7f7e6 at {username='slave'} at 127.0.0.1:56926: session id = 94085cf341634eb686a95983b6b7f7e6-d63bb58dbda1427191933eb8353d8d75
I20260709 13:14:08.068006 32209 tablet_copy_source_session.cc:215] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:08.068969  3161 tablet_bootstrap.cc:492] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap starting.
I20260709 13:14:08.076386  3153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d63bb58dbda1427191933eb8353d8d75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:08.084964  3163 tablet_copy_client.cc:806] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:08.085739  3163 tablet_copy_client.cc:670] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:08.090530  3163 tablet_copy_client.cc:538] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:08.114908  3163 tablet_bootstrap.cc:492] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6: Bootstrap starting.
I20260709 13:14:08.163836  3153 tablet_copy_client.cc:806] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:08.164526   400 raft_consensus.cc:1217] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 9 LEARNER]: Deduplicated request from leader. Original: 9.6->[9.7-9.7]   Dedup: 9.7->[]
I20260709 13:14:08.167167  3065 raft_consensus.cc:993] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:08.167724  3149 raft_consensus.cc:1081] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:08.169580 32192 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:14:08.171350 32192 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:08.175055 32192 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:08.182802 32192 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:08.164623  3153 tablet_copy_client.cc:670] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:08.186107 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:08.186739 32115 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:08.192778  3153 tablet_copy_client.cc:538] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:08.194351 32115 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:08.195674 32165 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:08.196452  2786 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:08.196962  2786 raft_consensus.cc:697] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:08.197853  2786 consensus_queue.cc:237] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:08.205928 32192 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:08.206779 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:08.207453 32269 raft_consensus.cc:3055] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:08.207764 32269 raft_consensus.cc:740] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:08.209834 32269 consensus_queue.cc:260] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:08.211054 32269 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:08.219980 32269 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:08.221828  3149 raft_consensus.cc:993] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:14:08.224634  3080 raft_consensus.cc:993] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:08.231868 32019 catalog_manager.cc:5697] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 9 to 10, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 10 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:08.282135  3080 raft_consensus.cc:1081] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:08.330252  3153 tablet_bootstrap.cc:492] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap starting.
I20260709 13:14:08.334828 32192 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:14:08.335476 32192 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:08.335805 32192 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:08.316799  3171 raft_consensus.cc:1081] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Signalling peer fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:14:08.359180 32192 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:08.390551  3161 tablet_bootstrap.cc:492] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=1 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:08.391608  3161 tablet_bootstrap.cc:492] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap complete.
I20260709 13:14:08.406894 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:08.407708 32269 raft_consensus.cc:3055] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:08.408088 32269 raft_consensus.cc:740] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:08.408950 32269 consensus_queue.cc:260] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:08.409866 32269 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:08.392455  3161 ts_tablet_manager.cc:1403] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6: Time spent bootstrapping tablet: real 0.324s	user 0.032s	sys 0.010s
W20260709 13:14:08.414072 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 62398.6us
I20260709 13:14:08.417148 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:08.417750 32115 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:08.422279 32123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:56890
I20260709 13:14:08.422999 32123 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:08.423344 32123 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:08.442778 32123 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:08.449672 32115 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:08.450369 32119 raft_consensus.cc:1240] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:08.454285 32192 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:08.476718 32123 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:08.481940 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:08.482975 32273 raft_consensus.cc:3055] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:08.483374 32273 raft_consensus.cc:740] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:08.484530 32273 consensus_queue.cc:260] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:08.486037 32273 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:14:08.489194 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 75758.2us
I20260709 13:14:08.505710  3163 tablet_bootstrap.cc:492] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:08.517962  3170 raft_consensus.cc:993] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:14:08.518507  3170 raft_consensus.cc:1081] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Signalling peer fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:14:08.490968  3161 raft_consensus.cc:359] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:08.525228  3161 raft_consensus.cc:740] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Initialized, Role: LEARNER
I20260709 13:14:08.525980  3161 consensus_queue.cc:260] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:08.529685  3163 tablet_bootstrap.cc:492] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6: Bootstrap complete.
I20260709 13:14:08.530507  3163 ts_tablet_manager.cc:1403] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6: Time spent bootstrapping tablet: real 0.416s	user 0.044s	sys 0.027s
I20260709 13:14:08.534188 32115 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:56890
I20260709 13:14:08.534783 32115 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:08.535118 32115 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:08.538658 32269 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:08.555502 32273 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:14:08.554584 32115 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:08.558601 32115 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:08.559952 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 66184.1us
I20260709 13:14:08.528576  3161 ts_tablet_manager.cc:1434] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6: Time spent starting tablet: real 0.108s	user 0.005s	sys 0.001s
I20260709 13:14:08.564889 32090 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:08.563745 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:08.564453 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:08.577358 32273 raft_consensus.cc:3055] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:08.577817 32273 raft_consensus.cc:740] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:08.580204  2786 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:08.581802  2786 raft_consensus.cc:697] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:08.576876  3149 raft_consensus.cc:993] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:14:08.585947 32134 tablet_copy_service.cc:342] P fcfc3281929645969ecedbb0c0af759d: Request end of tablet copy session 94085cf341634eb686a95983b6b7f7e6-acd9953c536c4b5fa2ebab1015a61b53 received from {username='slave'} at 127.0.0.1:55358
I20260709 13:14:08.589533 32134 tablet_copy_service.cc:434] P fcfc3281929645969ecedbb0c0af759d: ending tablet copy session 94085cf341634eb686a95983b6b7f7e6-acd9953c536c4b5fa2ebab1015a61b53 on tablet acd9953c536c4b5fa2ebab1015a61b53 with peer 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:08.592845  3002 raft_consensus.cc:1064] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:14:08.595360 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:08.596166 32198 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:08.603380 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:08.604394 32192 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:08.579035 32273 consensus_queue.cc:260] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:08.621546 32273 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:14:08.681137 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 68480.7us
I20260709 13:14:08.680061  3176 raft_consensus.cc:2804] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:08.600092  3002 consensus_queue.cc:237] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:08.691614 32192 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:14:08.610615  2786 consensus_queue.cc:237] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:08.692822  3176 raft_consensus.cc:697] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 6 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:08.639773  3172 raft_consensus.cc:1081] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Signalling peer fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:14:08.710996 32198 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:14:08.716779 32273 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:14:08.727432  3163 raft_consensus.cc:359] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:08.728526  3163 raft_consensus.cc:740] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Initialized, Role: LEARNER
I20260709 13:14:08.729372  3163 consensus_queue.cc:260] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:08.737139  3176 consensus_queue.cc:237] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:08.743202 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 124987us
I20260709 13:14:08.751610  3163 ts_tablet_manager.cc:1434] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6: Time spent starting tablet: real 0.221s	user 0.011s	sys 0.005s
I20260709 13:14:08.744271 32090 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:08.755976  3078 raft_consensus.cc:2804] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:08.756639  3078 raft_consensus.cc:697] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:08.757622  3078 consensus_queue.cc:237] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:08.764020 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 149506us
I20260709 13:14:08.771658 32134 tablet_copy_service.cc:342] P fcfc3281929645969ecedbb0c0af759d: Request end of tablet copy session 94085cf341634eb686a95983b6b7f7e6-6021998dccdb415f9b8203cebee0292c received from {username='slave'} at 127.0.0.1:55358
I20260709 13:14:08.772218 32134 tablet_copy_service.cc:434] P fcfc3281929645969ecedbb0c0af759d: ending tablet copy session 94085cf341634eb686a95983b6b7f7e6-6021998dccdb415f9b8203cebee0292c on tablet 6021998dccdb415f9b8203cebee0292c with peer 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:08.779839 32116 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:56890
I20260709 13:14:08.780635 32116 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:08.781047 32116 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:08.781595 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 88252.5us
I20260709 13:14:08.816056   400 raft_consensus.cc:1217] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 7 LEARNER]: Deduplicated request from leader. Original: 7.4->[7.5-7.5]   Dedup: 7.5->[]
I20260709 13:14:08.841436 32116 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:08.843865   400 raft_consensus.cc:1217] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.6->[11.7-11.7]   Dedup: 11.7->[]
I20260709 13:14:08.850911  3153 tablet_bootstrap.cc:492] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:14:08.855173 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 57054.9us
I20260709 13:14:08.872871   400 raft_consensus.cc:1275] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 9 LEARNER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:14:08.877818 32022 catalog_manager.cc:5697] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 9 to 10, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 10 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:08.880129 32273 raft_consensus.cc:1275] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:14:08.881208  3153 tablet_bootstrap.cc:492] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap complete.
I20260709 13:14:08.893112  3153 ts_tablet_manager.cc:1403] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6: Time spent bootstrapping tablet: real 0.563s	user 0.044s	sys 0.046s
I20260709 13:14:08.889879  3176 consensus_queue.cc:1048] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:08.894091  3002 consensus_queue.cc:1048] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:08.906428  3153 raft_consensus.cc:359] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:08.908306  3153 raft_consensus.cc:740] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Initialized, Role: LEARNER
I20260709 13:14:08.907788 32021 catalog_manager.cc:5697] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 6 to 7, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 7 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:08.909880  3153 consensus_queue.cc:260] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:08.910758 32021 catalog_manager.cc:5697] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 5 to 6, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 6 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:08.912014 32116 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:08.917032 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:08.917614 32266 raft_consensus.cc:3055] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:08.917935 32266 raft_consensus.cc:740] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:08.918637 32266 consensus_queue.cc:260] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:08.919864 32266 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:08.929301 32273 raft_consensus.cc:1275] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:08.935449 32266 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:14:08.937467 32090 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:08.938285  3002 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:08.938805  3002 raft_consensus.cc:697] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
W20260709 13:14:08.937954 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 45802.4us
I20260709 13:14:08.942168  3002 consensus_queue.cc:237] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:08.951910 32197 raft_consensus.cc:1275] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:14:08.952548 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:08.956220 32191 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:08.963351  3153 ts_tablet_manager.cc:1434] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.000s
I20260709 13:14:08.967617 32209 tablet_copy_service.cc:342] P 113b5461952d47e0944d463ea4e32801: Request end of tablet copy session 94085cf341634eb686a95983b6b7f7e6-d63bb58dbda1427191933eb8353d8d75 received from {username='slave'} at 127.0.0.1:56926
I20260709 13:14:08.968124 32209 tablet_copy_service.cc:434] P 113b5461952d47e0944d463ea4e32801: ending tablet copy session 94085cf341634eb686a95983b6b7f7e6-d63bb58dbda1427191933eb8353d8d75 on tablet d63bb58dbda1427191933eb8353d8d75 with peer 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:08.976171  3187 consensus_queue.cc:1048] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:08.987478 32115 raft_consensus.cc:1275] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:08.993930  3190 consensus_queue.cc:1048] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:08.994711   401 raft_consensus.cc:1217] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 7 LEARNER]: Deduplicated request from leader. Original: 7.6->[7.7-7.7]   Dedup: 7.7->[]
I20260709 13:14:08.996332  3187 consensus_queue.cc:1048] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:09.001639 32191 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:14:09.049053 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:09.086263  3190 raft_consensus.cc:2955] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:14:09.090798 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 52213.4us
I20260709 13:14:09.100117   400 raft_consensus.cc:2955] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:09.120524 32191 raft_consensus.cc:2955] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:09.137758 32019 catalog_manager.cc:5697] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 9 to 10, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 10 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:09.151391 32021 catalog_manager.cc:5697] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 7 to 8, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:09.152227 32273 raft_consensus.cc:2955] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:09.183245 32116 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:09.201174 32192 raft_consensus.cc:1275] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:14:09.206429  3002 consensus_queue.cc:1048] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:09.202709 32117 consensus_queue.cc:237] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:09.201939  3183 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:14:09.258671 32192 raft_consensus.cc:1275] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:14:09.258311  3002 raft_consensus.cc:1064] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:14:09.262636  3002 consensus_queue.cc:237] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 3, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:09.273583 32266 raft_consensus.cc:1275] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:14:09.287808   400 raft_consensus.cc:1275] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:14:09.290486  3192 consensus_queue.cc:1048] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:09.264149  3190 consensus_queue.cc:1048] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:14:09.299297  3078 consensus_queue.cc:1048] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:09.324609 32266 raft_consensus.cc:1275] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:14:09.339782 32192 raft_consensus.cc:1275] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:14:09.341114 32198 raft_consensus.cc:2955] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:09.352962  3192 consensus_queue.cc:1048] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:09.363013 32264 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:09.368247  2786 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:09.320698  3136 raft_consensus.cc:2955] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:14:09.413187 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 55293.3us
I20260709 13:14:09.392555  3192 consensus_queue.cc:1048] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:14:09.441875 32192 raft_consensus.cc:1275] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:14:09.456390  3189 raft_consensus.cc:1064] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:14:09.479737 32198 raft_consensus.cc:1275] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:09.427157 32021 catalog_manager.cc:5697] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 reported cstate change: config changed from index 8 to 9, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New cstate: current_term: 9 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:09.501030  3211 consensus_queue.cc:1048] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:09.502990  3192 consensus_queue.cc:1048] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:09.503440  3189 consensus_queue.cc:237] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:09.546618   401 raft_consensus.cc:1275] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 7 LEARNER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:14:09.559305   401 raft_consensus.cc:1275] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 7 LEARNER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:14:09.587116  3189 consensus_queue.cc:1048] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:09.595911 32119 raft_consensus.cc:1275] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:14:09.596967  3211 consensus_queue.cc:1048] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:09.642606 32259 tablet_service.cc:1558] Processing DeleteTablet for tablet 80b1d1e505fa4808b5b8fabb554df626 with delete_type TABLET_DATA_TOMBSTONED (TS 6b3ed521ce8947db80c4b4828b355c06 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:45768
I20260709 13:14:09.647989 32009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 80b1d1e505fa4808b5b8fabb554df626 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:09.647116 32266 raft_consensus.cc:1275] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:14:09.661564  3185 raft_consensus.cc:1064] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:14:09.664069  3185 consensus_queue.cc:237] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 5, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:09.677381   401 raft_consensus.cc:2955] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:09.681421  3189 consensus_queue.cc:1048] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:09.683512  2786 consensus_queue.cc:1048] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:09.689190 32264 raft_consensus.cc:1275] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:09.690495 32270 raft_consensus.cc:1275] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:14:09.752794  3224 tablet_replica.cc:333] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:14:09.755159  3224 raft_consensus.cc:2243] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:09.732620  3136 consensus_queue.cc:1048] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:14:09.744081  3190 consensus_queue.cc:1048] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:14:09.830520 32264 raft_consensus.cc:1275] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:09.824774  3224 raft_consensus.cc:2272] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:09.856689   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 70697.4us
W20260709 13:14:09.857272  3223 log.cc:927] Time spent T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:14:09.860221   400 raft_consensus.cc:1275] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 11 LEARNER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:09.875607  3212 consensus_queue.cc:1048] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:09.876624  3136 consensus_queue.cc:1048] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:14:09.927042 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 170739us
W20260709 13:14:09.993472 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 51836us
W20260709 13:14:10.006378 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 221574us
I20260709 13:14:10.099224  3224 ts_tablet_manager.cc:1916] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:10.116962  3237 raft_consensus.cc:2955] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index 5 to 6, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:14:10.118925  3232 log.cc:927] Time spent T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:14:10.119462  3224 ts_tablet_manager.cc:1929] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.8
I20260709 13:14:10.119902  3224 log.cc:1199] T 80b1d1e505fa4808b5b8fabb554df626 P 6b3ed521ce8947db80c4b4828b355c06: Deleting WAL directory at /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-2-root/wals/80b1d1e505fa4808b5b8fabb554df626
I20260709 13:14:10.139890 32009 catalog_manager.cc:5028] TS 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): tablet 80b1d1e505fa4808b5b8fabb554df626 (table test-workload [id=9b9dc20f98e547b59efac9c530f28125]) successfully deleted
I20260709 13:14:10.161152   401 raft_consensus.cc:2955] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 5 to 6, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:14:10.197113 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 152843us
I20260709 13:14:10.245477 32020 catalog_manager.cc:5697] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 5 to 6, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:14:10.313078 32162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 69743.3us
I20260709 13:14:10.315136 32267 raft_consensus.cc:2955] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 5 to 6, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:14:10.339898 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 97516.1us
W20260709 13:14:10.341684 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 98299.8us
I20260709 13:14:10.345396 32198 raft_consensus.cc:1275] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:10.353089  3189 raft_consensus.cc:2955] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 7 to 8, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:10.358238 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:10.368255 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 139897us
I20260709 13:14:10.406041   400 raft_consensus.cc:2955] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:10.425153 32197 raft_consensus.cc:2955] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 5 to 6, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:10.460291  3237 consensus_queue.cc:1048] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:10.499927 32115 raft_consensus.cc:2955] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:10.502224  3184 raft_consensus.cc:2955] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index 7 to 8, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:14:10.510746   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 247298us
I20260709 13:14:10.472018 32021 catalog_manager.cc:5697] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 reported cstate change: config changed from index 7 to 8, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:10.543767   400 raft_consensus.cc:2955] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:10.549845 32270 raft_consensus.cc:2955] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:10.577152 32191 raft_consensus.cc:2955] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:10.587600 32265 raft_consensus.cc:2955] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:10.590940 32117 consensus_queue.cc:237] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:10.616542   400 raft_consensus.cc:1275] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:14:10.625736  3190 consensus_queue.cc:1048] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:10.628379 32020 catalog_manager.cc:5697] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 7 to 8, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:10.651993  3184 raft_consensus.cc:2955] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:10.651902   400 raft_consensus.cc:2955] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:10.675572 32265 raft_consensus.cc:1275] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:14:10.677991  3237 consensus_queue.cc:1048] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:10.686573 32270 raft_consensus.cc:2955] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:10.728147 32021 catalog_manager.cc:5697] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: config changed from index 6 to 7, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New cstate: current_term: 7 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:10.730165 32117 consensus_queue.cc:237] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:10.742630 32181 tablet_service.cc:1558] Processing DeleteTablet for tablet 6021998dccdb415f9b8203cebee0292c with delete_type TABLET_DATA_TOMBSTONED (TS 113b5461952d47e0944d463ea4e32801 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:46032
I20260709 13:14:10.746493 32191 consensus_queue.cc:237] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:10.749018 32265 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:10.749629 32265 raft_consensus.cc:606] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:10.754937   400 raft_consensus.cc:1275] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:14:10.759351  3235 raft_consensus.cc:993] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:14:10.764420 32265 raft_consensus.cc:1275] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:14:10.766186   401 raft_consensus.cc:1275] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:14:10.772349 32270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:10.776305 32270 raft_consensus.cc:606] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:14:10.779495  3190 consensus_queue.cc:1048] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:10.781688 32009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6021998dccdb415f9b8203cebee0292c with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:10.773101  3262 tablet_replica.cc:333] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:14:10.785542  3187 consensus_queue.cc:1048] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:10.785812  3262 raft_consensus.cc:2243] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:10.787784  3189 consensus_queue.cc:1048] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:10.789642 32191 raft_consensus.cc:1275] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:14:10.775527  3235 raft_consensus.cc:1081] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Signalling peer fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:14:10.793110 32270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d001b18973b4cbf86649781d9445577"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:10.793735 32270 raft_consensus.cc:606] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:14:10.795478  3186 consensus_queue.cc:1048] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:10.796204 32115 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:56890
I20260709 13:14:10.796803 32115 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:10.797156 32115 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:10.788556  3262 raft_consensus.cc:2272] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:10.805425  3219 raft_consensus.cc:993] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:10.806125  3220 raft_consensus.cc:1081] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:10.808467 32197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:14:10.809054 32197 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:10.809430 32197 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:10.812536  3262 ts_tablet_manager.cc:1916] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:10.818369 32197 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:10.820314 32197 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:10.821760  3186 raft_consensus.cc:2955] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 8 to 9, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:10.824759 32119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:42262
I20260709 13:14:10.822618  2786 raft_consensus.cc:2955] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Committing config change with OpId 7.9: config changed from index 8 to 9, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:10.826460   401 raft_consensus.cc:2955] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Committing config change with OpId 7.9: config changed from index 8 to 9, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:10.826460   400 raft_consensus.cc:2955] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:10.805462 32115 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:10.837484 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:10.838380 32117 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:10.837850 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:10.845366 32270 raft_consensus.cc:3055] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:10.845868 32270 raft_consensus.cc:740] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:10.846676 32119 raft_consensus.cc:606] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:10.847374 32119 raft_consensus.cc:630] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Rejecting request to transfer leadership because tablet server 6b3ed521ce8947db80c4b4828b355c06 is not a voter in the active config
I20260709 13:14:10.846683 32270 consensus_queue.cc:260] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:10.848357 32270 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:10.850312 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:14:10.850409 32009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet acd9953c536c4b5fa2ebab1015a61b53 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:10.844683 32115 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:10.843019 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:10.852283 32265 raft_consensus.cc:3055] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:10.852651 32265 raft_consensus.cc:740] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:10.853475 32265 consensus_queue.cc:260] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:10.854871 32265 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:10.867769 32117 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:14:10.868455 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:10.869208 32270 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:14:10.874007 32265 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:14:10.875356 32090 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:10.875530 32019 catalog_manager.cc:5697] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 8 to 9, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New cstate: current_term: 7 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:10.876520  3186 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:10.877401  3186 raft_consensus.cc:697] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:10.900189 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:10.900816 32199 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:10.902392 32021 catalog_manager.cc:5697] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d reported cstate change: config changed from index 8 to 9, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New cstate: current_term: 11 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:10.909231 32269 raft_consensus.cc:2955] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Committing config change with OpId 7.9: config changed from index 8 to 9, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:10.914868 32199 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:14:10.929755 32165 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:10.931588  3242 raft_consensus.cc:2804] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:10.932113  3242 raft_consensus.cc:697] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:10.937806 32008 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d63bb58dbda1427191933eb8353d8d75 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:10.943797 32110 tablet_service.cc:1558] Processing DeleteTablet for tablet d63bb58dbda1427191933eb8353d8d75 with delete_type TABLET_DATA_TOMBSTONED (TS fcfc3281929645969ecedbb0c0af759d not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:56870
I20260709 13:14:10.960496 32259 tablet_service.cc:1558] Processing DeleteTablet for tablet acd9953c536c4b5fa2ebab1015a61b53 with delete_type TABLET_DATA_TOMBSTONED (TS 6b3ed521ce8947db80c4b4828b355c06 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:45768
I20260709 13:14:10.964321  3262 ts_tablet_manager.cc:1929] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.6
I20260709 13:14:10.964955  3262 log.cc:1199] T 6021998dccdb415f9b8203cebee0292c P 113b5461952d47e0944d463ea4e32801: Deleting WAL directory at /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-1-root/wals/6021998dccdb415f9b8203cebee0292c
I20260709 13:14:10.983387 32199 raft_consensus.cc:2955] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:10.983264  3242 consensus_queue.cc:237] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:10.999750  3251 raft_consensus.cc:993] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:11.000617  3220 raft_consensus.cc:1081] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:11.003931 32197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d001b18973b4cbf86649781d9445577"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:14:11.004693 32197 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:11.005194 32197 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:11.005488 32008 catalog_manager.cc:5028] TS 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): tablet 6021998dccdb415f9b8203cebee0292c (table test-workload [id=9b9dc20f98e547b59efac9c530f28125]) successfully deleted
I20260709 13:14:10.969955  3186 consensus_queue.cc:237] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:11.015386  3263 tablet_replica.cc:333] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:14:11.028898  3263 raft_consensus.cc:2243] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.046550 32197 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:11.045612  3263 raft_consensus.cc:2272] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.054656 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:11.056277 32119 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:11.068070  3263 ts_tablet_manager.cc:1916] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:11.073123  3264 tablet_replica.cc:333] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:14:11.074338  3264 raft_consensus.cc:2243] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.076135  3264 raft_consensus.cc:2272] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.077535 32197 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:11.079337 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:11.080021 32265 raft_consensus.cc:3055] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:11.080315 32265 raft_consensus.cc:740] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:11.081173 32265 consensus_queue.cc:260] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:11.082608 32265 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:11.092759 32119 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:14:11.096565 32265 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:14:11.089689 32021 catalog_manager.cc:5697] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 6 to 7, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 7 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:11.098213 32165 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:11.102362  3181 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:11.102952  3181 raft_consensus.cc:697] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 12 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:11.103937  3181 consensus_queue.cc:237] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:11.121780  3264 ts_tablet_manager.cc:1916] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:11.153836 32021 catalog_manager.cc:5697] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 11 to 12, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 12 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:11.156011 32020 catalog_manager.cc:5697] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 9 to 10, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 10 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:11.260854 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 109847us
I20260709 13:14:11.273805  3263 ts_tablet_manager.cc:1929] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.8
I20260709 13:14:11.274420  3263 log.cc:1199] T d63bb58dbda1427191933eb8353d8d75 P fcfc3281929645969ecedbb0c0af759d: Deleting WAL directory at /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-0-root/wals/d63bb58dbda1427191933eb8353d8d75
I20260709 13:14:11.283649 32009 catalog_manager.cc:5028] TS fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): tablet d63bb58dbda1427191933eb8353d8d75 (table test-workload [id=9b9dc20f98e547b59efac9c530f28125]) successfully deleted
W20260709 13:14:11.284735 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 119698us
W20260709 13:14:11.289029  3267 log.cc:927] Time spent T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.173s	user 0.010s	sys 0.000s
W20260709 13:14:11.375419   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 76709.4us
W20260709 13:14:11.383163 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 54339.1us
I20260709 13:14:11.396253  3264 ts_tablet_manager.cc:1929] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.8
I20260709 13:14:11.416286  3264 log.cc:1199] T acd9953c536c4b5fa2ebab1015a61b53 P 6b3ed521ce8947db80c4b4828b355c06: Deleting WAL directory at /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-2-root/wals/acd9953c536c4b5fa2ebab1015a61b53
I20260709 13:14:11.425707 32009 catalog_manager.cc:5028] TS 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): tablet acd9953c536c4b5fa2ebab1015a61b53 (table test-workload [id=9b9dc20f98e547b59efac9c530f28125]) successfully deleted
I20260709 13:14:11.435110 32265 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:11.440552  3184 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:11.456300 32117 raft_consensus.cc:1275] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:14:11.458145  3245 consensus_queue.cc:1048] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:11.528944 32198 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:11.536525  3136 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:11.579937 32273 raft_consensus.cc:1275] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:11.593713 32265 raft_consensus.cc:1275] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:14:11.600750  3231 consensus_queue.cc:1048] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:11.600975  3244 consensus_queue.cc:1048] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:11.671674 32117 raft_consensus.cc:1275] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:11.681901  3245 consensus_queue.cc:1048] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:11.869591 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:12.190315 32115 consensus_queue.cc:237] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:12.213478 32269 raft_consensus.cc:1275] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:14:12.214380 32087 consensus_peers.cc:597] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f89f60951b564577beff269254a33cde. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:12.214797 32198 raft_consensus.cc:1275] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:12.216290  3190 consensus_queue.cc:1048] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:12.217808  3186 consensus_queue.cc:1048] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:12.267019  3186 raft_consensus.cc:2955] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:12.270850 32198 raft_consensus.cc:2955] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:12.287184 32268 raft_consensus.cc:2955] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:12.290738 32021 catalog_manager.cc:5697] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 reported cstate change: config changed from index -1 to 7, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New cstate: current_term: 10 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:12.303119 32115 consensus_queue.cc:237] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:12.316243 32265 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:14:12.319568 32198 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:14:12.320873 32087 consensus_peers.cc:597] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0aaeda9c539745d5b9b44fb7acb8b438. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:12.324887  3213 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:14:12.329900  3213 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:12.339777  3186 raft_consensus.cc:2955] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:12.342801 32198 raft_consensus.cc:2955] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:12.342996 32269 raft_consensus.cc:2955] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:12.408991 32269 consensus_queue.cc:237] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
W20260709 13:14:12.425441 32236 consensus_peers.cc:597] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 05806ba48f814549969547f21c7101c3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:12.431746 32115 raft_consensus.cc:1275] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:14:12.433840 32198 raft_consensus.cc:1275] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:14:12.434028  3235 consensus_queue.cc:1048] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:12.443599  3235 consensus_queue.cc:1048] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:12.476159  3270 raft_consensus.cc:2955] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:12.467832 32020 catalog_manager.cc:5697] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: config changed from index -1 to 8, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New cstate: current_term: 10 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:12.486034 32119 raft_consensus.cc:2955] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:12.543097 32192 raft_consensus.cc:2955] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:12.565281 32020 catalog_manager.cc:5697] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d reported cstate change: config changed from index -1 to 6, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New cstate: current_term: 8 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:12.569512 32119 consensus_queue.cc:237] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
W20260709 13:14:12.771493 32087 consensus_peers.cc:597] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 19e09eecc9b2466db338be646fedba5f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:12.773198  3299 ts_tablet_manager.cc:933] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339)
I20260709 13:14:12.775851 32268 raft_consensus.cc:1275] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:12.779152  3213 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:12.799777 32197 raft_consensus.cc:1275] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:12.813354  3186 raft_consensus.cc:2955] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Committing config change with OpId 12.7: config changed from index -1 to 7, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:12.815861 32273 raft_consensus.cc:2955] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Committing config change with OpId 12.7: config changed from index -1 to 7, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:12.842267  3213 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:12.845294  3299 tablet_copy_client.cc:323] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Beginning tablet copy session from remote peer at address 127.30.63.1:42339
I20260709 13:14:12.847121 32134 tablet_copy_service.cc:140] P fcfc3281929645969ecedbb0c0af759d: Received BeginTabletCopySession request for tablet f89f60951b564577beff269254a33cde from peer 94085cf341634eb686a95983b6b7f7e6 ({username='slave'} at 127.0.0.1:55358)
I20260709 13:14:12.847707 32134 tablet_copy_service.cc:161] P fcfc3281929645969ecedbb0c0af759d: Beginning new tablet copy session on tablet f89f60951b564577beff269254a33cde from peer 94085cf341634eb686a95983b6b7f7e6 at {username='slave'} at 127.0.0.1:55358: session id = 94085cf341634eb686a95983b6b7f7e6-f89f60951b564577beff269254a33cde
I20260709 13:14:12.875521 32020 catalog_manager.cc:5697] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d reported cstate change: config changed from index -1 to 7, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New cstate: current_term: 12 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:12.877215 32134 tablet_copy_source_session.cc:215] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:12.881143  3299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f89f60951b564577beff269254a33cde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.939350 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:12.980018  3304 ts_tablet_manager.cc:933] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339)
I20260709 13:14:12.984568 32192 raft_consensus.cc:2955] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Committing config change with OpId 12.7: config changed from index -1 to 7, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:12.996784  3304 tablet_copy_client.cc:323] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Beginning tablet copy session from remote peer at address 127.30.63.1:42339
I20260709 13:14:12.998689 32134 tablet_copy_service.cc:140] P fcfc3281929645969ecedbb0c0af759d: Received BeginTabletCopySession request for tablet 0aaeda9c539745d5b9b44fb7acb8b438 from peer 94085cf341634eb686a95983b6b7f7e6 ({username='slave'} at 127.0.0.1:55358)
I20260709 13:14:12.999258 32134 tablet_copy_service.cc:161] P fcfc3281929645969ecedbb0c0af759d: Beginning new tablet copy session on tablet 0aaeda9c539745d5b9b44fb7acb8b438 from peer 94085cf341634eb686a95983b6b7f7e6 at {username='slave'} at 127.0.0.1:55358: session id = 94085cf341634eb686a95983b6b7f7e6-0aaeda9c539745d5b9b44fb7acb8b438
I20260709 13:14:13.012389 32134 tablet_copy_source_session.cc:215] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:13.019506  3304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aaeda9c539745d5b9b44fb7acb8b438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.028105  3306 ts_tablet_manager.cc:933] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:13.041445  3306 tablet_copy_client.cc:323] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Beginning tablet copy session from remote peer at address 127.30.63.3:36651
I20260709 13:14:13.043550 32282 tablet_copy_service.cc:140] P 6b3ed521ce8947db80c4b4828b355c06: Received BeginTabletCopySession request for tablet 05806ba48f814549969547f21c7101c3 from peer 94085cf341634eb686a95983b6b7f7e6 ({username='slave'} at 127.0.0.1:50584)
I20260709 13:14:13.044250 32282 tablet_copy_service.cc:161] P 6b3ed521ce8947db80c4b4828b355c06: Beginning new tablet copy session on tablet 05806ba48f814549969547f21c7101c3 from peer 94085cf341634eb686a95983b6b7f7e6 at {username='slave'} at 127.0.0.1:50584: session id = 94085cf341634eb686a95983b6b7f7e6-05806ba48f814549969547f21c7101c3
I20260709 13:14:13.052873  3299 tablet_copy_client.cc:806] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:13.054509 32282 tablet_copy_source_session.cc:215] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:13.080046  3299 tablet_copy_client.cc:670] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:13.083621  3306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05806ba48f814549969547f21c7101c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.100718  3299 tablet_copy_client.cc:538] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:13.112699  3304 tablet_copy_client.cc:806] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:13.113509  3304 tablet_copy_client.cc:670] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:13.123000  3304 tablet_copy_client.cc:538] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:13.145500  3304 tablet_bootstrap.cc:492] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap starting.
I20260709 13:14:13.179863  3306 tablet_copy_client.cc:806] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:13.181008  3299 tablet_bootstrap.cc:492] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6: Bootstrap starting.
I20260709 13:14:13.189244  3306 tablet_copy_client.cc:670] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:13.194763  3308 ts_tablet_manager.cc:933] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339)
I20260709 13:14:13.197777  3306 tablet_copy_client.cc:538] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:13.219651 32119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:42262
I20260709 13:14:13.220307 32119 raft_consensus.cc:606] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:13.229588 32273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:13.231132 32273 raft_consensus.cc:606] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:14:13.226550  3308 tablet_copy_client.cc:323] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Beginning tablet copy session from remote peer at address 127.30.63.1:42339
I20260709 13:14:13.238143 32199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:14:13.238783 32199 raft_consensus.cc:606] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:13.239248 32134 tablet_copy_service.cc:140] P fcfc3281929645969ecedbb0c0af759d: Received BeginTabletCopySession request for tablet 19e09eecc9b2466db338be646fedba5f from peer 94085cf341634eb686a95983b6b7f7e6 ({username='slave'} at 127.0.0.1:55358)
I20260709 13:14:13.239811 32134 tablet_copy_service.cc:161] P fcfc3281929645969ecedbb0c0af759d: Beginning new tablet copy session on tablet 19e09eecc9b2466db338be646fedba5f from peer 94085cf341634eb686a95983b6b7f7e6 at {username='slave'} at 127.0.0.1:55358: session id = 94085cf341634eb686a95983b6b7f7e6-19e09eecc9b2466db338be646fedba5f
I20260709 13:14:13.244311 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:14:13.245589 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:13.249672  3306 tablet_bootstrap.cc:492] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap starting.
I20260709 13:14:13.268229  3213 raft_consensus.cc:993] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d: : Instructing follower 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:14:13.269039  3213 raft_consensus.cc:1081] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Signalling peer 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:14:13.271586 32273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:36084
I20260709 13:14:13.272193 32273 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:13.272604 32273 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:13.278024  3302 raft_consensus.cc:993] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801: : Instructing follower 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:14:13.278707  3296 raft_consensus.cc:1081] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Signalling peer 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:14:13.280119 32134 tablet_copy_source_session.cc:215] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:13.281694 32269 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:36080
I20260709 13:14:13.282284 32269 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:13.282608 32269 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:13.289714 32273 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:13.291740  3308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19e09eecc9b2466db338be646fedba5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.292975 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:13.293747 32119 raft_consensus.cc:3055] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:13.294045 32119 raft_consensus.cc:740] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:13.294961 32119 consensus_queue.cc:260] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:13.296168 32273 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:13.296573 32119 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:13.297290 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:13.297900 32197 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:13.297554 32269 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:13.310107 32119 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:13.313380 32197 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:13.312347 32239 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:13.318449  3270 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:13.319013  3270 raft_consensus.cc:697] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:13.326284 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:13.326972 32117 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:13.333806 32117 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:14:13.334893 32239 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:13.338073  3235 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:13.338696  3235 raft_consensus.cc:697] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:13.339586  3235 consensus_queue.cc:237] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:13.336534 32269 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:13.319908  3270 consensus_queue.cc:237] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:13.354884 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:13.355536 32197 raft_consensus.cc:3055] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:13.355834 32197 raft_consensus.cc:740] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:13.356500 32197 consensus_queue.cc:260] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:13.360837 32197 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:13.367730 32197 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:14:13.423316 32020 catalog_manager.cc:5697] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 12 to 13, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 13 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:13.476073   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 105870us
W20260709 13:14:13.629424 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 64528.3us
I20260709 13:14:13.633926  3308 tablet_copy_client.cc:806] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:13.661971  3308 tablet_copy_client.cc:670] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 1 WAL segments...
W20260709 13:14:13.746987 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 57870.4us
W20260709 13:14:13.751861 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 111897us
W20260709 13:14:13.749259  3304 log.cc:927] Time spent T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.069s	user 0.002s	sys 0.000s
I20260709 13:14:13.829977  3270 raft_consensus.cc:993] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:13.830488  3270 raft_consensus.cc:1081] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:13.851809  3304 tablet_bootstrap.cc:492] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:13.853223  3304 tablet_bootstrap.cc:492] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap complete.
I20260709 13:14:13.854414  3304 ts_tablet_manager.cc:1403] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6: Time spent bootstrapping tablet: real 0.709s	user 0.035s	sys 0.021s
I20260709 13:14:13.873512  3299 tablet_bootstrap.cc:492] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:13.876701  3299 tablet_bootstrap.cc:492] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6: Bootstrap complete.
I20260709 13:14:13.885684  3299 ts_tablet_manager.cc:1403] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6: Time spent bootstrapping tablet: real 0.709s	user 0.056s	sys 0.014s
I20260709 13:14:13.889185  3299 raft_consensus.cc:359] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:13.890054  3299 raft_consensus.cc:740] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Initialized, Role: LEARNER
I20260709 13:14:13.890844  3299 consensus_queue.cc:260] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:13.893759  3299 ts_tablet_manager.cc:1434] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
W20260709 13:14:13.920961 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 143790us
W20260709 13:14:13.931424 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 249030us
W20260709 13:14:13.952814   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 77990us
I20260709 13:14:13.963611 32133 tablet_copy_service.cc:342] P fcfc3281929645969ecedbb0c0af759d: Request end of tablet copy session 94085cf341634eb686a95983b6b7f7e6-f89f60951b564577beff269254a33cde received from {username='slave'} at 127.0.0.1:55358
I20260709 13:14:13.964190 32133 tablet_copy_service.cc:434] P fcfc3281929645969ecedbb0c0af759d: ending tablet copy session 94085cf341634eb686a95983b6b7f7e6-f89f60951b564577beff269254a33cde on tablet f89f60951b564577beff269254a33cde with peer 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:13.983458  3304 raft_consensus.cc:359] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:14.005776  3304 raft_consensus.cc:740] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Initialized, Role: LEARNER
I20260709 13:14:14.006947  3304 consensus_queue.cc:260] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:13.977377  3306 tablet_bootstrap.cc:492] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:14.011272  3306 tablet_bootstrap.cc:492] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap complete.
I20260709 13:14:14.012132  3306 ts_tablet_manager.cc:1403] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6: Time spent bootstrapping tablet: real 0.763s	user 0.043s	sys 0.044s
I20260709 13:14:14.014421 32121 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:14.022454 32198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:14:14.023218 32198 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:14.023684 32198 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:14.003211 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 43587.2us
I20260709 13:14:14.025903 32117 raft_consensus.cc:1275] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:14.016613  3342 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:14:14.043756 32199 raft_consensus.cc:1275] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:14.047043 32198 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:14.064792   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 103173us
I20260709 13:14:14.040719  3308 tablet_copy_client.cc:538] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:14.069126 32198 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:14.049734  3304 ts_tablet_manager.cc:1434] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6: Time spent starting tablet: real 0.190s	user 0.009s	sys 0.000s
I20260709 13:14:14.042654  3251 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
W20260709 13:14:14.111104 32236 consensus_peers.cc:597] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:14.113054 32268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45768
I20260709 13:14:14.116112 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:14.116717 32270 raft_consensus.cc:3055] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:14.117003 32270 raft_consensus.cc:740] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:14.117713 32270 consensus_queue.cc:260] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:14.118548 32270 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:14.121845  3306 raft_consensus.cc:359] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:14.123945 32134 tablet_copy_service.cc:342] P fcfc3281929645969ecedbb0c0af759d: Request end of tablet copy session 94085cf341634eb686a95983b6b7f7e6-0aaeda9c539745d5b9b44fb7acb8b438 received from {username='slave'} at 127.0.0.1:55358
I20260709 13:14:14.124002  3306 raft_consensus.cc:740] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Initialized, Role: LEARNER
I20260709 13:14:14.124473 32134 tablet_copy_service.cc:434] P fcfc3281929645969ecedbb0c0af759d: ending tablet copy session 94085cf341634eb686a95983b6b7f7e6-0aaeda9c539745d5b9b44fb7acb8b438 on tablet 0aaeda9c539745d5b9b44fb7acb8b438 with peer 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:14.131561  3306 consensus_queue.cc:260] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
W20260709 13:14:14.137130 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:14.143819 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:14.144721 32121 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:14.151296 32268 raft_consensus.cc:606] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Received request to transfer leadership
I20260709 13:14:14.144302 32198 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:14.159888 32270 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:14.169268  3349 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:14.181309 32268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45768
I20260709 13:14:14.181988 32268 raft_consensus.cc:606] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Received request to transfer leadership
I20260709 13:14:14.182106 32121 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:14.182858  3337 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:14:14.183398 32009 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 19e09eecc9b2466db338be646fedba5f already in progress [suppressed 1 similar messages]
I20260709 13:14:14.184986 32165 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:14.185856  3298 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:14.186384  3298 raft_consensus.cc:697] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:14.187213  3298 consensus_queue.cc:237] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:14.202941  3306 ts_tablet_manager.cc:1434] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6: Time spent starting tablet: real 0.190s	user 0.012s	sys 0.000s
I20260709 13:14:14.210466 32121 raft_consensus.cc:1240] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:14.219812 32282 tablet_copy_service.cc:342] P 6b3ed521ce8947db80c4b4828b355c06: Request end of tablet copy session 94085cf341634eb686a95983b6b7f7e6-05806ba48f814549969547f21c7101c3 received from {username='slave'} at 127.0.0.1:50584
I20260709 13:14:14.220355 32282 tablet_copy_service.cc:434] P 6b3ed521ce8947db80c4b4828b355c06: ending tablet copy session 94085cf341634eb686a95983b6b7f7e6-05806ba48f814549969547f21c7101c3 on tablet 05806ba48f814549969547f21c7101c3 with peer 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:14.217374 32021 catalog_manager.cc:5697] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 9 to 10, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 10 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:14.246604 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:14.269075  3308 tablet_bootstrap.cc:492] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6: Bootstrap starting.
W20260709 13:14:14.282363 32009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 98704.2us
I20260709 13:14:14.376955  3315 raft_consensus.cc:993] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:14.377537  3315 raft_consensus.cc:1081] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:14.430717   400 raft_consensus.cc:1217] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.6->[10.7-10.7]   Dedup: 10.7->[]
I20260709 13:14:14.432240 32196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
W20260709 13:14:14.442335 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 76899.1us
I20260709 13:14:14.542943 32196 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:14.544260 32196 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:14.556998 32265 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45768
I20260709 13:14:14.558655 32265 raft_consensus.cc:606] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Received request to transfer leadership
W20260709 13:14:14.572710 32070 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:14:14.573312 32070 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 19e09eecc9b2466db338be646fedba5f already in progress
W20260709 13:14:14.573709 32070 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 19e09eecc9b2466db338be646fedba5f already in progress
I20260709 13:14:14.664769   400 raft_consensus.cc:1217] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.7->[10.8-10.8]   Dedup: 10.8->[]
I20260709 13:14:14.697540   403 raft_consensus.cc:1217] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 8 LEARNER]: Deduplicated request from leader. Original: 8.5->[8.6-8.6]   Dedup: 8.6->[]
I20260709 13:14:14.653843 32196 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:14.742538 32019 catalog_manager.cc:5697] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 9 to 10, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 10 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:14.770962 32265 raft_consensus.cc:1275] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:14.780249 32196 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:14.793424 32116 raft_consensus.cc:1275] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:14.797902 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:14.798676 32119 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:14.809401 32119 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:14:14.818948 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:14.819659 32270 raft_consensus.cc:3055] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:14.819977 32270 raft_consensus.cc:740] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:14.820914 32270 consensus_queue.cc:260] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:14.822856 32270 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:14.826581  3319 consensus_queue.cc:1048] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:14.852854  3319 consensus_queue.cc:1048] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:14.857000 32165 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:14.858965  3298 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:14.859503  3298 raft_consensus.cc:697] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:14.860554  3298 consensus_queue.cc:237] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:14.867447 32270 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:14:14.896945 32019 catalog_manager.cc:5697] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 13 to 14, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 14 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:14.922641  3340 raft_consensus.cc:1064] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:14:14.931694  3340 consensus_queue.cc:237] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 5, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:14.962945  3308 tablet_bootstrap.cc:492] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:14.986343  3308 tablet_bootstrap.cc:492] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6: Bootstrap complete.
I20260709 13:14:14.987313  3308 ts_tablet_manager.cc:1403] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6: Time spent bootstrapping tablet: real 0.745s	user 0.036s	sys 0.015s
I20260709 13:14:14.995999  3308 raft_consensus.cc:359] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:14.999720  3308 raft_consensus.cc:740] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Initialized, Role: LEARNER
I20260709 13:14:15.000535  3308 consensus_queue.cc:260] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:15.007278  3308 ts_tablet_manager.cc:1434] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:14:15.011861 32134 tablet_copy_service.cc:342] P fcfc3281929645969ecedbb0c0af759d: Request end of tablet copy session 94085cf341634eb686a95983b6b7f7e6-19e09eecc9b2466db338be646fedba5f received from {username='slave'} at 127.0.0.1:55358
I20260709 13:14:15.012718 32134 tablet_copy_service.cc:434] P fcfc3281929645969ecedbb0c0af759d: ending tablet copy session 94085cf341634eb686a95983b6b7f7e6-19e09eecc9b2466db338be646fedba5f on tablet 19e09eecc9b2466db338be646fedba5f with peer 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:15.026577 32198 raft_consensus.cc:1275] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:14:15.027493   403 raft_consensus.cc:1275] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 10 LEARNER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:14:15.029737  3341 consensus_queue.cc:1048] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:15.026636 32265 raft_consensus.cc:1275] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:14:15.031989  3340 consensus_queue.cc:1048] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:15.032970  3341 consensus_queue.cc:1048] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:15.063002  3235 raft_consensus.cc:1064] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:14:15.066345  3235 consensus_queue.cc:237] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 4, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:15.093940  3372 raft_consensus.cc:2955] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:15.096745   400 raft_consensus.cc:2955] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:15.099541 32265 raft_consensus.cc:2955] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:15.118206   403 raft_consensus.cc:1275] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 8 LEARNER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:14:15.121408  3315 consensus_queue.cc:1048] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:15.141407 32198 raft_consensus.cc:2955] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:15.119632 32019 catalog_manager.cc:5697] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 7 to 8, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:15.184444 32121 raft_consensus.cc:1275] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:14:15.185273 32196 raft_consensus.cc:1275] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:14:15.187491  3322 consensus_queue.cc:1048] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:15.190809  3331 consensus_queue.cc:1048] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:15.229836 32121 consensus_queue.cc:237] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:15.261219  3348 raft_consensus.cc:2955] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:15.291031 32196 raft_consensus.cc:2955] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:15.307791 32269 raft_consensus.cc:1275] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:14:15.320137  3340 consensus_queue.cc:1048] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:15.339069   401 raft_consensus.cc:2955] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:15.356055   400 raft_consensus.cc:1275] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:14:15.361645  3341 raft_consensus.cc:2955] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:15.372644 32021 catalog_manager.cc:5697] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: config changed from index 6 to 7, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:15.373689 32269 raft_consensus.cc:2955] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:15.397011 32270 raft_consensus.cc:1275] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:14:15.399483 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:15.404021  3370 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:15.407621 32009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f89f60951b564577beff269254a33cde with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:15.410197 32121 raft_consensus.cc:1275] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:14:15.414685 32270 consensus_queue.cc:237] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:15.423691 32019 catalog_manager.cc:5697] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d reported cstate change: config changed from index 8 to 9, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New cstate: current_term: 10 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:15.431749   401 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 12 LEARNER]: Advancing to term 14
I20260709 13:14:15.435135   402 raft_consensus.cc:1275] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:14:15.437629 32198 raft_consensus.cc:1275] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:14:15.441499  3348 consensus_queue.cc:1048] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:15.457616  3235 consensus_queue.cc:1048] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:15.473659  3370 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:15.486049   402 raft_consensus.cc:2955] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:15.489743  3385 consensus_queue.cc:1048] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:15.523123  3372 raft_consensus.cc:1064] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:14:15.505889  3235 raft_consensus.cc:2955] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 7 to 8, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:15.529654  3372 consensus_queue.cc:237] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:15.560417 32181 tablet_service.cc:1558] Processing DeleteTablet for tablet f89f60951b564577beff269254a33cde with delete_type TABLET_DATA_TOMBSTONED (TS 113b5461952d47e0944d463ea4e32801 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:46032
I20260709 13:14:15.561479 32198 raft_consensus.cc:2955] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:15.577692   401 raft_consensus.cc:1275] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 14 LEARNER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:14:15.587260   400 raft_consensus.cc:2955] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:15.593322  3354 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:15.603325 32009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 05806ba48f814549969547f21c7101c3 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:15.623381  3388 tablet_replica.cc:333] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:14:15.657703 32019 catalog_manager.cc:5697] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 7 to 8, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New cstate: current_term: 8 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:15.731637   400 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 10 LEARNER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:14:15.733476  3373 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:14:15.691249 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 52824.4us
I20260709 13:14:15.758445 32270 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:14:15.758566 32110 tablet_service.cc:1558] Processing DeleteTablet for tablet 05806ba48f814549969547f21c7101c3 with delete_type TABLET_DATA_TOMBSTONED (TS fcfc3281929645969ecedbb0c0af759d not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:56870
W20260709 13:14:15.773236 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 106559us
I20260709 13:14:15.817139  3388 raft_consensus.cc:2243] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:15.817804  3384 log.cc:927] Time spent T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:14:15.818323  3388 raft_consensus.cc:2272] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:15.819681  3355 log.cc:927] Time spent T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:14:15.821151 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 64808.8us
I20260709 13:14:15.901213  3213 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:14:15.907258  3403 tablet_replica.cc:333] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:14:15.910457 32191 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:14:15.954809  3354 raft_consensus.cc:1064] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
W20260709 13:14:15.964695 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 69894.3us
I20260709 13:14:16.018869  3388 ts_tablet_manager.cc:1916] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:14:16.024832 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 46750.6us
W20260709 13:14:16.044246 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 62475us
W20260709 13:14:16.086928 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 98055.9us
W20260709 13:14:16.129712  3405 log.cc:927] Time spent T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260709 13:14:16.164235 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 57118.8us
W20260709 13:14:16.168156 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 80566.6us
I20260709 13:14:16.355404 32273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:16.356572 32273 raft_consensus.cc:606] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
W20260709 13:14:16.559705 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 353882us
W20260709 13:14:16.565166   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 44387.7us
W20260709 13:14:16.567636 32162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 284102us
W20260709 13:14:16.567741 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 498684us
I20260709 13:14:16.572742  3403 raft_consensus.cc:2243] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:16.577553 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 409743us
I20260709 13:14:16.588260  3429 raft_consensus.cc:2955] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:16.597610  3403 pending_rounds.cc:70] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d: Trying to abort 1 pending ops.
I20260709 13:14:16.598037  3403 pending_rounds.cc:77] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d: Aborting op as it isn't in flight: id { term: 8 index: 7 } timestamp: 7305637294343901184 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "05806ba48f814549969547f21c7101c3" old_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } } new_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } } }
I20260709 13:14:16.604928  3403 raft_consensus.cc:2917] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Aborting config change with OpId 8.7: Aborted: Op aborted
I20260709 13:14:16.605386  3403 raft_consensus.cc:2889] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:14:16.605754  3403 raft_consensus.cc:2272] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:16.613649  3403 ts_tablet_manager.cc:1916] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:16.621189   402 raft_consensus.cc:2955] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:16.633457  3439 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:16.634096  3439 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:16.636376  3439 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:16.643744  3388 ts_tablet_manager.cc:1929] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.8
I20260709 13:14:16.668648  3354 consensus_queue.cc:237] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:16.674245  3420 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:16.682780  3403 ts_tablet_manager.cc:1929] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.7
I20260709 13:14:16.686368 32197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:14:16.713635 32197 raft_consensus.cc:606] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 6 LEADER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:16.719525  3403 log.cc:1199] T 05806ba48f814549969547f21c7101c3 P fcfc3281929645969ecedbb0c0af759d: Deleting WAL directory at /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-0-root/wals/05806ba48f814549969547f21c7101c3
I20260709 13:14:16.721971 32009 catalog_manager.cc:5028] TS fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): tablet 05806ba48f814549969547f21c7101c3 (table test-workload [id=9b9dc20f98e547b59efac9c530f28125]) successfully deleted
I20260709 13:14:16.742846 32192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:14:16.743569 32192 raft_consensus.cc:606] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:16.747174 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:16.735960  3388 log.cc:1199] T f89f60951b564577beff269254a33cde P 113b5461952d47e0944d463ea4e32801: Deleting WAL directory at /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-1-root/wals/f89f60951b564577beff269254a33cde
I20260709 13:14:16.750669 32021 catalog_manager.cc:5697] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d reported cstate change: config changed from index 8 to 9, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:16.751518  3388 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46032 (request call id 2) took 1191 ms. Trace:
I20260709 13:14:16.755213 32123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:42262
I20260709 13:14:16.755928 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:16.759235   400 raft_consensus.cc:1275] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 14 LEARNER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:14:16.755971 32123 raft_consensus.cc:606] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:16.769584  3348 raft_consensus.cc:993] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:16.770396 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:14:16.772324 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:14:16.774958 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:16.775697  3411 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:16.779964 32273 raft_consensus.cc:1275] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:14:16.770416  3348 raft_consensus.cc:1081] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:16.755016  3388 rpcz_store.cc:276] 0709 13:14:15.559871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:15.560111 (+   240us) service_pool.cc:224] Handling call
0709 13:14:15.622659 (+ 62548us) ts_tablet_manager.cc:1151] Deleting tablet f89f60951b564577beff269254a33cde
0709 13:14:15.622867 (+   208us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:14:16.379197 (+756330us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:16.643599 (+264402us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:16.751398 (+107799us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":61526,"thread_start_us":1665,"threads_started":1}
I20260709 13:14:16.786995 32008 catalog_manager.cc:5028] TS 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): tablet f89f60951b564577beff269254a33cde (table test-workload [id=9b9dc20f98e547b59efac9c530f28125]) successfully deleted
I20260709 13:14:16.785494 32267 raft_consensus.cc:2955] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:16.765266 32197 raft_consensus.cc:2955] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:16.802434  3439 raft_consensus.cc:993] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801: : Instructing follower 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:14:16.802920  3439 raft_consensus.cc:1081] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 6 LEADER]: Signalling peer 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:14:16.808681 32192 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:14:16.828699 32192 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:16.829105 32192 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:16.830242 32273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:36080
I20260709 13:14:16.832160 32273 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:16.832507 32273 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:16.856755  3402 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:14:16.862447 32123 raft_consensus.cc:1275] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:14:16.840343 32192 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:16.873360 32273 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:16.880038 32192 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:16.881742 32273 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:16.882548 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:16.881000 32165 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:16.883704 32116 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:16.888341  3402 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:16.889083 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:16.889708 32267 raft_consensus.cc:3055] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:16.890209 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:16.890897 32121 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:16.890141 32267 raft_consensus.cc:740] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:16.891965 32267 consensus_queue.cc:260] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:16.893355 32267 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:16.901980 32267 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
I20260709 13:14:16.906958 32121 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
I20260709 13:14:16.909585 32165 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:16.910461  3393 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:16.912752  3393 raft_consensus.cc:697] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 11 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:16.913450  3420 raft_consensus.cc:993] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d: : Instructing follower 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:14:16.913980  3420 raft_consensus.cc:1081] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Signalling peer 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:14:16.913704  3393 consensus_queue.cc:237] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:16.912142 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:16.924273 32192 raft_consensus.cc:3055] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:16.926754 32192 raft_consensus.cc:740] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:16.929376 32192 consensus_queue.cc:260] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:16.930359 32192 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:16.931672 32116 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:14:16.933204  3344 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:16.933894 32273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:36084
I20260709 13:14:16.934648 32273 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:16.935169 32273 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:16.935266  3411 raft_consensus.cc:2955] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 7 to 10, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:16.933917 32239 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:16.946725  3398 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:16.948599  3398 raft_consensus.cc:697] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:16.944993 32273 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:16.953102 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:16.949812  3398 consensus_queue.cc:237] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:16.952273 32116 raft_consensus.cc:2955] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 7 to 10, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:16.955159 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:16.955744 32119 raft_consensus.cc:3055] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:16.956040 32119 raft_consensus.cc:740] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:16.953774 32197 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:16.956878 32119 consensus_queue.cc:260] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:16.958226 32119 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:16.967867 32119 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:16.970135 32273 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:16.971364 32192 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:14:16.969712 32239 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:16.985721 32197 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:16.991325  3425 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:16.997273  3415 raft_consensus.cc:993] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801: : Instructing follower fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:14:16.997979  3415 raft_consensus.cc:1081] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Signalling peer fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:14:17.007714 32273 raft_consensus.cc:2955] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 7 to 10, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:17.006692  3425 raft_consensus.cc:697] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:17.015897  3425 consensus_queue.cc:237] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:17.031100   401 raft_consensus.cc:2955] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 7 to 10, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:17.043512 32116 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:56884
I20260709 13:14:17.044185 32116 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:17.044543 32116 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:17.069298 32019 catalog_manager.cc:5697] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 10 to 11, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 11 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:17.120338 32116 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:17.125741 32116 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:17.129216 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:17.129832 32192 raft_consensus.cc:3055] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:17.130101 32192 raft_consensus.cc:740] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:17.130892 32192 consensus_queue.cc:260] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:17.132069 32192 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:17.146968 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:17.147836 32267 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:17.152319 32022 catalog_manager.cc:5697] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 7 to 10, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:17.170763 32267 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:17.171838 32090 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:17.172571  3429 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:17.173297  3429 raft_consensus.cc:697] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:17.174158  3429 consensus_queue.cc:237] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:17.183709 32192 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:17.208420 32019 catalog_manager.cc:5697] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 6 to 7, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 7 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:17.221807 32019 catalog_manager.cc:5697] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 10 to 11, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 11 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:17.264683 32198 consensus_queue.cc:237] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:17.279784 32116 raft_consensus.cc:1275] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:14:17.280658   401 raft_consensus.cc:1275] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:14:17.281337  3354 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:17.282922  3415 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:17.297384  3354 raft_consensus.cc:2955] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:17.301746   402 raft_consensus.cc:2955] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:17.311019 32022 catalog_manager.cc:5697] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 10 to 11, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 11 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:17.324788 32117 raft_consensus.cc:2955] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:17.339486 32020 catalog_manager.cc:5697] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 10 to 11, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New cstate: current_term: 14 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:17.354753 32008 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 19e09eecc9b2466db338be646fedba5f with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:17.368745 32259 tablet_service.cc:1558] Processing DeleteTablet for tablet 19e09eecc9b2466db338be646fedba5f with delete_type TABLET_DATA_TOMBSTONED (TS 6b3ed521ce8947db80c4b4828b355c06 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:45768
I20260709 13:14:17.372476  3454 tablet_replica.cc:333] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:14:17.379962  3454 raft_consensus.cc:2243] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:17.381263  3454 raft_consensus.cc:2272] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:17.384985  3454 ts_tablet_manager.cc:1916] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:17.388375 32117 consensus_queue.cc:237] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:17.393859   402 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:14:17.399061  3429 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:17.409606 32198 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:14:17.411252  3420 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:17.419064  3432 raft_consensus.cc:2955] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:17.421280   402 raft_consensus.cc:2955] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:17.429039 32009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0aaeda9c539745d5b9b44fb7acb8b438 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:17.426892 32198 raft_consensus.cc:2955] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:17.441138 32267 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:17.451215 32192 raft_consensus.cc:1275] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:14:17.457849  3412 consensus_queue.cc:1048] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:17.473711  3319 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:17.481000 32022 catalog_manager.cc:5697] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d reported cstate change: config changed from index 9 to 10, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New cstate: current_term: 10 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:17.518702 32259 tablet_service.cc:1558] Processing DeleteTablet for tablet 0aaeda9c539745d5b9b44fb7acb8b438 with delete_type TABLET_DATA_TOMBSTONED (TS 6b3ed521ce8947db80c4b4828b355c06 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:45768
I20260709 13:14:17.517313  3454 ts_tablet_manager.cc:1929] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.10
I20260709 13:14:17.523278  3454 log.cc:1199] T 19e09eecc9b2466db338be646fedba5f P 6b3ed521ce8947db80c4b4828b355c06: Deleting WAL directory at /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-2-root/wals/19e09eecc9b2466db338be646fedba5f
I20260709 13:14:17.544468 32117 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:17.565623  3454 tablet_replica.cc:333] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:14:17.566300 32009 catalog_manager.cc:5028] TS 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): tablet 19e09eecc9b2466db338be646fedba5f (table test-workload [id=9b9dc20f98e547b59efac9c530f28125]) successfully deleted
I20260709 13:14:17.556120  3415 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:14:17.584403 32117 raft_consensus.cc:1275] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:14:17.586746  3454 raft_consensus.cc:2243] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:17.607209  3454 raft_consensus.cc:2272] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:17.608870  3396 consensus_queue.cc:1048] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:14:17.613224 32196 raft_consensus.cc:1275] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:17.615526  3454 ts_tablet_manager.cc:1916] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:17.629069  3459 consensus_queue.cc:1048] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:17.680215 32196 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:17.689054 32116 raft_consensus.cc:1275] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:17.706353 32267 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:17.707981  3429 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:17.745427  3436 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:17.746608  3454 ts_tablet_manager.cc:1929] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.9
I20260709 13:14:17.747089  3454 log.cc:1199] T 0aaeda9c539745d5b9b44fb7acb8b438 P 6b3ed521ce8947db80c4b4828b355c06: Deleting WAL directory at /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-2-root/wals/0aaeda9c539745d5b9b44fb7acb8b438
I20260709 13:14:17.748908 32009 catalog_manager.cc:5028] TS 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): tablet 0aaeda9c539745d5b9b44fb7acb8b438 (table test-workload [id=9b9dc20f98e547b59efac9c530f28125]) successfully deleted
I20260709 13:14:17.753559  3459 consensus_queue.cc:1048] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:14:17.781988 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:18.773028 32270 consensus_queue.cc:237] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
W20260709 13:14:18.809566 32236 consensus_peers.cc:597] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 64767c8d367b4cc1b7e2ffbcbf73ce29. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:18.810326 32197 raft_consensus.cc:1275] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:14:18.811820  3435 consensus_queue.cc:1048] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:18.813230 32117 raft_consensus.cc:1275] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:14:18.817525  3435 consensus_queue.cc:1048] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:18.833073  3425 raft_consensus.cc:2955] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Committing config change with OpId 11.6: config changed from index -1 to 6, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:18.838140 32197 raft_consensus.cc:2955] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Committing config change with OpId 11.6: config changed from index -1 to 6, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:18.865566 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:18.891464 32019 catalog_manager.cc:5697] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: config changed from index -1 to 6, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New cstate: current_term: 11 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:18.891958 32116 consensus_queue.cc:237] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:18.924638 32119 raft_consensus.cc:2955] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Committing config change with OpId 11.6: config changed from index -1 to 6, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
W20260709 13:14:18.939466 32087 consensus_peers.cc:597] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ddd7dfc158794e3ab7427d0b86b46c8d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:18.943064 32267 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:14:18.952458  3429 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:18.966291 32197 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:14:18.970872  3429 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:14:19.040696 32162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 60041us
W20260709 13:14:19.071583 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 102898us
I20260709 13:14:19.070811  3432 raft_consensus.cc:2955] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:19.075567 32267 raft_consensus.cc:2955] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
W20260709 13:14:19.121467 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 65739.1us
W20260709 13:14:19.203089 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 44731.9us
I20260709 13:14:19.219144 32197 raft_consensus.cc:2955] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:19.233184 32273 consensus_queue.cc:237] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:19.258558 32196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:14:19.259307 32196 raft_consensus.cc:606] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:19.274252 32196 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:14:19.275895  3435 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:19.277228 32121 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:14:19.278671 32236 consensus_peers.cc:597] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0cf85dc23ac44824a3668eb1b1f3aa42. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:19.279323 32273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:19.279752  3396 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:19.279887 32273 raft_consensus.cc:606] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:14:19.301798 32022 catalog_manager.cc:5697] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d reported cstate change: config changed from index -1 to 5, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New cstate: current_term: 7 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:19.314914 32116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:42262
I20260709 13:14:19.315680 32116 raft_consensus.cc:606] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:19.321738  3459 raft_consensus.cc:2955] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Committing config change with OpId 13.7: config changed from index -1 to 7, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:19.325495 32267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:19.326159 32267 raft_consensus.cc:606] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:14:19.329710 32121 raft_consensus.cc:2955] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Committing config change with OpId 13.7: config changed from index -1 to 7, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:19.388726 32197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "94085cf341634eb686a95983b6b7f7e6"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:14:19.389616 32197 raft_consensus.cc:606] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Received request to transfer leadership to TS 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:19.393402  3492 ts_tablet_manager.cc:933] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339)
I20260709 13:14:19.999882  3494 ts_tablet_manager.cc:933] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:20.020188   401 thread.cc:641] tablet-copy [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.001s	sys 0.005s
W20260709 13:14:20.020689   401 thread.cc:608] tablet-copy [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.002s	sys 0.005s
W20260709 13:14:20.082046 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 707624us
I20260709 13:14:20.359951  3408 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:20.360707  3408 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:20.369184  3494 tablet_copy_client.cc:323] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Beginning tablet copy session from remote peer at address 127.30.63.3:36651
I20260709 13:14:20.377772  3408 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:14:20.378918  3492 thread.cc:641] tablet-download-pool [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.000s	sys 0.005s
W20260709 13:14:20.380088  3492 thread.cc:608] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.000s	sys 0.006s
W20260709 13:14:20.392511   367 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.003s	sys 0.007s
W20260709 13:14:20.393097   367 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.003s	sys 0.007s
I20260709 13:14:20.396157  3459 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:20.396793  3459 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:20.403277  3459 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:20.398427  3492 tablet_copy_client.cc:323] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Beginning tablet copy session from remote peer at address 127.30.63.1:42339
I20260709 13:14:20.410431  3459 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:20.409515  3500 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:20.411388  3500 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:20.415119  3500 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:20.411077  3459 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:20.423094  3459 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:20.451102  3499 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:20.451850  3499 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:20.454224  3499 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:20.454713  3499 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:20.455245  3499 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:20.457569  3499 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:20.461866  3459 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:20.462504  3459 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:20.464730  3459 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:20.466249  3503 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:20.466935  3503 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:20.469192  3503 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:20.481065  3496 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:20.481673  3496 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:20.482944 32282 tablet_copy_service.cc:140] P 6b3ed521ce8947db80c4b4828b355c06: Received BeginTabletCopySession request for tablet 64767c8d367b4cc1b7e2ffbcbf73ce29 from peer 94085cf341634eb686a95983b6b7f7e6 ({username='slave'} at 127.0.0.1:50584)
I20260709 13:14:20.483594 32282 tablet_copy_service.cc:161] P 6b3ed521ce8947db80c4b4828b355c06: Beginning new tablet copy session on tablet 64767c8d367b4cc1b7e2ffbcbf73ce29 from peer 94085cf341634eb686a95983b6b7f7e6 at {username='slave'} at 127.0.0.1:50584: session id = 94085cf341634eb686a95983b6b7f7e6-64767c8d367b4cc1b7e2ffbcbf73ce29
I20260709 13:14:20.484145  3496 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:20.489246 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:20.494829 32282 tablet_copy_source_session.cc:215] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:20.498442  3494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64767c8d367b4cc1b7e2ffbcbf73ce29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:20.507643 32020 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49556 (request call id 239) took 1181 ms. Trace:
I20260709 13:14:20.508064 32020 rpcz_store.cc:276] 0709 13:14:19.326148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:19.326391 (+   243us) service_pool.cc:224] Handling call
0709 13:14:20.507548 (+1181157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7020,"reported_tablets":3}
I20260709 13:14:20.515771 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:20.516175  3494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:38164 (request call id 190) took 1055 ms. Trace:
I20260709 13:14:20.517447 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:20.516616  3494 rpcz_store.cc:276] 0709 13:14:19.461092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:19.461279 (+   187us) service_pool.cc:224] Handling call
0709 13:14:20.000397 (+539118us) ts_tablet_manager.cc:934] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
0709 13:14:20.497040 (+496643us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:14:20.507815 (+ 10775us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:20.507930 (+   115us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:14:20.515420 (+  7490us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:14:20.515708 (+   288us) tablet_replica.cc:206] Creating consensus instance
0709 13:14:20.516009 (+   301us) ts_tablet_manager.cc:989] Replica registered.
0709 13:14:20.516066 (+    57us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":364,"tablet-copy.queue_time_us":534901,"thread_start_us":913170,"threads_started":2}
I20260709 13:14:20.519851  3494 tablet_copy_client.cc:806] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:20.522719  3499 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:20.523350  3499 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:20.520519  3494 tablet_copy_client.cc:670] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:20.531088  3494 tablet_copy_client.cc:538] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:20.588824  3500 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:20.589437  3500 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:20.589718  3503 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:20.590346  3503 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:20.591765  3500 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:20.592676  3503 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:20.593199  3503 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:20.593858  3503 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:20.594265  3493 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:20.595602  3499 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:20.595274  3493 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:20.596019  3503 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:20.597849  3493 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:20.594218  3502 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:20.600996  3502 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:20.601482  3505 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:20.602003  3505 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:20.603189  3502 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:20.603528  3505 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:20.605032 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:20.610716 32192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 2966) took 1331 ms. Trace:
I20260709 13:14:20.611155 32192 rpcz_store.cc:276] 0709 13:14:19.279038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:19.279144 (+   106us) service_pool.cc:224] Handling call
0709 13:14:19.279581 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:19.279901 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:19.279928 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:19.280769 (+   841us) log.cc:844] Serialized 492 byte log entry
0709 13:14:19.374077 (+ 93308us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:19.374118 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:19.374193 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:20.610479 (+1236286us) raft_consensus.cc:1685] finished
0709 13:14:20.610502 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:20.610625 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":92940,"threads_started":1,"wal-append.queue_time_us":92431,"wal-append.run_cpu_time_us":2158,"wal-append.run_wall_time_us":1024627}
I20260709 13:14:20.623705  3494 tablet_bootstrap.cc:492] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap starting.
I20260709 13:14:20.631210  3503 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:20.632040  3503 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:20.634460  3503 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:20.637852  3502 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:20.638494  3501 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:20.638476  3502 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:20.639217  3501 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:20.641245  3502 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:20.650014 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:20.641608  3501 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:20.641799  3503 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:20.652297  3500 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:20.733186  3408 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:20.668444  3496 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:20.734833  3459 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:20.756673  3508 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:20.734797 32020 catalog_manager.cc:5697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: config changed from index -1 to 7, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New cstate: current_term: 13 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:20.741045   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:20.741492  3493 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:20.746119  3499 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:20.746351  3409 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:20.669811  3495 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:14:20.746928   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 78151.8us
W20260709 13:14:20.747174 32236 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.218s	user 0.008s	sys 0.017s
W20260709 13:14:20.785049 32236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.256s	user 0.008s	sys 0.017s
I20260709 13:14:20.756613  3500 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:20.757050  3459 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:20.651746  3501 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:20.757280   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:20.757795  3496 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:20.775534  3396 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:20.776247  3506 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:20.794214  3511 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:20.794797  3511 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:20.797148  3511 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:20.778885  3502 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:20.781778  3505 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:20.756703  3408 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:20.784648  3475 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:20.811304  3506 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:20.779472  3503 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:20.820327 32070 auto_rebalancer.cc:629] Failed to schedule move for tablet 980228c6820f4e3aab0ccf2eace31a25: Remote error: Service unavailable: leader transfer in progress
I20260709 13:14:20.790560  3513 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:20.842898  3518 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:20.781534  3493 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:14:20.847715   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 62924.3us
I20260709 13:14:20.846328 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:20.852281  3511 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:20.780236  3508 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:20.854432 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:20.792855  3501 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:20.788373  3409 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:20.855317  3511 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:20.863418 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:20.865201 32191 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:14:20.788982  3499 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:20.864099   368 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:20.790199  3495 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:20.813083  3505 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:20.851061  3507 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:20.850994  3435 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:20.852313  3504 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:20.873739 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:20.811049  3396 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:20.886035 32191 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:14:20.878763  3507 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:20.891633  3493 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:20.892166  3507 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:20.885499  3435 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:20.811489  3502 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:14:20.851792  3513 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:20.913985  3495 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:20.914352  3499 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:20.914546  3513 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:20.914664  3495 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:20.914965  3499 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:20.915297  3495 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:20.915722  3408 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:20.915486  3499 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:20.915901  3513 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:20.865510  3515 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:20.866001  3512 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:20.823462  3475 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:20.896121  3507 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:20.914970  3409 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:20.917649  3519 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:20.923590  3521 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:20.924048  3495 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:20.924460  3521 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:20.925906  3499 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:20.927949  3521 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:20.930425  3506 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:20.930591  3496 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:20.930460  3500 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:20.928956  3507 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:20.864598  3518 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:14:20.953989   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 90002.7us
I20260709 13:14:20.953125 32196 raft_consensus.cc:2955] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Committing config change with OpId 13.7: config changed from index -1 to 7, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:20.929109  3409 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:20.957351 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:20.962103  3459 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:20.962684  3510 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:20.963279  3510 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:20.965468  3510 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:20.966825  3510 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:20.967319  3510 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:20.969496  3510 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:20.929368  3512 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:20.894004  3504 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:20.919827  3515 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:20.932778  3519 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.090713  3524 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:21.101754  3499 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:21.105769  3499 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.108011  3499 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.109095 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.109210 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.110284 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:20.969666  3508 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:21.101559  3509 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:21.129858 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:20.954995  3506 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:20.960014  3409 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.103065  3510 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:21.103899  3507 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.118302  3521 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:21.146792  3510 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.146960  3521 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:21.012212  3459 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:21.147895 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.141516  3501 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.147389  3538 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:21.102111  3523 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:21.148366  3459 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:21.118010  3511 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:21.161453 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.090929  3500 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:21.066488  3408 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:21.118505  3503 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.101765  3530 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:21.104647  3522 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:21.135969  3508 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:21.135488  3499 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:14:21.180325 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 68231.1us
I20260709 13:14:21.167438  3495 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:21.181630  3500 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.182447  3521 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:21.180081  3501 raft_consensus.cc:993] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801: : Instructing follower 94085cf341634eb686a95983b6b7f7e6 to start an election
I20260709 13:14:21.184338   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:21.184489  3540 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:21.143476  3506 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.146844  3507 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:21.185415  3511 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:21.185952  3516 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:21.187070  3529 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:21.215822 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:14:21.190140  3494 log.cc:927] Time spent T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:14:21.267352   400 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:21.187500  3505 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.177734  3538 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.288357 32190 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:21.218508  3435 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:21.140719  3509 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:21.199062  3408 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:21.286141  3521 raft_consensus.cc:1081] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Signalling peer 94085cf341634eb686a95983b6b7f7e6 to start an election
I20260709 13:14:21.144954  3524 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.260200  3495 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:21.261353  3508 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.283558  3522 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.262904  3499 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:21.197713  3523 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.343423  3535 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:21.344061  3509 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.289487  3540 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.346379 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.344310  3495 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:21.292341  3511 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.300923  3475 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:21.261075  3530 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.307693  3510 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.344061  3535 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.365664  3510 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:21.365903  3540 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.365159  3506 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.366477  3540 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:21.367147  3506 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:21.367678  3506 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:21.368335  3524 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.296394  3516 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.369901  3506 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:21.370639  3522 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.370848  3516 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:21.373313  3535 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.304229 32162 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
W20260709 13:14:21.359937   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 69748.6us
I20260709 13:14:21.356048 32197 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 9.
I20260709 13:14:21.360448  3543 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:21.354676  3409 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.439154  3548 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:21.362149  3530 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:21.344413  3523 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.446550 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.294278  3529 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.363694  3544 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:21.356617  3518 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:21.440899  3505 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:21.364377  3511 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:21.366240  3510 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.452826  3396 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:21.454488  3510 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.365139  3459 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:21.297859  3507 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.458761   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:21.309433  3515 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.361351  3519 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.362215  3504 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:21.383050 32162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 78890.2us
I20260709 13:14:21.353001  3435 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:21.442802  3543 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.437990  3508 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:14:21.401378 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 159232us
I20260709 13:14:21.486984   402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75"
dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
 from {username='slave'} at 127.0.0.1:38176
I20260709 13:14:21.353221  3509 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:21.488754  3551 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:21.488927  3509 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.489289  3551 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.491154  3509 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.358544  3542 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:21.491792  3553 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:21.491873  3542 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:21.493233  3546 log.cc:927] Time spent T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:14:21.494508  3542 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:21.495582  3529 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:21.495520   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:21.496793  3502 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.497365   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:21.498896   397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:21.499577   397 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:14:21.382562  3538 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.351475  3536 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:21.365049  3408 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.460793   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:21.479259 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.504354 32116 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:21.479482  3507 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.484452  3511 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:21.367164  3540 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.482532 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.449586  3530 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:21.487564   402 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:21.491356  3551 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:21.501432   368 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:21.449086  3548 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.535131  3513 raft_consensus.cc:2804] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:21.535502  3513 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:21.535861  3513 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:21.452548  3505 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:21.478367  3545 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:21.550688  3505 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:21.550859  3545 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.552790  3507 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:21.553189  3545 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.492403  3553 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.555398  3553 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.480504   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:21.554076  3507 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.515944  3512 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:21.516533 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.517254 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.517463 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.488104  3435 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.460903  3544 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.518069 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.519485  3543 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:21.519762 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.512944  3518 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:21.508116  3508 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:21.500164  3500 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.521270 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.564849 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.521847  3542 raft_consensus.cc:993] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:21.521502  3511 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.523294 32020 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49556 (request call id 240) took 1006 ms. Trace:
I20260709 13:14:21.518898 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:21.526252 32121 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
I20260709 13:14:21.527357 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.527479 32238 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:21.529629   402 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:21.530042  3530 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.530334 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.523314  3520 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:21.600883  3520 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.603077  3520 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.528645  3529 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:21.534061  3499 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:21.536101  3548 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.538205   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:21.538861  3538 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:21.609640 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.609977  3538 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.611603 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.612176  3538 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.539569  3526 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:21.612318 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.612784  3529 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.612824  3526 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:21.614689 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.614988  3529 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:21.615113  3526 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:21.540292  3555 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:21.615772  3555 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.616999 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.618479  3507 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.618831  3555 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.618959 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.540947  3523 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:21.619946  3523 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.622272   369 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:21.622591  3523 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.541852  3552 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:21.623051  3496 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:21.623347  3552 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.549628  3513 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:21.626221  3552 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.541949  3540 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.542883  3396 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:21.627168  3396 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.627453 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.627900 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.628647 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.628938 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.629217  3396 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:21.543637  3549 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:14:21.544139 32294 debug-util.cc:398] Leaking SignalData structure 0x7b0800323a00 after lost signal to thread 30975
I20260709 13:14:21.629688 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.629930 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:14:21.630805 32294 debug-util.cc:398] Leaking SignalData structure 0x7b08001e7260 after lost signal to thread 32056
I20260709 13:14:21.544981  3539 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:21.631636 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:14:21.632078 32294 debug-util.cc:398] Leaking SignalData structure 0x7b08001d8d00 after lost signal to thread 32148
I20260709 13:14:21.549643 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.544838  3554 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:21.588793 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.633075 32117 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 14.
I20260709 13:14:21.632836  3554 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.633181 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.634264 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.635025  3554 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:21.537173 32236 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:21.635270 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.635816 32268 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:14:21.564270 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.636389 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.566625  3508 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:21.637125 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.638286 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.567795  3543 raft_consensus.cc:1081] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:21.573050 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.574278  3511 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:21.565977 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.576992 32238 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:21.629941  3549 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:14:21.639909 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.577463 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.640753 32270 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
I20260709 13:14:21.581197  3435 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:21.581053 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.582181  3556 ts_tablet_manager.cc:933] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.641654 32266 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:14:21.641798 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.642366 32270 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:14:21.642529 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.643159 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.643594 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.643703 32270 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:21.576161 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.644620 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.583127 32134 tablet_copy_service.cc:140] P fcfc3281929645969ecedbb0c0af759d: Received BeginTabletCopySession request for tablet ddd7dfc158794e3ab7427d0b86b46c8d from peer 94085cf341634eb686a95983b6b7f7e6 ({username='slave'} at 127.0.0.1:55358)
I20260709 13:14:21.583069  3505 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:21.577533  3542 raft_consensus.cc:2804] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:21.644996 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.645430 32134 tablet_copy_service.cc:161] P fcfc3281929645969ecedbb0c0af759d: Beginning new tablet copy session on tablet ddd7dfc158794e3ab7427d0b86b46c8d from peer 94085cf341634eb686a95983b6b7f7e6 at {username='slave'} at 127.0.0.1:55358: session id = 94085cf341634eb686a95983b6b7f7e6-ddd7dfc158794e3ab7427d0b86b46c8d
I20260709 13:14:21.645520  3542 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:21.646054  3542 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:21.646811  3505 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:21.647504 32199 raft_consensus.cc:1240] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:21.648031  3549 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:21.581835  3518 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:21.649286 32294 debug-util.cc:398] Leaking SignalData structure 0x7b08001e2340 after lost signal to thread 32223
W20260709 13:14:21.650430 32294 debug-util.cc:398] Leaking SignalData structure 0x7b08003cde20 after lost signal to thread 32297
I20260709 13:14:21.650352  3518 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.509174  3536 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.590938 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.586925 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.652632  3536 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.650911   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:21.653182 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.654561 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.655855 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.592111 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.588097 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.599076 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.658557 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.590260 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.631592  3539 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.660559  3542 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.545274  3459 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:21.562247 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.661731 32272 raft_consensus.cc:2393] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 7: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:21.661625 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.662358 32124 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:21.638659  3508 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:21.640269 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.640882 32271 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
I20260709 13:14:21.598500 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.649153 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.661198  3539 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:21.585644 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.661556  3459 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:21.650919 32294 debug-util.cc:398] Leaking SignalData structure 0x7b08003494a0 after lost signal to thread 32298
I20260709 13:14:21.667299  3459 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:21.667734 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:14:21.668362 32294 debug-util.cc:398] Leaking SignalData structure 0x7b08002a6200 after lost signal to thread 427
I20260709 13:14:21.663570 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.668321 32115 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:21.668282 32273 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
I20260709 13:14:21.669683 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.670234  3513 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:21.568106 32020 rpcz_store.cc:276] 0709 13:14:20.517102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.517259 (+   157us) service_pool.cc:224] Handling call
0709 13:14:21.523216 (+1005957us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:20.801278 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:20.801668 (+   390us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:20.801692 (+    24us) write_op.cc:435] Acquired schema lock
0709 13:14:20.801703 (+    11us) tablet.cc:662] Decoding operations
0709 13:14:20.801941 (+   238us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:20.801994 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:20.802011 (+    17us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:14:20.802177 (+   166us) tablet.cc:701] Row locks acquired
0709 13:14:20.802200 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:14:20.802324 (+   124us) write_op.cc:270] Start()
0709 13:14:20.802418 (+    94us) write_op.cc:276] Timestamp: P: 1783602860802288 usec, L: 0
0709 13:14:20.802432 (+    14us) op_driver.cc:348] REPLICATION: starting
0709 13:14:20.802913 (+   481us) log.cc:844] Serialized 591 byte log entry
0709 13:14:21.150157 (+347244us) op_driver.cc:464] REPLICATION: finished
0709 13:14:21.497349 (+347192us) write_op.cc:301] APPLY: starting
0709 13:14:21.497440 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:21.497534 (+    94us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:21.497670 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:21.497905 (+   235us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:21.498074 (+   169us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:14:21.498116 (+    42us) write_op.cc:312] APPLY: finished
0709 13:14:21.498295 (+   179us) log.cc:844] Serialized 23 byte log entry
0709 13:14:21.498461 (+   166us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:21.498538 (+    77us) write_op.cc:454] Released schema lock
0709 13:14:21.498576 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:21.498914 (+   338us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:21.498943 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":317135,"apply.run_cpu_time_us":1561,"apply.run_wall_time_us":10711,"num_ops":1,"prepare.queue_time_us":15931,"prepare.run_cpu_time_us":32200,"prepare.run_wall_time_us":73066,"raft.queue_time_us":190174,"raft.run_cpu_time_us":29607,"raft.run_wall_time_us":322598,"replication_time_us":320137,"thread_start_us":540463,"threads_started":4,"wal-append.queue_time_us":127411}]]}
I20260709 13:14:21.666991 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.671717 32116 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
I20260709 13:14:21.672744 32269 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:14:21.674239 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.674855 32117 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:14:21.675282   369 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:21.676505 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:21.676997 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:21.597467  3544 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.678934  3513 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:21.681691  3513 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:21.680451   369 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:21.681846 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 152176us
I20260709 13:14:21.682417  3511 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:21.630725 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.599184  3494 tablet_bootstrap.cc:492] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:21.680013  3530 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:21.644536 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:21.683223 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 106313us
I20260709 13:14:21.686313   402 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:21.687453  3543 raft_consensus.cc:2804] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:21.691349   369 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:21.691510   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:21.696611 32270 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:14:21.698575   403 raft_consensus.cc:1240] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:21.692380  3513 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:21.704986  3408 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:21.692369  3496 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:21.699455  3543 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:21.706241  3543 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:21.706890 32134 tablet_copy_source_session.cc:215] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:21.707350 32238 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:21.708127 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.708906 32238 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:21.692705  3511 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:21.709733  3511 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:21.710438  3508 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:21.711196  3508 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:21.711825  3494 tablet_bootstrap.cc:492] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap complete.
I20260709 13:14:21.712568  3494 ts_tablet_manager.cc:1403] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6: Time spent bootstrapping tablet: real 1.089s	user 0.052s	sys 0.029s
I20260709 13:14:21.709275 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:21.713587 32194 raft_consensus.cc:3055] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:21.715565 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.715857  3505 consensus_queue.cc:1059] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:21.717753   402 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.717392  3494 raft_consensus.cc:359] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:21.718329  3494 raft_consensus.cc:740] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Initialized, Role: LEARNER
I20260709 13:14:21.719036  3494 consensus_queue.cc:260] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:21.713822 32194 raft_consensus.cc:740] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:21.717530 32238 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:21.724309  3508 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:21.724097 32194 consensus_queue.cc:260] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:21.724821  3508 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:21.725282  3508 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:21.725464 32194 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:21.727864 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.730065 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.730684 32119 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:14:21.732805  3492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd7dfc158794e3ab7427d0b86b46c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:21.732941 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.733531 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.734124 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.740098 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.741984 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.742194 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.743312 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.745155 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.745329  3542 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:21.741302 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.746201 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.746690 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.747677 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.748992  3556 tablet_copy_client.cc:323] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Beginning tablet copy session from remote peer at address 127.30.63.3:36651
I20260709 13:14:21.749799 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.750007 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.751123 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.752745 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.753954 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.755975 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.757046 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:21.757275 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.757658 32268 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:21.759588 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.760732 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.760844 32197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:14:21.761673 32197 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:21.762043 32197 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:21.761089 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.765204  3513 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:21.766422  3511 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:21.767553  3543 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:21.796072 32269 raft_consensus.cc:1240] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:21.796675  3511 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:21.769222 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.770315 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.770529 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.770622 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.771055 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.771313 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.771865 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.772994 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.773689 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.800256 32116 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
I20260709 13:14:21.774395 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.801116 32121 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:21.802219 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.800275   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:21.803813   402 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:21.774847  3508 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.775110 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.776744 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.798363 32282 tablet_copy_service.cc:140] P 6b3ed521ce8947db80c4b4828b355c06: Received BeginTabletCopySession request for tablet 0cf85dc23ac44824a3668eb1b1f3aa42 from peer 94085cf341634eb686a95983b6b7f7e6 ({username='slave'} at 127.0.0.1:50584)
I20260709 13:14:21.805696 32282 tablet_copy_service.cc:161] P 6b3ed521ce8947db80c4b4828b355c06: Beginning new tablet copy session on tablet 0cf85dc23ac44824a3668eb1b1f3aa42 from peer 94085cf341634eb686a95983b6b7f7e6 at {username='slave'} at 127.0.0.1:50584: session id = 94085cf341634eb686a95983b6b7f7e6-0cf85dc23ac44824a3668eb1b1f3aa42
I20260709 13:14:21.804955 32118 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:21.806066 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.806725 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.807145 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.807284 32118 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:14:21.808135 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.779644 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.799790 32117 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:14:21.780411 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.781407 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.810977 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.811877  3492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:38184 (request call id 234) took 2455 ms. Trace:
I20260709 13:14:21.802997 32119 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
I20260709 13:14:21.813210 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.783274 32194 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 8.
I20260709 13:14:21.783895 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.788932 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.763115 32165 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:21.814309 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.793459   369 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:21.814873 32116 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
I20260709 13:14:21.808197 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.794797 32268 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 8.
I20260709 13:14:21.769733 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.833755 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.777078 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.815734   369 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:21.817894 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.837009 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.838411 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.813526 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.834703 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.793701 32197 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:21.838374 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.815773   368 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:21.854983   369 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:21.853001 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.855849 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.832775  3499 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:21.852254  3408 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:21.860785 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.861060  3495 raft_consensus.cc:2804] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:21.861580  3495 raft_consensus.cc:697] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 8 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:21.861771 32282 tablet_copy_source_session.cc:215] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:21.862454 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.862527  3495 consensus_queue.cc:237] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:21.864008 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.860811 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.796703  3543 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:21.871340 32190 raft_consensus.cc:1240] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:21.836859  3508 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:14:21.845953 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 82903.6us
I20260709 13:14:21.860244 32264 raft_consensus.cc:1240] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:21.876423 32197 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:21.832499  3496 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:14:21.832963  3505 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:14:21.883852 32272 raft_consensus.cc:1240] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:21.870337   402 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:14:21.859073 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.871927 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.872119   369 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:21.885073 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:14:21.859230   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 43566.3us
I20260709 13:14:21.880963 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:21.886310 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.886833 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.886682 32236 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:21.888031 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.888047 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.889046   369 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:21.890690 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.890785  3532 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:21.892179  3532 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:21.892725 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.893060 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.893831 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.894381  3543 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:21.895612  3494 ts_tablet_manager.cc:1434] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6: Time spent starting tablet: real 0.183s	user 0.007s	sys 0.000s
I20260709 13:14:21.896209  3543 raft_consensus.cc:697] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:21.886473  3408 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:21.897135  3543 consensus_queue.cc:237] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:21.899099 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:21.900128 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:21.899847  3513 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:21.900856 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:21.812258  3492 rpcz_store.cc:276] 0709 13:14:19.356783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:19.356945 (+   162us) service_pool.cc:224] Handling call
0709 13:14:19.393814 (+ 36869us) ts_tablet_manager.cc:934] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339)
0709 13:14:21.731329 (+2337515us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:14:21.784354 (+ 53025us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:21.784476 (+   122us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:14:21.811170 (+ 26694us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:14:21.811457 (+   287us) tablet_replica.cc:206] Creating consensus instance
0709 13:14:21.811747 (+   290us) ts_tablet_manager.cc:989] Replica registered.
0709 13:14:21.811799 (+    52us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":10733,"tablet-copy.queue_time_us":35809,"thread_start_us":1021205,"threads_started":2}
I20260709 13:14:21.903815  3518 consensus_queue.cc:1059] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:21.909042  3518 raft_consensus.cc:3055] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:21.909399  3518 raft_consensus.cc:740] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:21.910184  3518 consensus_queue.cc:260] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:21.911391  3518 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:21.925355  3492 tablet_copy_client.cc:806] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:21.927114  3492 tablet_copy_client.cc:670] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:21.933568 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:21.939210   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 50221.4us
I20260709 13:14:21.941267 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.943980  3556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cf85dc23ac44824a3668eb1b1f3aa42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:21.959635 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.976804 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.977954 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:21.978820 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.985852 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.992897 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.995482 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:21.992980 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.997164 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.997799 32165 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:22.001065 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:22.001152 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:21.989194 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:22.002300 32165 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:22.002965  3505 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:22.003314 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:22.003417  3505 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:22.003953  3505 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:22.007902  3500 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:22.008375  3500 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:22.008755  3539 consensus_queue.cc:1059] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:22.009933  3459 raft_consensus.cc:3055] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:22.010282  3459 raft_consensus.cc:740] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:22.011211   402 raft_consensus.cc:1217] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.5->[11.6-11.6]   Dedup: 11.6->[]
I20260709 13:14:22.011075  3459 consensus_queue.cc:260] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:22.012274  3459 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:22.012794 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:22.012972 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:22.013177 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:22.014282 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:22.016614 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:22.018760   369 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.019989 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:22.025763 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:22.026341 32090 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.029337 32090 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.034029  3492 tablet_copy_client.cc:538] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:22.035580  3544 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:22.036765  3555 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:22.039136 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:22.039388 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:22.040477 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:22.040870 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:22.041121 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:22.041653 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:22.041910 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:22.042279 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:22.043032 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:22.043071  3540 consensus_queue.cc:1059] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:22.008764  3500 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:22.044318  3523 raft_consensus.cc:3055] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:22.044718  3523 raft_consensus.cc:740] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:22.044821 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:22.045535  3523 consensus_queue.cc:260] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:22.046676 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:22.046947 32090 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.047945  3555 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:22.049202 32090 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.050796 32090 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.052362 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:22.054708 32090 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.050736 32020 catalog_manager.cc:5697] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 7 to 8, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 8 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:22.059108 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:22.061507  3510 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:22.062427 32282 tablet_copy_service.cc:342] P 6b3ed521ce8947db80c4b4828b355c06: Request end of tablet copy session 94085cf341634eb686a95983b6b7f7e6-64767c8d367b4cc1b7e2ffbcbf73ce29 received from {username='slave'} at 127.0.0.1:50584
I20260709 13:14:22.032699  3558 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:14:22.062883 32282 tablet_copy_service.cc:434] P 6b3ed521ce8947db80c4b4828b355c06: ending tablet copy session 94085cf341634eb686a95983b6b7f7e6-64767c8d367b4cc1b7e2ffbcbf73ce29 on tablet 64767c8d367b4cc1b7e2ffbcbf73ce29 with peer 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:22.053942  3518 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:22.070191 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:22.076455   402 raft_consensus.cc:1240] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:22.078078 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:22.078815   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:22.080861 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:22.052331  3555 raft_consensus.cc:2749] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:22.085218 32090 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.101977 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:22.102331  3500 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:22.106806 32090 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.108106 32090 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.110700 32273 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
W20260709 13:14:22.082582 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 80337us
I20260709 13:14:22.112423 32165 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:22.112254 32239 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.109532  3552 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:22.119369  3542 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:22.120493  3526 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:22.120963 32090 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.121899  3526 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:22.122252 32090 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.123584 32090 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.126746 32090 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.128002 32165 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:22.130854 32090 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.131870 32165 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:22.111397  3518 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:22.136281 32239 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.132669  3499 raft_consensus.cc:2804] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:22.138062  3502 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:22.140883 32239 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.141906 32090 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.139644 32022 catalog_manager.cc:5697] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 6 to 7, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 7 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:22.128937  3536 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:22.152602 32239 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.130234  3538 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:22.138918  3555 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:22.155862 32165 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
W20260709 13:14:22.158468 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:22.130439  3561 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:22.157932 32239 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.148432  3499 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:22.147267  3540 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:22.149016  3549 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:22.148840  3502 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:22.164305 32239 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.152969  3543 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:22.169116 32239 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.170684 32239 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.176826  3554 raft_consensus.cc:2749] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:22.164466  3530 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:22.169948  3516 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:22.161949  3539 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:22.159704  3518 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:22.182399 32239 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.160845  3561 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:22.165220  3499 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:22.169018  3502 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:22.193960 32239 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.195609 32239 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.156651  3500 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:22.197578 32239 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.187496  3516 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:14:22.201882 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 46120.5us
I20260709 13:14:22.203564 32239 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.195182  3543 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:22.194430  3561 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:22.205718 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 63954.6us
I20260709 13:14:22.227946 32090 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.228960  3526 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:22.230394 32090 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.231184  3526 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:22.196645  3508 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:22.212706  3435 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:22.234059  3505 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:22.204891  3500 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:22.214432  3492 tablet_bootstrap.cc:492] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6: Bootstrap starting.
I20260709 13:14:22.249650   403 raft_consensus.cc:1240] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:22.198733  3530 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:22.214772  3523 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:22.253798 32239 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.258114  3530 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:22.204386  3539 raft_consensus.cc:2749] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:22.232559 32090 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.260362 32239 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.264321 32239 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.265676 32090 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.268203 32239 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.270083 32090 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:14:22.271621 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 118127us
I20260709 13:14:22.274793 32090 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:14:22.275283 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 70287us
I20260709 13:14:22.276953 32239 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.276414 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:22.278730 32087 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:22.278663 32239 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.281217 32239 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.263299  3555 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:22.283613 32239 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.280340  3511 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:22.271433  3518 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:22.275054  3508 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:22.272802  3435 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:22.279065  3549 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:22.275584  3505 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:22.309475 32239 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.304947 32090 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.310333  3554 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:22.280645  3540 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:22.274739  3510 consensus_queue.cc:1059] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:14:22.282593  3542 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:22.320777 32090 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.267285  3544 consensus_queue.cc:1059] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:14:22.323432 32239 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.283851  3539 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:22.282502  3538 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:22.339512  3518 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:22.283494  3566 consensus_queue.cc:1059] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:14:22.329875  3561 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:22.347572  3561 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:22.332965  3475 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:22.338744 32239 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.349013 32193 raft_consensus.cc:1275] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:14:22.349284 32239 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.350507 32239 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.350785  3549 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:22.350697  3408 consensus_queue.cc:1048] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:22.351423  3530 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:22.351574  3435 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:22.351789 32239 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.352691  3435 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:14:22.339891 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 61507.1us
I20260709 13:14:22.355508 32087 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:22.355336  3499 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:22.356752  3536 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:22.357585  3536 raft_consensus.cc:3055] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:22.357954  3536 raft_consensus.cc:740] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:22.358779  3536 consensus_queue.cc:260] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:22.360092  3536 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:22.363363 32087 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:22.368669 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:22.369580 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:22.370340 32119 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:22.371894 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 51226.2us
I20260709 13:14:22.372687 32090 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.326579  3563 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:22.341581  3510 raft_consensus.cc:3055] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:22.341975  3459 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:22.373570 32090 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.379484 32090 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.378595  3510 raft_consensus.cc:740] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:22.376658  3564 raft_consensus.cc:2749] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:22.378425  3555 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:14:22.384195 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 73820.3us
I20260709 13:14:22.386050 32090 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.383932  3552 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:22.383024  3544 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:22.383196  3526 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:22.367038  3569 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:22.406406 32090 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.390093 32119 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:22.402405 32165 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:22.412827 32239 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.413626 32122 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
I20260709 13:14:22.416083  3499 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:22.418525  3518 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:22.427973  3435 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:14:22.428892  3518 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:22.381945  3510 consensus_queue.cc:260] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:22.430605  3502 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:22.432819 32239 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.434278  3542 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:22.435412  3502 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:22.434284  3567 raft_consensus.cc:3055] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:22.438129  3567 raft_consensus.cc:740] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:22.439034   403 raft_consensus.cc:1275] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:14:22.440690  3435 consensus_queue.cc:1048] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:22.429114 32090 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.449766 32090 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.429111  3556 tablet_copy_client.cc:806] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:22.423141  3569 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:22.457345  3569 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:22.454448 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 52122.8us
I20260709 13:14:22.454365  3555 raft_consensus.cc:2749] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:22.455030  3518 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:22.462733 32264 raft_consensus.cc:1240] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:22.448688  3567 consensus_queue.cc:260] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:22.466185  3567 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:22.473431  3556 tablet_copy_client.cc:670] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:22.476866  3510 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:22.478012  3502 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:22.481233  3502 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:22.481774  3502 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:22.458787 32165 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:22.488806  3565 raft_consensus.cc:2804] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:22.489262  3565 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:22.489689  3565 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:22.490715 32264 raft_consensus.cc:1275] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:14:22.492985  3556 tablet_copy_client.cc:538] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:22.496204 32165 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:22.496680 32123 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:14:22.498098  3499 raft_consensus.cc:2804] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:22.498520  3499 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:22.498917  3499 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:22.498970  3515 consensus_queue.cc:1048] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:22.502102 32124 raft_consensus.cc:1275] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:14:22.507140  3569 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:22.509819  3569 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:22.512805 32165 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:22.517238  3565 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:14:22.519344  3565 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:22.520229  3566 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:22.520830  3566 raft_consensus.cc:697] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:22.522661  3566 consensus_queue.cc:237] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:22.526732  3555 consensus_queue.cc:1059] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:22.538129 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:22.540689 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:22.541365 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:22.544031 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:22.546177 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:22.547956 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:22.549953  3554 consensus_queue.cc:1048] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:22.552948 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:22.553092 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:22.554214 32269 raft_consensus.cc:2393] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 8: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:22.558243 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:22.560717 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:22.563597 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:22.566741 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:22.576153 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:22.577741 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:22.585652 32122 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
I20260709 13:14:22.589761  3499 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:22.590770 32165 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.30.63.1:42339 timed out after 1.502s (SENT)
I20260709 13:14:22.602363  3523 raft_consensus.cc:3055] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:22.615427  3523 raft_consensus.cc:740] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:22.640679  3523 consensus_queue.cc:260] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:22.644697  3523 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:22.641256  3499 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:22.679968 32165 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.681244  3502 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:22.683068  3502 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:22.686213  3435 raft_consensus.cc:1064] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:14:22.686949  3556 tablet_bootstrap.cc:492] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap starting.
I20260709 13:14:22.688825  3499 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:22.689258  3499 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:22.689643  3499 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:22.716919 32165 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.732790  3569 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:22.733256  3569 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:22.733629  3569 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:22.741577 32021 catalog_manager.cc:5697] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 9 to 10, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 10 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:22.745568 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:22.752354 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:22.698441  3499 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:22.758111 32165 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.760664  3567 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:22.761101  3567 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:22.761497  3567 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:22.761732  3499 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:22.757902  3435 consensus_queue.cc:237] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 4, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:22.774001 32165 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.778565 32165 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.779395  3499 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:22.779728 32165 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.785581  3500 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:22.786155  3500 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:22.786582  3500 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:22.794518   402 raft_consensus.cc:1240] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:22.796505  3510 consensus_queue.cc:1059] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:22.797636  3570 raft_consensus.cc:3055] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:22.798018  3570 raft_consensus.cc:740] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:22.798825  3570 consensus_queue.cc:260] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:22.800019  3570 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:22.803709  3500 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:22.804857  3567 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:22.806888  3567 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:22.846063  3569 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:22.847615 32193 raft_consensus.cc:1240] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:22.856017   402 raft_consensus.cc:1275] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 11 LEARNER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:22.857749  3539 consensus_queue.cc:1048] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:22.864895  3572 raft_consensus.cc:2764] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 13:14:22.866627 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 86973.8us
I20260709 13:14:22.869587 32123 raft_consensus.cc:1275] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:22.870316 32165 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.871184  3567 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:22.871194  3549 consensus_queue.cc:1059] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:22.871757  3567 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:22.872203  3567 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:22.872524  3549 raft_consensus.cc:3055] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:22.872376  3508 consensus_queue.cc:1048] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:22.873027  3549 raft_consensus.cc:740] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:22.874008  3549 consensus_queue.cc:260] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:22.875555  3549 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:22.877699 32193 raft_consensus.cc:1275] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:22.879189 32165 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.880856 32165 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.881963 32165 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.883553  3565 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:22.884038  3565 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:22.884795  3566 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:22.885083  3500 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:22.885273  3566 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:22.885818  3566 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:22.885871  3500 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:22.886456  3500 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:22.884449  3565 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:22.894256 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:22.883584 32165 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.901631  3572 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:22.902134  3572 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:22.902770  3572 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:22.909366 32165 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.913545  3561 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:22.914403  3561 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:22.914783  3561 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:22.921231 32165 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.923739 32165 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:22.886824  3500 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:22.923026  3505 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:22.927024  3505 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:22.929510  3505 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:22.930878  3502 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:22.931347  3502 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:22.932099  3502 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:22.912084  3565 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:22.915673  3566 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:22.944618  3572 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:22.923805  3499 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:22.919515  3549 consensus_queue.cc:1048] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:14:22.969677  3572 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:22.970247  3566 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:22.928287  3569 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:22.970435  3565 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:22.977571 32193 raft_consensus.cc:1240] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 13:14:22.972675  3492 log.cc:927] Time spent T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.064s	user 0.003s	sys 0.002s
W20260709 13:14:22.981962 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:22.965481  3510 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:14:22.984573 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 60919.5us
I20260709 13:14:22.977635  3570 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:22.986456 32165 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:22.982834  3508 consensus_queue.cc:1059] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:14:22.990507  3508 raft_consensus.cc:3055] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:22.990931  3508 raft_consensus.cc:740] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:22.991909  3508 consensus_queue.cc:260] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:22.995450  3508 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:22.995519  3492 tablet_bootstrap.cc:492] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:22.996639  3492 tablet_bootstrap.cc:492] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6: Bootstrap complete.
I20260709 13:14:22.997376  3492 ts_tablet_manager.cc:1403] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6: Time spent bootstrapping tablet: real 0.783s	user 0.032s	sys 0.017s
I20260709 13:14:22.987550  3510 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:22.999418  3567 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.000464 32199 raft_consensus.cc:1240] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:23.000478  3510 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:23.002002 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:23.004211  3549 consensus_queue.cc:1059] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:23.006707 32165 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:23.005260  3549 raft_consensus.cc:3055] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:23.008553  3592 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:23.009080  3592 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:23.010010  3592 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:23.008371  3505 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:23.011092 32165 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:23.008843  3549 raft_consensus.cc:740] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:23.004231  3492 raft_consensus.cc:359] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:22.988461  3570 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.008392  3499 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:23.013340  3565 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:23.010764  3510 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:23.048717  3592 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.034300 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:23.041839  3505 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:23.042619  3570 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:23.044348 32196 raft_consensus.cc:1240] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:23.080288 32199 raft_consensus.cc:1240] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:23.045074  3561 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.081161 32193 raft_consensus.cc:1240] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:23.046198  3549 consensus_queue.cc:260] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.048414  3567 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:23.028250  3500 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.050341  3510 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.082481  3561 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:23.083040  3549 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:23.033165 32165 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:23.048794  3492 raft_consensus.cc:740] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Initialized, Role: LEARNER
I20260709 13:14:23.049990  3502 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.057446 32194 raft_consensus.cc:1240] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:23.062754 32191 raft_consensus.cc:1240] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:23.045197 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:23.085970  3561 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:23.086853  3561 raft_consensus.cc:697] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 11 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:23.088812  3508 consensus_queue.cc:1059] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:23.089901  3508 raft_consensus.cc:3055] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:23.090222  3508 raft_consensus.cc:740] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:23.090644  3592 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:23.083694  3500 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:23.088411  3561 consensus_queue.cc:237] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:23.090744  3510 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:23.093219 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:23.095093 32197 raft_consensus.cc:1240] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:23.096354  3502 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:23.097352 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 64278.9us
I20260709 13:14:23.097812  3475 consensus_queue.cc:1059] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:23.100857  3492 consensus_queue.cc:260] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:23.103513  3492 ts_tablet_manager.cc:1434] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6: Time spent starting tablet: real 0.106s	user 0.006s	sys 0.001s
I20260709 13:14:23.105443  3475 raft_consensus.cc:3055] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:23.105844  3475 raft_consensus.cc:740] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:23.114678 32165 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:23.115738  3502 raft_consensus.cc:2804] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:23.116421  3502 raft_consensus.cc:697] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:23.122831 32197 raft_consensus.cc:1240] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:23.125128 32197 raft_consensus.cc:1240] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:23.117775  3502 consensus_queue.cc:237] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:23.129940 32197 raft_consensus.cc:1240] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:23.132449 32197 raft_consensus.cc:1240] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:23.134260 32197 raft_consensus.cc:1240] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:23.139319 32197 raft_consensus.cc:1240] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:23.140786 32194 raft_consensus.cc:1240] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:23.141292 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:23.142709 32193 raft_consensus.cc:1240] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:23.149291 32191 raft_consensus.cc:1240] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:23.150050 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:23.153877 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:23.156694 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:23.152462 32134 tablet_copy_service.cc:342] P fcfc3281929645969ecedbb0c0af759d: Request end of tablet copy session 94085cf341634eb686a95983b6b7f7e6-ddd7dfc158794e3ab7427d0b86b46c8d received from {username='slave'} at 127.0.0.1:55358
I20260709 13:14:23.159632 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:23.160032 32134 tablet_copy_service.cc:434] P fcfc3281929645969ecedbb0c0af759d: ending tablet copy session 94085cf341634eb686a95983b6b7f7e6-ddd7dfc158794e3ab7427d0b86b46c8d on tablet ddd7dfc158794e3ab7427d0b86b46c8d with peer 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:23.160491 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:23.161536  3542 consensus_queue.cc:1059] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:23.154971  3508 consensus_queue.cc:260] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.173218 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:23.175838 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:23.182775 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:23.186074 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:23.194710 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:23.195154 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:23.196955 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:23.199885 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:23.200198 32124 raft_consensus.cc:1275] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:23.175658  3435 raft_consensus.cc:3055] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:23.203110  3435 raft_consensus.cc:740] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:23.204233  3435 consensus_queue.cc:260] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.205567 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:23.214519 32021 catalog_manager.cc:5697] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 10 to 11, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 11 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:23.220815  3508 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:23.220705  3475 consensus_queue.cc:260] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.221915 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:23.222543  3475 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:23.227216 32270 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
W20260709 13:14:23.228024 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 88295.2us
I20260709 13:14:23.231241 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:23.234452 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:14:23.235213 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 66222.3us
I20260709 13:14:23.236956 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:23.237708 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:23.230269  3584 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.255724 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:23.255966 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:23.257632 32269 raft_consensus.cc:2410] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:14:23.261245 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:23.268975 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:23.281078 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:23.281078 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:23.282291 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:23.283568 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:23.238044  3596 consensus_queue.cc:1059] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:14:23.285563 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:23.284317 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:23.286815 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:23.284983 32197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:14:23.287448 32197 raft_consensus.cc:606] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:23.288110  3435 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:23.289481 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:23.292428  3570 consensus_queue.cc:1059] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:23.293011  3596 raft_consensus.cc:3055] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:23.293474  3570 raft_consensus.cc:3055] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:23.293992  3570 raft_consensus.cc:740] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:23.294384 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:23.293604  3596 raft_consensus.cc:740] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:23.301913  3596 consensus_queue.cc:260] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.303951 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:23.305799 32270 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
W20260709 13:14:23.312045 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 51469us
I20260709 13:14:23.313944  3596 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:23.256616  3584 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:23.322592 32191 raft_consensus.cc:1240] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:23.319473 32197 raft_consensus.cc:1240] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:23.322901 32165 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:23.320272  3597 log.cc:927] Time spent T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:14:23.349403 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:23.301937  3570 consensus_queue.cc:260] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.329221  3500 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:14:23.312119  3539 consensus_queue.cc:1059] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:14:23.352072  3539 raft_consensus.cc:3055] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:23.352419  3539 raft_consensus.cc:740] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:23.352902 32268 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
I20260709 13:14:23.353329  3539 consensus_queue.cc:260] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.354579  3539 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:23.331346 32165 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:23.273528  3595 consensus_queue.cc:1059] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:14:23.357709  3595 raft_consensus.cc:3055] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:23.358095  3595 raft_consensus.cc:740] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:23.358982  3595 consensus_queue.cc:260] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.344600  3510 consensus_queue.cc:1059] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:23.322230  3523 consensus_queue.cc:1059] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:14:23.345330  3584 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:14:23.356654  3600 consensus_queue.cc:1175] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fcfc3281929645969ecedbb0c0af759d" responder_term: 9 status { last_received { term: 9 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 9 index: 6 } }
I20260709 13:14:23.363868 32165 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:23.360538  3595 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:23.372687  3500 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:23.384951 32165 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:23.365857 32264 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
W20260709 13:14:23.374112 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:23.383296 32197 raft_consensus.cc:1240] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:23.392823 32269 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
W20260709 13:14:23.394963 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 156540us
I20260709 13:14:23.394387  3592 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:23.397569  3523 raft_consensus.cc:3055] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:23.398006  3523 raft_consensus.cc:740] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:23.403405 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:23.394914 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:23.404661 32122 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 10.
I20260709 13:14:23.405006 32264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:23.405656 32264 raft_consensus.cc:606] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:14:23.405357 32165 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:23.406056 32264 raft_consensus.cc:614] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:23.387482  3502 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:23.411255  3542 consensus_queue.cc:1059] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:23.411358  3523 consensus_queue.cc:260] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.413743  3542 raft_consensus.cc:3055] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:23.414258  3542 raft_consensus.cc:740] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:23.415191  3542 consensus_queue.cc:260] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.407332  3500 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:23.416793  3542 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:23.406775  3435 consensus_queue.cc:1059] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:14:23.417738  3435 raft_consensus.cc:3055] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:23.418098  3435 raft_consensus.cc:740] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:23.419445 32165 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:23.400399  3600 consensus_queue.cc:1059] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:14:23.420886  3499 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:23.421026  3600 raft_consensus.cc:3055] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:23.408685  3567 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:23.421545  3600 raft_consensus.cc:740] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:23.406940  3570 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:23.423638   369 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:23.421422  3499 raft_consensus.cc:697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:23.422472  3600 consensus_queue.cc:260] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:23.425629  3584 raft_consensus.cc:2804] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:23.426136  3584 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:23.426573  3584 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:23.426311  3499 consensus_queue.cc:237] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.428777  3435 consensus_queue.cc:260] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.425164 32165 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:23.430920 32165 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:23.431659  3567 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:23.457758  3567 raft_consensus.cc:697] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:23.458283  3561 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:23.431245  3604 raft_consensus.cc:3055] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:23.459293  3604 raft_consensus.cc:740] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:23.439534 32196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bdc1594189c43f49251261c5d073447"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:14:23.457931 32165 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:23.460039 32196 raft_consensus.cc:606] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:23.458300 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 135463us
I20260709 13:14:23.446687  3435 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:23.465775  3523 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:23.447463  3556 tablet_bootstrap.cc:492] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=1 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:23.458721  3567 consensus_queue.cc:237] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.467037  3556 tablet_bootstrap.cc:492] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap complete.
I20260709 13:14:23.434473  3600 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:23.467859  3556 ts_tablet_manager.cc:1403] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6: Time spent bootstrapping tablet: real 0.781s	user 0.039s	sys 0.010s
I20260709 13:14:23.442162  3584 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:23.459645  3561 raft_consensus.cc:697] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:23.469496  3561 consensus_queue.cc:237] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.471485  3556 raft_consensus.cc:359] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:23.472412  3556 raft_consensus.cc:740] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Initialized, Role: LEARNER
I20260709 13:14:23.477054 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:23.476629 32165 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:23.474116  3584 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:23.460248  3604 consensus_queue.cc:260] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.478572 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:23.482805 32122 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:23.481976 32264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:23.483845 32264 raft_consensus.cc:606] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:14:23.497745  3604 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:23.498682 32122 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 11.
I20260709 13:14:23.499830   369 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:23.500792  3496 raft_consensus.cc:2804] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:23.501335  3496 raft_consensus.cc:697] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 11 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:23.502280  3496 consensus_queue.cc:237] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:23.486950  3502 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:23.512567  3502 raft_consensus.cc:697] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 11 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:23.513724  3502 consensus_queue.cc:237] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.493659 32165 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:23.518929 32165 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:23.522989  3505 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:23.523422 32165 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:23.489650  3499 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:23.520951  3500 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:23.525704  3505 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:23.529743  3556 consensus_queue.cc:260] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:23.516933  3607 consensus_queue.cc:1059] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:14:23.539860  3607 raft_consensus.cc:3055] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:23.540236  3607 raft_consensus.cc:740] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:23.540927  3556 ts_tablet_manager.cc:1434] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.000s
I20260709 13:14:23.553478  3500 raft_consensus.cc:993] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801: : Instructing follower fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:14:23.553206 32165 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:23.553972  3500 raft_consensus.cc:1081] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Signalling peer fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:14:23.554881  3500 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:23.557514 32196 raft_consensus.cc:1240] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:23.559077  3542 consensus_queue.cc:1059] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:23.560032  3542 raft_consensus.cc:3055] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:23.560343  3542 raft_consensus.cc:740] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:23.561281  3542 consensus_queue.cc:260] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.562583  3542 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:23.555467  3500 consensus_queue.cc:1048] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:14:23.567588 32165 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:23.569427  3500 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:23.570101  3523 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:23.570696  3523 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.573649 32165 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:23.573745 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:23.582556 32165 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:23.545032  3499 raft_consensus.cc:697] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:23.585587  3572 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:23.581009  3523 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:23.584776  3500 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:23.587862 32165 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:23.596875 32282 tablet_copy_service.cc:342] P 6b3ed521ce8947db80c4b4828b355c06: Request end of tablet copy session 94085cf341634eb686a95983b6b7f7e6-0cf85dc23ac44824a3668eb1b1f3aa42 received from {username='slave'} at 127.0.0.1:50584
I20260709 13:14:23.597396 32282 tablet_copy_service.cc:434] P 6b3ed521ce8947db80c4b4828b355c06: ending tablet copy session 94085cf341634eb686a95983b6b7f7e6-0cf85dc23ac44824a3668eb1b1f3aa42 on tablet 0cf85dc23ac44824a3668eb1b1f3aa42 with peer 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:23.588603  3607 consensus_queue.cc:260] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.597565  3499 consensus_queue.cc:237] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.601281 32021 catalog_manager.cc:5697] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 9 to 11, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 11 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:23.604355  3607 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:23.611280 32165 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:23.613467  3612 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:14:23.615662 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:23.616958 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 126903us
I20260709 13:14:23.617498 32165 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:23.619242  3604 consensus_queue.cc:1059] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:23.620426  3523 raft_consensus.cc:3055] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:23.620867  3523 raft_consensus.cc:740] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:23.621724  3523 consensus_queue.cc:260] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.622954  3523 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:23.609387  3561 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:14:23.626942 32089 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:23.624691  3612 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:23.629272 32264 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:14:23.629702  3570 consensus_queue.cc:1059] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:14:23.630708  3570 raft_consensus.cc:3055] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:23.631093  3570 raft_consensus.cc:740] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:23.631371   403 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:23.634881  3602 raft_consensus.cc:993] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:23.636489 32089 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:23.636565 32115 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:56884
I20260709 13:14:23.631968  3570 consensus_queue.cc:260] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:14:23.637470 32115 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:23.637799 32089 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:23.638228  3542 raft_consensus.cc:1081] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:14:23.637952  3606 consensus_queue.cc:1059] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:23.635109  3510 raft_consensus.cc:2749] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:23.639354  3510 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:23.639994  3510 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:23.646162 32197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:14:23.647020 32197 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:23.647488 32197 raft_consensus.cc:3060] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:23.661062  3570 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:23.637868 32115 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:23.664461   402 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 7 LEARNER]: Advancing to term 8
I20260709 13:14:23.679441   402 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 8 LEARNER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:14:23.681190  3567 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:23.683763   403 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:14:23.690979 32021 catalog_manager.cc:5697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 8 to 9, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 9 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:23.700163 32021 catalog_manager.cc:5697] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 7 to 8, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 8 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:23.721144 32021 catalog_manager.cc:5697] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 7 to 8, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 8 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:23.722971 32021 catalog_manager.cc:5697] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 8 to 9, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 9 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:23.697942  3567 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:14:23.724512 32021 catalog_manager.cc:5697] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 10 to 11, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 11 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:23.749789 32115 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.758214  3510 raft_consensus.cc:3055] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:23.820950  3510 raft_consensus.cc:740] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:23.776328  3502 raft_consensus.cc:1064] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
W20260709 13:14:23.821821  3502 raft_consensus.cc:1068] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801: Unable to promote non-voter 94085cf341634eb686a95983b6b7f7e6: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:14:23.826481 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:23.827049 32264 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:23.821834  3510 consensus_queue.cc:260] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.830015  3510 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:23.767226 32020 catalog_manager.cc:5697] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 7 to 8, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 8 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:23.803581 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 165864us
I20260709 13:14:23.836668 32122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:42262
I20260709 13:14:23.837235 32122 raft_consensus.cc:606] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:23.839985 32122 raft_consensus.cc:614] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:23.816138 32197 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:23.841264 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:23.842970 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:23.858076   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:23.860119   402 raft_consensus.cc:3060] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:23.864676 32197 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:23.859565 32264 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:14:23.866534 32090 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:23.867383  3607 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:23.867871  3607 raft_consensus.cc:697] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:23.868847  3607 consensus_queue.cc:237] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.873652 32115 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:23.888741   402 raft_consensus.cc:2468] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:14:23.893999  3592 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:23.898561   401 raft_consensus.cc:1240] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:23.903071  3542 consensus_queue.cc:1059] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:23.904351  3542 raft_consensus.cc:3055] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:23.904745  3542 raft_consensus.cc:740] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:23.905707  3542 consensus_queue.cc:260] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:23.907367  3542 raft_consensus.cc:3060] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:23.909147 32162 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:23.921581  3561 raft_consensus.cc:2804] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:23.922235  3561 raft_consensus.cc:697] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:23.923305  3561 consensus_queue.cc:237] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:23.931913 32115 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:14:23.944227 32022 catalog_manager.cc:5697] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 4 to 5, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 5 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:23.957604 32020 catalog_manager.cc:5697] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 8 to 9, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 9 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:23.965952 32115 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:14:23.976742  3542 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.977362  3542 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:23.979557  3542 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:23.981825 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:23.981909 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:23.984018 32238 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:23.984853  3435 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:14:23.989986  3623 log.cc:927] Time spent T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:14:24.000509 32269 raft_consensus.cc:1240] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:24.000654 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:24.002280 32115 raft_consensus.cc:1275] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:14:24.004968 32270 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:14:24.006353 32196 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:14:24.003734 32269 raft_consensus.cc:1275] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:24.004082 32122 raft_consensus.cc:1240] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:24.012614 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:24.013794 32122 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:24.013872 32115 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:24.014297 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:24.014844 32193 raft_consensus.cc:3055] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:24.019042 32264 raft_consensus.cc:2468] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:14:24.015179 32193 raft_consensus.cc:740] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:24.020931 32193 consensus_queue.cc:260] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:24.021896 32193 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:24.010655  3499 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.023784  3499 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:24.015592  3496 consensus_queue.cc:1048] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:14:24.027386   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:24.028084   401 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 15.
I20260709 13:14:24.029676 32162 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:24.019918 32196 raft_consensus.cc:1275] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:14:24.031390  3561 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:24.036760  3572 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:24.046276 32122 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:14:24.061429  3612 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:24.061959  3612 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:24.062345  3612 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:24.053733  3584 consensus_queue.cc:1048] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:14:24.068179  3500 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:24.068599  3567 raft_consensus.cc:993] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801: : Instructing follower fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:14:24.069168  3542 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:24.070081  3567 raft_consensus.cc:1081] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Signalling peer fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:14:24.069828  3542 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:24.072906 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:24.077350 32193 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:14:24.079054 32115 raft_consensus.cc:1275] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:24.029695  3499 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:14:24.115885 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 49398.5us
I20260709 13:14:24.130422  3607 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.131167  3607 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:24.132802  3542 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:24.137962 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:24.140357 32238 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:24.115314  3602 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.115504  3584 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:24.142855  3435 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:24.155095 32122 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:24.157723  3510 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.158284  3510 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:24.160548  3510 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:24.163519 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:24.164177 32269 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:14:24.166152 32122 raft_consensus.cc:1275] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:24.169328 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:24.172838 32122 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:14:24.167865 32089 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:24.176537 32270 raft_consensus.cc:1275] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:24.178668 32272 raft_consensus.cc:1275] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:24.180734  3616 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:24.182138  3607 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:24.182467 32271 raft_consensus.cc:1275] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:14:24.155970  3584 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:24.186000  3584 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:24.143694  3602 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:24.189990 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:24.190649 32193 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:14:24.191915 32238 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:24.195873 32090 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:24.197795 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:24.198465 32123 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:14:24.199640 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:24.206478 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:24.211313 32121 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3bdc1594189c43f49251261c5d073447"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:56884
I20260709 13:14:24.212085 32121 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:24.212327 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:24.213269 32193 raft_consensus.cc:2393] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 12: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:24.214807 32121 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:24.214874   368 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:24.216282 32123 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:24.221367 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:24.222235 32271 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 12.
I20260709 13:14:24.188871  3602 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:24.206351  3510 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:24.211714  3435 raft_consensus.cc:2804] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:24.239943  3496 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:24.246364  3542 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:24.246948  3542 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:24.263379 32123 raft_consensus.cc:1275] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:14:24.238339  3435 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:24.272565 32121 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:24.270008  3435 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:24.297103 32121 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:24.298281 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:24.305212 32271 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:24.297750 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:24.306268 32193 raft_consensus.cc:2393] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 12: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:24.295351  3607 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.295843  3542 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:14:24.322489   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 107675us
I20260709 13:14:24.332870  3607 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:24.340930  3607 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:24.340803  3561 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:24.313503  3612 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:24.347648 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:24.348264 32264 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:14:24.354180 32271 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
W20260709 13:14:24.356149 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 43632us
I20260709 13:14:24.359175 32090 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:14:24.362015 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 65490.5us
I20260709 13:14:24.360265  3502 consensus_queue.cc:1048] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:14:24.358305  3607 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.373059  3634 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:24.376226  3505 raft_consensus.cc:1064] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:14:24.377040  3616 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:24.399668  3640 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:24.377970  3612 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:24.400298  3640 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:24.379581   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:24.401715   402 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:24.367645 32090 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:24.391762 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:24.406759 32119 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:24.407590   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:24.408607 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:24.408807  3640 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:24.409250 32264 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:24.409710  3640 raft_consensus.cc:2804] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:24.410333  3640 raft_consensus.cc:697] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:24.408617 32271 raft_consensus.cc:1275] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:24.412822  3642 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.413354  3642 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:24.421876   402 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:14:24.387151  3496 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:24.423460 32162 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:24.432893 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:24.433915 32271 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 8.
I20260709 13:14:24.434059   401 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:24.435225  3639 consensus_queue.cc:1048] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:24.435750 32090 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:24.416509  3616 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:24.415328  3435 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:24.420431  3617 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:24.433248 32239 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:24.445295  3617 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:24.446344  3592 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:24.441097  3616 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:24.416805  3628 consensus_queue.cc:1048] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:14:24.430249  3642 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:24.417073  3607 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:24.436540  3639 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:24.466763 32267 raft_consensus.cc:2393] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 8: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:24.469069 32087 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:24.466351  3641 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:24.472234  3510 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:24.472901  3510 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:24.472662  3641 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:24.476843  3641 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:24.433615  3567 consensus_queue.cc:1048] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:14:24.461516  3500 consensus_queue.cc:1048] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:14:24.473634  3435 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:24.478286  3616 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:24.483634 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:24.484223 32191 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:24.442148  3643 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:24.506585  3647 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:24.507112  3647 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:24.507455  3647 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:24.508232  3648 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.511030 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:24.511672 32115 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:24.416217  3634 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:14:24.480880  3592 raft_consensus.cc:697] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:24.528424 32115 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
W20260709 13:14:24.529050 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 88217.5us
I20260709 13:14:24.530226 32239 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:24.488798  3643 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:24.482833  3640 consensus_queue.cc:237] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:24.557073  3510 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:24.526731  3649 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:24.561159 32191 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:14:24.483103  3639 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:24.534696  3643 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:24.573978 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:24.574646 32267 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:24.578068 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 47928.3us
I20260709 13:14:24.560313  3616 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:24.536645  3561 consensus_queue.cc:1048] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:14:24.542932  3637 consensus_queue.cc:1048] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:14:24.533603  3648 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:24.578683  3435 raft_consensus.cc:2804] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:24.623893 32267 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:14:24.626322 32090 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:24.613118  3602 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.612957  3646 raft_consensus.cc:476] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Not starting pre-election -- already a leader
I20260709 13:14:24.631266  3602 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:24.633399  3602 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:24.633958  3602 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:24.618564  3642 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:24.605002  3592 consensus_queue.cc:237] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:24.618026  3567 consensus_queue.cc:1048] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:14:24.650316  3642 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:24.579077  3649 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:24.648828  3634 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:24.669819  3634 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:24.670414  3634 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:24.672828  3650 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:24.657238  3653 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:24.645131  3602 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:24.676681  3642 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:24.685518  3641 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:24.687055 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:24.715025 32191 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:14:24.688144 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:24.716387 32196 raft_consensus.cc:2393] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 8: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
W20260709 13:14:24.717571 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 101076us
I20260709 13:14:24.715245  3654 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.701417 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:14:24.718742 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 95523.3us
I20260709 13:14:24.718956 32193 raft_consensus.cc:2393] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 11: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:24.719141  3654 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:24.720290 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:24.720671  3661 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.702124   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:24.723127  3435 raft_consensus.cc:697] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:24.673622  3650 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:24.726171 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 65062.2us
I20260709 13:14:24.727836 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:24.749810 32123 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:14:24.750561  3435 consensus_queue.cc:237] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:24.728385 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:24.729445  3654 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:24.754319 32238 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:24.731304  3602 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:24.734879  3641 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:24.721163  3661 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:24.712688  3634 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:24.714270  3653 raft_consensus.cc:697] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:24.719002  3659 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.743335 32270 raft_consensus.cc:1275] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:14:24.745188 32273 raft_consensus.cc:1240] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:14:24.745905 32267 raft_consensus.cc:1275] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:14:24.756860 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 104614us
I20260709 13:14:24.696681  3617 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:24.765208  3510 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:24.767781  3649 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:24.772342 32266 raft_consensus.cc:1240] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 9. Current term is 10. Ops: []
W20260709 13:14:24.742023  3651 log.cc:927] Time spent T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:14:24.769891  3650 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:24.769896  3602 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.800645  3661 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:24.801318  3661 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:24.801668  3661 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:24.801990  3661 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:24.802493  3653 consensus_queue.cc:237] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:24.804909  3602 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:24.807904  3602 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:24.790853  3659 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:24.809758  3643 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:24.811276  3659 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:24.825248  3647 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:24.826143  3643 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:24.828487  3647 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:24.876605 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:24.877851 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:24.878850 32121 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:14:24.878954 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:24.753515 32122 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:24.881132 32124 raft_consensus.cc:1240] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:14:24.881868 32123 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:24.876573 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:24.885797 32117 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:14:24.880178 32118 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
W20260709 13:14:24.902889 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:24.903836 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:24.907924 32121 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:14:24.911216 32123 raft_consensus.cc:1275] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:14:24.912040 32115 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:24.754492 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:24.917749 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:24.918354 32193 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:14:24.919493 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:24.755154 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:24.920287 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:24.921499 32191 raft_consensus.cc:2393] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 12: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:24.922528 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:24.922592 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:24.923444 32191 raft_consensus.cc:2393] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 14: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:24.923817 32193 raft_consensus.cc:2393] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 11: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:24.925159 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:24.925593 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:24.926780 32190 raft_consensus.cc:2393] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 11: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:24.926812 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:24.924340 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:24.927935 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:24.928144 32191 raft_consensus.cc:2393] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 12: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:24.929136 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:24.929299 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:24.930608 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:24.929196 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:24.932432 32194 raft_consensus.cc:3055] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:24.933053 32194 raft_consensus.cc:740] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:24.934587 32194 consensus_queue.cc:260] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:24.932303 32191 raft_consensus.cc:1275] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:24.937542 32194 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:24.755146 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:24.945421 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:24.945742 32196 raft_consensus.cc:2393] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 8: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:24.946449 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:24.947763 32199 raft_consensus.cc:2393] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 8: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:24.945717 32193 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
W20260709 13:14:24.947752 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 193364us
I20260709 13:14:24.954176 32238 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:24.957111   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
W20260709 13:14:24.957712 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:24.983846  3617 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.985138  3617 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.037319  3510 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:25.037981  3617 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:25.038461  3510 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.044734  3643 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:25.045617  3643 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.048135  3643 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:25.048861  3659 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:25.049428  3659 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:25.049777  3659 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:25.061614  3671 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.064949 32194 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:14:25.065562   401 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:25.068789  3607 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:25.070148 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:25.070925   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 65810.4us
I20260709 13:14:25.072165  3669 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.072710  3642 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:25.073145  3669 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.073747  3642 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:25.076225 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:25.080070  3567 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.081103  3567 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:14:25.081982  3647 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:25.082590  3647 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.086196  3647 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:25.092515 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:25.093582 32119 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:14:25.094890 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:25.094991 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:25.095821 32116 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:14:25.062587  3671 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.095820 32117 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:14:25.100455  3567 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:25.103045 32122 raft_consensus.cc:1240] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:14:25.103838  3641 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:25.113632  3641 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.076527  3642 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:25.129170  3648 leader_election.cc:290] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:25.119249  3641 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:25.149605  3510 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:25.154186 32239 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:25.115056  3669 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:25.168763  3669 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.170715  3669 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.172115  3668 raft_consensus.cc:2804] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:25.172722  3668 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:25.173244  3668 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:25.178778  3669 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:25.180972 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:25.159668  3641 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:25.181931 32265 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:25.189415 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:25.190332 32192 raft_consensus.cc:2393] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 12: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:25.189715  3641 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.194897  3505 consensus_queue.cc:237] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:25.197053  3639 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:25.196704  3637 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.199599  3637 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.205257  3637 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:25.214255 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:25.215167 32265 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:25.215746 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:25.216651 32199 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
W20260709 13:14:25.216837 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 62991.1us
I20260709 13:14:25.218595 32239 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:25.219882  3634 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:25.220396  3634 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:25.220829  3634 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:25.225907 32239 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:25.227077  3666 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:25.227581  3666 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:25.228011  3666 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:25.236335  3659 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.239159  3661 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.244920  3641 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:25.246402 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:25.246790  3661 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:25.247051 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:25.247659 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:25.247185 32269 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:14:25.248039 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:25.248821 32272 raft_consensus.cc:2393] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 8: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:25.248790 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:25.250267  3666 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.254797  3666 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:25.256033 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:25.256899 32199 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:25.242432 32020 catalog_manager.cc:5697] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:25.260032  3671 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:25.261052 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:25.264063 32123 raft_consensus.cc:1240] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:25.272931 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:25.274214 32268 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:14:25.276827 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:25.277434 32269 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:25.278734 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:25.279407 32269 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:25.279852 32238 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:25.284418  3567 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.284687 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:25.228380 32239 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:25.286340 32265 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:25.287346 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:25.289126 32199 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:14:25.289937  3671 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:25.289677  3567 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.290488  3671 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:25.291023  3671 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:25.292960 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:25.294126 32194 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:25.297307 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:25.298161 32269 raft_consensus.cc:2368] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 10. Current term is 11.
I20260709 13:14:25.300945 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:25.300848  3572 consensus_queue.cc:1059] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:14:25.309315 32269 raft_consensus.cc:2393] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 15: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:25.309727  3667 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:25.316293 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:25.310305 32238 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:25.322738 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:25.323688 32198 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:25.324556  3502 raft_consensus.cc:3055] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:25.324337  3659 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:25.325325  3502 raft_consensus.cc:740] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:25.326660  3502 consensus_queue.cc:260] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.328207  3502 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:25.321393 32194 raft_consensus.cc:2393] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 9: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:25.311898  3567 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:25.333369 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:25.333778 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 105508us
I20260709 13:14:25.334123 32265 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 8.
W20260709 13:14:25.332116 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 46027us
I20260709 13:14:25.321410  3667 raft_consensus.cc:697] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:25.338598  3667 consensus_queue.cc:237] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.342722 32090 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:25.343869 32090 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:25.315953  3668 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:14:25.344743  3639 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:25.344923  3650 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:25.345283  3639 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:25.345357  3650 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:25.345775  3639 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:25.358249   401 raft_consensus.cc:1275] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:14:25.345834  3650 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:25.366885 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:25.367280 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:25.367755 32199 raft_consensus.cc:2393] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 8: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:25.368076 32192 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:25.369262  3668 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:25.359992  3505 consensus_queue.cc:1048] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:14:25.370055 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:25.370898 32194 raft_consensus.cc:2393] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 8: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:25.345927 32022 catalog_manager.cc:5697] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 9 to 10, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 10 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:25.373060  3668 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:25.373783  3668 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.378767 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:25.375878  3668 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:25.358476  3659 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:25.379525 32269 raft_consensus.cc:1275] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:25.381168 32238 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:25.388887 32268 raft_consensus.cc:1275] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:25.392486  3637 consensus_queue.cc:1059] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:25.393395  3637 consensus_queue.cc:1243] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer fcfc3281929645969ecedbb0c0af759d log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:14:25.394052  3567 raft_consensus.cc:3055] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:25.394425  3567 raft_consensus.cc:740] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:25.395386  3567 consensus_queue.cc:260] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.336187  3634 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.396867  3659 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:25.397843  3567 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:25.398263  3659 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:25.397879 32198 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:25.399389 32192 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:14:25.400135  3666 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:25.400548  3666 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:25.400918  3666 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:25.401422  3639 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:25.410077 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:25.413015 32239 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:25.413744 32090 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:25.414121  3661 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:25.415153  3661 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:25.415408   403 raft_consensus.cc:1275] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:14:25.415565  3661 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:25.415855 32090 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:25.416922  3655 raft_consensus.cc:2804] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:25.417316  3655 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:25.417627  3655 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:25.414739  3643 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:25.420794  3643 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:25.421242  3643 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:25.422654   403 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 8 LEARNER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:14:25.423887 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:25.429034 32090 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:25.430177  3617 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:25.430748  3617 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:25.431640  3617 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:25.434846  3671 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.438715 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:25.439335 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:25.439494 32123 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:14:25.439991 32124 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:14:25.440196 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:25.441371 32120 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:14:25.443406  3502 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.444007  3502 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.445755  3639 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:25.446154  3502 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:25.445784  3658 consensus_queue.cc:1048] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:25.443642  3565 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.450623  3565 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.450832 32090 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:25.451421 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:25.452310 32192 raft_consensus.cc:2393] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 8: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:25.452481  3639 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:25.451442 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:25.453989 32194 raft_consensus.cc:2393] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 10: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:25.456375  3500 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:25.458020  3659 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.453073  3639 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:25.452324 32090 leader_election.cc:400] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 10. Current term is 11.
I20260709 13:14:25.464757 32090 leader_election.cc:403] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:25.467257  3510 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.467991  3510 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.460981  3639 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:25.473412  3565 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:25.473308  3666 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.473803  3616 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:14:25.479108 32198 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:25.481101  3510 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:25.473767 32090 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:25.483232 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:25.483439 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:25.484412 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:25.484628  3510 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:25.484761 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:25.485055 32117 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:25.485332  3510 raft_consensus.cc:697] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:25.484324 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:25.486503  3510 consensus_queue.cc:237] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:25.488981 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:25.449658  3650 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.453385  3634 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:25.495131  3617 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.496635 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:25.497253 32121 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:14:25.495785  3671 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:25.498006 32123 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:25.500702 32117 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:14:25.431342  3655 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.484383 32090 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:25.491845  3650 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:25.503214 32116 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:14:25.507162  3500 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:25.508826  3653 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:25.509752  3616 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 10. Current term is 11.
I20260709 13:14:25.509572  3653 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.510465  3616 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:25.510870  3616 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:25.460528  3659 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:25.513027 32120 raft_consensus.cc:2368] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9.
I20260709 13:14:25.513774  3565 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.513999  3655 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:25.515413  3661 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.517406  3653 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:25.523525 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:25.524307 32124 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:25.527838 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:25.528462 32121 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:25.532816  3637 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.533286  3572 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.533567 32118 raft_consensus.cc:1275] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:14:25.533443  3637 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:25.533844  3572 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.535712  3572 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:25.525866  3505 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.537921  3505 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.535729  3637 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:25.539945  3505 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:25.541896 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:25.542814 32118 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:25.511258  3616 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:25.549135 32121 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:25.546761  3647 consensus_queue.cc:1048] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
W20260709 13:14:25.554069 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 88014.2us
I20260709 13:14:25.554332 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:25.554266 32239 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:25.556260 32239 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:25.560876 32122 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:14:25.562863 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:25.563535 32269 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:14:25.568239 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:25.568989 32271 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:14:25.569391 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:25.570188 32264 raft_consensus.cc:2368] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12.
I20260709 13:14:25.571604 32123 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:25.572700  3659 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:25.573284  3659 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:25.573706  3659 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:25.545377  3650 consensus_queue.cc:1048] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:14:25.579993 32265 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:14:25.583564 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:25.585048  3628 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.585618  3628 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.567370 32238 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:25.596230 32268 raft_consensus.cc:2368] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12.
I20260709 13:14:25.593223 32239 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:25.595299 32238 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:25.588439  3628 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:25.598642 32239 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:25.592450  3634 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:25.597309  3667 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:25.594046  3617 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:25.566107  3565 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:25.600435  3641 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:25.603317  3602 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:25.607758  3435 raft_consensus.cc:2804] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:25.606740 32090 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:14:25.609117 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 63985.5us
I20260709 13:14:25.610216  3602 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:25.610637  3602 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:25.603777  3634 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:25.604981  3667 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:25.615370 32090 leader_election.cc:400] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12.
I20260709 13:14:25.614069 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:25.619172 32090 leader_election.cc:403] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:14:25.617791 32239 leader_election.cc:400] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9.
I20260709 13:14:25.617383  3435 raft_consensus.cc:697] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:25.619658 32239 leader_election.cc:403] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:25.610577  3666 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:25.614737  3607 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:25.613458  3641 raft_consensus.cc:697] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:25.626317 32239 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:25.619349  3634 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:25.620820  3667 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:25.628278 32090 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:25.627144  3435 consensus_queue.cc:237] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:14:25.636437 32090 leader_election.cc:400] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12.
I20260709 13:14:25.611605  3643 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:25.636965 32090 leader_election.cc:403] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:14:25.638872 32239 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:25.639704 32239 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:25.627554  3607 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:25.641697  3668 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:25.642275  3654 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:25.642859  3669 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:25.638370  3617 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:25.640826 32239 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:25.645052  3666 consensus_queue.cc:1048] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:14:25.660935  3641 consensus_queue.cc:237] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.667177  3659 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.655349  3639 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.679646  3639 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:25.633687  3628 consensus_queue.cc:1059] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:14:25.677438  3648 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:25.681459 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:25.646587  3607 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:25.661640  3666 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:14:25.701820 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 61039.2us
I20260709 13:14:25.699182 32269 raft_consensus.cc:2368] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12.
I20260709 13:14:25.653458  3617 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:25.703387  3617 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:25.709125  3639 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:25.709707 32090 leader_election.cc:400] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12.
I20260709 13:14:25.710100 32090 leader_election.cc:403] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:14:25.709954  3639 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.711419  3640 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:25.713946  3639 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:25.718245  3654 raft_consensus.cc:697] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:25.719363  3654 consensus_queue.cc:237] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.719290 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:25.725461 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 125417us
I20260709 13:14:25.687284 32271 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:14:25.655907  3642 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12.
I20260709 13:14:25.669692  3661 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:25.733515 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:25.742307 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:14:25.742702 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:25.701785  3643 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:25.746778 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:14:25.748325  3687 log.cc:927] Time spent T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:14:25.748711  3565 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:25.724462  3637 raft_consensus.cc:3055] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:25.763427 32118 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:25.731207  3671 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9.
I20260709 13:14:25.789284 32090 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:25.774664  3696 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:14:25.775200  3688 log.cc:927] Time spent T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:14:25.780999  3435 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:25.784456  3502 consensus_queue.cc:1048] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:14:25.785270  3691 log.cc:927] Time spent T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:14:25.785653  3655 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12.
I20260709 13:14:25.702302  3648 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.790418 32239 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:25.732496  3668 raft_consensus.cc:697] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:25.766042  3666 raft_consensus.cc:697] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:25.811717  3435 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.818854 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:25.820667 32194 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:25.809768  3643 raft_consensus.cc:2804] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:25.823699 32198 raft_consensus.cc:1275] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:14:25.800596  3642 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:25.788166  3637 raft_consensus.cc:740] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:25.825376 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:25.826138 32198 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:25.744186  3617 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.829944 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:25.832115 32199 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:25.816378  3669 raft_consensus.cc:697] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:25.833245 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:25.834734 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:25.841380 32193 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:25.844437 32194 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:25.846318 32192 raft_consensus.cc:2393] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 11: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:25.820142  3661 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:14:25.853252 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 101377us
I20260709 13:14:25.833020  3643 raft_consensus.cc:697] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:25.846006  3641 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:25.873521  3435 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:25.876189  3637 consensus_queue.cc:260] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.877331  3637 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:25.878221  3694 consensus_queue.cc:1048] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:14:25.845475  3642 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:25.830736  3696 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.843253  3616 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.886075  3641 raft_consensus.cc:697] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:25.863626  3661 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.907761 32198 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:25.911482 32122 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:25.895823  3668 consensus_queue.cc:237] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.929961  3696 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:25.931409  3648 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:25.898635  3659 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:25.935307 32122 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:14:25.941232 32193 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:14:25.941280 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:25.944229  3702 consensus_queue.cc:1048] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:14:25.948122  3634 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.908430  3643 consensus_queue.cc:237] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.950405  3634 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:25.900928  3666 consensus_queue.cc:237] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.955322 32199 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:25.960542 32272 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:14:25.967242  3642 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:25.969008 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:25.902562  3669 consensus_queue.cc:237] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.974866  3667 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.976328 32268 raft_consensus.cc:2368] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12.
I20260709 13:14:25.982584  3641 consensus_queue.cc:237] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:25.986310 32269 raft_consensus.cc:1275] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:25.991526 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:25.992261 32124 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
I20260709 13:14:25.993602 32117 raft_consensus.cc:1275] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:14:25.938684  3661 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:25.999418 32120 raft_consensus.cc:1240] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:26.009783 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:26.000197 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:25.999580 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:26.010669 32124 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
I20260709 13:14:26.011027 32119 raft_consensus.cc:2393] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 12: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:26.002653 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:26.003566 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:26.004262 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:26.004022 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:26.002115 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:26.008147 32265 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:14:26.012421 32267 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
I20260709 13:14:25.956308  3640 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12.
I20260709 13:14:26.011798 32266 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
W20260709 13:14:26.031596   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 176004us
I20260709 13:14:26.033776 32118 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:14:26.033586 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:26.034240 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:26.034917 32124 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:14:26.040027 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:26.040853 32120 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:14:26.040781 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:26.040179  3617 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:26.046480 32121 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:26.050678 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:26.044503 32090 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:26.052171 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:26.052855 32118 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
I20260709 13:14:26.053105 32123 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
I20260709 13:14:26.055693 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:26.059969 32090 leader_election.cc:400] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12.
I20260709 13:14:26.060298 32090 leader_election.cc:403] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:14:26.060917  3647 consensus_queue.cc:1048] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:26.061338  3616 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:26.062311  3616 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:26.062717  3667 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:26.063164 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:26.043020  3607 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:26.064077 32272 raft_consensus.cc:2410] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:14:26.060755  3602 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:26.065716 32117 raft_consensus.cc:2393] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 11: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:26.065557 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:26.072818 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:26.073107 32267 raft_consensus.cc:2393] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 9: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:26.073609 32265 raft_consensus.cc:2368] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 8. Current term is 9.
I20260709 13:14:26.077214 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:26.077397 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:26.078289 32199 raft_consensus.cc:2393] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 11: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:26.081102 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:26.081314 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:26.078097 32198 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 8.
I20260709 13:14:26.082868 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:26.057123  3640 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:26.086442 32271 raft_consensus.cc:1240] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:14:26.087723 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:26.088400 32198 raft_consensus.cc:2368] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12.
I20260709 13:14:26.083709  3607 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:26.075605  3702 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.091158 32273 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:26.092000 32117 raft_consensus.cc:1240] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:26.095274   401 raft_consensus.cc:1275] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:26.096998 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:26.099685 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:26.100790 32199 raft_consensus.cc:2368] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 10. Current term is 11.
I20260709 13:14:26.102727 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:26.103632 32199 raft_consensus.cc:2368] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 8. Current term is 9.
I20260709 13:14:26.109315 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:26.097360 32089 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:26.110188 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:26.110350 32193 raft_consensus.cc:2368] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12.
I20260709 13:14:26.110906 32194 raft_consensus.cc:2368] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12.
I20260709 13:14:26.099781  3702 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:26.114005 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:26.114667 32192 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:14:26.121073 32198 raft_consensus.cc:1275] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:26.122707 32090 leader_election.cc:400] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 8. Current term is 9.
I20260709 13:14:26.123114 32090 leader_election.cc:403] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:14:26.123755  3648 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 8. Current term is 9.
I20260709 13:14:26.127556 32199 raft_consensus.cc:1275] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:14:26.127942 32199 pending_rounds.cc:85] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 5
I20260709 13:14:26.099021  3640 raft_consensus.cc:697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:26.128144 32199 pending_rounds.cc:107] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:14:26.141045 32199 raft_consensus.cc:2889] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:26.141567 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:26.142345 32197 raft_consensus.cc:2393] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 9: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:26.142169  3647 consensus_queue.cc:1048] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:26.143914  3602 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:26.144241 32191 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:14:26.144732 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:26.147246 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:26.148464 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:26.149560 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:26.149181  3640 consensus_queue.cc:237] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:26.150244 32190 raft_consensus.cc:2393] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 11: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:26.151448 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:26.157608 32089 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:26.162252 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:26.162902 32196 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:26.173252 32238 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:26.174250 32238 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:26.177090 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:26.177920 32190 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:26.179891 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:26.183605 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:26.184433 32192 raft_consensus.cc:2393] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 10: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:26.185276 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:26.186064 32193 raft_consensus.cc:2368] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12.
W20260709 13:14:26.188678 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 398291us
I20260709 13:14:26.193946  3702 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:26.172478  3643 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:26.226409 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:26.214478 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:14:26.220723 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:26.221712 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:26.232015  3709 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:14:26.234655 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:26.225423 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:26.238688 32198 raft_consensus.cc:2393] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 14: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:26.216074 32122 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:14:26.181389  3669 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:26.241160 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:26.251346 32190 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:26.255108 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:26.258800 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:26.208431  3666 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:26.339042 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:26.340258 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:26.343151 32123 raft_consensus.cc:2368] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 10. Current term is 11.
I20260709 13:14:26.368944 32120 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:14:26.254693  3667 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:26.391518 32089 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:26.377736 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:26.406538 32116 raft_consensus.cc:1275] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:14:26.406986 32239 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:26.414577 32196 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:14:26.382404 32020 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49550 (request call id 257) took 1155 ms. Trace:
W20260709 13:14:26.389520  3712 log.cc:927] Time spent T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:14:26.384895 32022 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49534 (request call id 258) took 1111 ms. Trace:
W20260709 13:14:26.393469  3637 consensus_meta.cc:287] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.000s
I20260709 13:14:26.445482 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:26.447428  3666 raft_consensus.cc:697] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:14:26.448192 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 181550us
I20260709 13:14:26.449003 32238 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:26.376405  3616 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12.
I20260709 13:14:26.412298  3661 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:26.464875  3666 consensus_queue.cc:237] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:26.465695 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 211546us
I20260709 13:14:26.388330  3667 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:26.479811 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:26.455734  3640 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:14:26.481634 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 74708.1us
W20260709 13:14:26.516146 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 47983.6us
I20260709 13:14:26.460376  3637 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:26.462491  3648 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:26.554764 32089 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:26.555717  3640 raft_consensus.cc:2749] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:26.512210  3709 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:26.486814  3699 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:26.557561  3699 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:26.559973  3699 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:26.561827  3637 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:26.522110  3671 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:26.566349  3671 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:26.529213  3641 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:26.433421 32020 rpcz_store.cc:276] 0709 13:14:25.227354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:25.227812 (+   458us) service_pool.cc:224] Handling call
0709 13:14:25.238334 (+ 10522us) spinlock_profiling.cc:243] Waited 8.51 ms on lock 0x7b5400047c54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5b090 00007fb59eff9f3a 00007fb5a4db01cc 00007fb5a4eae37e 00007fb5a336f2a4 00007fb5a336f232 00007fb5a336f161 00007fb5a336f0dc 00007fb5a336e392 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:26.382289 (+1143955us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:25.408737 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:25.409435 (+   698us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:25.409522 (+    87us) write_op.cc:435] Acquired schema lock
0709 13:14:25.409565 (+    43us) tablet.cc:662] Decoding operations
0709 13:14:25.410053 (+   488us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:25.410161 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:25.410189 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:14:25.410635 (+   446us) tablet.cc:701] Row locks acquired
0709 13:14:25.410698 (+    63us) write_op.cc:260] PREPARE: finished
0709 13:14:25.410911 (+   213us) write_op.cc:270] Start()
0709 13:14:25.411161 (+   250us) write_op.cc:276] Timestamp: P: 1783602865410840 usec, L: 0
0709 13:14:25.411205 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 13:14:25.411981 (+   776us) log.cc:844] Serialized 530 byte log entry
0709 13:14:26.111916 (+699935us) op_driver.cc:464] REPLICATION: finished
0709 13:14:26.184925 (+ 73009us) write_op.cc:301] APPLY: starting
0709 13:14:26.185033 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:26.185160 (+   127us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:26.185280 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:26.185581 (+   301us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:26.185839 (+   258us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:14:26.185899 (+    60us) write_op.cc:312] APPLY: finished
0709 13:14:26.186178 (+   279us) log.cc:844] Serialized 23 byte log entry
0709 13:14:26.186363 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:26.186437 (+    74us) write_op.cc:454] Released schema lock
0709 13:14:26.186489 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:26.186908 (+   419us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:26.186942 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":19578752,"child_traces":[["op",{"apply.queue_time_us":72682,"apply.run_cpu_time_us":1963,"apply.run_wall_time_us":1968,"mutex_wait_us":619,"num_ops":1,"prepare.queue_time_us":74111,"prepare.run_cpu_time_us":17053,"prepare.run_wall_time_us":206909,"raft.queue_time_us":429946,"raft.run_cpu_time_us":7441,"raft.run_wall_time_us":138383,"replication_time_us":678495,"spinlock_wait_cycles":2816,"thread_start_us":468340,"threads_started":4,"wal-append.queue_time_us":195625}]]}
I20260709 13:14:26.533165 32165 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:26.533591  3502 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:26.469671  3661 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:26.521098  3659 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:26.443392 32022 rpcz_store.cc:276] 0709 13:14:25.273732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:25.274943 (+  1211us) service_pool.cc:224] Handling call
0709 13:14:25.289592 (+ 14649us) spinlock_profiling.cc:243] Waited 9.34 ms on lock 0x7b5400047c54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5b090 00007fb59eff9f3a 00007fb5a4db01cc 00007fb5a4eae37e 00007fb5a336f2a4 00007fb5a336f232 00007fb5a336f161 00007fb5a336f0dc 00007fb5a336e392 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:26.384812 (+1095220us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:25.589039 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:25.589633 (+   594us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:25.589669 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:14:25.589689 (+    20us) tablet.cc:662] Decoding operations
0709 13:14:25.590049 (+   360us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:25.590100 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:25.590135 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:14:25.590422 (+   287us) tablet.cc:701] Row locks acquired
0709 13:14:25.590443 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:14:25.590587 (+   144us) write_op.cc:270] Start()
0709 13:14:25.590701 (+   114us) write_op.cc:276] Timestamp: P: 1783602865590533 usec, L: 0
0709 13:14:25.590727 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:14:25.605019 (+ 14292us) log.cc:844] Serialized 535 byte log entry
0709 13:14:26.222303 (+617284us) op_driver.cc:464] REPLICATION: finished
0709 13:14:26.232597 (+ 10294us) write_op.cc:301] APPLY: starting
0709 13:14:26.232686 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:26.232795 (+   109us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:26.232911 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:26.233203 (+   292us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:26.233374 (+   171us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:14:26.233422 (+    48us) write_op.cc:312] APPLY: finished
0709 13:14:26.233617 (+   195us) log.cc:844] Serialized 23 byte log entry
0709 13:14:26.233794 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:26.233900 (+   106us) write_op.cc:454] Released schema lock
0709 13:14:26.233961 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:26.234326 (+   365us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:26.234359 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":147564,"reported_tablets":4,"spinlock_wait_cycles":21478272,"child_traces":[["op",{"apply.queue_time_us":5140,"apply.run_cpu_time_us":1703,"apply.run_wall_time_us":1703,"num_ops":1,"prepare.queue_time_us":202133,"prepare.run_cpu_time_us":2918,"prepare.run_wall_time_us":23113,"replication_time_us":619153}]]}
W20260709 13:14:26.547118  3719 log.cc:927] Time spent T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.178s	user 0.004s	sys 0.001s
I20260709 13:14:26.551882  3667 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:26.512378  3669 raft_consensus.cc:697] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:26.613930  3669 consensus_queue.cc:237] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:26.531219 32019 catalog_manager.cc:5697] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 6 to 8, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 8 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:26.574512 32165 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:26.617352 32019 catalog_manager.cc:5697] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 11 to 12, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 12 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:26.525564  3696 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:26.619338  3696 raft_consensus.cc:697] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:26.620437  3696 consensus_queue.cc:237] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:26.624486  3702 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:26.625065  3702 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:26.625504  3702 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:26.627817   400 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 13 LEARNER]: Advancing to term 14
I20260709 13:14:26.631656  3661 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:26.607191 32089 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:26.598654 32117 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:26.629087  3637 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:26.663813  3702 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:26.633754  3616 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:26.657832  3671 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:14:26.694885 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 207173us
I20260709 13:14:26.609058  3572 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:26.696211 32239 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:26.710716 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 103880us
I20260709 13:14:26.711483  3572 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:26.713598  3572 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:26.713585 32239 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:26.717109  3661 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:26.717595 32239 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:26.721027 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 272088us
I20260709 13:14:26.666736  3702 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:26.722050   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 226018us
I20260709 13:14:26.727339 32239 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:26.718549  3671 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:26.746501 32239 leader_election.cc:400] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 10. Current term is 11.
I20260709 13:14:26.749214 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:26.750289 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:26.729537  3667 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:26.754029 32196 raft_consensus.cc:1275] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:26.718743  3607 consensus_queue.cc:1048] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:14:26.710901  3659 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:26.748644 32239 leader_election.cc:403] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:14:26.761082 32192 raft_consensus.cc:1275] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:14:26.763178 32089 leader_election.cc:304] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:26.764635   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:26.761334 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:26.766553 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:26.766757  3705 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:26.767359  3705 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:26.769541  3705 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:26.770071  3694 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:26.771116 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:26.816284 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 53296.4us
I20260709 13:14:26.750327  3697 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:14:26.817894 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:26.819304 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 200604us
I20260709 13:14:26.829869 32267 raft_consensus.cc:1275] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:26.817457  3617 raft_consensus.cc:2764] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260709 13:14:26.843184 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 83065us
I20260709 13:14:26.844381  3435 consensus_queue.cc:1048] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:26.853147 32089 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:26.854429 32121 raft_consensus.cc:1275] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:14:26.853363 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:26.856567 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:26.856295 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:26.865500 32117 raft_consensus.cc:1275] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:26.869278 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:26.871556 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:26.872766 32116 raft_consensus.cc:1275] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:14:26.875260 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:26.878270  3659 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:26.878464 32190 raft_consensus.cc:1275] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:26.896999   400 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 14 LEARNER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:14:26.906394  3648 consensus_queue.cc:1048] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:26.906740  3637 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.907267  3637 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:26.907991  3505 consensus_queue.cc:1059] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:14:26.897941  3697 raft_consensus.cc:697] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:26.909534  3637 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:26.909873  3697 consensus_queue.cc:237] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:26.906574 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 75045.9us
I20260709 13:14:26.905025 32165 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:14:26.924669 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 57016.7us
W20260709 13:14:26.916471  3726 log.cc:927] Time spent T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:14:26.931016  3628 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:26.936744  3435 consensus_queue.cc:1048] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:26.936604  3733 consensus_queue.cc:1048] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:14:26.938504  3661 consensus_queue.cc:1048] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:26.944437  3628 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:26.979803  3435 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:26.988654  3435 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:26.981840 32193 raft_consensus.cc:1275] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:14:26.980647 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:26.959982 32196 raft_consensus.cc:1275] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:26.955322  3654 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:26.956310  3628 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:26.994812 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:14:26.994984 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 67651.6us
W20260709 13:14:26.999017 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 51600.6us
I20260709 13:14:27.009946 32089 leader_election.cc:400] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12.
I20260709 13:14:27.011234 32089 leader_election.cc:400] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 10. Current term is 11.
I20260709 13:14:26.985030  3602 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:27.015529 32239 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:27.012337 32089 leader_election.cc:400] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 8. Current term is 9.
I20260709 13:14:27.017059 32239 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:27.017261  3699 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:27.018373  3699 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:27.017077  3641 consensus_queue.cc:1048] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:14:27.019402 32089 leader_election.cc:400] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12.
I20260709 13:14:27.020414 32089 leader_election.cc:400] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12.
I20260709 13:14:27.020908 32239 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:27.021733  3699 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:27.022123 32239 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:27.022861  3699 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:27.023970  3671 consensus_queue.cc:1048] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:27.025949 32239 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:27.026678  3671 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:26.997066  3607 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:26.983603  3572 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:27.052387 32089 leader_election.cc:400] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12.
I20260709 13:14:27.054288 32089 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:27.064626  3435 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:27.075414  3694 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 10. Current term is 11.
I20260709 13:14:27.080631 32089 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:27.081138 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:27.084227 32123 raft_consensus.cc:1275] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:27.091975 32089 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:27.094772 32119 raft_consensus.cc:2393] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 10: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:26.999856  3654 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:27.098640  3643 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:27.063746  3648 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:27.114426  3647 raft_consensus.cc:2749] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:27.104377 32119 raft_consensus.cc:1275] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:27.039166  3602 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:27.113368  3742 log.cc:927] Time spent T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:14:27.047389  3671 consensus_queue.cc:1048] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:14:27.058228  3616 consensus_queue.cc:1048] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:14:27.068022  3617 consensus_queue.cc:1048] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:14:27.162166 32123 raft_consensus.cc:1275] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:27.166894  3602 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:14:27.171732 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 79874.8us
I20260709 13:14:27.175655 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:27.176780 32122 raft_consensus.cc:2393] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 9: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
W20260709 13:14:27.176700 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 146013us
I20260709 13:14:27.191368  3654 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:27.194327 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:27.194875 32122 raft_consensus.cc:1275] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:14:27.195169 32119 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:14:27.202370  3628 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:27.205324  3572 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:27.214934  3648 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:14:27.216714  3743 log.cc:927] Time spent T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.232s	user 0.002s	sys 0.000s
I20260709 13:14:27.209606 32022 catalog_manager.cc:5697] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 11 to 12, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1), now has a pending config: VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1), VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2), VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3), VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 12 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } } pending_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:27.216846  3753 raft_consensus.cc:2955] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Committing config change with OpId 11.7: config changed from index 6 to 7, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:14:27.313042 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 102351us
I20260709 13:14:27.411381  3607 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:27.412703 32165 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:27.411934   401 raft_consensus.cc:2955] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Committing config change with OpId 11.7: config changed from index 6 to 7, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:27.433832 32269 raft_consensus.cc:2955] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Committing config change with OpId 11.7: config changed from index 6 to 7, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:14:27.414196 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:27.430276  3628 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:27.372967  3602 consensus_queue.cc:1048] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:27.455065  3637 raft_consensus.cc:3055] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:27.455683  3637 raft_consensus.cc:740] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
W20260709 13:14:27.467175  3720 log.cc:927] Time spent T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.639s	user 0.006s	sys 0.008s
I20260709 13:14:27.468725 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:27.469415 32196 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:14:27.469748 32115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 2158) took 1463 ms. Trace:
I20260709 13:14:27.469648  3637 consensus_queue.cc:260] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:27.470737 32193 raft_consensus.cc:1275] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:14:27.470274 32115 rpcz_store.cc:276] 0709 13:14:26.006773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:26.010251 (+  3478us) service_pool.cc:224] Handling call
0709 13:14:26.033708 (+ 23457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:26.040314 (+  6606us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:26.040344 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:26.161594 (+121250us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b2c000278a8. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59d8eaa11 00007fb59d8fa372 00007fb59f02ca01 00007fb59eff143a 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2
0709 13:14:26.167177 (+  5583us) log.cc:844] Serialized 26 byte log entry
0709 13:14:26.460047 (+292870us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:26.460962 (+   915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:26.461413 (+   451us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:27.466636 (+1005223us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:14:27.469418 (+  2782us) raft_consensus.cc:1685] finished
0709 13:14:27.469440 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:27.469660 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6668,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"spinlock_wait_cycles":13622912,"thread_start_us":277094,"threads_started":1,"wal-append.queue_time_us":578363}
W20260709 13:14:27.490468 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 77860.8us
I20260709 13:14:27.491708  3505 raft_consensus.cc:2804] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:27.492102  3505 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:27.492450  3505 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:27.494037  3751 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:27.498566  3628 consensus_queue.cc:1059] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:27.500236  3643 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:27.500355  3702 raft_consensus.cc:3055] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:27.500952  3702 raft_consensus.cc:740] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:27.500908  3643 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:27.502015  3637 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:27.502116 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:27.501984  3702 consensus_queue.cc:260] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:27.502915 32193 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:14:27.503401  3643 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:27.504191  3702 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:27.504490 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:27.505240 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:27.513048 32193 raft_consensus.cc:1275] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:27.514964  3505 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
W20260709 13:14:27.521437 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 245047us
I20260709 13:14:27.525492 32165 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:27.540036 32165 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:27.555706 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:27.529858  3607 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:27.578250 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:27.598875 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 62949us
I20260709 13:14:27.531704 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:27.600693 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 45098us
I20260709 13:14:27.599586 32238 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:27.545877  3572 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:14:27.606330 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 59767.3us
I20260709 13:14:27.602320  3751 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:27.596518  3702 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:27.552673  3661 consensus_queue.cc:1048] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:14:27.615348 32239 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:27.614254 32165 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:27.547796  3666 consensus_queue.cc:1048] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:14:27.622103 32165 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:27.620127 32238 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:27.623103  3715 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:14:27.623488 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 60962.1us
I20260709 13:14:27.623853  3607 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:27.620839  3762 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:27.553795  3643 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:27.614723  3572 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:27.642906  3694 raft_consensus.cc:2804] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:27.643483  3671 consensus_queue.cc:1048] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:27.644652  3747 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:27.646167  3505 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:27.618803  3705 consensus_queue.cc:1048] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:14:27.597311  3628 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:14:27.650111  3715 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:27.622370  3668 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:27.618566  3751 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:27.606731  3654 consensus_queue.cc:1048] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:14:27.681831  3641 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:27.616508  3617 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:27.636274  3640 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:27.690312 32238 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:27.683122  3572 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:27.682318  3694 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:27.716120  3435 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:27.716475  3435 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:27.716835  3435 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:27.718407  3768 log.cc:927] Time spent T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:14:27.714879  3733 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:27.692562  3616 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:27.723217  3733 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:27.723328  3616 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:27.689962  3667 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:27.725013  3667 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:27.726045  3733 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:27.727421  3667 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:27.685333  3643 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:27.714788  3640 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:27.729696  3643 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:27.731101  3616 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:27.731317  3640 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:27.733582  3435 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:27.696807  3647 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:27.695338  3715 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:27.688917  3648 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:27.686693  3762 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:27.694428  3607 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:27.697018  3751 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:27.743541  3435 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:27.698834  3669 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:27.712184  3641 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:27.734086  3694 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:27.699110  3696 consensus_queue.cc:1048] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:14:27.754506  3668 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:27.756074  3772 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:27.755779  3607 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:27.756924  3775 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:27.757689  3669 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:27.748189  3648 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:27.745128  3647 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:27.743177  3617 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:27.777045  3765 log.cc:927] Time spent T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.219s	user 0.004s	sys 0.000s
I20260709 13:14:27.788604  3775 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:27.790571  3762 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:27.800647 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:27.773874  3641 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:27.797907 32264 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:14:27.805629 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:27.805788 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:27.808053 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:27.812330  3715 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:27.814507  3715 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:27.815398  3775 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:27.816211  3669 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:27.817323  3751 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:27.817819  3607 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:27.819406  3751 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:27.820758  3648 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:27.822045  3647 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:27.803514  3758 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:27.807525 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:27.806280 32268 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
W20260709 13:14:27.827430 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 71792.5us
I20260709 13:14:27.830627 32019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49556 (request call id 252) took 2056 ms. Trace:
I20260709 13:14:27.832669  3758 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:27.834903  3617 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:27.795089  3772 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:27.840766  3647 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:27.863512  3778 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:27.864148  3778 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:27.866505  3778 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:27.871548  3694 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:27.850464  3762 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:27.852929  3640 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:27.859472  3772 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:27.862291   397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:27.862818  3758 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:27.873283 32115 raft_consensus.cc:1275] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:27.870639  3778 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:27.875912  3572 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:27.867715 32022 catalog_manager.cc:5697] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 6 to 7, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1), VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2), VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3), VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 12 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:27.925628 32022 catalog_manager.cc:5697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 13 to 14, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 14 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:27.885599  3647 raft_consensus.cc:1064] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:14:27.885704 32090 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:27.846096 32019 rpcz_store.cc:276] 0709 13:14:25.777771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:25.778597 (+   826us) service_pool.cc:224] Handling call
0709 13:14:27.830557 (+2051960us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:26.987843 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:27.076140 (+ 88297us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:27.076175 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:14:27.076191 (+    16us) tablet.cc:662] Decoding operations
0709 13:14:27.076626 (+   435us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:27.076679 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:27.076705 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:14:27.077016 (+   311us) tablet.cc:701] Row locks acquired
0709 13:14:27.077030 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:14:27.077176 (+   146us) write_op.cc:270] Start()
0709 13:14:27.077298 (+   122us) write_op.cc:276] Timestamp: P: 1783602867077125 usec, L: 0
0709 13:14:27.077317 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:14:27.081252 (+  3935us) log.cc:844] Serialized 917 byte log entry
0709 13:14:27.201030 (+119778us) op_driver.cc:464] REPLICATION: finished
0709 13:14:27.269302 (+ 68272us) write_op.cc:301] APPLY: starting
0709 13:14:27.269420 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:27.269618 (+   198us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:27.269776 (+   158us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:27.270280 (+   504us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:27.270560 (+   280us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:14:27.270690 (+   130us) write_op.cc:312] APPLY: finished
0709 13:14:27.270963 (+   273us) log.cc:844] Serialized 29 byte log entry
0709 13:14:27.271214 (+   251us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:27.271338 (+   124us) write_op.cc:454] Released schema lock
0709 13:14:27.271395 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:27.519973 (+248578us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b5400047a00. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a295b161 00007fb5a2a3033d 00007fb5a2a293c2 00007fb5a2a28b53 00007fb5a2a2cd61 00007fb5a2a2cd19 00007fb5a2a2cca9 00007fb5a2a2cc71 00007fb5a2a2be9d 000000000038f354 000000000038f199
0709 13:14:27.520216 (+   243us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:27.520244 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":54859,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":66213,"apply.run_cpu_time_us":11188,"apply.run_wall_time_us":250894,"num_ops":2,"prepare.queue_time_us":296358,"prepare.run_cpu_time_us":3755,"prepare.run_wall_time_us":100010,"replication_time_us":104388,"spinlock_wait_cycles":82201344,"thread_start_us":227948,"threads_started":2}]]}
I20260709 13:14:27.901611 32117 raft_consensus.cc:1275] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:14:27.845486 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 223433us
I20260709 13:14:27.930601 32165 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:27.931579 32193 raft_consensus.cc:1240] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:27.909795 32192 raft_consensus.cc:1240] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:27.910501 32197 raft_consensus.cc:1240] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:27.910822 32190 raft_consensus.cc:1275] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:27.933497 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:27.913643 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:27.914980 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:27.903328  3735 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:27.934510 32198 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:27.917917 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:14:27.934310 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 48678us
I20260709 13:14:27.932222 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:27.941026 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:27.941666 32115 raft_consensus.cc:2393] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 11: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:27.947201 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:27.947961 32115 raft_consensus.cc:2393] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 9: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:27.958539 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:27.958846 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:27.959565 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:27.959614 32117 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:14:27.962535 32194 raft_consensus.cc:1240] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:14:27.974541 32199 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
W20260709 13:14:27.945303  3647 raft_consensus.cc:1068] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d: Unable to promote non-voter 94085cf341634eb686a95983b6b7f7e6: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:14:27.945761  3758 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:27.966785 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:27.982501 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:27.938896  3671 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:27.990181 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:27.990393 32190 raft_consensus.cc:1275] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:27.985391 32271 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:27.992005 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:27.958753  3628 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:27.923705  3640 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:27.990846 32270 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:14:28.000902 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:27.938287  3778 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:27.944892  3762 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:27.985080  3758 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:27.951220  3735 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:28.009622 32115 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:14:28.011415   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:28.011747 32197 raft_consensus.cc:1240] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 13:14:28.013727  3777 log.cc:927] Time spent T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:14:28.015311  3647 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:28.015838  3647 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:28.018159  3647 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:28.030540 32116 raft_consensus.cc:1275] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:28.033375  3763 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:28.034102  3763 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:28.035441  3694 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:28.036911  3763 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:28.038937 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:28.033484  3572 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:28.023011  3758 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:28.053135 32090 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:27.998641  3671 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:28.046204   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:28.054472 32090 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:28.079106 32239 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:28.075464 32090 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
W20260709 13:14:28.074826 32089 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 2.038s (SENT)
I20260709 13:14:28.087877 32266 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:14:28.063432  3763 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:28.094314 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:28.096056 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:28.046571   397 raft_consensus.cc:2468] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 5.
I20260709 13:14:28.075855  3647 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:28.101429 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:14:28.102497 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 112294us
I20260709 13:14:28.088843  3607 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:28.076434  3751 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:28.094548  3763 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:14:28.214591 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 119214us
W20260709 13:14:28.217725  3782 log.cc:927] Time spent T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:14:28.218103  3731 consensus_queue.cc:1048] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.121s
W20260709 13:14:28.218534 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 119073us
I20260709 13:14:28.234272 32165 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:28.097107  3705 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 13:14:28.246328 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:28.246956 32124 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:28.216982  3667 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:28.242635 32238 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:28.254194 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:28.262115 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:28.262341 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:28.262631 32238 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:28.262956 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:28.263717 32273 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:28.254958  3435 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:28.264885 32090 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:28.264986  3435 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:28.256260 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:28.233281  3763 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:28.227195  3647 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:28.275424 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:28.276616 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:14:28.241225  3768 log.cc:927] Time spent T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.148s	user 0.006s	sys 0.000s
I20260709 13:14:28.260686  3667 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:14:28.279698  3784 log.cc:927] Time spent T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 13:14:28.279606 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:14:28.314530 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 51973.1us
W20260709 13:14:28.249240  3687 log.cc:927] Time spent T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:14:28.295748 32124 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:14:28.319247 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:28.308620  3602 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:28.285138  3435 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:28.307516 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:28.310575 32271 raft_consensus.cc:1240] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:14:28.281157  3715 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:28.233201  3751 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:28.248685  3666 consensus_queue.cc:1059] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:14:28.305528 32120 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:28.314620  3694 consensus_queue.cc:1048] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:14:28.350747 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:28.351572 32115 raft_consensus.cc:1240] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:14:28.309122  3647 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:28.357199 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:28.270464  3762 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:28.316707  3697 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:14:28.339959 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 265134us
I20260709 13:14:28.248827  3669 consensus_queue.cc:1048] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:14:28.313966  3667 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:28.306955  3772 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:28.343227 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:28.343227 32122 raft_consensus.cc:2393] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 11: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:28.303447  3607 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:28.317013  3733 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:28.331929  3602 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:28.308852  3661 consensus_queue.cc:1059] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
W20260709 13:14:28.366331  3756 log.cc:927] Time spent T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.134s	user 0.005s	sys 0.000s
I20260709 13:14:28.366799  3736 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:28.381146  3654 raft_consensus.cc:3055] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:28.310966  3659 consensus_queue.cc:1059] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:14:28.384567 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:28.390347 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:28.393577 32090 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:28.398707 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:28.402706 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:28.367306 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:28.373202  3775 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:28.322268  3641 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:28.398432  3602 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:28.438741  3783 log.cc:927] Time spent T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
W20260709 13:14:28.439349 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 45849.9us
I20260709 13:14:28.391238  3607 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:28.438133  3734 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:14:28.438665  3759 log.cc:927] Time spent T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:14:28.383778  3697 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:28.485975  3697 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:28.404872  3671 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:28.447425 32120 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:28.444214  3617 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:28.487018  3617 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:28.487537  3617 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:28.490916  3778 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:28.483374  3779 consensus_queue.cc:1048] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:14:28.419612  3654 raft_consensus.cc:740] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:14:28.509311 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 194056us
I20260709 13:14:28.397989  3733 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:28.454116  3607 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:28.449462  3736 raft_consensus.cc:697] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:28.396975  3772 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
W20260709 13:14:28.524776  3798 log.cc:927] Time spent T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.077s	user 0.003s	sys 0.000s
I20260709 13:14:28.443238  3775 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:28.529178  3785 log.cc:927] Time spent T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.288s	user 0.000s	sys 0.013s
I20260709 13:14:28.494376 32194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "002126350f9348faac039e490fafb4d7"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:14:28.549736 32194 raft_consensus.cc:606] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:28.531984  3735 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:28.565750  3757 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:28.567207  3790 log.cc:927] Time spent T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:14:28.568178 32194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "375545897daf43fa925e7b181b2a634b"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:14:28.565096 32264 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
I20260709 13:14:28.568814 32194 raft_consensus.cc:606] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:28.569238 32194 raft_consensus.cc:614] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:14:28.569238 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 45515.5us
I20260709 13:14:28.597481 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:28.598336 32197 raft_consensus.cc:2393] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 11: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:28.598376 32198 raft_consensus.cc:1275] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:28.599555 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:28.605510 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:28.605695 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:28.611295 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:28.612720 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:28.613098 32193 raft_consensus.cc:1275] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:28.613526 32199 raft_consensus.cc:2368] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 8. Current term is 9.
I20260709 13:14:28.616185 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:28.618093 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:28.622881 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:28.623924 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:28.625874 32198 raft_consensus.cc:2393] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 12: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:28.625877 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:28.594735  3715 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:28.604166  3572 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:28.630722 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:28.633973 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:28.634850 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:28.636571 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:28.637820 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:28.608496  3671 consensus_queue.cc:1059] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:14:28.664482 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:28.673426  3753 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:28.674059  3753 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:28.674338 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:28.666710 32196 raft_consensus.cc:1240] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:28.676173  3753 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:28.679483 32236 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:28.681597  3666 raft_consensus.cc:2804] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:28.682088  3666 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:28.682528  3666 raft_consensus.cc:3060] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:28.683857 32239 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:28.609840  3694 consensus_queue.cc:1059] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 13:14:28.692175   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 316941us
I20260709 13:14:28.708353  3435 raft_consensus.cc:3055] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:28.708982  3435 raft_consensus.cc:740] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:28.506439  3734 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:28.566347  3757 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:28.706157  3696 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:28.632012  3715 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:28.744670  3641 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:14:28.746516  3802 log.cc:927] Time spent T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:14:28.709926  3435 consensus_queue.cc:260] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:14:28.748157 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:14:28.779789 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 94502.7us
I20260709 13:14:28.606750  3654 consensus_queue.cc:260] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:28.772377 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:28.696910  3659 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:28.749439  3669 raft_consensus.cc:3055] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:28.638482  3572 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:28.772069 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:28.793056 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:28.793916 32165 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:28.794030 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:28.825150 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:28.796536  3659 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:28.796695  3617 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:28.797612 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:28.830994 32196 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
W20260709 13:14:28.798472  3797 log.cc:927] Time spent T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:14:28.771328  3696 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:28.804924  3666 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:28.810683  3734 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:28.813719  3762 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:28.816707  3667 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:28.817044 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:28.925519 32124 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:28.817935 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:28.819175 32117 raft_consensus.cc:1240] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:14:28.820573 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:28.927779 32115 raft_consensus.cc:2393] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 9: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:28.825901 32120 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:14:28.776245  3671 raft_consensus.cc:3055] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:28.633589  3736 consensus_queue.cc:237] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:28.836179 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:28.872054 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:28.878728 32196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:14:28.819738  3669 raft_consensus.cc:740] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:14:28.944962 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 164159us
I20260709 13:14:28.711434  3602 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:28.945346 32122 raft_consensus.cc:1240] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:28.945395 32196 raft_consensus.cc:606] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:28.947995 32239 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:28.877852  3696 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:28.879011  3733 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:28.955551 32272 raft_consensus.cc:1240] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:28.934165  3671 raft_consensus.cc:740] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:28.944451  3734 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:28.953332  3648 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:28.966975 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 179254us
I20260709 13:14:28.933641  3643 consensus_queue.cc:1048] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:14:28.974906 32089 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:28.933796  3762 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:28.978749 32089 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:14:28.979862 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 147541us
I20260709 13:14:28.987982 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:28.990679 32268 raft_consensus.cc:2393] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 9: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:28.980680  3648 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:28.991981 32196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d002861120de41408d48712b6bd491e1"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:14:28.992686  3648 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:28.992734 32196 raft_consensus.cc:606] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 13 LEADER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:29.000674 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:28.997154   369 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:29.007710 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 59875.7us
I20260709 13:14:29.013554 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:29.014099 32089 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:29.015610 32089 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:28.984503  3818 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:29.020799  3762 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:29.032938  3823 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:29.033203  3762 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:29.033334  3617 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:29.033692  3823 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:29.016660  3757 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:28.986109  3667 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:29.020258 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:14:29.042362 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:29.043509 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:29.017138  3647 consensus_meta.cc:287] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.636s	user 0.011s	sys 0.000s
I20260709 13:14:28.980373  3734 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:29.018391  3669 consensus_queue.cc:260] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.016778  3806 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:29.046802 32239 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
W20260709 13:14:29.086330 32162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 67232.2us
I20260709 13:14:29.116317 32022 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59534 (request call id 118) took 1279 ms. Trace:
I20260709 13:14:29.099618 32198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
W20260709 13:14:29.124472 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 77743.7us
I20260709 13:14:29.129348 32198 raft_consensus.cc:606] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:29.130167  3826 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:29.080132 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 97560.2us
I20260709 13:14:29.126791 32197 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
W20260709 13:14:29.127985 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 112487us
I20260709 13:14:29.129556 32239 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
W20260709 13:14:29.057051 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 263213us
W20260709 13:14:29.148459  3763 consensus_meta.cc:287] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.829s	user 0.011s	sys 0.000s
I20260709 13:14:29.148666  3762 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:29.148948  3763 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.149290  3762 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.062955  3696 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.150139 32119 raft_consensus.cc:1240] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:29.151644  3762 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:29.151835  3666 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:14:29.152299  3799 log.cc:927] Time spent T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.548s	user 0.008s	sys 0.008s
I20260709 13:14:29.154071 32121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 3177) took 1148 ms. Trace:
I20260709 13:14:29.154651 32089 leader_election.cc:400] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 8. Current term is 9.
I20260709 13:14:29.129012 32022 rpcz_store.cc:276] 0709 13:14:27.836659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:27.836823 (+   164us) service_pool.cc:224] Handling call
0709 13:14:29.116228 (+1279405us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:27.980443 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:28.036195 (+ 55752us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:28.036233 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:14:28.036250 (+    17us) tablet.cc:662] Decoding operations
0709 13:14:28.036819 (+   569us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:28.036892 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:28.036931 (+    39us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:14:28.037241 (+   310us) tablet.cc:701] Row locks acquired
0709 13:14:28.037268 (+    27us) write_op.cc:260] PREPARE: finished
0709 13:14:28.037447 (+   179us) write_op.cc:270] Start()
0709 13:14:28.037599 (+   152us) write_op.cc:276] Timestamp: P: 1783602868037398 usec, L: 0
0709 13:14:28.037630 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:14:28.038402 (+   772us) log.cc:844] Serialized 1029 byte log entry
0709 13:14:28.772715 (+734313us) op_driver.cc:464] REPLICATION: finished
0709 13:14:28.971712 (+198997us) write_op.cc:301] APPLY: starting
0709 13:14:28.971827 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:28.997151 (+ 25324us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:29.016604 (+ 19453us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:29.039221 (+ 22617us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:29.047302 (+  8081us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:14:29.055257 (+  7955us) write_op.cc:312] APPLY: finished
0709 13:14:29.055453 (+   196us) log.cc:844] Serialized 29 byte log entry
0709 13:14:29.055614 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:29.055697 (+    83us) write_op.cc:454] Released schema lock
0709 13:14:29.055740 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:29.056106 (+   366us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:29.056134 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":192451,"apply.run_cpu_time_us":2236,"apply.run_wall_time_us":84371,"num_ops":2,"prepare.queue_time_us":11838,"prepare.run_cpu_time_us":3319,"prepare.run_wall_time_us":73082,"replication_time_us":666827,"thread_start_us":142686,"threads_started":1}]]}
W20260709 13:14:29.046625  3607 consensus_meta.cc:287] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.502s	user 0.006s	sys 0.002s
I20260709 13:14:29.161965 32197 raft_consensus.cc:1240] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:14:29.154598 32121 rpcz_store.cc:276] 0709 13:14:28.005832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:28.005956 (+   124us) service_pool.cc:224] Handling call
0709 13:14:28.006285 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:28.010886 (+  4601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:28.010917 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:28.011370 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:14:28.241885 (+230515us) spinlock_profiling.cc:243] Waited 7.1 ms on lock 0x7b180002fec0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bee6e07 00007fb5a4d41ab9 00007fb59bf0369b 00007fb59bf0193f 00007fb59bf03c02 00007fb59eb8b20b 00007fb59eb90d23 00007fb59eb910d1 00007fb59efaca0f
0709 13:14:28.368784 (+126899us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:28.368832 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:28.368898 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:29.151567 (+782669us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:14:29.153803 (+  2236us) raft_consensus.cc:1685] finished
0709 13:14:29.153836 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:29.153999 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1960,"raft.queue_time_us":2517,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":22542080,"thread_start_us":126701,"threads_started":1,"wal-append.queue_time_us":526906}
I20260709 13:14:29.163632 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:29.164003  3824 consensus_queue.cc:1048] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:29.167476 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:29.169101 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:29.169737 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:29.170733 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:29.171979 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:29.172773 32264 raft_consensus.cc:2393] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 9: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:29.175776 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:29.176117 32195 raft_consensus.cc:1240] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:14:29.176059 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:29.176452 32264 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:29.177184 32196 raft_consensus.cc:2410] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:14:29.105710  3810 log.cc:927] Time spent T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.232s	user 0.004s	sys 0.000s
W20260709 13:14:29.102494  3758 consensus_meta.cc:287] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 1.034s	user 0.013s	sys 0.000s
W20260709 13:14:29.102430  3822 log.cc:927] Time spent T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:14:29.163391 32089 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:29.162722 32165 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:29.178191 32238 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:29.179852 32239 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:29.062180  3732 raft_consensus.cc:2804] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:29.181277 32197 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:29.177443 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:29.061893  3661 raft_consensus.cc:3055] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:29.152701  3696 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:29.057341  3602 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:29.098202  3640 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:29.064893  3715 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:29.057662  3805 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:29.185732 32089 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:29.056716  3572 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:29.158542  3697 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:29.065620  3659 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:29.193917 32090 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:29.177608  3667 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:29.190627 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:29.196710 32089 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:29.186528  3502 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:29.185719  3661 raft_consensus.cc:740] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:29.050333  3671 consensus_queue.cc:260] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.185751  3757 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:29.177912  3747 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:29.185130  3702 consensus_queue.cc:1059] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:14:29.193792  3779 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:29.189167  3694 consensus_queue.cc:1059] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:14:29.204811  3640 raft_consensus.cc:2749] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:29.154045  3647 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.201658 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:29.130689  3826 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.212934 32089 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:29.212103  3502 raft_consensus.cc:697] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:29.178653  3607 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.184271  3758 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.205066  3697 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:29.231769  3697 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:29.212312  3733 consensus_queue.cc:1059] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:14:29.238117  3826 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:29.217132  3616 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:29.238718 32122 raft_consensus.cc:1240] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:29.205780  3696 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:29.205022  3667 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:29.226277 32089 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:29.226967  3818 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:29.229043  3502 consensus_queue.cc:237] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:29.247115 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 59421.6us
I20260709 13:14:29.238171  3758 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:29.250075 32089 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:29.251822 32089 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:29.255513 32165 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:29.262435 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 82650.5us
I20260709 13:14:29.249459  3667 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:29.248931  3824 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:29.261993  3818 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:29.258879  3779 raft_consensus.cc:697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:29.268646  3758 consensus_queue.cc:1059] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:14:29.269191  3831 log.cc:927] Time spent T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:14:29.269568  3779 consensus_queue.cc:237] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.267246  3637 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:29.264319 32238 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:29.256799  3616 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:29.241466  3702 consensus_queue.cc:1059] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:14:29.259238  3732 raft_consensus.cc:697] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:29.284765 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:29.288233 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:29.288643 32118 raft_consensus.cc:2393] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 10: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:29.216037  3747 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.289135 32120 raft_consensus.cc:2393] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 12: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:29.290709 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:29.291466  3763 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:29.292107  3647 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:29.281723  3668 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:29.294409  3728 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:29.294919  3806 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:29.294997  3728 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:29.295703  3827 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:29.296109  3827 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:29.296314  3572 raft_consensus.cc:3055] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:29.296460  3827 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:29.296844  3572 raft_consensus.cc:740] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:29.297269  3728 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:29.297820  3572 consensus_queue.cc:260] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:29.299368  3572 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:29.302551 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:29.303447 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:29.306957 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:29.307935 32116 raft_consensus.cc:2410] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:14:29.309631 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:29.314483  3747 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:29.316660  3668 raft_consensus.cc:697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:29.351254 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:29.358624 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 103206us
I20260709 13:14:29.369895 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:29.374104 32165 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:29.375938 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:29.376860 32239 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:29.400435  3607 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:29.393961  3827 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.391841  3667 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.413589 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:29.413488 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:29.439114 32123 raft_consensus.cc:2368] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 11. Current term is 12.
I20260709 13:14:29.410425 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:29.413998 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:29.402509  3671 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:29.384078  3616 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:29.414392 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:29.440781  3827 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:29.418503  3753 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:29.381325  3803 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:29.416395 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:29.396183  3697 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.395541  3751 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:29.394389  3668 consensus_queue.cc:237] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.525054  3697 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:29.442545  3654 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:29.412890 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:29.378573  3732 consensus_queue.cc:237] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
W20260709 13:14:29.443913 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 59163.3us
I20260709 13:14:29.444645  3667 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:29.394888  3775 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:29.450955  3757 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:29.493242  3637 raft_consensus.cc:3055] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:29.530416  3637 raft_consensus.cc:740] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:29.493549  3505 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:29.531373  3738 raft_consensus.cc:993] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801: : Instructing follower 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:14:29.530501 32165 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:29.497551  3763 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:29.532661  3763 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.533231 32165 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:29.498458 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:29.534778  3572 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:29.534937  3763 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:29.499544 32118 raft_consensus.cc:1240] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:14:29.430665  3747 raft_consensus.cc:993] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801: : Instructing follower 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:14:29.514175 32268 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:29.509845 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:29.538372 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:29.539252  3751 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:29.517593 32239 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:29.540953  3702 raft_consensus.cc:1081] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 13 LEADER]: Signalling peer 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:14:29.542326 32239 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:29.543678 32165 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:29.531636  3505 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.551558  3572 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:29.521710  3753 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.532994  3502 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:29.542665  3731 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:29.552421  3505 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:29.544512  3697 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:29.554687  3753 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:29.561623  3661 consensus_queue.cc:260] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.562785  3661 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:29.567315 32165 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:29.568142  3505 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:29.562775 32020 catalog_manager.cc:5697] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:29.577382  3505 raft_consensus.cc:697] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 11 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:29.577932  3435 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:29.578770  3505 consensus_queue.cc:237] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.532015  3738 raft_consensus.cc:1081] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Signalling peer 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:14:29.581375  3637 consensus_queue.cc:260] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.517441 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:29.582607  3637 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:29.582823 32192 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 9.
I20260709 13:14:29.518147  3616 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:14:29.584543 32089 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:29.585376  3616 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:29.585942  3616 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:29.586319  3616 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:29.586822  3616 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:29.399801  3772 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:29.539060  3669 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:29.588059 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:29.547901 32273 raft_consensus.cc:1240] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:29.547621 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:29.576923 32020 catalog_manager.cc:5697] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:29.586369  3776 consensus_queue.cc:1059] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:14:29.591908  3776 raft_consensus.cc:3055] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:29.592507  3776 raft_consensus.cc:740] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:29.590984 32020 catalog_manager.cc:5697] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 13 to 15, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 15 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:29.600788  3838 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:14:29.545111 32239 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:29.612648 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 67611us
I20260709 13:14:29.613162 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:29.593801  3776 consensus_queue.cc:260] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.617424 32089 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:29.623111 32120 raft_consensus.cc:1240] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:29.623831 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:29.624686 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:29.628053 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:29.630328 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:29.631667 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:29.631901 32268 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:14:29.632356 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:29.632860 32269 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:14:29.633119 32090 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:29.635164  3763 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:29.635758  3763 raft_consensus.cc:697] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 13 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:29.637035 32271 raft_consensus.cc:1240] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:29.637110  3763 consensus_queue.cc:237] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.641022 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:29.641237 32090 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:29.632946  3772 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:29.645591  3648 raft_consensus.cc:2804] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:29.646063  3648 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:29.646442  3648 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:29.652261 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:29.653585 32239 leader_election.cc:400] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 11. Current term is 12.
I20260709 13:14:29.658025 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:29.625962  3734 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:29.679721 32165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.673990 32121 raft_consensus.cc:1240] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:29.679154 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:29.683295 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:29.685642   369 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:29.648468  3820 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:29.713752   369 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:29.716086  3806 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:29.716747  3734 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:29.716385  3702 consensus_queue.cc:1059] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:29.682024  3715 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:29.718393  3502 raft_consensus.cc:3055] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:29.718263  3715 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.718833  3502 raft_consensus.cc:740] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:29.719828  3502 consensus_queue.cc:260] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.721678  3502 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:29.725863  3648 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:14:29.696959  3572 consensus_queue.cc:1059] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:29.697152 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:29.739836 32197 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:29.697751 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:29.698222 32191 raft_consensus.cc:1240] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:14:29.698522 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:29.698762  3838 consensus_queue.cc:1059] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:29.699187 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:29.741870 32196 raft_consensus.cc:2410] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:14:29.689319  3776 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:29.699715 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:29.699949  3840 consensus_queue.cc:1059] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:29.700520  3787 raft_consensus.cc:993] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801: : Instructing follower fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:14:29.700937 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:29.696975 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:29.761427 32192 raft_consensus.cc:2410] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:14:29.679112 32265 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d002861120de41408d48712b6bd491e1"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:36080
I20260709 13:14:29.761926 32265 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:29.762284 32265 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:29.710330 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:29.726763 32193 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:14:29.695248  3803 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:29.690068 32271 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "002126350f9348faac039e490fafb4d7"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:36080
I20260709 13:14:29.765672 32271 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:29.766149 32271 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:29.720331  3715 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:29.737178 32270 raft_consensus.cc:1240] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:29.744246 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:29.744349 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:29.770725 32165 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:29.771109 32266 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
W20260709 13:14:29.757679 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 45984.6us
I20260709 13:14:29.772238 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:29.774443 32199 raft_consensus.cc:2393] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 9: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:29.767925 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:29.757850 32198 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:29.763339 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:29.777086  3747 consensus_queue.cc:1059] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:29.771014 32117 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
I20260709 13:14:29.777918 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:29.778182  3747 raft_consensus.cc:3055] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:29.778651  3747 raft_consensus.cc:740] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:29.779939  3648 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:29.781531 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:29.781973 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:29.783197 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:29.783740 32193 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:29.778672 32190 raft_consensus.cc:2393] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 15: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:29.779594  3747 consensus_queue.cc:260] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.785419 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:29.788021 32238 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:29.787609   369 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:29.792142 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:29.792896 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:29.808418  3840 raft_consensus.cc:3055] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:29.809039  3840 raft_consensus.cc:740] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:29.809855  3840 consensus_queue.cc:260] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.811079  3840 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:29.817836 32117 raft_consensus.cc:1275] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:14:29.794799 32271 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.822379 32238 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:29.823663 32165 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:29.817710 32265 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.846614 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:29.848986 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:29.849645 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:29.850219 32117 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:29.857784 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:29.773451  3787 raft_consensus.cc:3055] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:29.772794  3702 raft_consensus.cc:1081] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Signalling peer fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:14:29.877417 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:29.878335 32121 raft_consensus.cc:2393] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 14: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:29.880026 32196 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:14:29.880640 32193 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:29.778273  3572 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:29.821327  3648 raft_consensus.cc:3055] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:29.821911  3728 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:29.885807 32271 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:29.820900  3715 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:29.891412 32272 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:29.897149 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:29.870204  3667 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:29.904351 32267 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:14:29.852413  3805 consensus_queue.cc:1059] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:14:29.874243  3816 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:29.870959  3787 raft_consensus.cc:740] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:29.907589 32090 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:29.883244  3732 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:29.887961  3648 raft_consensus.cc:740] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:29.921749 32117 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:14:29.883314  3666 consensus_queue.cc:1048] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:14:29.914129  3747 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:29.920360  3616 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.930694  3616 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:29.909082  3659 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:29.943132 32123 raft_consensus.cc:1240] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:29.908161  3505 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:29.908789  3817 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:29.888841  3572 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.914960  3647 raft_consensus.cc:2804] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:14:29.953919 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 130358us
I20260709 13:14:29.957140 32165 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:29.967449 32165 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:29.920279  3732 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.963442  3647 raft_consensus.cc:697] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:29.973649 32194 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:29.969499  3637 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:29.988714 32165 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:29.953414  3659 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.974957  3738 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:29.959156  3817 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:29.958289  3648 consensus_queue.cc:260] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:29.999464  3648 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:30.009410  3502 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:30.031404  3669 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:30.032012  3669 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:30.006188 32190 raft_consensus.cc:2955] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Committing config change with OpId 11.7: config changed from index 6 to 7, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:30.062508 32199 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 8.
I20260709 13:14:29.987461  3787 consensus_queue.cc:260] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:30.070021 32239 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:14:30.089596 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.147434   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
W20260709 13:14:30.149565 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 76563.2us
I20260709 13:14:30.154657  3666 raft_consensus.cc:2804] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:30.035046  3502 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:30.013617  3738 consensus_queue.cc:1059] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
W20260709 13:14:30.163733  3856 log.cc:927] Time spent T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:14:30.066960  3669 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:30.166126  3659 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:30.166299  3728 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:30.170049   401 raft_consensus.cc:1240] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:30.170441  3728 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:30.171876  3732 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:14:30.172716  3687 log.cc:927] Time spent T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:14:30.172719  3848 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.173527  3817 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:30.173760  3848 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:30.039032  3647 consensus_queue.cc:237] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:14:30.178066 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:30.176260  3848 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:14:30.179352 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 188060us
I20260709 13:14:30.182410 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:30.183136 32236 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:30.180887  3728 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:30.188892 32089 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:30.162091  3502 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:30.189710 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:14:30.193536 32165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.196684  3747 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.197700 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:30.201340 32192 raft_consensus.cc:2393] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 9: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:30.198455 32089 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:30.202184   369 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:30.203779 32165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.204435 32089 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:14:30.204814 32165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.205603 32089 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:30.206149 32165 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:30.207830 32120 raft_consensus.cc:1275] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:30.209293 32089 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:30.211259 32198 raft_consensus.cc:1240] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:14:30.212898 32121 raft_consensus.cc:1240] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:30.210338  3728 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:30.214653  3859 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:30.214926  3753 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:30.215809  3757 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:30.203320  3818 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:30.192059  3705 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:14:30.234035 32197 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:30.244684 32115 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:56884
I20260709 13:14:30.245498 32115 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:30.246027 32115 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:30.252178 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:30.224404  3668 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.264158 32265 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:30.235088  3753 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:30.212790  3747 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:30.270442 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 177579us
I20260709 13:14:30.276258 32269 raft_consensus.cc:1240] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:30.263262 32115 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:30.280308  3833 raft_consensus.cc:3055] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:30.280975  3833 raft_consensus.cc:740] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:30.282122 32267 raft_consensus.cc:1240] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:30.287667 32267 raft_consensus.cc:1275] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:30.293757 32265 raft_consensus.cc:1240] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:30.292712 32115 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:30.266619  3827 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:30.267868  3753 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:14:30.307147 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 97936.6us
I20260709 13:14:30.319690 32089 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:30.353279 32089 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:30.267236  3668 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:30.317139  3861 log.cc:927] Time spent T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
W20260709 13:14:30.316403  3854 log.cc:927] Time spent T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:14:30.308511  3753 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:30.368810  3871 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:30.369431  3616 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:14:30.377060 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 107228us
I20260709 13:14:30.383064 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:30.386421 32265 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:30.308979  3858 consensus_queue.cc:1059] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:14:30.307256  3838 consensus_queue.cc:1059] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:14:30.317615  3776 consensus_queue.cc:1059] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:14:30.309125  3859 consensus_queue.cc:1048] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
W20260709 13:14:30.397538 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 44385.4us
I20260709 13:14:30.381835  3871 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:30.400916  3871 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:30.392148  3736 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.404644  3736 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:30.405004   400 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:14:30.405442   400 pending_rounds.cc:85] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6: Aborting all ops after (but not including) 6
I20260709 13:14:30.405711   400 pending_rounds.cc:107] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 8.7
I20260709 13:14:30.405958   400 raft_consensus.cc:2917] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Aborting config change with OpId 8.7: Aborted: Op aborted by new leader
I20260709 13:14:30.406385   400 raft_consensus.cc:2889] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 9 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:30.410573  3816 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:30.411492 32271 raft_consensus.cc:1240] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:30.415997 32089 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:30.419402 32089 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:30.424522 32265 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:30.425871 32089 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:30.425994 32090 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:30.427759  3840 raft_consensus.cc:3055] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:30.420339  3763 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:30.420234  3659 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:14:30.436553  3753 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:30.432226  3668 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:30.433027  3833 consensus_queue.cc:260] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:30.437525  3736 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:30.441128  3572 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:30.444103  3747 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:30.449080 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:30.394109  3666 raft_consensus.cc:697] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:30.454712  3616 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:30.455467  3738 raft_consensus.cc:3055] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:30.455950  3738 raft_consensus.cc:740] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:30.456959  3738 consensus_queue.cc:260] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:30.458350  3738 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:30.453027 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:30.444880  3502 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:30.430987  3840 raft_consensus.cc:740] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:30.459954  3874 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:14:30.467315  3616 raft_consensus.cc:697] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:30.474609  3616 consensus_queue.cc:237] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:30.474805  3502 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:30.478161  3840 consensus_queue.cc:260] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:30.478530  3870 log.cc:927] Time spent T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.058s	user 0.003s	sys 0.000s
I20260709 13:14:30.479600  3840 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:30.473239  3666 consensus_queue.cc:237] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:30.474632  3763 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:30.480665  3763 raft_consensus.cc:697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:30.481006  3833 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:30.481528  3763 consensus_queue.cc:237] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:30.489015  3871 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:30.491341  3871 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:30.495386 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:30.495978 32265 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:30.506232 32270 raft_consensus.cc:1240] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:30.511044 32270 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:30.513936  3753 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:30.516357 32265 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:30.521529 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:14:30.472350 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 44958.3us
I20260709 13:14:30.526608 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:30.529754 32089 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:30.531025 32265 raft_consensus.cc:2368] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10.
I20260709 13:14:30.534215 32165 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:30.535324 32090 leader_election.cc:400] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10.
I20260709 13:14:30.536814 32090 leader_election.cc:403] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:14:30.537281 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:30.538034 32197 raft_consensus.cc:3055] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:30.538419 32197 raft_consensus.cc:740] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:30.541769 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:30.545071 32089 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:30.547101 32195 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:14:30.547704 32195 pending_rounds.cc:85] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 6
I20260709 13:14:30.548038 32195 pending_rounds.cc:107] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 8.7
I20260709 13:14:30.548435 32195 raft_consensus.cc:2917] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Aborting config change with OpId 8.7: Aborted: Op aborted by new leader
I20260709 13:14:30.524945  3753 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:14:30.549407 32195 raft_consensus.cc:2889] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:30.551632 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:30.553486 32194 raft_consensus.cc:1275] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:14:30.535763  3758 raft_consensus.cc:2749] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:30.554502 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:30.555548  3874 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:30.603024  3705 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:30.566552  3787 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:30.567685 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:30.569623  3776 consensus_queue.cc:1048] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:30.570194  3819 raft_consensus.cc:1064] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
W20260709 13:14:30.611375  3819 raft_consensus.cc:1068] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d: Unable to promote non-voter 94085cf341634eb686a95983b6b7f7e6: Illegal state: Replica fcfc3281929645969ecedbb0c0af759d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:30.570960  3820 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:30.226806 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:30.612375  3820 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:30.549798 32197 consensus_queue.cc:260] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:30.577540  3848 consensus_queue.cc:1059] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:30.580775 32272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36084 (request call id 2526) took 1169 ms. Trace:
I20260709 13:14:30.617708 32272 rpcz_store.cc:276] 0709 13:14:29.410963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:29.413253 (+  2290us) service_pool.cc:224] Handling call
0709 13:14:30.580543 (+1167290us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b54001f7054. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:30.580681 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":641664768}
I20260709 13:14:30.581393 32273 raft_consensus.cc:1240] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:30.618477  3848 raft_consensus.cc:3055] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:30.619103  3848 raft_consensus.cc:740] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:30.620559 32273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 2176) took 1005 ms. Trace:
I20260709 13:14:30.620980 32273 rpcz_store.cc:276] 0709 13:14:29.615687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:29.615840 (+   153us) service_pool.cc:224] Handling call
0709 13:14:30.581117 (+965277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:30.618944 (+ 37827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:30.620379 (+  1435us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b54001f7050. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff08ad 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:30.620504 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2218897664}
I20260709 13:14:30.582553  3647 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:30.622237  3647 raft_consensus.cc:697] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 8 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:30.623376  3647 consensus_queue.cc:237] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:30.545425  3838 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:30.624897  3838 raft_consensus.cc:697] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:30.625727  3838 consensus_queue.cc:237] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:30.584838  3805 consensus_queue.cc:1059] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:30.601608 32238 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:30.586275 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:30.630919  3733 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:30.631440  3733 raft_consensus.cc:697] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:30.632027 32269 raft_consensus.cc:1275] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:30.632284  3733 consensus_queue.cc:237] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:30.633155 32266 raft_consensus.cc:1240] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:30.634655 32272 raft_consensus.cc:1275] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:14:30.635026 32272 pending_rounds.cc:85] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06: Aborting all ops after (but not including) 5
I20260709 13:14:30.635248 32272 pending_rounds.cc:107] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:14:30.635453 32272 raft_consensus.cc:2889] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:30.638721  3858 raft_consensus.cc:3055] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:30.639181  3858 raft_consensus.cc:740] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:30.640296  3858 consensus_queue.cc:260] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:30.641712  3858 raft_consensus.cc:3060] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:30.643918 32190 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:14:30.645318 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:30.646020 32272 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
W20260709 13:14:30.654217 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 101780us
I20260709 13:14:30.654624 32123 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:14:30.648957 32090 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:30.655359 32089 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:30.659528 32089 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:30.663036 32090 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:30.661556  3771 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:30.615118  3820 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:30.679273 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:30.683770 32117 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:14:30.685194 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:30.686107 32121 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:30.690413  3818 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:30.694357 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:30.699067 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:30.699795 32190 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:14:30.700500  3818 raft_consensus.cc:697] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:30.701510  3818 consensus_queue.cc:237] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:30.662144  3753 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:30.656769  3819 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:30.708865 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:30.709641 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:30.677464  3607 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:30.718107 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:30.620241  3848 consensus_queue.cc:260] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:30.691768  3771 raft_consensus.cc:697] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:30.742128 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:30.743227 32199 raft_consensus.cc:2393] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 9: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:30.745317 32195 raft_consensus.cc:1240] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:30.666637  3871 consensus_queue.cc:1048] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:14:30.748569 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:30.749529 32192 raft_consensus.cc:3055] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:30.750088 32192 raft_consensus.cc:740] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:30.754387 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:30.755291 32196 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:30.733201  3865 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.713805  3819 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:30.768836  3865 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:30.771872 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:30.772617 32195 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:30.774654 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:30.776031 32265 raft_consensus.cc:2393] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 11: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
W20260709 13:14:30.776600 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.777518 32190 raft_consensus.cc:1275] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:30.777817 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:30.778455 32122 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:30.781659 32238 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:30.783478 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:30.784222 32199 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:30.784900 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:30.735656  3753 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:30.733493  3607 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:30.788419 32192 consensus_queue.cc:260] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:30.710938  3805 consensus_queue.cc:1048] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
W20260709 13:14:30.790274 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.791504 32238 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:30.807907 32192 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:30.809031 32197 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:30.770676  3819 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:30.783056  3848 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:30.822989 32196 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:30.824062 32193 raft_consensus.cc:1240] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:30.819829 32238 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:30.832926  3435 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:30.833475  3435 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:30.833817  3435 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:30.793354  3607 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:30.832368 32238 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:30.842442 32192 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:30.810177  3661 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:30.812508  3671 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:30.856612  3865 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:30.808553  3753 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:30.812460  3827 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:30.845929  3659 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:30.833838  3873 consensus_queue.cc:1059] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:14:30.853826  3771 consensus_queue.cc:237] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:30.794977  3814 consensus_queue.cc:1048] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:14:30.887614 32118 raft_consensus.cc:1240] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:30.877966 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:30.911104 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:30.887614 32115 raft_consensus.cc:1240] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:30.841166 32197 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:14:30.885226 32123 raft_consensus.cc:1240] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 11. Current term is 12. Ops: []
W20260709 13:14:30.888315 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.919054 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:30.802831  3705 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:14:30.907987 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:30.876802  3435 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:30.953622  3435 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:30.954352 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:14:30.901243  3879 log.cc:927] Time spent T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:14:30.955350 32192 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:30.956103 32121 raft_consensus.cc:1275] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:30.957993 32118 raft_consensus.cc:1240] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 13 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:30.962495 32122 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:30.874701  3671 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:30.934634  3659 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:30.918272  3661 raft_consensus.cc:697] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:30.973407 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:30.974030 32192 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:30.878695  3863 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:30.979075 32089 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:30.993577 32192 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:30.970407  3873 raft_consensus.cc:3055] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:30.970183  3671 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:30.971997  3659 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:30.946741  3827 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:31.004698 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.029852 32238 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:30.981024  3732 consensus_queue.cc:1059] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
W20260709 13:14:31.038075 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 59068.8us
I20260709 13:14:31.044126 32089 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:30.990031  3863 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:30.997228  3820 consensus_queue.cc:1048] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:14:31.041157  3435 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:31.057116  3435 raft_consensus.cc:697] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:31.058111  3435 consensus_queue.cc:237] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:31.032286  3873 raft_consensus.cc:740] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:31.035238  3648 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:31.067898  3872 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:31.092767  3874 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10.
I20260709 13:14:31.062163  3661 consensus_queue.cc:237] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:31.125496  3827 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:31.105700  3872 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:14:31.119395  3787 consensus_meta.cc:287] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.514s	user 0.012s	sys 0.000s
I20260709 13:14:31.114523  3805 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.142891  3863 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:31.150044 32193 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:14:31.143072  3892 log.cc:927] Time spent T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:14:31.136286 32124 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:31.127393  3753 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:31.143726  3872 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:31.181577  3893 log.cc:927] Time spent T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:14:31.156827  3805 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:31.208828 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 76756.3us
I20260709 13:14:31.215130  3607 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:31.216679 32117 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:14:31.149369  3873 consensus_queue.cc:260] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:31.240646 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:31.244714 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:31.241602  3648 raft_consensus.cc:697] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
W20260709 13:14:31.240006  3889 log.cc:927] Time spent T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
W20260709 13:14:31.261319  3894 log.cc:927] Time spent T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:14:31.259626  3648 consensus_queue.cc:237] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:31.270676  3900 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:14:31.272490 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.282264 32266 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:31.258069  3873 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:31.286173  3900 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:31.301124  3900 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:31.306104 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:31.306789 32115 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:31.307610 32118 raft_consensus.cc:1275] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:14:31.308930 32120 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:31.317011  3805 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:31.320993 32266 raft_consensus.cc:1275] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:14:31.323859 32115 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:31.332086 32239 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:31.332950 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:31.338492 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:31.339277 32119 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:14:31.350519 32239 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:31.353396  3732 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:31.355935  3661 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:14:31.354104  3848 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:31.382913  3607 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:31.385874  3671 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:31.395345  3848 raft_consensus.cc:1064] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
W20260709 13:14:31.396337  3848 raft_consensus.cc:1068] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06: Unable to promote non-voter 94085cf341634eb686a95983b6b7f7e6: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:14:31.335796  3872 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:32.417586 32053 debug-util.cc:398] Leaking SignalData structure 0x7b08003303a0 after lost signal to thread 30975
I20260709 13:14:32.993785  3912 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:32.994618  3912 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:32.997885  3912 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:32.999725  3912 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.000352  3912 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.002682  3913 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.020920  3913 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:33.023383  3913 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:33.023833 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:33.023927  3913 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.003187  3912 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.024873  3912 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:33.025357  3912 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.027427  3820 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.027556  3912 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.028255  3912 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.028726  3912 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.029340  3915 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:33.029819  3915 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.030346 32197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2308) took 2089 ms. Trace:
I20260709 13:14:33.030887  3912 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.030643 32197 rpcz_store.cc:276] 0709 13:14:30.940998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:30.941145 (+   147us) service_pool.cc:224] Handling call
0709 13:14:30.943619 (+  2474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:31.048115 (+104496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:31.048163 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:31.048222 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:31.048268 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:33.030109 (+1981841us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54001dfbd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:33.030161 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:33.030278 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239661952}
I20260709 13:14:33.031445  3912 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:33.031351  3820 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.032610  3913 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:33.033599  3820 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.033861 32120 raft_consensus.cc:1275] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:33.034062  3820 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:33.034500 32120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 3242) took 1728 ms. Trace:
I20260709 13:14:33.034775  3913 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.034555  3820 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:33.032150  3912 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.034979 32120 rpcz_store.cc:276] 0709 13:14:31.306277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:31.308523 (+  2246us) service_pool.cc:224] Handling call
0709 13:14:31.308822 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:33.034268 (+1725446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:33.034447 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:33.012202  3914 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:33.019634  3671 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:33.037173  3915 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.036856  3912 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.036540  3820 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:33.042121  3914 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.044915  3912 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:33.045435  3912 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:33.047209  3820 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:33.047719  3820 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.050958  3915 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:33.051498  3915 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:33.053606  3915 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:33.056475  3914 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.059212  3916 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:33.059770  3916 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.061946  3916 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.062366  3916 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.062719  3916 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.064079  3916 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.064494  3916 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.071273  3915 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:33.071800  3607 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:33.071897  3915 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.072418  3607 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.091138  3917 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:33.091876  3919 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:33.092000  3917 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:33.093660  3607 leader_election.cc:290] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.092722  3919 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.109777  3607 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:33.094905  3887 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:33.097787  3787 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:33.088498  3915 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.104732  3648 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:33.112986  3787 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:33.113791  3648 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.115360  3787 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:33.065424  3916 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:33.115825  3648 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.116667  3607 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:33.109248 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:33.112099  3919 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.117450  3916 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.197386  3918 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.196834  3787 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.198004  3918 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.198520  3787 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:33.200348  3918 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.200901  3918 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.201372  3918 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.202123  3787 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:33.205183  3787 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:33.205255  3916 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:33.206357  3787 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:33.206641  3916 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.203390  3918 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.202201  3734 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:33.211535  3607 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.211699  3916 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.214320  3922 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:33.217003  3922 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:31.346354  3771 consensus_queue.cc:1048] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:14:33.214043  3734 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:14:33.220304 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 1.86813e+06us
I20260709 13:14:33.221477  3916 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.221558 32239 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:33.215328  3917 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.216439  3787 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:33.222821 32239 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:33.223076  3918 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.224481  3772 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:33.224675  3435 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:14:33.252301 32089 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.737s (SENT)
I20260709 13:14:33.255245  3871 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:33.261884  3734 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.262326  3871 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.263186  3915 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:33.258846  3772 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:33.263708  3915 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.264307  3772 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:33.265187  3871 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.265579  3825 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.265805  3915 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.266125  3825 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:33.259761  3435 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.256934  3648 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:33.228207  3787 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:33.219535  3922 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:33.228089  3731 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.223232  3671 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:33.221607  3654 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:14:33.141185  3887 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.289803  3654 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:33.290409  3887 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.260742  3918 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.273414  3435 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:33.297685  3435 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:33.299086  3435 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:14:33.273370 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:33.274860  3736 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:33.276561  3697 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.279024  3922 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:33.255386  3916 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.270345  3648 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:33.279562  3671 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:33.282145 32053 debug-util.cc:398] Leaking SignalData structure 0x7b08001c4e00 after lost signal to thread 32022
I20260709 13:14:33.284735  3731 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.270308  3825 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:33.286027 32194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3247) took 2521 ms. Trace:
I20260709 13:14:33.286984  3705 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.322696  3705 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.308563 32196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3251) took 2296 ms. Trace:
I20260709 13:14:33.292870  3923 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:33.310530  3697 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.309971  3736 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:33.315150  3916 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.313139  3924 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.292908  3918 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.294951  3817 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:14:33.313376 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 85447us
I20260709 13:14:33.317238 32190 raft_consensus.cc:1275] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:14:33.313001  3435 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:33.290407  3654 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.319404  3731 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:33.319759  3648 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:33.321404  3671 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:33.324712   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:33.333611  3924 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.322463 32194 rpcz_store.cc:276] 0709 13:14:30.768020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:30.773279 (+  5259us) service_pool.cc:224] Handling call
0709 13:14:30.803680 (+ 30401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:30.805066 (+  1386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:30.805097 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:30.815499 (+ 10402us) log.cc:844] Serialized 26 byte log entry
0709 13:14:33.110018 (+2294519us) spinlock_profiling.cc:243] Waited 9.17 ms on lock 0x7b18003137e0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bee6e07 00007fb5a4d41ab9 00007fb59bf0369b 00007fb59bf0193f 00007fb59bf03c02 00007fb59eb8b20b 00007fb59eb90d23 00007fb59eb910d1 00007fb59efaca0f
0709 13:14:33.207668 (+ 97650us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:33.207729 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:33.207826 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:33.285679 (+ 77853us) raft_consensus.cc:1685] finished
0709 13:14:33.285702 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:33.285942 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4950,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":2225,"spinlock_wait_cycles":21083008,"thread_start_us":97428,"threads_started":1,"wal-append.queue_time_us":2396550}
I20260709 13:14:33.341974 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:33.333905  3918 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:33.343128  3918 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.343515  3917 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:33.344237  3817 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:33.344823  3817 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.345376  3918 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.345906  3697 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:33.346158  3927 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:33.346490  3697 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.346750  3927 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.347005  3697 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.328341  3923 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.342595  3924 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.349928  3736 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:33.324186 32196 rpcz_store.cc:276] 0709 13:14:31.012017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:31.012222 (+   205us) service_pool.cc:224] Handling call
0709 13:14:31.018819 (+  6597us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:31.019204 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:31.059682 (+ 40478us) log.cc:844] Serialized 14 byte log entry
0709 13:14:31.060679 (+   997us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:31.061139 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 13:14:31.061261 (+   122us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:31.061426 (+   165us) log.cc:844] Serialized 14 byte log entry
0709 13:14:31.061613 (+   187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:31.061680 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:33.295314 (+2233634us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b18001f8a60. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bf043f3 00007fb59bf067c1 00007fb59bf06779 00007fb59bf06709 00007fb59bf066d1 00007fb59bf059cd 000000000038f354 000000000038f199 00007fb59bee783a
0709 13:14:33.308328 (+ 13014us) raft_consensus.cc:1685] finished
0709 13:14:33.308357 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:33.308505 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3461,"prepare.queue_time_us":131912,"prepare.run_cpu_time_us":126,"prepare.run_wall_time_us":8879,"raft.queue_time_us":604,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":23007,"spinlock_wait_cycles":8469376,"thread_start_us":40787,"threads_started":2,"wal-append.queue_time_us":89214}
I20260709 13:14:33.350692  3923 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.351253 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:33.351877 32196 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:14:33.352569  3654 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:33.337795 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:33.337080 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:33.353861 32191 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:33.332161  3916 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:33.338821 32195 raft_consensus.cc:1275] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:33.342589 32194 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:14:33.327715 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:33.347177  3731 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:33.354017 32192 raft_consensus.cc:2468] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:14:33.355105 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:33.338379  3705 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:33.338207  3928 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.278323  3787 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.355113 32267 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 10.
I20260709 13:14:33.344067  3917 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:33.313565  3922 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:33.356472 32196 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 6.
I20260709 13:14:33.358505  3916 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:33.361304  3929 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.361963  3918 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:33.354619  3772 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.363401  3927 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:33.356715  3928 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.372710  3917 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.372999  3697 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:33.347018  3817 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:33.373077  3928 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:33.355808  3671 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.374219 32191 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:14:33.374181  3671 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.366827  3923 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.375916  3922 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:33.376066  3923 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.376461  3671 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:33.376497  3922 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.377245  3922 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:14:33.378393  3923 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.378955  3923 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.379451  3922 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.365571  3880 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:33.383891  3880 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:33.370563 32238 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:33.387115  3817 consensus_queue.cc:1048] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:33.388969  3880 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.389794  3671 raft_consensus.cc:2804] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:33.390347  3671 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:33.390822  3671 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:33.360260  3731 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:33.386713 32239 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:33.393911  3731 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:33.394472  3928 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:33.394884  3928 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:33.395251  3928 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:33.396394  3772 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:33.397401  3929 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.401335  3671 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.398298 32238 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:33.403000  3916 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:33.403429  3918 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:33.379403  3923 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.404379  3787 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.404937  3928 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.407173  3705 consensus_queue.cc:1048] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:33.417685 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:33.357385  3736 consensus_queue.cc:1059] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:14:33.412214 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:33.414399 32238 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:33.415001 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:33.419030 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:33.420476 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:33.414036  3697 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:33.423408 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:33.425907 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:33.427130 32118 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:14:33.427215 32115 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:33.425161 32116 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:14:33.427352 32238 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:33.413038  3930 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:33.410933  3929 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.431763 32238 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:33.434267 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:33.426757  3697 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.440155 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:33.441118 32197 raft_consensus.cc:2468] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 6.
I20260709 13:14:33.423947  3872 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.447515 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:33.448818 32199 raft_consensus.cc:1240] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:33.450201 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:33.450289 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:33.456718 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:33.430469  3932 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:33.437022  3787 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:33.424939  3654 consensus_queue.cc:1048] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:14:31.334769  3659 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.431036  3731 raft_consensus.cc:2804] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:33.522910 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:33.532253  3731 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.488243 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:33.534835 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:33.535698 32199 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:33.536835 32193 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:14:33.444859   369 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
W20260709 13:14:33.538795   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 94076.1us
I20260709 13:14:33.499876 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:33.539842 32191 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:14:33.540535 32118 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:33.544170 32197 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:33.487833 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:33.433562  3927 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:33.432459  3916 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:33.534252   368 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:33.538249 32238 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:33.547824 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:33.437160  3772 raft_consensus.cc:2804] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:33.551256  3932 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.554733  3932 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:33.554752 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:33.556290 32120 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:33.557655 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:33.557940  3932 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:33.438218  3930 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:14:33.589412 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:33.558333 32120 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:14:33.591272 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:33.595641 32120 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:33.594637 32118 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:33.443213  3697 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:33.442536  3924 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:33.582195  3659 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:14:33.600266 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 62117.8us
I20260709 13:14:33.600649  3939 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:33.601306  3787 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:33.532860  3731 raft_consensus.cc:3060] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:33.601773 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:33.500140  3736 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:33.547235  3917 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:33.607399 32238 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:33.585508  3772 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:33.612702 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:14:33.603081 32239 connection.cc:256] RPC call timeout handler was delayed by -1.0686198539997349s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2109s for a response
I20260709 13:14:33.616180  3923 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.607059  3924 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.559131  3932 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.603562  3850 raft_consensus.cc:2804] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:33.620853 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:33.622851 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:33.585182  3916 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.585421  3927 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:33.610695  3939 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:33.624650 32121 raft_consensus.cc:1275] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:33.715747  3930 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:33.664781  3928 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:33.707604 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:33.717867 32191 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:33.683116  3771 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:33.721101  3771 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.723678  3771 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.682163  3732 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:33.724823  3732 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:33.725234  3732 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:33.725692 32191 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:14:33.727377 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:33.728118 32191 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:33.726433  3928 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.676529  3872 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:33.728967  3872 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:33.730979  3757 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.390s	user 0.029s	sys 0.036s
I20260709 13:14:33.665206  3918 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:33.731768  3757 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.439s	user 0.029s	sys 0.036s
I20260709 13:14:33.695475  3671 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:33.679457  3924 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.675918  3937 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:33.646476   368 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:33.619771  3772 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:33.621970  3850 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:33.732918  3928 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.733594  3787 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:33.713903  3818 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:33.714166  3648 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:33.742179  3731 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:33.732240  3927 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:33.763697  3880 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:33.765331  3731 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:33.765856  3928 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:33.767200  3734 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:33.759351  3939 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:33.612306  3917 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:33.677840  3668 consensus_queue.cc:1059] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 13:14:33.748571 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 131468us
I20260709 13:14:33.670073  3912 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:33.754061 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:33.750186  3937 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.758307  3818 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:33.759253 32191 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:14:33.759181  3648 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:33.751441  3850 raft_consensus.cc:3060] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:33.733635  3872 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.773869  3736 raft_consensus.cc:697] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:14:33.775382   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 129017us
I20260709 13:14:33.764345  3880 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:33.777097   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:33.895656 32118 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:14:33.813823 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:33.897907 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:33.791589 32022 catalog_manager.cc:5697] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 8 to 9, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 9 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:33.778368   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:33.899461 32239 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:33.901683 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:33.751557  3671 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:33.908969 32239 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:33.909838  3941 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:33.840708  3772 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:33.910256  3941 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.910632  3941 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:33.910818 32267 raft_consensus.cc:1240] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:33.912253  3916 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:33.914539 32118 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:14:33.792125  3917 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:33.906598  3858 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.914417  3939 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:33.789897  3860 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:33.791970  3647 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.139s
I20260709 13:14:33.921000   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:33.921065  3858 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:33.875970   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:33.906816  3918 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:33.921528  3939 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:33.784339  3697 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:33.953480 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 58997.5us
I20260709 13:14:33.907518  3671 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.977641 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:33.979799 32118 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 15.
I20260709 13:14:33.923035 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:33.980952 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:33.980684  3860 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:14:33.931991 32165 connection.cc:256] RPC call timeout handler was delayed by -1.6474313590001657s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1829s for a response
W20260709 13:14:33.984952 32165 connection.cc:256] RPC call timeout handler was delayed by -1.5544013510000241s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20640000000000003s for a response
W20260709 13:14:33.985471 32165 connection.cc:256] RPC call timeout handler was delayed by -1.299797462000015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22480000000000003s for a response
I20260709 13:14:33.985975 32118 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 7.
I20260709 13:14:33.915361  3916 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.975817  3648 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:33.984166  3772 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:33.933130  3930 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:33.989898 32271 raft_consensus.cc:2368] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 13. Current term is 14.
I20260709 13:14:33.987879   369 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:33.989003   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:33.994524   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:34.005244 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.010175 32190 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:14:33.987753 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.011875 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:33.981899  3939 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:34.023579   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:34.027421   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:34.023160   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:33.984115  3671 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:34.034366   395 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
I20260709 13:14:34.035553   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:34.036237 32162 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:34.012478 32118 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 16.
I20260709 13:14:34.024556  3946 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:34.028232  3937 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:34.028936 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.029713  3818 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:34.029765   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:34.031585  3697 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:34.037757 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.023952  3880 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:34.037818   369 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:34.041132 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.047961 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:33.981706  3918 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:34.042728   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:34.007720   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:34.039022  3946 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:14:34.044982 32117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56890 (request call id 3226) took 3341 ms (client timeout 2109 ms). Trace:
I20260709 13:14:34.042009  3923 raft_consensus.cc:2804] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:34.001075   397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:34.042771 32190 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
W20260709 13:14:34.052591 32117 rpcz_store.cc:269] 0709 13:14:30.708299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:30.708524 (+   225us) service_pool.cc:224] Handling call
0709 13:14:34.040535 (+3332011us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b54000983d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:34.040690 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1165494016}
I20260709 13:14:34.054011 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.054447 32190 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:34.003266  3860 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:33.988687   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:34.043308 32118 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
I20260709 13:14:33.991768  3732 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:34.039518  3817 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.050506 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.059612 32192 raft_consensus.cc:2368] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 13. Current term is 14.
I20260709 13:14:34.019443  3916 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:34.060235 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.060911 32192 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:14:34.061312  3858 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:34.061758 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.062572 32192 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
I20260709 13:14:34.063387 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.054981 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:34.065068 32190 raft_consensus.cc:2368] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10.
I20260709 13:14:34.066102 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.066859 32190 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:14:34.067822 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.068849 32190 raft_consensus.cc:2393] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 11: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:33.984310  3736 consensus_queue.cc:237] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:34.003978  3917 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:34.051219  3947 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:34.075254 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.075400  3947 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:14:34.049857 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 69040.3us
I20260709 13:14:34.076365  3941 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:34.056232 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.078233 32118 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
I20260709 13:14:34.079175 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.081924  3941 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:34.082083  3917 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:34.076184 32198 raft_consensus.cc:2393] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 11: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:34.053841  3923 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:34.063668  3932 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:34.057843 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.001184  3930 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:14:34.069656 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:34.084961 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.093021  3930 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:34.076097  3947 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:34.106863  3916 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:34.107805 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.108558 32272 raft_consensus.cc:2368] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 for earlier term 6. Current term is 7.
I20260709 13:14:34.109655  3918 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:34.110785  3939 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:34.084681  3923 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:34.113271 32053 debug-util.cc:398] Leaking SignalData structure 0x7b0800034340 after lost signal to thread 32056
I20260709 13:14:34.053440  3946 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:34.094126 32198 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:34.094712   397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38184 (request call id 303) took 1028 ms. Trace:
I20260709 13:14:34.116763   397 rpcz_store.cc:276] 0709 13:14:33.066020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.000783 (+934763us) service_pool.cc:224] Handling call
0709 13:14:34.094638 (+ 93855us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:34.098099  3732 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:34.098307 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.117972 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.118868 32116 raft_consensus.cc:2393] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 14: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:34.118870 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.119771 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.120112 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.121884 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.123003 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.123915 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.116418 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.125115 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.126377  3772 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:34.126915  3772 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:14:34.127614 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.128206 32266 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:34.128729  3941 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.129272  3941 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:34.129850  3772 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:34.131345  3941 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:34.132047   397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:34.132385  3661 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.073431  3817 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:34.132920  3661 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:34.133460 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.134549 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:34.135052 32196 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:34.135146 32265 raft_consensus.cc:1240] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:34.098305  3850 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:34.099138 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.145677 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.100327 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.074211 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.101146 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.165732 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:34.171876 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.183735 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.200444 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:34.202253 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:34.202994 32194 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:34.233541   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:34.080408 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.105502 32191 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:34.257491 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.106173 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.132507   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:34.258749 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.246033 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:34.259585 32122 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:34.246040 32195 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:34.262117 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.262864 32195 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:14:34.246676 32190 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:14:34.248881 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.248112 32193 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:34.249723 32192 raft_consensus.cc:2468] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:14:34.252876  3874 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.254796  3817 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:14:34.255095 32053 debug-util.cc:398] Leaking SignalData structure 0x7b0800082dc0 after lost signal to thread 32148
I20260709 13:14:34.252234 32197 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
W20260709 13:14:34.265580 32053 debug-util.cc:398] Leaking SignalData structure 0x7b08003b0300 after lost signal to thread 32149
I20260709 13:14:34.266139 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:14:34.266769 32053 debug-util.cc:398] Leaking SignalData structure 0x7b0800300d00 after lost signal to thread 32223
W20260709 13:14:34.267132 32053 debug-util.cc:398] Leaking SignalData structure 0x7b08002af500 after lost signal to thread 32224
I20260709 13:14:34.126082 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:14:34.268194 32053 debug-util.cc:398] Leaking SignalData structure 0x7b08002fe580 after lost signal to thread 32297
I20260709 13:14:34.255261   369 leader_election.cc:400] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 for earlier term 6. Current term is 7.
I20260709 13:14:34.256014 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.268679 32198 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
W20260709 13:14:34.245278 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 101305us
I20260709 13:14:34.256705 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:34.259490 32270 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
W20260709 13:14:34.268473 32053 debug-util.cc:398] Leaking SignalData structure 0x7b0800393ac0 after lost signal to thread 32298
I20260709 13:14:34.269560 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:34.269707 32269 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:34.272217 32053 debug-util.cc:398] Leaking SignalData structure 0x7b08001fdd60 after lost signal to thread 427
I20260709 13:14:34.270370 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:14:34.273105 32053 debug-util.cc:398] Leaking SignalData structure 0x7b0800321740 after lost signal to thread 428
I20260709 13:14:34.255044 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.270501 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.284812 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.285125 32117 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:14:34.272646 32198 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:34.285429 32123 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
I20260709 13:14:34.284832 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.270895 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.286514 32119 raft_consensus.cc:2410] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:14:34.270720 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.272970 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.274052 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.287465 32193 raft_consensus.cc:2368] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 13. Current term is 14.
I20260709 13:14:34.287834 32124 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:14:34.277204 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.274766   402 raft_consensus.cc:2468] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:14:34.278481 32267 raft_consensus.cc:1240] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:34.289256  3584 consensus_queue.cc:1059] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:14:34.279076 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.290344 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:34.280112   401 raft_consensus.cc:1240] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:34.290951 32115 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:14:34.256011   397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:34.293427 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.294010 32117 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:14:34.294307 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.294860 32123 raft_consensus.cc:2468] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 3.
I20260709 13:14:34.271116 32118 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:14:34.287427 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.278086 32239 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:34.289449 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.289386   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:34.301313   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:34.302131 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.303119 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.304165  3584 raft_consensus.cc:3055] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:34.304556  3584 raft_consensus.cc:740] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:34.305536  3584 consensus_queue.cc:260] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:34.306118  3946 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:34.306716  3584 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:34.307300   394 raft_consensus.cc:1240] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:34.309043 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.285447 32196 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:14:34.264894 32194 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:34.282931   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:34.293272 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.311275 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.294806 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.311775 32124 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 11.
I20260709 13:14:34.310683 32198 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:14:34.312383 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.295902 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.296664 32239 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:34.300151 32269 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 11.
I20260709 13:14:34.282384 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.275175  3671 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:34.317226 32122 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:34.316457   369 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:34.317428 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.278896 32238 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:34.318120 32124 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:14:34.295789 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.314025 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:34.314124 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.319916 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.319612 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.320295 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.320606 32124 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:14:34.314733 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:34.314962 32239 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:34.321172 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.314059 32265 raft_consensus.cc:2410] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:14:34.321197 32123 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:14:34.321650 32193 raft_consensus.cc:3060] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:34.321777 32192 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:14:34.322130 32239 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:34.315330 32196 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:34.318369 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:34.316099 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.281000  3661 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:34.304419  3732 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:34.319056  3734 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:34.326242 32123 raft_consensus.cc:1275] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:14:34.275022  3874 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:34.326476 32119 raft_consensus.cc:1240] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:34.331946 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.335511  3654 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:34.330686  3659 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:34.326742 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.342792 32273 raft_consensus.cc:2410] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 13:14:34.324520 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 45695.6us
I20260709 13:14:34.308424  3946 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:34.319828  3647 consensus_queue.cc:1059] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:14:34.319608  3848 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:34.329048 32122 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:34.350643 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:34.353606 32115 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:34.327625  3732 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:34.330855  3734 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:34.362699 32238 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:34.341373 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.372159 32265 raft_consensus.cc:2393] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 7: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:34.330789  3937 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:34.328384 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:34.382280 32122 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 8.
I20260709 13:14:34.365866 32193 raft_consensus.cc:2468] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:14:34.387080 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.387836 32193 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 8.
I20260709 13:14:34.388628  3957 consensus_queue.cc:1048] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:34.390580 32194 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
W20260709 13:14:34.393384 32053 debug-util.cc:398] Leaking SignalData structure 0x7b080037fd20 after lost signal to thread 3861
I20260709 13:14:34.396149 32194 raft_consensus.cc:1275] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:34.358057 32196 raft_consensus.cc:1240] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:34.342062  3659 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:34.400632 32239 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:34.403326 32194 raft_consensus.cc:1275] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:14:34.403517 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.408538 32265 raft_consensus.cc:2393] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 9: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:34.404443  3654 raft_consensus.cc:697] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:34.410801 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.366827  3732 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:34.413317 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.362226  3848 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:34.365235  3939 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:34.414516 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:34.414934 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:14:34.423213   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 93436.4us
I20260709 13:14:34.423872 32121 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:34.424883 32115 raft_consensus.cc:2410] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:14:34.406778 32193 raft_consensus.cc:1240] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10. Ops: []
W20260709 13:14:34.415637 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:34.425156   369 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:34.417619 32194 raft_consensus.cc:1240] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:34.375396  3734 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:34.420123 32119 raft_consensus.cc:1240] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:34.377722  3937 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:34.415315 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.430719 32265 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:14:34.410955  3654 consensus_queue.cc:237] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:34.436837 32197 raft_consensus.cc:1275] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:14:34.428785   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 96661us
I20260709 13:14:34.429514 32193 raft_consensus.cc:1275] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:14:34.408766  3814 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:14:34.423779  3951 log.cc:927] Time spent T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:14:34.414127  3659 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:34.443974 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.445192 32273 raft_consensus.cc:2393] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 7: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:34.423666  3848 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:34.445721 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:34.447916 32193 raft_consensus.cc:2368] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 for earlier term 6. Current term is 7.
I20260709 13:14:34.430353  3956 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:34.452627 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.454587  3671 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:34.455317 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:34.439669  3953 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:34.460775  3850 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 6 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:34.461604 32271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36084 (request call id 2572) took 3221 ms (client timeout 1737 ms). Trace:
I20260709 13:14:34.449281  3814 raft_consensus.cc:697] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:34.465080 32239 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:34.477914 32271 rpcz_store.cc:269] 0709 13:14:31.240106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:31.240387 (+   281us) service_pool.cc:224] Handling call
0709 13:14:34.461353 (+3220966us) spinlock_profiling.cc:243] Waited 2.75 s on lock 0x7b54002b7fd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:34.461501 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6320839552}
I20260709 13:14:34.436981  3937 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:34.478803  3814 consensus_queue.cc:237] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:34.480114 32239 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:34.481213  3661 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:34.481527  3960 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:34.482277  3960 raft_consensus.cc:697] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:34.483307  3960 consensus_queue.cc:237] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:34.469390 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 106783us
I20260709 13:14:34.474186 32115 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:34.489440  3937 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:34.491708  3937 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:34.492823 32165 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:34.493448  3947 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:34.495016  3863 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:34.495478  3947 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:34.496574 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.496733  3923 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:34.456313 32121 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:14:34.500213 32115 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:34.500515 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.470654 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:34.502022 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.486064 32239 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:34.502938 32269 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:34.503432 32239 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:34.494002 32165 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:34.504504 32194 raft_consensus.cc:1240] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:34.506731 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:34.507110 32238 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:34.568203 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.569353 32269 raft_consensus.cc:2410] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:14:34.569619 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:34.570025 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 45317us
I20260709 13:14:34.570748 32165 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:14:34.573230 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 66433.9us
I20260709 13:14:34.572616 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.574854 32238 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:34.576241 32273 raft_consensus.cc:2410] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:14:34.576812 32165 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:34.578424 32165 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:34.523463  3918 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:34.545907  3671 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:34.571645  3956 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:34.586004 32239 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:34.594709 32238 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:34.596055 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.596766 32269 raft_consensus.cc:2393] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 10: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:34.584697  3930 raft_consensus.cc:2804] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:34.598109 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.567160  3953 raft_consensus.cc:697] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 8 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:34.605971 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.584438  3924 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:34.566910  3805 consensus_queue.cc:1048] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:14:34.582139  3939 raft_consensus.cc:2804] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:34.618448 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.586243  3958 consensus_queue.cc:1048] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:14:34.589090  3671 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:34.571377  3937 consensus_queue.cc:1048] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:14:34.624655 32197 raft_consensus.cc:1240] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:34.655184  3671 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:34.599061  3956 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:34.602272  3814 raft_consensus.cc:2804] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:34.650247 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.651969  3939 raft_consensus.cc:697] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:34.644033  3924 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:34.667354  3924 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:34.660458  3814 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:34.668097  3814 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:34.633225  3953 consensus_queue.cc:237] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:34.630434  3874 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:34.632685  3825 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:34.685304  3825 raft_consensus.cc:697] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:34.686345  3825 consensus_queue.cc:237] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:34.686859 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.688056 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.688879 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:34.689288 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.678558  3913 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.690349 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.692919 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.693224  3939 consensus_queue.cc:237] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:34.693518  3734 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:34.694252 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.694654   399 raft_consensus.cc:1240] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:34.695526 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.696388 32267 raft_consensus.cc:2393] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 11: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:34.690389  3913 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:34.699635  3913 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:34.701107  3732 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:34.703289  3732 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:34.705026 32120 raft_consensus.cc:1275] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:34.706353  3848 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:34.709249   368 leader_election.cc:400] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 6 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 for earlier term 6. Current term is 7.
I20260709 13:14:34.709728   368 leader_election.cc:403] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:14:34.711105   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:34.712404 32019 catalog_manager.cc:5697] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 7 to 8, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 8 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:34.615271  3776 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:34.603226  3930 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
W20260709 13:14:34.659336 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 81015.6us
I20260709 13:14:34.716859  3850 raft_consensus.cc:3060] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:34.716971  3776 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:34.718281  3776 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:34.718698 32165 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:34.660254  3956 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:34.666731  3666 raft_consensus.cc:3055] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:34.720418  3666 raft_consensus.cc:740] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:34.720620  3818 raft_consensus.cc:3055] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:34.721021  3818 raft_consensus.cc:740] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:34.721328  3666 consensus_queue.cc:260] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:34.721892  3818 consensus_queue.cc:260] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:34.621047  3817 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:34.722811  3817 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:34.722944  3818 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:34.723397  3817 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:34.724910  3916 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:34.678444 32197 raft_consensus.cc:1275] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:34.716997  3930 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:34.663317 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.722393  3666 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:34.729171 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:34.715895 32019 catalog_manager.cc:5697] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 7 to 8, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 8 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:34.734460 32019 catalog_manager.cc:5697] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:34.735319  3930 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:34.735769  3697 consensus_queue.cc:1059] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:34.737337  3873 raft_consensus.cc:3055] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:34.737824  3873 raft_consensus.cc:740] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:34.738610  3873 consensus_queue.cc:260] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:34.739821  3873 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:34.675890  3820 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:34.737450  3930 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:34.742182 32165 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:34.742974  3930 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:34.743074 32165 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:34.739850 32191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54182 (request call id 3277) took 1290 ms. Trace:
I20260709 13:14:34.743434  3930 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:34.743929  3930 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:34.743641 32191 rpcz_store.cc:276] 0709 13:14:33.449211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:33.909049 (+459838us) service_pool.cc:224] Handling call
0709 13:14:34.739666 (+830617us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54002a6f54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:34.739788 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286649088}
I20260709 13:14:34.744143 32198 raft_consensus.cc:1275] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:34.745883  3814 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:34.741305  3817 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:34.753749 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.753819 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.755445   368 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:34.763622 32165 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:34.735953 32019 catalog_manager.cc:5697] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 8 to 9, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 9 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:34.769870 32019 catalog_manager.cc:5697] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 10 to 11, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 11 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:34.783564   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:34.786767 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.784433 32019 catalog_manager.cc:5697] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 9 to 10, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 10 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:34.788321 32020 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49550 (request call id 258) took 6774 ms. Trace:
I20260709 13:14:34.788537 32019 catalog_manager.cc:5697] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:34.791519 32162 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:34.788990 32020 rpcz_store.cc:276] 0709 13:14:27.980389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:27.980557 (+   168us) service_pool.cc:224] Handling call
0709 13:14:34.754731 (+6774174us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:30.005439 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:30.021345 (+ 15906us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:30.021398 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:14:30.021425 (+    27us) tablet.cc:662] Decoding operations
0709 13:14:30.022172 (+   747us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:30.022230 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:30.022267 (+    37us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:14:30.022641 (+   374us) tablet.cc:701] Row locks acquired
0709 13:14:30.022657 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:14:30.022821 (+   164us) write_op.cc:270] Start()
0709 13:14:30.022971 (+   150us) write_op.cc:276] Timestamp: P: 1783602870022756 usec, L: 0
0709 13:14:30.023002 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:14:30.023910 (+   908us) log.cc:844] Serialized 1299 byte log entry
0709 13:14:30.442942 (+419032us) op_driver.cc:464] REPLICATION: finished
0709 13:14:30.683182 (+240240us) write_op.cc:301] APPLY: starting
0709 13:14:30.683267 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:30.683411 (+   144us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:30.683547 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:30.683979 (+   432us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:30.684176 (+   197us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:14:30.684232 (+    56us) write_op.cc:312] APPLY: finished
0709 13:14:30.684452 (+   220us) log.cc:844] Serialized 35 byte log entry
0709 13:14:30.684647 (+   195us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:30.684754 (+   107us) write_op.cc:454] Released schema lock
0709 13:14:30.684796 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:30.685149 (+   353us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:30.685180 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":26535,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":239931,"apply.run_cpu_time_us":1955,"apply.run_wall_time_us":1956,"num_ops":3,"prepare.queue_time_us":376326,"prepare.run_cpu_time_us":4085,"prepare.run_wall_time_us":75257,"replication_time_us":402862,"thread_start_us":339584,"threads_started":2}]]}
W20260709 13:14:34.805474 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 210821us
I20260709 13:14:34.791038 32019 catalog_manager.cc:5697] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:34.806484 32238 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:34.807318  3666 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:34.807546 32019 catalog_manager.cc:5697] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:34.809902 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.816700 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.817649 32273 raft_consensus.cc:2468] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:14:34.808377 32238 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:34.817600 32019 catalog_manager.cc:5697] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:34.761324  3814 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:34.781494  3946 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:14:34.805001  3858 raft_consensus.cc:2804] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:34.825646 32238 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:34.826817 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.792342  3848 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:14:34.834923 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 249039us
I20260709 13:14:34.839138 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.828274   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:34.836767  3971 consensus_queue.cc:1059] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:14:34.840373 32238 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:34.840308 32239 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:34.804644  3671 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:34.828424  3732 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:34.828826  3858 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:34.847035 32239 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:34.853314 32267 raft_consensus.cc:1240] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:34.847668 32120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 2244) took 1075 ms. Trace:
I20260709 13:14:34.858680 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.848287 32195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56926 (request call id 415) took 1389 ms. Trace:
I20260709 13:14:34.858865 32120 rpcz_store.cc:276] 0709 13:14:33.772531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.681839 (+909308us) service_pool.cc:224] Handling call
0709 13:14:34.682281 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:34.705483 (+ 23202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:34.847426 (+141943us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b5400346a54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:34.847606 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51459968}
I20260709 13:14:34.859670 32195 rpcz_store.cc:276] 0709 13:14:33.459154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.320868 (+861714us) service_pool.cc:224] Handling call
0709 13:14:34.322897 (+  2029us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:34.323076 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:34.323098 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:34.323135 (+    37us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:34.323187 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:34.323240 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:34.848132 (+524892us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b54001d42d0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff08ad 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:34.848230 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3988864}
W20260709 13:14:34.854351 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 90839.6us
I20260709 13:14:34.838965   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:34.844197  3814 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:34.864944  3814 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:34.865422  3814 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:34.868851 32269 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 8.
I20260709 13:14:34.862111 32238 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:34.862179 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.862957 32165 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:34.863585 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:34.884048 32270 raft_consensus.cc:2393] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 16: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:34.857985  3858 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:34.861595  3960 raft_consensus.cc:2804] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:34.842149  3659 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:34.862329  3805 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:34.889866  3734 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:34.883296 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:34.859783  3736 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:34.895720 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:34.933734 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:34.943161 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 84693.6us
I20260709 13:14:34.904879 32266 raft_consensus.cc:1275] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
W20260709 13:14:34.917428 32162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 136905us
I20260709 13:14:34.943912 32266 pending_rounds.cc:85] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06: Aborting all ops after (but not including) 8
I20260709 13:14:34.936259  3814 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:34.944535 32238 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:34.950807 32266 pending_rounds.cc:107] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:14:34.951303 32266 raft_consensus.cc:2889] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:34.944607 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:34.958788 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:34.959669 32122 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:34.963349 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:34.904894 32165 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:34.970168 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:34.971094 32124 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:34.973372 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:34.977447 32120 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:34.989962 32119 raft_consensus.cc:1240] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:34.884006  3848 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:14:34.995193 32162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 50457.9us
I20260709 13:14:34.999019 32122 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:34.937436  3732 raft_consensus.cc:2804] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:35.003536 32124 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:35.006623 32264 raft_consensus.cc:1240] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:34.894125  3981 raft_consensus.cc:2764] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:14:34.937253  3817 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:34.948714  3850 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 for earlier term 6. Current term is 7.
W20260709 13:14:35.066977 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 74488.9us
I20260709 13:14:34.953244  3805 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:35.076880 32268 raft_consensus.cc:1240] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:14:35.106150 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:34.904017  3960 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:14:35.046118  3977 log.cc:927] Time spent T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:14:35.078656   403 raft_consensus.cc:1240] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:34.995990  3930 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:35.102780 32266 raft_consensus.cc:1240] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:35.077977 32269 raft_consensus.cc:1240] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:34.892473  3956 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:35.142839 32089 leader_election.cc:336] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.737s (SENT)
I20260709 13:14:35.118907 32270 raft_consensus.cc:1240] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:35.148505 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:35.002161  3923 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:14:35.107609  3974 log.cc:927] Time spent T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7: Append to log took a long time: real 0.245s	user 0.000s	sys 0.002s
I20260709 13:14:35.176117 32120 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 12.
I20260709 13:14:35.176463 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:35.111315  3805 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:35.179327 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 234843us
I20260709 13:14:35.184433 32238 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:35.015332  3736 raft_consensus.cc:697] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:35.101372  3732 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:35.186148 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:35.209300 32266 raft_consensus.cc:1275] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:14:35.186461  3980 log.cc:927] Time spent T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:14:35.140413  3984 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:35.187846  3776 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:35.127592  3666 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:35.189385   369 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:35.193122 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:35.218848 32264 raft_consensus.cc:2368] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12.
I20260709 13:14:35.193408 32269 raft_consensus.cc:1240] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:35.194005 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:35.220279 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:35.221318 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:35.221537  3776 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:35.221984 32271 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:14:35.194209 32268 raft_consensus.cc:1275] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:35.224206 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:35.183023  3697 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:35.225131   399 raft_consensus.cc:1240] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 16. Current term is 17. Ops: []
I20260709 13:14:35.194787 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:35.196499  3671 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:35.214721  3732 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:35.225502  3805 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:35.119704  3924 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:35.140785  3863 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.199116  3957 raft_consensus.cc:1064] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:14:35.199280  3659 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:35.199440  3848 raft_consensus.cc:697] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:35.245399  3848 consensus_queue.cc:237] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:35.200336  3668 raft_consensus.cc:1064] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:14:35.203753  3858 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:35.249215  3697 raft_consensus.cc:697] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:35.250247  3697 consensus_queue.cc:237] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:35.251008  3858 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:35.204950 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 62636.2us
I20260709 13:14:35.174415  3971 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:35.252097  3971 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:35.214304 32265 raft_consensus.cc:2393] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 9: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:35.227595 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:35.252523  3971 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:35.252997 32264 raft_consensus.cc:2393] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 12: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:35.147296  3960 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:35.230049 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 45706.2us
W20260709 13:14:35.256218 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:35.196859  3930 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:35.199301  3814 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:35.238248 32273 raft_consensus.cc:1275] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:35.235601  3850 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:35.235957  3984 consensus_queue.cc:1059] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:14:35.239701  3736 consensus_queue.cc:237] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:35.240937  3957 consensus_queue.cc:237] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:35.261747 32238 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:35.259500  3956 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:14:35.264524 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 359885us
I20260709 13:14:35.265901 32239 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:35.237457  3941 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:35.270545 32239 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:35.252875  3863 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:35.268954  3850 raft_consensus.cc:697] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 12 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:35.274529  3666 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:35.274232  3972 raft_consensus.cc:2804] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:35.300371  3987 raft_consensus.cc:3055] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:35.300930  3987 raft_consensus.cc:740] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:35.301903  3987 consensus_queue.cc:260] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:35.303409  3987 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:35.283867  3850 consensus_queue.cc:237] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:35.307891  3924 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:35.309512  3863 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:35.311434  3985 raft_consensus.cc:3055] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:14:35.311904  3985 raft_consensus.cc:740] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:35.312737  3985 consensus_queue.cc:260] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:35.313973  3985 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:35.318197  3732 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:35.297062  3805 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:35.291633  3971 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:35.327167  3971 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:35.329708  3960 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:14:35.331507  3960 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:14:35.366590 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 145949us
W20260709 13:14:35.369066 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 148814us
I20260709 13:14:35.377755 32090 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
W20260709 13:14:35.387750 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 113931us
I20260709 13:14:35.389599 32165 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
W20260709 13:14:35.385991 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:35.394747 32271 raft_consensus.cc:1240] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10. Ops: []
W20260709 13:14:35.395834 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:35.398401 32165 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:14:35.406461 32089 leader_election.cc:336] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 2.033s (SENT)
I20260709 13:14:35.407174 32268 raft_consensus.cc:1240] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:35.407405 32089 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:35.414091 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:35.425861  3659 consensus_queue.cc:1048] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:35.436209  3671 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:35.437058  3671 raft_consensus.cc:697] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:35.325233  3732 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:14:35.456413 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 83916.2us
I20260709 13:14:35.436388  3814 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:35.466450  3814 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:35.467211  3805 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.467314  3671 consensus_queue.cc:237] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:35.468215  3805 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:35.470968 32195 raft_consensus.cc:1240] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:35.471433  3805 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:35.469022 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 198417us
I20260709 13:14:35.486701 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:35.493481 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:35.494927 32120 raft_consensus.cc:2393] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 12: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:35.495787  3814 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:35.500413   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:35.501799  3584 consensus_queue.cc:1059] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:35.503635  3584 raft_consensus.cc:3055] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:35.504119  3584 raft_consensus.cc:740] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
W20260709 13:14:35.505501 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 99377.7us
W20260709 13:14:35.493770 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 116304us
I20260709 13:14:35.512086  3584 consensus_queue.cc:260] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:35.516316  3584 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:35.521301  3863 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:35.522054  3863 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:35.522475  3863 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:35.472417  3805 raft_consensus.cc:2804] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:35.549727 32239 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:14:35.561637 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 169085us
W20260709 13:14:35.584726   365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:35.586167  4001 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:35.586438  3946 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.587360  4001 consensus_queue.cc:1059] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:35.564874  3805 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:35.589552  3805 raft_consensus.cc:3060] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:35.587307  3946 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:35.612897  3985 consensus_queue.cc:1048] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:14:35.600111 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 89000.4us
I20260709 13:14:35.614789  3971 consensus_queue.cc:1059] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:14:35.617806  3971 raft_consensus.cc:3055] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:35.618304  3971 raft_consensus.cc:740] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:35.619241  3946 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:35.620249 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:35.625123  3975 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:14:35.635601 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 159024us
I20260709 13:14:35.637771  3814 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:35.638388  3814 raft_consensus.cc:697] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:14:35.640656 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 64192.7us
W20260709 13:14:35.642218 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:35.644266 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:35.644809 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:35.645829 32124 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:35.648887 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:35.649183  3818 raft_consensus.cc:3055] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:35.649755  3818 raft_consensus.cc:740] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:35.634621  3941 raft_consensus.cc:697] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:35.651265  3818 consensus_queue.cc:260] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:35.651713  3941 consensus_queue.cc:237] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:35.639639  3814 consensus_queue.cc:237] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:35.653164  3818 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:35.644917  3848 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:14:35.642499 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 68210.4us
I20260709 13:14:35.669839  3913 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:14:35.671326  3668 raft_consensus.cc:1068] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06: Unable to promote non-voter 94085cf341634eb686a95983b6b7f7e6: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }.
  Pending config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:35.638715  3972 raft_consensus.cc:697] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:35.672248 32090 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
W20260709 13:14:35.717442 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 45375.3us
I20260709 13:14:35.717523  3848 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:35.716032  3972 consensus_queue.cc:237] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:35.720973  3971 consensus_queue.cc:260] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:35.722798  3971 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:35.724458  4001 raft_consensus.cc:2764] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:14:35.725512  4001 consensus_queue.cc:1059] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:35.726608  4001 consensus_queue.cc:1059] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:35.727634  4001 consensus_queue.cc:1059] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:35.730180  3975 raft_consensus.cc:3055] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:35.730672  3975 raft_consensus.cc:740] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
W20260709 13:14:35.732729 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:35.732899  4005 raft_consensus.cc:3055] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:35.733342  4005 raft_consensus.cc:740] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:35.734469  4005 consensus_queue.cc:260] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:35.735925  4005 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:35.731837  3975 consensus_queue.cc:260] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:35.737475  3975 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:35.736322 32089 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:35.742894  4008 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:35.743520  4008 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:35.744215  4008 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:35.745471 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:35.748654 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:35.749402 32121 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:14:35.716174  3974 log.cc:927] Time spent T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:14:35.752377 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:35.745338 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:35.754946 32117 raft_consensus.cc:3055] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:35.755035 32123 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:14:35.755555 32117 raft_consensus.cc:740] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:35.742946 32122 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:35.755291  3913 consensus_queue.cc:1059] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:35.770123  3848 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:35.788254  4002 raft_consensus.cc:3055] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:35.788770  3913 consensus_queue.cc:1243] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer 6b3ed521ce8947db80c4b4828b355c06 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:14:35.788962  4002 raft_consensus.cc:740] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
W20260709 13:14:35.790393 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 58155.5us
I20260709 13:14:35.790174  4002 consensus_queue.cc:260] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:35.791301 32238 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:35.791837  4002 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:35.791970 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:35.793505   399 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 9 LEARNER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:14:35.805219 32121 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
W20260709 13:14:35.808801 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:35.811041 32124 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:14:35.815348 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:35.825290 32117 consensus_queue.cc:260] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:35.825407 32089 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:35.828814  3925 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:35.834343  3925 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:35.834786  3925 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:35.837512 32239 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:35.838529 32239 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:35.839396  3668 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:35.839833  3668 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:35.840247  3668 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:35.841187  4006 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:35.842120  4006 raft_consensus.cc:697] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:35.843238  3960 consensus_queue.cc:1059] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:35.844624  3960 raft_consensus.cc:3055] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:35.845016  3960 raft_consensus.cc:740] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:35.846045  3960 consensus_queue.cc:260] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:35.847452 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:35.848217 32195 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:35.848917   369 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:35.848793  3666 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:14:35.849445 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:35.850664  3584 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:35.851008 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:35.851233  3584 raft_consensus.cc:697] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 11 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:35.852300  3584 consensus_queue.cc:237] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:35.853114 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:35.853781 32198 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:35.852481 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:35.858349 32193 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:14:35.863735 32239 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:35.868633 32117 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:35.865859 32022 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59534 (request call id 121) took 5178 ms. Trace:
I20260709 13:14:35.883153 32121 raft_consensus.cc:1275] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:35.847559  3960 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:35.843662  4006 consensus_queue.cc:237] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:35.907634  3972 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.908421 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:35.875638  3863 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:35.904677  3671 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:35.954950 32124 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:14:35.960772 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:35.957382 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:35.908416  3972 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:35.985743 32271 raft_consensus.cc:1240] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:35.987217  3972 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:35.988178 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:35.989292 32273 raft_consensus.cc:1275] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:35.991357 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:35.999748  4008 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:36.001674 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:35.958798  3671 raft_consensus.cc:697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:35.969961  3985 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:36.017895 32193 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:36.018915  3818 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:14:36.021242  4014 log.cc:927] Time spent T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:14:36.022316  3668 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:36.024439 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:36.025122 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:36.026163  3863 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:36.025141 32265 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:14:35.878700 32022 rpcz_store.cc:276] 0709 13:14:30.687400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:30.687844 (+   444us) service_pool.cc:224] Handling call
0709 13:14:30.767867 (+ 80023us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b5400047c54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5b090 00007fb59eff9f3a 00007fb5a4db01cc 00007fb5a4eae37e 00007fb5a336f2a4 00007fb5a336f232 00007fb5a336f161 00007fb5a336f0dc 00007fb5a336e392 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:30.883671 (+115804us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b5400010810. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59becd640 00007fb5a4da4b76 00007fb5a4eaec3e 00007fb5a336f2a4 00007fb5a336f232 00007fb5a336f161 00007fb5a336f0dc 00007fb5a336e392 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:35.865480 (+4981809us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:34.631378 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:34.632287 (+   909us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:34.632340 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:14:34.632367 (+    27us) tablet.cc:662] Decoding operations
0709 13:14:34.632845 (+   478us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:34.632933 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:34.632969 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:14:34.633208 (+   239us) tablet.cc:701] Row locks acquired
0709 13:14:34.633228 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:14:34.633418 (+   190us) write_op.cc:270] Start()
0709 13:14:34.633575 (+   157us) write_op.cc:276] Timestamp: P: 1783602874633352 usec, L: 0
0709 13:14:34.633611 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:14:34.663250 (+ 29639us) log.cc:844] Serialized 591 byte log entry
0709 13:14:35.672645 (+1009395us) op_driver.cc:464] REPLICATION: finished
0709 13:14:35.778683 (+106038us) write_op.cc:301] APPLY: starting
0709 13:14:35.778849 (+   166us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:35.779030 (+   181us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:35.779187 (+   157us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:35.779538 (+   351us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:35.779871 (+   333us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:14:35.779928 (+    57us) write_op.cc:312] APPLY: finished
0709 13:14:35.780347 (+   419us) log.cc:844] Serialized 23 byte log entry
0709 13:14:35.780629 (+   282us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:35.780743 (+   114us) write_op.cc:454] Released schema lock
0709 13:14:35.780806 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:35.781400 (+   594us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:35.781443 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3470377,"reported_tablets":1,"spinlock_wait_cycles":68248832,"child_traces":[["op",{"apply.queue_time_us":103545,"apply.run_cpu_time_us":2712,"apply.run_wall_time_us":2716,"num_ops":1,"prepare.queue_time_us":137371,"prepare.run_cpu_time_us":23461,"prepare.run_wall_time_us":221348,"raft.queue_time_us":368911,"raft.run_cpu_time_us":19182,"raft.run_wall_time_us":162262,"replication_time_us":955476,"thread_start_us":626128,"threads_started":4,"wal-append.queue_time_us":181084}]]}
I20260709 13:14:36.026846  3863 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:36.027582  3863 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:36.024660 32267 raft_consensus.cc:1240] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12. Ops: []
W20260709 13:14:36.032011 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.037431  3671 consensus_queue.cc:237] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:36.041649  3805 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:36.021265  3818 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:36.045013  3818 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:36.045710 32198 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:36.047438 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:36.050220 32116 raft_consensus.cc:1240] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:36.051872 32121 raft_consensus.cc:1275] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:14:36.052289 32122 raft_consensus.cc:1275] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:36.053925 32117 raft_consensus.cc:1275] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:36.052285 32121 pending_rounds.cc:85] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d: Aborting all ops after (but not including) 4
W20260709 13:14:36.055586 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 299028us
I20260709 13:14:36.055502 32121 pending_rounds.cc:107] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:14:36.058346 32121 raft_consensus.cc:2889] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:36.059027 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:36.062808 32124 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:36.070820 32192 raft_consensus.cc:1240] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 15. Current term is 16. Ops: []
I20260709 13:14:36.073975 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:36.076745 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:36.083201 32195 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:36.067230  3668 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:36.085577 32198 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:36.089416 32190 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:14:36.089763 32194 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:14:36.091572   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:36.115502 32193 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:36.123517 32194 raft_consensus.cc:1275] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:36.124068 32117 raft_consensus.cc:1240] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:14:36.125044  3850 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:36.131201 32090 leader_election.cc:400] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12.
I20260709 13:14:36.073179  3985 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:36.131613 32090 leader_election.cc:403] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:14:36.066999 32267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45768
I20260709 13:14:36.141700 32124 raft_consensus.cc:1240] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:36.146414 32190 raft_consensus.cc:1275] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:36.146586 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:36.150291 32267 raft_consensus.cc:606] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Received request to transfer leadership
I20260709 13:14:36.143131  3971 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:36.166767  4019 log.cc:927] Time spent T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:14:36.166095  3971 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:36.168304 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:36.168996 32192 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:36.172828  4020 consensus_queue.cc:1048] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
W20260709 13:14:36.176936   365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.185735  4026 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12.
I20260709 13:14:36.189134 32194 raft_consensus.cc:2393] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 9: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:36.190173 32115 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:14:36.190624 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:36.191315 32190 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:36.195506  3913 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:36.198519  3805 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:36.164755  3863 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:36.207870 32019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49556 (request call id 253) took 7577 ms. Trace:
I20260709 13:14:36.209287  3971 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:36.218386 32195 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
W20260709 13:14:36.221618 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 65442.4us
W20260709 13:14:36.224097 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.227459 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:14:36.225908 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 75613us
I20260709 13:14:36.229574 32198 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:14:36.233368 32198 raft_consensus.cc:1240] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:14:36.233719 32267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45768
I20260709 13:14:36.234283 32267 raft_consensus.cc:606] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Received request to transfer leadership
I20260709 13:14:36.242583  3985 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:36.243741  3873 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:36.244392  3873 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:36.245783  4008 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:36.224849  3925 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:36.267637 32264 raft_consensus.cc:2393] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 12: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:36.268913  3925 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:36.213244 32019 rpcz_store.cc:276] 0709 13:14:28.630517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:28.630647 (+   130us) service_pool.cc:224] Handling call
0709 13:14:36.207675 (+7577028us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:34.893358 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:34.893931 (+   573us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:34.893965 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:14:34.893985 (+    20us) tablet.cc:662] Decoding operations
0709 13:14:34.895083 (+  1098us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:34.895137 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:34.903675 (+  8538us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:14:35.060128 (+156453us) tablet.cc:701] Row locks acquired
0709 13:14:35.060157 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:14:35.082660 (+ 22503us) write_op.cc:270] Start()
0709 13:14:35.112113 (+ 29453us) write_op.cc:276] Timestamp: P: 1783602875076335 usec, L: 0
0709 13:14:35.119484 (+  7371us) op_driver.cc:348] REPLICATION: starting
0709 13:14:35.240684 (+121200us) log.cc:844] Serialized 3970 byte log entry
0709 13:14:35.754133 (+513449us) op_driver.cc:464] REPLICATION: finished
0709 13:14:35.784956 (+ 30823us) write_op.cc:301] APPLY: starting
0709 13:14:35.785050 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:35.785366 (+   316us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:35.785472 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:35.786791 (+  1319us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:35.787006 (+   215us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:14:35.787059 (+    53us) write_op.cc:312] APPLY: finished
0709 13:14:35.787344 (+   285us) log.cc:844] Serialized 77 byte log entry
0709 13:14:35.787530 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:35.787799 (+   269us) write_op.cc:454] Released schema lock
0709 13:14:35.787846 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:35.811407 (+ 23561us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:35.814503 (+  3096us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":382348,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":30581,"apply.run_cpu_time_us":3263,"apply.run_wall_time_us":17493,"num_ops":10,"prepare.queue_time_us":239,"prepare.run_cpu_time_us":7763,"prepare.run_wall_time_us":347621,"replication_time_us":634389,"thread_start_us":49073,"threads_started":1}]]}
W20260709 13:14:36.271746 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.275545  3941 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:36.278640  4006 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:36.285356 32198 raft_consensus.cc:1240] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 11. Current term is 12. Ops: []
W20260709 13:14:36.290861 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.298593  3814 consensus_queue.cc:1048] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:36.303427 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:14:36.305449   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 176654us
I20260709 13:14:36.305807 32090 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:36.279332  4006 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:36.301894  4002 consensus_queue.cc:1048] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:14:36.323328 32267 raft_consensus.cc:1240] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:36.323734 32090 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:36.276392  3941 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:36.324807  4026 consensus_queue.cc:1048] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:36.318794 32239 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:36.328765 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:36.329089  3666 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:36.329620  3666 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:36.329684 32119 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:36.330108  3666 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:36.332952  3956 consensus_queue.cc:1059] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:36.334158  3814 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:36.335642  3941 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:36.335857  3972 raft_consensus.cc:3055] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:36.323891  4002 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:36.336208  3972 raft_consensus.cc:740] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:36.336400  4002 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:36.336807  4002 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:36.337167  3972 consensus_queue.cc:260] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:36.338364  3972 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:36.344123 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:36.345299   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:36.346307 32194 raft_consensus.cc:1240] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:36.347990 32197 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:14:36.349710 32196 raft_consensus.cc:1275] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:14:36.322477   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 105836us
I20260709 13:14:36.354804  4028 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:36.355701  4028 consensus_queue.cc:1059] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:14:36.359331 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.322229 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:36.318292 32192 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:14:36.365005 32193 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:14:36.364949 32190 raft_consensus.cc:2468] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:14:36.366704 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:36.366878  4004 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:14:36.369939 32265 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
I20260709 13:14:36.352082  3848 consensus_queue.cc:1048] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:36.385550 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:36.389211 32264 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 8.
I20260709 13:14:36.315618  3873 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:36.397310 32197 raft_consensus.cc:1240] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:36.398321 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:36.320674  3960 consensus_queue.cc:1048] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:14:36.335686  3814 consensus_queue.cc:1048] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:14:36.380887  3818 raft_consensus.cc:3055] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:36.356688  4028 consensus_queue.cc:1059] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:14:36.409277 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:14:36.414197 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 85476.1us
I20260709 13:14:36.407269 32121 raft_consensus.cc:1275] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:36.415809 32264 raft_consensus.cc:1240] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:36.390359  4008 consensus_queue.cc:1048] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:14:36.419006 32121 raft_consensus.cc:1275] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:36.406512   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:36.426090 32115 raft_consensus.cc:1275] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:36.425786  4022 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:14:36.425802 32273 raft_consensus.cc:1275] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:14:36.431401 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:36.432555 32271 raft_consensus.cc:1240] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:14:36.433167  4022 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.434024 32120 raft_consensus.cc:1275] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:14:36.431679 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:36.433745  4022 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:36.436487 32011 maintenance_manager.cc:419] P ffbfb630fccf464dbfd0bffd795262f7: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033391
I20260709 13:14:36.413270  3818 raft_consensus.cc:740] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:36.437529  4006 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:36.418640  4020 consensus_queue.cc:1059] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:14:36.453208 32119 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:36.443302 32121 raft_consensus.cc:1275] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:36.456046 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:14:36.448647 32009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 120582us
I20260709 13:14:36.465473 32192 raft_consensus.cc:1275] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:36.467808 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:36.470549 32193 raft_consensus.cc:1275] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:36.471995  3818 consensus_queue.cc:260] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:36.473433  3818 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:36.473994  4022 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:36.472891 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:36.476971 32271 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 7.
I20260709 13:14:36.478719   399 raft_consensus.cc:1275] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:14:36.480813  3873 consensus_queue.cc:1048] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:36.481292 32191 raft_consensus.cc:3055] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:36.481706 32191 raft_consensus.cc:740] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:36.482558 32191 consensus_queue.cc:260] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:36.483439  4001 raft_consensus.cc:3055] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:36.484196  4001 raft_consensus.cc:740] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:36.485791  4026 consensus_queue.cc:1048] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:36.486959 32165 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:36.487300  4026 consensus_queue.cc:1048] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:36.486836  4001 consensus_queue.cc:260] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:36.487910  3985 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:36.488418  3985 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:36.488641 32118 raft_consensus.cc:1275] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:36.488894  3985 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:36.493714  4002 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:36.496277  3668 raft_consensus.cc:993] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 94085cf341634eb686a95983b6b7f7e6 to start an election
I20260709 13:14:36.483526 32191 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:36.496915  3925 raft_consensus.cc:1081] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Signalling peer 94085cf341634eb686a95983b6b7f7e6 to start an election
I20260709 13:14:36.536573 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:36.537400 32199 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:36.538018 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:36.508679 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:36.521291 32118 raft_consensus.cc:1275] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:14:36.508082 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:36.508363 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:36.516978 32194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "002126350f9348faac039e490fafb4d7"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:14:36.511327 32196 raft_consensus.cc:1240] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:36.512574 32190 raft_consensus.cc:1240] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:36.543478 32273 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
I20260709 13:14:36.541047 32194 raft_consensus.cc:606] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:36.557067 32194 raft_consensus.cc:614] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:36.560994 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:36.517475 32266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45768
I20260709 13:14:36.542790 32019 catalog_manager.cc:5697] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 7 to 8, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 8 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:36.567790 32266 raft_consensus.cc:606] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Received request to transfer leadership
I20260709 13:14:36.570542 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:36.488664  4001 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:36.496527  4002 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:36.568334 32198 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:36.501962  4028 raft_consensus.cc:3055] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:36.568207 32019 catalog_manager.cc:5697] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 10 to 11, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 11 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:36.580957 32121 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:14:36.569397 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:36.565193  4022 consensus_queue.cc:1059] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:14:36.581797 32019 catalog_manager.cc:5697] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 11 to 12, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 12 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:36.519899  3584 consensus_queue.cc:1048] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:14:36.503266  3850 consensus_queue.cc:1059] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:14:36.507263  4030 consensus_queue.cc:1059] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:14:36.515808  3985 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:36.598838 32021 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49534 (request call id 259) took 7332 ms. Trace:
I20260709 13:14:36.599306 32021 rpcz_store.cc:276] 0709 13:14:29.266622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:29.277371 (+ 10749us) service_pool.cc:224] Handling call
0709 13:14:36.598649 (+7321278us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18280,"reported_tablets":14}
I20260709 13:14:36.600932 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:36.603524 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.583503  4022 raft_consensus.cc:3055] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:14:36.610256 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.607385 32118 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:36.580408  4028 raft_consensus.cc:740] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:36.606715 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:36.605942 32238 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:36.609324 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:36.612860 32270 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:36.615447  3873 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:36.615875  3873 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:36.616251  3873 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:36.610277  4022 raft_consensus.cc:740] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:36.619439 32199 raft_consensus.cc:1275] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:14:36.617587  4022 consensus_queue.cc:260] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:36.621778  4022 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:36.614888 32198 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:36.622391 32165 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:36.627274 32190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:14:36.627903 32190 raft_consensus.cc:606] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:36.628253 32190 raft_consensus.cc:614] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:36.629376 32196 raft_consensus.cc:1275] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:36.630014 32090 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:36.631217 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:36.641955  3913 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:36.633419  3666 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:36.642692  3913 raft_consensus.cc:697] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:36.643301  4030 raft_consensus.cc:3055] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:36.643754  4030 raft_consensus.cc:740] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:36.643637  3913 consensus_queue.cc:237] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:36.659238 32120 raft_consensus.cc:1275] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:36.660367 32196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:14:36.660962 32196 raft_consensus.cc:606] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:36.661281 32196 raft_consensus.cc:614] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:14:36.665987   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 112104us
I20260709 13:14:36.644804  3850 raft_consensus.cc:3055] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:36.649472  3805 raft_consensus.cc:2764] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 13:14:36.666957 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 69294.3us
I20260709 13:14:36.644524  3666 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:36.662150   394 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d"
dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
 from {username='slave'} at 127.0.0.1:38164
I20260709 13:14:36.673027 32238 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:36.633394  4028 consensus_queue.cc:260] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:14:36.683633   394 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:36.684093   394 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:36.684197 32119 raft_consensus.cc:1275] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:36.668911  3850 raft_consensus.cc:740] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:36.685927  3850 consensus_queue.cc:260] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:36.687111  3850 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:36.688762 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 95071.1us
I20260709 13:14:36.689626 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:36.692071 32165 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:36.696671 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.705329 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:36.705643 32270 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:36.705968 32123 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:36.707526 32090 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:36.710088 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:36.715651  4022 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:36.719085 32119 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:14:36.721524  4022 raft_consensus.cc:697] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:36.705163  3805 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:36.727113 32192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d001b18973b4cbf86649781d9445577"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:14:36.644857  4030 consensus_queue.cc:260] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:36.708873  3972 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:36.730896 32192 raft_consensus.cc:606] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:36.725852 32118 consensus_queue.cc:237] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:36.735524 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:36.739228 32192 raft_consensus.cc:614] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:14:36.740612 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 71073.7us
I20260709 13:14:36.743757 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:36.706516  3584 consensus_queue.cc:1048] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:14:36.739877 32239 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:36.722898  3863 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:36.747834 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:14:36.748407 32089 leader_election.cc:336] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.553s (SENT)
I20260709 13:14:36.748934 32089 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:36.748747 32124 raft_consensus.cc:2393] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 9: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:36.724974  4022 consensus_queue.cc:237] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:36.762203 32123 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:36.713760  4040 consensus_queue.cc:1059] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.147s
W20260709 13:14:36.746312 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 54360.4us
I20260709 13:14:36.721599  4004 consensus_queue.cc:1048] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:14:36.733585  3666 consensus_queue.cc:1048] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:14:36.775864 32165 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:36.791917 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 50607.3us
I20260709 13:14:36.816726 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:36.764377  3668 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:36.766409  4002 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:36.748665  3976 consensus_queue.cc:1048] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:14:36.777433  3985 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:36.821342 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 45579.4us
I20260709 13:14:36.826599 32192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:14:36.827116 32192 raft_consensus.cc:606] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 11 LEADER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:36.822520 32239 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:36.829460 32239 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:36.830359 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:14:36.830438 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 82078.5us
I20260709 13:14:36.822772  3863 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:36.845139 32238 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:36.817649  3736 consensus_queue.cc:1048] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:14:36.817639  4035 consensus_queue.cc:1048] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 13:14:36.850396 32165 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:36.854015 32089 leader_election.cc:336] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.584s (SENT)
I20260709 13:14:36.854614 32089 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:36.853008  4045 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:36.864118 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:36.865535 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:36.864674 32238 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:36.844897  3925 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:36.905876 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:36.849061  3668 raft_consensus.cc:697] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:36.909466 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:36.909679  3668 consensus_queue.cc:237] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:36.910588 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:36.914353  3939 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:36.915349  3939 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:36.916956  4045 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:36.919350  4045 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:36.920558 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:36.920755  3985 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:36.921314 32192 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 11.
W20260709 13:14:36.921819 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 67847.1us
W20260709 13:14:36.922462 32089 leader_election.cc:336] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.611s (SENT)
I20260709 13:14:36.922787   368 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:36.922961  4002 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:36.922816 32089 leader_election.cc:304] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:36.989403 32117 raft_consensus.cc:1240] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:36.904816  3666 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:14:36.962114   365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.913302  3925 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:36.991695  3925 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:36.991945  4008 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:36.950919  3873 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:36.969468   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:36.966903   394 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:14:36.920333 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 70027.3us
W20260709 13:14:36.990171 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 125591us
I20260709 13:14:37.078758  3971 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.974262  4044 raft_consensus.cc:3055] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:36.949952 32115 raft_consensus.cc:1240] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:36.940491  4045 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:14:37.078833 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 156390us
W20260709 13:14:37.082969 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.084312  4001 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:37.085304  4043 log.cc:927] Time spent T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.267s	user 0.003s	sys 0.010s
W20260709 13:14:37.085424  4050 log.cc:927] Time spent T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.237s	user 0.000s	sys 0.005s
I20260709 13:14:37.086489  4028 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:37.083016 32191 consensus_meta.cc:287] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.559s	user 0.008s	sys 0.008s
I20260709 13:14:37.090035 32121 raft_consensus.cc:1240] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:37.089781  4030 raft_consensus.cc:3060] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:37.112388 32264 raft_consensus.cc:1240] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:37.126097 32191 raft_consensus.cc:1275] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:14:37.132084 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:37.133692 32089 leader_election.cc:336] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.624s (SENT)
I20260709 13:14:37.134261 32089 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:37.135433 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:37.101377  4044 raft_consensus.cc:740] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:37.109455  4045 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:14:37.139129 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 45855.9us
I20260709 13:14:37.144541   403 raft_consensus.cc:1240] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:37.109125  3850 consensus_queue.cc:1048] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:14:37.136622  3946 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:37.156312 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 326897us
W20260709 13:14:37.156114 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 62554.9us
I20260709 13:14:37.124334  4040 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:14:37.142992  4045 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:37.124735  4001 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:37.196867 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 63209.2us
I20260709 13:14:37.195057 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:37.194864 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:37.198431 32191 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:37.198483 32120 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:37.099429  3971 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:37.151389  3863 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.237496  3666 consensus_queue.cc:1048] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
W20260709 13:14:37.253407  4056 log.cc:927] Time spent T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:14:37.235891  3976 consensus_queue.cc:1048] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
W20260709 13:14:37.257407 32089 leader_election.cc:336] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.653s (SENT)
I20260709 13:14:37.257999 32089 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:37.257884  3925 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:37.259589 32089 leader_election.cc:336] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.662s (SENT)
I20260709 13:14:37.259996 32089 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:37.260711  4026 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:37.154127  3668 consensus_queue.cc:1059] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:14:37.192011  4002 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:37.191039  4022 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.266258  4022 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:37.247879 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 97863.5us
I20260709 13:14:37.244889 32239 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:37.272698 32165 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:37.253407  3873 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:37.272692  4022 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:37.278447  4001 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:37.271476  3925 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:37.285364  3985 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:37.296684  4045 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:37.303835 32120 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 10.
I20260709 13:14:37.298257 32191 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 10.
I20260709 13:14:37.231717  3946 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:14:37.314535 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 54978.2us
I20260709 13:14:37.306234  4026 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:14:37.314711 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 76663.9us
I20260709 13:14:37.319754  4055 consensus_queue.cc:1048] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:14:37.317201  3972 consensus_queue.cc:1048] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:14:37.311882  3873 consensus_queue.cc:1059] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
W20260709 13:14:37.324815 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:37.325522 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.311219  4004 raft_consensus.cc:3055] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:37.327286   399 raft_consensus.cc:1240] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:37.330080  3873 raft_consensus.cc:3055] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:14:37.331372  3946 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:37.310194  4044 consensus_queue.cc:260] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:37.327431  3668 raft_consensus.cc:2804] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:14:37.350787 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:37.351100 32089 leader_election.cc:336] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.779s (SENT)
I20260709 13:14:37.355162 32089 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:37.301327  3863 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:37.356431   403 raft_consensus.cc:1275] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:14:37.350696  3873 raft_consensus.cc:740] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:37.357704  3946 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:37.357672  3873 consensus_queue.cc:260] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:37.358327  3946 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:37.359200  3873 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:37.360138  4044 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:37.351605 32239 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:37.360486  3946 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:37.361909  3666 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:37.362425  3666 raft_consensus.cc:697] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:37.363330  3666 consensus_queue.cc:237] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:37.364734   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:37.373602 32120 raft_consensus.cc:1240] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:14:37.352965 32238 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:37.377499   369 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:37.328346   394 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:37.347723  4004 raft_consensus.cc:740] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:37.313966  3925 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:14:37.349615  3971 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:37.400204 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:37.354302  3668 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:14:37.405475 32089 leader_election.cc:336] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.800s (SENT)
I20260709 13:14:37.409330 32089 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:37.405987 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:37.406847 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:37.410744 32191 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 17.
I20260709 13:14:37.411305 32193 raft_consensus.cc:2393] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 9: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:37.413836  4045 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:37.415110 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:37.415884 32192 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:37.415928 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 63060.9us
I20260709 13:14:37.415144  3668 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:37.415266  3960 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:14:37.419512 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 47301us
I20260709 13:14:37.420781 32115 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 16.
I20260709 13:14:37.398234  4030 raft_consensus.cc:2804] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:37.397886  4008 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:14:37.425737 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 153204us
I20260709 13:14:37.432289 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:14:37.433681 32089 leader_election.cc:336] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.757s (SENT)
I20260709 13:14:37.434275 32089 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:37.431183   368 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:37.418628  3972 consensus_queue.cc:1059] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:14:37.393966  3946 consensus_queue.cc:1059] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:14:37.440718 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:37.451511 32192 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 12.
W20260709 13:14:37.465797 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 47198.1us
I20260709 13:14:37.438508  4045 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:37.472267 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:37.425144  4020 consensus_queue.cc:1048] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:14:37.438946  4030 raft_consensus.cc:697] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 10 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
W20260709 13:14:37.486497 32089 leader_election.cc:336] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.851s (SENT)
I20260709 13:14:37.486990 32089 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:37.440696  4022 consensus_queue.cc:1059] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:14:37.469161  3960 raft_consensus.cc:697] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:37.472894  4045 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.481762  4002 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:37.483336  4062 consensus_queue.cc:1059] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:14:37.499380  3946 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.527989  3946 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:37.515340   394 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 14 LEARNER]: Advancing to term 16
I20260709 13:14:37.525357 32165 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:37.487135  3985 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:37.527192  4062 raft_consensus.cc:3055] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:37.517530  4045 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:14:37.536275 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 49804.9us
I20260709 13:14:37.444602  4004 consensus_queue.cc:260] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:14:37.548806 32089 leader_election.cc:336] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.865s (SENT)
I20260709 13:14:37.554625 32089 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:37.529635  4022 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:37.572881 32115 raft_consensus.cc:1275] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:37.536334  4026 raft_consensus.cc:3055] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:14:37.550025  4063 log.cc:927] Time spent T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 13:14:37.576066 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.537361  4062 raft_consensus.cc:740] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:37.545285  4065 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:14:37.598315 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 94657.4us
I20260709 13:14:37.577816  4026 raft_consensus.cc:740] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:37.590378  3863 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:37.602420 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:37.600351 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 51599.4us
W20260709 13:14:37.620447 32089 leader_election.cc:336] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.916s (SENT)
I20260709 13:14:37.621836 32089 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:14:37.618535 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 86035.7us
I20260709 13:14:37.618676  4039 raft_consensus.cc:3055] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:37.595353  4030 consensus_queue.cc:237] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:37.660473  3697 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:14:37.597978  4028 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:37.615901  4076 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:14:37.670526 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 50135us
W20260709 13:14:37.674434 32089 leader_election.cc:336] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 2.037s (SENT)
I20260709 13:14:37.674806 32089 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:37.649883  4075 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:14:37.677429 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 51224.3us
I20260709 13:14:37.673297  3946 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:37.656046  4039 raft_consensus.cc:740] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:37.685014  4026 consensus_queue.cc:260] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:37.673324  4001 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.687769 32165 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:37.599340  3960 consensus_queue.cc:237] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:37.715188 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:14:37.734341 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 46690.3us
I20260709 13:14:37.734378  3863 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:37.735024  3863 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.735339 32165 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:37.737192  4065 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:37.735505  3863 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:37.739027 32165 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:37.740077  4065 raft_consensus.cc:2749] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:37.740856 32165 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:37.741875  4065 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:14:37.733433 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 266297us
I20260709 13:14:37.743083 32165 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:37.743882  4065 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:37.745189 32165 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:37.743410 32238 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:37.696038  4076 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:14:37.778894  4064 log.cc:927] Time spent T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
W20260709 13:14:37.781819 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.783761  3668 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:37.784906 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:37.785107   368 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:37.786448  3850 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:37.787066  3850 raft_consensus.cc:697] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 12 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
W20260709 13:14:37.789162  4068 log.cc:927] Time spent T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:14:37.786567 32267 raft_consensus.cc:1275] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:14:37.787938  3850 consensus_queue.cc:237] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:37.783789 32269 raft_consensus.cc:1275] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:14:37.761198  4086 log.cc:927] Time spent T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.074s	user 0.001s	sys 0.001s
I20260709 13:14:37.804095  4073 consensus_queue.cc:1048] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:37.804575 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:37.655747  4062 consensus_queue.cc:260] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:37.808959  4094 raft_consensus.cc:2804] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:37.808563  3863 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:37.815724  3863 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:37.713871  4002 consensus_queue.cc:1059] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:14:37.818233  3975 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.845237  3975 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:37.846448  3863 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:37.847028  3863 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:37.848757 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 77512.2us
I20260709 13:14:37.770998  4065 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:14:37.819679 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 164934us
I20260709 13:14:37.761713  4001 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:37.828295 32089 leader_election.cc:336] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.950s (SENT)
I20260709 13:14:37.848209  3975 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:37.852501 32089 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:14:37.851882 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 106754us
I20260709 13:14:37.849292  3863 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:37.868654 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 125288us
I20260709 13:14:37.869611 32238 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:37.870240   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 159469us
I20260709 13:14:37.872515   399 raft_consensus.cc:1240] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 12 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:37.876102 32165 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:37.877693 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 49428.3us
W20260709 13:14:37.878633 32089 leader_election.cc:336] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 2.114s (SENT)
I20260709 13:14:37.879554 32089 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:37.862643  4094 raft_consensus.cc:697] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:14:37.891357  3873 consensus_meta.cc:287] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.532s	user 0.014s	sys 0.010s
I20260709 13:14:37.897030   394 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 16 LEARNER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:14:37.900521  4094 consensus_queue.cc:237] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:14:37.878024  4002 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:37.850114  4039 consensus_queue.cc:260] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:37.906838  4093 raft_consensus.cc:2804] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:37.885752  4099 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:37.914438  3668 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:14:37.915262  4091 log.cc:927] Time spent T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.134s	user 0.004s	sys 0.000s
W20260709 13:14:37.920181 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.910025 32238 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:37.888850  4065 raft_consensus.cc:2764] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:14:37.921131 32089 leader_election.cc:336] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.931s (SENT)
I20260709 13:14:37.923179  3873 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.922423  4004 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:37.925590  3863 consensus_queue.cc:1059] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:37.927667  4055 raft_consensus.cc:3055] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:37.928710  4039 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:37.932449 32089 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:37.932878 32165 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6
W20260709 13:14:37.935176 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.956172  3863 consensus_queue.cc:1243] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer 6b3ed521ce8947db80c4b4828b355c06 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:14:37.965467  4090 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:14:37.968014  3976 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:37.938040  3873 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:37.969843  4101 consensus_queue.cc:1048] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:37.970613  3873 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:37.932360  4065 consensus_queue.cc:1048] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
W20260709 13:14:37.971980 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 62057.3us
I20260709 13:14:37.972788 32238 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
W20260709 13:14:37.973486  4081 log.cc:927] Time spent T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.190s	user 0.002s	sys 0.000s
I20260709 13:14:37.975345  4073 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:37.976029  4073 consensus_queue.cc:1048] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:37.945601  4055 raft_consensus.cc:740] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:37.946672  4093 raft_consensus.cc:697] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:37.936379  3975 consensus_queue.cc:1059] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
W20260709 13:14:38.036198 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 115100us
I20260709 13:14:38.000690  3814 consensus_queue.cc:1048] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:14:37.960330  4076 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:14:38.042096 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 64395.7us
W20260709 13:14:38.041582 32089 leader_election.cc:336] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.952s (SENT)
W20260709 13:14:38.044318 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 59571.9us
I20260709 13:14:38.046648 32089 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:14:38.052093 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 73093.7us
I20260709 13:14:38.044018  3863 raft_consensus.cc:2804] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:38.037432  4099 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:37.996266  4045 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:38.048496  3975 consensus_queue.cc:1243] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Peer 94085cf341634eb686a95983b6b7f7e6 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:14:38.054814   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:38.045899  4035 consensus_queue.cc:1059] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:14:38.054498  4076 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:38.058938  4099 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:38.063439  3976 raft_consensus.cc:697] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:38.068228  4099 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:38.067584  3976 consensus_queue.cc:237] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:38.065141  4093 consensus_queue.cc:237] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:38.055503  3863 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:38.095798   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:38.056172  4090 consensus_queue.cc:1059] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:14:38.096256  3863 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:38.096510   403 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
W20260709 13:14:38.097762  4100 log.cc:927] Time spent T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:14:38.097872 32087 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:38.098865  4099 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:38.099257  4099 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:38.099608  4099 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:38.080992   399 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
W20260709 13:14:38.102757 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.064072   402 raft_consensus.cc:2955] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 7 to 9, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:38.055447  4055 consensus_queue.cc:260] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:38.080175 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:38.112875   369 leader_election.cc:336] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Timed out: RequestConsensusVote RPC to 127.30.63.3:36651 timed out after 1.646s (SENT)
I20260709 13:14:38.114410 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:38.115034 32192 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 12.
W20260709 13:14:38.115949 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 52528.6us
W20260709 13:14:38.115880 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 52663.4us
I20260709 13:14:38.116999   368 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:38.118177 32192 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:14:38.122013   365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.129793 32238 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:38.132953 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 200126us
I20260709 13:14:38.128854 32236 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:38.105029  4088 raft_consensus.cc:3055] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:14:38.138032 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 96475.2us
W20260709 13:14:38.138888 32089 leader_election.cc:336] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 2.043s (SENT)
I20260709 13:14:38.139318 32089 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:38.142230  4042 raft_consensus.cc:2804] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:38.142802  4042 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:38.143340  4042 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:38.143249  4065 consensus_queue.cc:1059] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:14:38.144979 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:38.145233 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:38.146113  4079 consensus_queue.cc:1048] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:14:38.146637 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:38.146826  3873 consensus_queue.cc:1048] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:38.147667  4044 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.147943  4109 raft_consensus.cc:1064] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
W20260709 13:14:38.148450  4109 raft_consensus.cc:1068] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06: Unable to promote non-voter 94085cf341634eb686a95983b6b7f7e6: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:14:38.146669  3668 consensus_queue.cc:1048] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:14:38.141448  4076 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:38.142834  3925 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:38.148195  4044 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:38.141887 32165 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:38.137372  4055 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:38.160625 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:14:38.164944 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.130403  3850 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:14:38.169639 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:38.139526  4088 raft_consensus.cc:740] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
W20260709 13:14:38.172523 32089 leader_election.cc:336] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 2.151s (SENT)
I20260709 13:14:38.176649 32089 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:38.177274 32192 raft_consensus.cc:1275] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:14:38.181738 32089 leader_election.cc:336] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 2.169s (SENT)
I20260709 13:14:38.182277 32089 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:38.183182 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:38.183809 32271 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 7.
I20260709 13:14:38.189217 32195 raft_consensus.cc:3055] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:38.189617 32195 raft_consensus.cc:740] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:38.191628 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:38.191632 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:38.168895  4035 raft_consensus.cc:2804] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:38.192685 32199 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:38.192665 32196 raft_consensus.cc:1275] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:38.196957 32192 raft_consensus.cc:1275] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:14:38.199303 32198 raft_consensus.cc:1275] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:38.175336  3925 raft_consensus.cc:697] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:38.184813  4076 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:14:38.229184 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 47454.8us
W20260709 13:14:38.230145 32089 leader_election.cc:336] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 2.174s (SENT)
I20260709 13:14:38.230615 32089 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:14:38.233948   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 47179.3us
I20260709 13:14:38.201162 32195 consensus_queue.cc:260] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:38.237491 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.195789  4035 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:38.245805 32194 raft_consensus.cc:3055] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:38.205224  4065 consensus_queue.cc:1243] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer 6b3ed521ce8947db80c4b4828b355c06 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:14:38.246330 32194 raft_consensus.cc:740] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
W20260709 13:14:38.249991 32089 leader_election.cc:336] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 2.225s (SENT)
I20260709 13:14:38.250378 32089 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:38.206020  4045 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:38.205801  3975 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:38.258781 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:38.266065 32192 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:38.267019 32195 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:38.276705 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.247471  4035 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:38.257316  4110 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:38.250597 32194 consensus_queue.cc:260] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:38.249133  4076 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:38.240033  3863 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:38.258491  4065 raft_consensus.cc:2804] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:38.304888 32195 raft_consensus.cc:1275] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:14:38.309095   367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:38.310797 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:38.310977  4119 log.cc:927] Time spent T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:14:38.314216 32194 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:38.270794  4028 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:38.323767 32199 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:38.328131 32191 raft_consensus.cc:1240] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 6. Current term is 7. Ops: []
W20260709 13:14:38.333446 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.335703 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:38.286274  4110 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:14:38.337925  4117 log.cc:927] Time spent T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:14:38.333927  4020 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.323623  4065 raft_consensus.cc:697] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:38.244835  4088 consensus_queue.cc:260] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:38.411141  4079 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:38.412003  4079 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:38.335336  4076 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.449299 32194 raft_consensus.cc:1275] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:38.459071 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:14:38.510717  3985 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:14:38.515400  4110 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:38.327250  3925 consensus_queue.cc:237] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:38.518139  4088 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:38.593462  4001 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:38.446522  4020 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:38.584311  4105 log.cc:927] Time spent T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.541s	user 0.004s	sys 0.000s
I20260709 13:14:38.452494  4076 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:38.734651 32264 raft_consensus.cc:1275] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:38.736788 32192 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 18.
I20260709 13:14:38.735199 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:38.671525   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 284352us
I20260709 13:14:38.685817 32124 raft_consensus.cc:1240] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260709 13:14:38.672415 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:38.750249 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:38.801031 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.692462 32194 raft_consensus.cc:1240] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 11. Current term is 12. Ops: []
W20260709 13:14:38.846443 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:38.847148 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:38.702598  4099 consensus_meta.cc:287] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.603s	user 0.011s	sys 0.000s
W20260709 13:14:38.800230 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 550189us
I20260709 13:14:38.802954 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:14:38.735808  4039 consensus_meta.cc:287] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6: Time spent flushing consensus metadata: real 0.789s	user 0.004s	sys 0.007s
W20260709 13:14:38.856144 32089 leader_election.cc:336] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 2.235s (SENT)
W20260709 13:14:38.833050  3976 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.011s	sys 0.004s
I20260709 13:14:38.825681 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:14:38.850485   367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:38.816639 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 674729us
I20260709 13:14:38.785490  4130 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.853695 32124 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:14:38.802402   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:38.753436 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:38.859095 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.862955 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:38.704389  4020 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:38.856734 32089 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:38.868115 32271 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:38.647076  3939 raft_consensus.cc:3055] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:38.862613 32117 raft_consensus.cc:2468] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 3.
I20260709 13:14:38.646263  4094 raft_consensus.cc:3055] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:38.847074  4026 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:38.876564  3939 raft_consensus.cc:740] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:14:38.861941  3976 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.012s	sys 0.004s
W20260709 13:14:38.893558   369 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.30.63.3:36651 timed out after 1.547s (SENT) [suppressed 34 similar messages]
I20260709 13:14:38.852020  4123 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.901202 32267 raft_consensus.cc:2393] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 10: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
W20260709 13:14:38.918557 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 65071us
W20260709 13:14:38.920291 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:38.918869 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 43600.2us
W20260709 13:14:38.915320 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:39.033049 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:39.031778 32115 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.003s	sys 0.032s
W20260709 13:14:39.034006 32115 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.003s	sys 0.032s
I20260709 13:14:38.859719  4110 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.862886  4113 consensus_queue.cc:1048] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:14:39.063827   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
W20260709 13:14:38.917366  4042 consensus_meta.cc:287] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6: Time spent flushing consensus metadata: real 0.754s	user 0.011s	sys 0.001s
I20260709 13:14:39.089417 32115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 3376) took 1532 ms. Trace:
W20260709 13:14:38.943212  3850 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.007s	sys 0.013s
W20260709 13:14:38.924830  4126 log.cc:927] Time spent T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:14:38.857035  4099 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:39.124082 32190 raft_consensus.cc:3055] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:38.916559  4094 raft_consensus.cc:740] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:39.064411  4103 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.602366  4065 consensus_queue.cc:237] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:39.068250  3863 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:38.924933  4001 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:39.091975 32115 rpcz_store.cc:276] 0709 13:14:37.532881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.601450 (+ 68569us) service_pool.cc:224] Handling call
0709 13:14:37.621344 (+ 19894us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:37.621545 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:14:38.515312 (+893767us) spinlock_profiling.cc:243] Waited 9.7 ms on lock 0x7b18003a8d60. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59eb994bc 00007fb59bee748b 00007fb5a4d41ab9 00007fb59bf0369b 00007fb59bf0193f 00007fb59bf01455 00007fb5a29e93c7 00007fb59effb9a7 00007fb59f00b0bf
0709 13:14:38.515508 (+   196us) log.cc:844] Serialized 14 byte log entry
0709 13:14:39.064886 (+549378us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:39.064936 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:39.064984 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:39.065064 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:39.065197 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54743,"prepare.queue_time_us":110699,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"spinlock_wait_cycles":22315904,"thread_start_us":596011,"threads_started":2}
I20260709 13:14:39.124511 32190 raft_consensus.cc:740] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
W20260709 13:14:39.060873 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 204754us
W20260709 13:14:39.098549 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 54499.2us
W20260709 13:14:39.099956  4004 consensus_meta.cc:287] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 1.155s	user 0.013s	sys 0.001s
I20260709 13:14:39.031339  4020 consensus_queue.cc:1048] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.099s
I20260709 13:14:39.067258  3985 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.921330   394 raft_consensus.cc:1275] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:14:39.118301  4062 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:39.136650 32124 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 18.
I20260709 13:14:39.125484  3956 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.091215  4110 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:39.144778  4035 consensus_meta.cc:287] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.845s	user 0.008s	sys 0.005s
I20260709 13:14:39.065168  4123 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:39.146059 32190 consensus_queue.cc:260] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:39.140213 32089 connection.cc:256] RPC call timeout handler was delayed by -1.2317898660000992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3437s for a response
I20260709 13:14:38.918455  4130 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:39.137393  4079 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:39.150383   394 pending_rounds.cc:85] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6: Aborting all ops after (but not including) 9
I20260709 13:14:39.095230  4042 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:39.142606  3913 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:14:39.166326 32089 connection.cc:256] RPC call timeout handler was delayed by -1.0275207849999788s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17920000000000003s for a response
W20260709 13:14:39.189728 32089 connection.cc:256] RPC call timeout handler was delayed by -1.0224971459999779s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2195s for a response
W20260709 13:14:39.173382  4125 log.cc:927] Time spent T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:14:39.190254 32089 leader_election.cc:336] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 2.225s (SENT)
I20260709 13:14:39.148370  4076 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:39.148985  4121 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.151178  3975 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:39.175168 32119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 3389) took 1006 ms. Trace:
I20260709 13:14:39.157431  4135 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:39.198668  4130 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:39.199023  4042 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:39.189087   394 pending_rounds.cc:107] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:14:39.203045  4128 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.206363  4123 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:39.210471  4099 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:39.211988 32019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59534 (request call id 122) took 2748 ms. Trace:
I20260709 13:14:38.730525 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:39.150702  3985 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:39.214840  3668 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:39.217540  4090 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.218112  4110 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:39.174644  4094 consensus_queue.cc:260] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:39.167237  4035 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:39.238737  3913 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:39.235984 32266 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 10.
I20260709 13:14:39.238225 32119 rpcz_store.cc:276] 0709 13:14:38.168362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:38.169889 (+  1527us) service_pool.cc:224] Handling call
0709 13:14:38.183140 (+ 13251us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:38.195977 (+ 12837us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:38.196007 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:38.200292 (+  4285us) log.cc:844] Serialized 26 byte log entry
0709 13:14:38.395099 (+194807us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:38.395138 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:38.395214 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:39.174935 (+779721us) raft_consensus.cc:1685] finished
0709 13:14:39.174957 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:39.175094 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6900,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":11418,"thread_start_us":142810,"threads_started":1,"wal-append.queue_time_us":557742}
W20260709 13:14:39.168999   365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:39.266722 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 76494.4us
W20260709 13:14:39.273806 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:39.296101 32238 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:39.297436 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 225003us
I20260709 13:14:39.166966  3956 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:39.304735   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 411185us
I20260709 13:14:39.314179 32019 rpcz_store.cc:276] 0709 13:14:36.473581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:36.473899 (+   318us) service_pool.cc:224] Handling call
0709 13:14:39.211867 (+2737968us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:37.248721 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:37.281348 (+ 32627us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:37.281401 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:14:37.281423 (+    22us) tablet.cc:662] Decoding operations
0709 13:14:37.282044 (+   621us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:37.282153 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:37.282188 (+    35us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:14:37.282613 (+   425us) tablet.cc:701] Row locks acquired
0709 13:14:37.282667 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:14:37.282852 (+   185us) write_op.cc:270] Start()
0709 13:14:37.282998 (+   146us) write_op.cc:276] Timestamp: P: 1783602877282779 usec, L: 0
0709 13:14:37.283022 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:14:37.283872 (+   850us) log.cc:844] Serialized 1284 byte log entry
0709 13:14:37.782425 (+498553us) op_driver.cc:464] REPLICATION: finished
0709 13:14:38.065635 (+283210us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59bee70ac 00007fb5a4d41ab9 00007fb59bf0369b 00007fb59bf0193f 00007fb59bf03c02 00007fb5a2a27ef0
0709 13:14:38.093733 (+ 28098us) write_op.cc:301] APPLY: starting
0709 13:14:38.093802 (+    69us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:38.094267 (+   465us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:38.094282 (+    15us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:38.094532 (+   250us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:38.094681 (+   149us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:14:38.094714 (+    33us) write_op.cc:312] APPLY: finished
0709 13:14:38.094904 (+   190us) log.cc:844] Serialized 35 byte log entry
0709 13:14:38.095095 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:38.095195 (+   100us) write_op.cc:454] Released schema lock
0709 13:14:38.095234 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:38.137061 (+ 41827us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:38.138832 (+  1771us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":54545,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":311108,"apply.run_cpu_time_us":1913,"apply.run_wall_time_us":34055,"num_ops":3,"prepare.queue_time_us":467857,"prepare.run_cpu_time_us":22301,"prepare.run_wall_time_us":183834,"raft.queue_time_us":254451,"raft.run_cpu_time_us":13393,"raft.run_wall_time_us":331969,"replication_time_us":499239,"spinlock_wait_cycles":38194944,"thread_start_us":853657,"threads_started":4,"wal-append.queue_time_us":160687,"wal-append.run_cpu_time_us":20280,"wal-append.run_wall_time_us":1662483}]]}
I20260709 13:14:39.351567   369 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:39.237617  3863 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:39.153558  3939 consensus_queue.cc:260] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:39.328693 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 87289.9us
W20260709 13:14:39.368312 32089 leader_election.cc:336] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.716s (SENT)
I20260709 13:14:39.229415 32190 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:39.332664 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:39.368844 32089 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:39.306034   394 raft_consensus.cc:2889] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:39.268746  3975 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:39.374145 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 78147.6us
W20260709 13:14:39.375473 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:39.302522  4055 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:14:39.316644  4002 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:14:39.380221 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:39.389680 32268 raft_consensus.cc:2368] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 for earlier term 9. Current term is 10.
I20260709 13:14:39.328748  4020 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:39.378470  4113 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:39.438215  3985 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:39.438112  4113 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:39.440076   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:39.394711   394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38164 (request call id 275) took 1357 ms. Trace:
I20260709 13:14:39.379352 32090 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:39.441200  3975 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:39.441761 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 62489.6us
I20260709 13:14:39.138145  4103 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:39.453658   369 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:39.354504  4099 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:39.395759  4154 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:39.342152  4044 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:39.397620  4076 consensus_queue.cc:1048] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:39.298058  4135 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:39.384032 32238 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:39.352519  3863 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:39.268505  4121 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:39.320979  3668 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:39.315131  4128 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:39.480407 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 96479.8us
I20260709 13:14:39.329985  4090 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:39.394891  4097 consensus_queue.cc:1048] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 13:14:39.455515 32270 raft_consensus.cc:1240] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:39.456962   369 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:39.063570  4075 raft_consensus.cc:2955] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index 7 to 9, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:39.462888 32193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3372) took 1128 ms. Trace:
I20260709 13:14:39.498255 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:39.377446  4123 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:39.398779 32192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3373) took 1003 ms. Trace:
I20260709 13:14:39.469040 32190 raft_consensus.cc:1275] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:39.399319  4042 raft_consensus.cc:2804] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:39.401134  4073 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:39.472903 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:39.438139  4140 log.cc:927] Time spent T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:14:39.507754  4055 consensus_queue.cc:1048] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:39.508177 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:39.475682  4109 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.440723   394 rpcz_store.cc:276] 0709 13:14:38.036980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:38.040937 (+  3957us) service_pool.cc:224] Handling call
0709 13:14:38.054768 (+ 13831us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:39.393028 (+1338260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:39.394353 (+  1325us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b54008a1454. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:39.394604 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1861027584}
I20260709 13:14:39.402014  3666 consensus_queue.cc:1048] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:14:39.444945  4077 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:39.473021  3736 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:39.528386  3736 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:39.529067 32191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3371) took 1214 ms. Trace:
I20260709 13:14:39.490020 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:39.529435 32191 rpcz_store.cc:276] 0709 13:14:38.314521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:38.552298 (+237777us) service_pool.cc:224] Handling call
0709 13:14:38.557208 (+  4910us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:38.800653 (+243445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:38.800684 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:38.818444 (+ 17760us) log.cc:844] Serialized 26 byte log entry
0709 13:14:39.096401 (+277957us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:39.096457 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:39.096550 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:39.528871 (+432321us) raft_consensus.cc:1685] finished
0709 13:14:39.528891 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:39.529009 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":259248,"raft.queue_time_us":244050,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":15351,"thread_start_us":227828,"threads_started":1,"wal-append.queue_time_us":679409}
I20260709 13:14:39.530722  4035 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:39.490496  3863 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:39.465785  3975 raft_consensus.cc:2749] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:39.531358 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:39.469781  4039 raft_consensus.cc:2804] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:39.498034 32193 rpcz_store.cc:276] 0709 13:14:38.334187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:38.590095 (+255908us) service_pool.cc:224] Handling call
0709 13:14:38.590559 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:38.801143 (+210584us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:38.801185 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:38.830977 (+ 29792us) log.cc:844] Serialized 26 byte log entry
0709 13:14:39.314188 (+483211us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:39.462267 (+148079us) log.cc:844] Serialized 14 byte log entry
0709 13:14:39.462523 (+   256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:39.462612 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:39.462661 (+    49us) raft_consensus.cc:1685] finished
0709 13:14:39.462677 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:39.462824 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":222835,"raft.queue_time_us":225572,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":18878,"spinlock_wait_cycles":7009024,"thread_start_us":520616,"threads_started":2,"wal-append.queue_time_us":532732}
I20260709 13:14:39.503468 32238 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:39.504055 32270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50584 (request call id 353) took 1354 ms. Trace:
I20260709 13:14:39.500394 32192 rpcz_store.cc:276] 0709 13:14:38.394980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:38.767725 (+372745us) service_pool.cc:224] Handling call
0709 13:14:38.768251 (+   526us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:38.815256 (+ 47005us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:38.815290 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:38.816028 (+   738us) log.cc:844] Serialized 26 byte log entry
0709 13:14:39.127209 (+311181us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:39.309062 (+181853us) log.cc:844] Serialized 14 byte log entry
0709 13:14:39.309291 (+   229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:39.309363 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:39.398492 (+ 89129us) raft_consensus.cc:1685] finished
0709 13:14:39.398519 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:39.398698 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58635,"raft.queue_time_us":76968,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":9094,"thread_start_us":434753,"threads_started":2,"wal-append.queue_time_us":499981}
I20260709 13:14:39.507124 32190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3358) took 1322 ms. Trace:
W20260709 13:14:39.508698  4145 log.cc:927] Time spent T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
W20260709 13:14:39.508821 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:39.509040  4118 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:14:39.504395  4042 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.455392  4020 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:39.492556  4079 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:39.504724  4044 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:39.510783  3668 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:39.486965  3814 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:39.472913 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 104629us
I20260709 13:14:39.506263  4123 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:39.517077 32265 raft_consensus.cc:2393] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 10: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:39.486519  4113 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:39.465400  4099 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:39.470330  4002 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:39.528314  4077 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:39.531430 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:39.532320 32194 raft_consensus.cc:2410] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:14:39.491807  3913 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:39.535202 32190 rpcz_store.cc:276] 0709 13:14:38.178925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:38.179033 (+   108us) service_pool.cc:224] Handling call
0709 13:14:38.179446 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:39.123996 (+944550us) spinlock_profiling.cc:243] Waited 70.2 ms on lock 0x7b54001d8920. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59ef68dc0 00007fb59eff31c0 00007fb59eff4231 00007fb59eff0d8f 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c
0709 13:14:39.500886 (+376890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:39.501091 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161452928}
I20260709 13:14:39.543653  4042 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:39.534097  4039 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.540747  3975 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:39.584775 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:39.553215  4076 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.543627 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:14:39.544438 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:39.548658 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:14:39.537145  4026 consensus_meta.cc:287] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.002s
I20260709 13:14:39.530679  3736 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:39.548054  4044 raft_consensus.cc:697] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:39.558018  3814 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:39.559229 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:39.559731  4079 raft_consensus.cc:697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:39.564127  3946 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:39.564671  3666 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:39.565915 32195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3374) took 1140 ms. Trace:
I20260709 13:14:39.585817  4039 raft_consensus.cc:3060] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:39.603261 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:39.614287 32192 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:39.567548  3956 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:14:39.567734  4152 log.cc:927] Time spent T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:14:39.541435  4156 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:39.540944  4035 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:39.574223 32191 raft_consensus.cc:2393] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 4: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:39.575690 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:39.625589 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:39.626241 32190 raft_consensus.cc:2368] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 12. Current term is 13.
I20260709 13:14:39.626881 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:39.534720 32270 rpcz_store.cc:276] 0709 13:14:38.143686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:38.144671 (+   985us) service_pool.cc:224] Handling call
0709 13:14:39.455228 (+1310557us) spinlock_profiling.cc:243] Waited 8.77 ms on lock 0x7b5800187898. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59beccf8c 00007fb59beccef6 0000000000375939 00007fb5a3f401e0 00007fb5a40090c4 00007fb5a4009131 00007fb5a3fcafc0 00007fb5a3fb5929 00007fb5a3fb53d2 00007fb59d52cbd4
0709 13:14:39.455357 (+   129us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:39.497454 (+ 42097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:39.497649 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20190720}
I20260709 13:14:39.488039  4122 consensus_queue.cc:1048] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
W20260709 13:14:39.583532 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:39.583802 32165 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:54182 dropped due to backpressure: service queue is full with 50 items
I20260709 13:14:39.471988  4154 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:39.568068  4137 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:39.632378 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:39.632804  4137 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.622300  3666 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:39.633598 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:39.595678 32193 raft_consensus.cc:2393] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 16: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:39.634205 32270 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 9.
I20260709 13:14:39.568115  4166 consensus_queue.cc:1048] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:14:39.573949  4135 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:39.564724  4101 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:39.566689  4128 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:39.601631 32195 rpcz_store.cc:276] 0709 13:14:38.426101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:38.816881 (+390780us) service_pool.cc:224] Handling call
0709 13:14:38.817282 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:38.852847 (+ 35565us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:38.852889 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:38.858868 (+  5979us) log.cc:844] Serialized 26 byte log entry
0709 13:14:39.317223 (+458355us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:39.317262 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:39.317325 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:39.565662 (+248337us) raft_consensus.cc:1685] finished
0709 13:14:39.565684 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:39.565843 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28188,"raft.queue_time_us":45141,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":52380,"thread_start_us":227582,"threads_started":1,"wal-append.queue_time_us":628649}
I20260709 13:14:39.621618  4113 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:39.617801 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:14:39.627761 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 78925us
I20260709 13:14:39.630496 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:14:39.617128  4161 log.cc:927] Time spent T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:14:39.603058  3668 consensus_queue.cc:1048] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:14:39.640622 32194 raft_consensus.cc:2393] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 9: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:39.615851  3946 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:39.631996 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:39.641659 32192 raft_consensus.cc:2393] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 12: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:39.627498  3913 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.633253  4137 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:39.642887  3913 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:39.627012 32162 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:54182 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54182 (request call id 3392)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2370)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2397)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2371)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2373)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2387)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2382)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2375)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2383)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54182 (request call id 3391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2380)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2374)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2376)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2377)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2378)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2385)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2379)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2384)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2381)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2386)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2360)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2393)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2357)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3377)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3378)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3379)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3380)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3381)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3382)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3383)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3384)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3385)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3387)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3388)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2388)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2389)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2391)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2392)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2394)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2396)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3389)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3390)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3393)
I20260709 13:14:39.525365  4109 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:39.646906  3913 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:39.647454  3913 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.647905  3913 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:39.648967  3946 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:39.601328  3975 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:39.603044 32118 raft_consensus.cc:1275] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:14:39.594383  4076 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
W20260709 13:14:39.623813  4088 consensus_meta.cc:287] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 1.039s	user 0.021s	sys 0.001s
I20260709 13:14:39.650367 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:39.685964 32191 raft_consensus.cc:2393] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 4: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:39.624132   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:39.650094  4101 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:39.666725  4079 consensus_queue.cc:237] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:39.668767 32089 leader_election.cc:336] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.913s (SENT)
I20260709 13:14:39.693764 32089 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:39.669052  3814 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:39.669186  3975 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:39.655049  4113 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:39.665416  3913 leader_election.cc:290] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:14:39.682237 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:39.663414  4169 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.696852   394 raft_consensus.cc:1813] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Handling vote request from an unknown peer 113b5461952d47e0944d463ea4e32801
I20260709 13:14:39.665319  4090 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:39.700273 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:39.717463 32191 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:14:39.671350  3666 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:39.629380  4156 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:39.722744 32117 raft_consensus.cc:1275] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:14:39.718426 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 104292us
I20260709 13:14:39.723971 32121 raft_consensus.cc:1275] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:14:39.725275   369 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:39.726451   369 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:39.697849  4088 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:39.711249  4135 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:39.779325 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:39.843370 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:39.715750  3975 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.844334 32272 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 12.
W20260709 13:14:39.783406 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:39.664785  4044 consensus_queue.cc:237] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:39.712299  4121 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:39.850914 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:14:39.873443 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:39.894249 32191 raft_consensus.cc:2393] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 11: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:39.896068 32123 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:14:39.728420  3946 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:39.840828  4123 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:39.900902 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:14:39.891965  4151 log.cc:927] Time spent T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 13:14:39.844786  4141 raft_consensus.cc:2804] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:14:39.906260 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:39.907912  4176 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:39.904709 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:14:39.911664 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 242879us
I20260709 13:14:39.918519 32191 raft_consensus.cc:2368] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 17. Current term is 18.
W20260709 13:14:39.921643 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:39.912024 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:39.898329  3697 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.925676 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:39.721346  4169 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:39.916807 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:39.904452   394 raft_consensus.cc:2410] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:14:39.846299  4174 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:39.927157 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:39.915745 32123 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:14:39.939447 32198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3367) took 1738 ms. Trace:
I20260709 13:14:39.942624 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:39.943378 32191 raft_consensus.cc:2368] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 8. Current term is 9.
I20260709 13:14:39.912194  4099 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:39.913748  4141 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.895988  4088 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:39.940032 32198 rpcz_store.cc:276] 0709 13:14:38.200527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:38.200681 (+   154us) service_pool.cc:224] Handling call
0709 13:14:38.233342 (+ 32661us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:38.452127 (+218785us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:38.452154 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:38.800398 (+348244us) log.cc:844] Serialized 26 byte log entry
0709 13:14:39.298073 (+497675us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:39.367072 (+ 68999us) log.cc:844] Serialized 14 byte log entry
0709 13:14:39.367614 (+   542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:39.367688 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:39.939174 (+571486us) raft_consensus.cc:1685] finished
0709 13:14:39.939202 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:39.939368 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7697,"prepare.queue_time_us":216415,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":36049,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":22204,"thread_start_us":701581,"threads_started":3,"wal-append.queue_time_us":749566}
I20260709 13:14:39.955893  4177 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:39.957099  4169 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:39.956766  4177 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:39.959602  4177 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:39.966286 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:39.967175 32195 raft_consensus.cc:2393] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 16: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:39.968029 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:14:39.950340  4162 log.cc:927] Time spent T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.280s	user 0.001s	sys 0.001s
I20260709 13:14:39.892614  4135 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:39.969779 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:39.973328 32195 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:14:39.925381  4077 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:39.898725  3975 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:39.949398 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:14:39.979104   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 79969.3us
I20260709 13:14:39.982997 32124 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:14:40.007643 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.007905 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.017851 32198 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:40.014762 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.019296 32195 raft_consensus.cc:2393] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 12: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:39.946833  4176 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:40.017540 32191 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:39.953017  4141 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:39.929680  3697 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:40.036095  4101 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:14:40.036664  4129 log.cc:927] Time spent T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 1.064s	user 0.014s	sys 0.015s
I20260709 13:14:40.037662  3697 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:40.029692 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.038352 32195 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:40.039149 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.035326  4176 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:40.041273  4176 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:40.041998 32195 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:40.042877 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.035365 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:40.043912 32195 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:14:40.045075 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.046983 32195 raft_consensus.cc:2393] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 13: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:40.047921 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:40.051803 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:40.053424 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.054388 32198 raft_consensus.cc:2368] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12.
I20260709 13:14:40.056443 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.056699 32115 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:14:40.057190 32191 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 8.
I20260709 13:14:40.016808  4154 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:40.059167 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:39.942289  4174 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:40.060482 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:40.061415 32123 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 13.
I20260709 13:14:40.063731 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.064889 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:40.061789 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:40.066103 32195 raft_consensus.cc:2393] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 15: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:40.071259 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:40.052691  4176 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.064426 32198 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:40.074437 32123 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:14:40.072567 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.016512  4137 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:40.101910 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:40.150405 32270 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:14:40.152163 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.105238 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:14:40.166817   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 149853us
I20260709 13:14:40.059731  3946 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:40.181525 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:40.055938  4172 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:40.182379 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:40.190241 32122 raft_consensus.cc:1275] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:40.192021 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:14:40.192631 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.075533  4076 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:40.199880 32195 raft_consensus.cc:1240] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:14:40.227183 32123 raft_consensus.cc:1275] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:14:40.228739   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:40.228266   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:40.243255 32122 raft_consensus.cc:1275] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:14:40.265745 32122 pending_rounds.cc:85] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d: Aborting all ops after (but not including) 6
I20260709 13:14:40.266017 32122 pending_rounds.cc:107] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:14:40.266252 32122 raft_consensus.cc:2889] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:40.245092 32198 raft_consensus.cc:1240] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:40.266690 32195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2357) took 1108 ms. Trace:
I20260709 13:14:40.266974 32198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3377) took 1050 ms. Trace:
I20260709 13:14:40.199201 32191 raft_consensus.cc:1240] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:40.267037 32195 rpcz_store.cc:276] 0709 13:14:39.158342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.182079 (+1023737us) service_pool.cc:224] Handling call
0709 13:14:40.192788 (+ 10709us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:40.266428 (+ 73640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.266637 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:40.188259  4156 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:40.181298  4176 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:40.257666 32123 pending_rounds.cc:85] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d: Aborting all ops after (but not including) 6
I20260709 13:14:40.270489 32123 pending_rounds.cc:107] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:14:40.270794 32123 raft_consensus.cc:2889] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:40.267398 32198 rpcz_store.cc:276] 0709 13:14:39.219590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.224453 (+1004863us) service_pool.cc:224] Handling call
0709 13:14:40.244858 (+ 20405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:40.266766 (+ 21908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.266927 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:40.234901 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 312232us
I20260709 13:14:40.258678  4088 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:40.260653  4137 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:40.263023  3975 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:40.189911  4172 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:40.241765  4178 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:40.256949   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:40.224576  3946 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:14:40.240965  4154 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:40.270399  4169 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:40.277161   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:40.267984 32191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2358) took 1103 ms. Trace:
I20260709 13:14:40.289505 32191 rpcz_store.cc:276] 0709 13:14:39.164536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.181721 (+1017185us) service_pool.cc:224] Handling call
0709 13:14:40.198995 (+ 17274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:40.267769 (+ 68774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.267936 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:40.273535  4135 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:40.291169 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.283296 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:40.282898  4178 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:40.268903  4192 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:40.322409  4135 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:40.275565   369 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:40.323267  4135 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:40.324111   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 48621.7us
I20260709 13:14:40.324858  4174 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:40.325498  4174 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:40.326216 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.326061  4174 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:40.327090 32191 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 8.
I20260709 13:14:40.292286 32198 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:40.330262  4042 consensus_meta.cc:287] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6: Time spent flushing consensus metadata: real 0.741s	user 0.007s	sys 0.003s
I20260709 13:14:40.330750  4042 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:40.295903 32271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:50578 (request call id 12) took 1081 ms. Trace:
I20260709 13:14:40.288511   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:40.332469 32271 rpcz_store.cc:276] 0709 13:14:39.214856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:39.216737 (+  1881us) service_pool.cc:224] Handling call
0709 13:14:40.295552 (+1078815us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54001f6b54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff7735 00007fb5a3fb7d29 00007fb59d5361d4 00007fb59d536162 00007fb59d536091 00007fb59d53600c 00007fb59d5352c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:40.295773 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":288547200}
I20260709 13:14:40.330189  4178 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:40.334921 32191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3378) took 1108 ms. Trace:
I20260709 13:14:40.335301 32191 rpcz_store.cc:276] 0709 13:14:39.219922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.327897 (+1107975us) service_pool.cc:224] Handling call
0709 13:14:40.328160 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:40.328338 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:40.328360 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:40.328398 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:40.328436 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.328484 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:40.328570 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:40.325528  4135 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:40.291777 32195 raft_consensus.cc:2468] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 4.
I20260709 13:14:40.287608  4088 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.288404   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:40.286070  4189 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.338409 32195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3380) took 1118 ms. Trace:
W20260709 13:14:40.297232  4186 log.cc:927] Time spent T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:14:40.339145 32198 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 13.
I20260709 13:14:40.340031 32191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3379) took 1119 ms. Trace:
W20260709 13:14:40.292726  4190 log.cc:927] Time spent T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:14:40.289011  4181 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:40.328382  4174 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:40.344434 32191 rpcz_store.cc:276] 0709 13:14:39.220204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.336128 (+1115924us) service_pool.cc:224] Handling call
0709 13:14:40.339243 (+  3115us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:40.339402 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:40.339425 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:40.339693 (+   268us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:40.339758 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.339837 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:40.339965 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:40.367671  4075 consensus_meta.cc:287] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.859s	user 0.006s	sys 0.006s
I20260709 13:14:40.368057 32191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3382) took 1147 ms. Trace:
I20260709 13:14:40.337962  4169 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:40.370883  4169 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:40.368418 32191 rpcz_store.cc:276] 0709 13:14:39.221013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.367182 (+1146169us) service_pool.cc:224] Handling call
0709 13:14:40.367502 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:40.367714 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:40.367739 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:40.367796 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:40.367832 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.367887 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:40.368004 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:40.372725  4039 consensus_meta.cc:287] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6: Time spent flushing consensus metadata: real 0.749s	user 0.011s	sys 0.000s
I20260709 13:14:40.359691  4020 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:40.360288  4181 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:40.373104 32191 raft_consensus.cc:1240] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:40.373924 32191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3383) took 1152 ms. Trace:
I20260709 13:14:40.374289 32191 rpcz_store.cc:276] 0709 13:14:39.221272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.372481 (+1151209us) service_pool.cc:224] Handling call
0709 13:14:40.372944 (+   463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:40.373706 (+   762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.373876 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:40.374864  4181 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:40.375413  4181 raft_consensus.cc:2804] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:40.376017  4181 raft_consensus.cc:697] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 13 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
W20260709 13:14:40.363948 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.337029  4192 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:40.364810  4042 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:40.291917  4154 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:40.343818  4088 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:40.363946  4141 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:40.347513  4189 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:40.373111  4039 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:40.379688 32198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3381) took 1159 ms. Trace:
I20260709 13:14:40.383445   394 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
W20260709 13:14:40.385012  4188 log.cc:927] Time spent T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.087s	user 0.000s	sys 0.002s
I20260709 13:14:40.385632 32195 rpcz_store.cc:276] 0709 13:14:39.220465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.337714 (+1117249us) service_pool.cc:224] Handling call
0709 13:14:40.337977 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:40.338130 (+   153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:40.338152 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:40.338188 (+    36us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:40.338224 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.338271 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:40.338356 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:40.392787   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 64785.7us
I20260709 13:14:40.395262 32198 rpcz_store.cc:276] 0709 13:14:39.220743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.348988 (+1128245us) service_pool.cc:224] Handling call
0709 13:14:40.379181 (+ 30193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:40.379365 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:40.379392 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:40.379436 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:40.379476 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.379531 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:40.379633 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:40.409719 32195 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:14:40.411358  4075 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:56870 (request call id 69) took 3797 ms. Trace:
I20260709 13:14:40.410662 32195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3385) took 1145 ms. Trace:
I20260709 13:14:40.412227 32195 rpcz_store.cc:276] 0709 13:14:39.265059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.406716 (+1141657us) service_pool.cc:224] Handling call
0709 13:14:40.407883 (+  1167us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:40.410429 (+  2546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.410589 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:40.411438 32198 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:14:40.413854 32195 raft_consensus.cc:1275] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:40.414436 32195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3388) took 1115 ms. Trace:
I20260709 13:14:40.415457 32198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3387) took 1118 ms. Trace:
I20260709 13:14:40.416040 32198 rpcz_store.cc:276] 0709 13:14:39.295471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.408927 (+1113456us) service_pool.cc:224] Handling call
0709 13:14:40.409226 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:40.413189 (+  3963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.413375 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:40.418649 32198 raft_consensus.cc:1240] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:14:40.411944   399 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:40.414973  4042 consensus_queue.cc:1059] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:14:40.411844  4075 rpcz_store.cc:276] 0709 13:14:36.629626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:36.641340 (+ 11714us) service_pool.cc:224] Handling call
0709 13:14:36.751048 (+109708us) log.cc:844] Serialized 487 byte log entry
0709 13:14:37.313587 (+562539us) spinlock_profiling.cc:243] Waited 5 ms on lock 0x7b54001b6320. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59ef6a142 00007fb59ef4aeaa 00007fb59ef51d53 00007fb59ef51cd9 00007fb59ef51c69 00007fb59ef51c31 00007fb59ef50dfd 000000000038f354 000000000038f199 00007fb59bf04475
0709 13:14:40.406867 (+3093280us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1433,"raft.queue_time_us":785,"raft.run_cpu_time_us":4081,"raft.run_wall_time_us":338757,"spinlock_wait_cycles":11497344,"thread_start_us":318915,"threads_started":1,"wal-append.queue_time_us":383231,"wal-append.run_cpu_time_us":2068,"wal-append.run_wall_time_us":1103374}
I20260709 13:14:40.429668  4181 consensus_queue.cc:237] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:40.431703 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.434623 32192 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
W20260709 13:14:40.443650 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:40.445348 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.418959  4192 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:40.415125 32195 rpcz_store.cc:276] 0709 13:14:39.299311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.413219 (+1113908us) service_pool.cc:224] Handling call
0709 13:14:40.413501 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:40.414242 (+   741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.414394 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:40.460955 32195 raft_consensus.cc:1240] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10. Ops: []
W20260709 13:14:40.484696  4204 log.cc:927] Time spent T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.051s	user 0.003s	sys 0.000s
W20260709 13:14:40.485752 32268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50584 (request call id 359) took 2338 ms (client timeout 2102 ms). Trace:
W20260709 13:14:40.486593  4201 log.cc:927] Time spent T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:14:40.438351  4189 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:40.487310 32264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 2649) took 1043 ms. Trace:
W20260709 13:14:40.486232 32268 rpcz_store.cc:269] 0709 13:14:38.155423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:38.155598 (+   175us) service_pool.cc:224] Handling call
0709 13:14:40.485473 (+2329875us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540014b754. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:40.485647 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2780464512}
I20260709 13:14:40.487655 32264 rpcz_store.cc:276] 0709 13:14:39.443717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:39.444255 (+   538us) service_pool.cc:224] Handling call
0709 13:14:39.444622 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:39.501969 (+ 57347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:39.501997 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:39.502034 (+    37us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:39.502071 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.487068 (+984997us) spinlock_profiling.cc:243] Waited 57.1 ms on lock 0x7b540014c154. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:40.487114 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:40.487250 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":131433856}
I20260709 13:14:40.576524 32198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2388) took 1041 ms. Trace:
W20260709 13:14:40.576814  4171 log.cc:927] Time spent T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.868s	user 0.003s	sys 0.000s
I20260709 13:14:40.578111 32192 raft_consensus.cc:1240] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:14:40.577312 32198 rpcz_store.cc:276] 0709 13:14:39.535426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.418038 (+882612us) service_pool.cc:224] Handling call
0709 13:14:40.418399 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:40.419108 (+   709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.576452 (+157344us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:40.578830 32192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2389) took 1042 ms. Trace:
W20260709 13:14:40.577325 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.579154 32192 rpcz_store.cc:276] 0709 13:14:39.536513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.435331 (+898818us) service_pool.cc:224] Handling call
0709 13:14:40.577863 (+142532us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:40.578548 (+   685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.578780 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:40.583362 32198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2394) took 1045 ms. Trace:
I20260709 13:14:40.583695 32198 rpcz_store.cc:276] 0709 13:14:39.538040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.579025 (+1040985us) service_pool.cc:224] Handling call
0709 13:14:40.582788 (+  3763us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:40.583012 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:40.583036 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:40.583073 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:40.583135 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.583190 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:40.583312 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:40.576515  4109 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:14:40.589061  4205 log.cc:927] Time spent T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:14:40.599701 32191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3384) took 1378 ms. Trace:
I20260709 13:14:40.600095 32191 rpcz_store.cc:276] 0709 13:14:39.221592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.375068 (+1153476us) service_pool.cc:224] Handling call
0709 13:14:40.375449 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:40.376171 (+   722us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:40.376201 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:40.376727 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:14:40.396817 (+ 20090us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:40.396900 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.396973 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:40.599488 (+202515us) raft_consensus.cc:1685] finished
0709 13:14:40.599510 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:40.599640 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":107,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"thread_start_us":19716,"threads_started":1,"wal-append.queue_time_us":36847}
I20260709 13:14:40.605407 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:40.606381 32121 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:14:40.606774 32191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3390) took 1013 ms. Trace:
I20260709 13:14:40.607630 32191 rpcz_store.cc:276] 0709 13:14:39.592942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.605906 (+1012964us) service_pool.cc:224] Handling call
0709 13:14:40.606247 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:40.606433 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:40.606462 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:40.606504 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:40.606540 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.606595 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:40.606712 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:40.612562  4198 log.cc:927] Time spent T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.314s	user 0.001s	sys 0.000s
I20260709 13:14:40.579891  4141 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 10 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:40.620328 32192 raft_consensus.cc:1275] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:14:40.583051  4002 leader_election.cc:290] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:40.621438 32192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2396) took 1082 ms. Trace:
I20260709 13:14:40.617422  4113 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:40.622918 32192 rpcz_store.cc:276] 0709 13:14:39.538609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.583137 (+1044528us) service_pool.cc:224] Handling call
0709 13:14:40.620024 (+ 36887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:40.621210 (+  1186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.621387 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:40.629560 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.630275 32192 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:14:40.633206 32118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55358 (request call id 314) took 1801 ms. Trace:
I20260709 13:14:40.633605 32118 rpcz_store.cc:276] 0709 13:14:38.831586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:38.831746 (+   160us) service_pool.cc:224] Handling call
0709 13:14:38.832119 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:39.652200 (+820081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.632951 (+980751us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b5400204754. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:40.633151 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1761168640}
I20260709 13:14:39.630230 32165 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:54182 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2370)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2397)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2371)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2373)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2387)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2382)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2375)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2383)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54182 (request call id 3391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2380)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2374)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2376)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2377)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2378)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2385)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2379)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2384)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2381)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2386)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2360)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2393)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2357)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3377)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3378)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3379)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3380)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3381)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3382)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3383)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3384)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3385)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3387)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3388)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2388)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2389)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2391)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2392)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2394)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2396)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3389)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3390)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3393)
I20260709 13:14:40.641052   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:40.642022   394 raft_consensus.cc:2393] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 8: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:14:40.642761  4002 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:40.642988 32195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2392) took 1105 ms. Trace:
I20260709 13:14:40.643420 32195 rpcz_store.cc:276] 0709 13:14:39.537417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.462213 (+924796us) service_pool.cc:224] Handling call
0709 13:14:40.462648 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:40.473683 (+ 11035us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:40.473738 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:40.519174 (+ 45436us) log.cc:844] Serialized 26 byte log entry
0709 13:14:40.586149 (+ 66975us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:40.586188 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.586233 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:40.642790 (+ 56557us) raft_consensus.cc:1685] finished
0709 13:14:40.642811 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:40.642933 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9273,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":1204,"thread_start_us":12995,"threads_started":1,"wal-append.queue_time_us":82874}
W20260709 13:14:40.647925 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.647980 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.649776 32195 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:40.651036 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.643751 32009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 64767c8d367b4cc1b7e2ffbcbf73ce29 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:40.643313  4002 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:40.660873  4002 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:40.664705 32195 raft_consensus.cc:2468] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 8.
I20260709 13:14:40.667703 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.668519 32195 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
W20260709 13:14:40.669988  4132 log.cc:927] Time spent T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 1.544s	user 0.008s	sys 0.000s
I20260709 13:14:40.669844   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:40.671700 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:14:40.672144 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.670249   396 raft_consensus.cc:1275] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:14:40.672969  3985 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.673079 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.673954 32195 raft_consensus.cc:2410] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:14:40.674918 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.675462 32195 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:40.673560  3985 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:14:40.673978   394 raft_consensus.cc:2368] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 9. Current term is 10.
W20260709 13:14:40.677904 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:40.678629 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.680471 32162 leader_election.cc:400] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025) with higher term. Message: Invalid argument: T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 9. Current term is 10.
I20260709 13:14:40.681285 32162 leader_election.cc:403] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:40.681444 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.670941 32269 raft_consensus.cc:2955] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 7 to 9, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:40.683194 32192 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
W20260709 13:14:40.684350   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 287710us
I20260709 13:14:40.677354  3939 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:40.690704 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:14:40.691733 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 54158.4us
I20260709 13:14:40.692332 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.693077 32195 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:40.677853  4118 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.693413 32192 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:14:40.694046 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.697862 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.698607 32192 raft_consensus.cc:2468] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 7.
I20260709 13:14:40.698995 32238 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:40.701665  4166 raft_consensus.cc:2804] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:40.702064  4166 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:40.702502  4166 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:40.681396  4135 consensus_queue.cc:1048] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:14:40.707120 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.707938 32192 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:14:40.708869 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:40.709463 32192 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:14:40.705124  3985 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:40.708035   368 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:40.712364 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.712643 32198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3389) took 1120 ms. Trace:
I20260709 13:14:40.713085 32198 rpcz_store.cc:276] 0709 13:14:39.592605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.584381 (+991776us) service_pool.cc:224] Handling call
0709 13:14:40.619185 (+ 34804us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:40.622826 (+  3641us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:40.622877 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:40.623570 (+   693us) log.cc:844] Serialized 26 byte log entry
0709 13:14:40.694618 (+ 71048us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:40.694664 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.695244 (+   580us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:40.712298 (+ 17054us) raft_consensus.cc:1685] finished
0709 13:14:40.712318 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:40.712543 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2075,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":1471,"thread_start_us":59155,"threads_started":1,"wal-append.queue_time_us":72651}
W20260709 13:14:40.714006 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.713038 32195 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:40.720487  4141 raft_consensus.cc:2804] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:40.721158  4141 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:40.721647  4141 raft_consensus.cc:3060] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:40.697444  4118 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:40.726581  4118 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:40.732880  4166 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:40.734603 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.746639 32198 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
W20260709 13:14:40.748152  4008 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.530s	user 0.006s	sys 0.013s
W20260709 13:14:40.759001  4146 log.cc:927] Time spent T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 1.552s	user 0.005s	sys 0.000s
I20260709 13:14:40.759137 32192 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 10.
I20260709 13:14:40.760485 32269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 2655) took 1242 ms. Trace:
I20260709 13:14:40.761593  4127 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:40.766925 32087 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:40.783977 32087 leader_election.cc:304] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:40.767966 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:40.768913 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:40.779443 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.780321   368 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:40.785687 32192 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:40.788126 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.789036 32198 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:40.793334 32122 raft_consensus.cc:1275] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:14:40.782013  4008 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.560s	user 0.007s	sys 0.013s
I20260709 13:14:40.795236 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:40.801048 32192 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:40.797343 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:40.793126  4207 consensus_queue.cc:1048] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:14:40.801885 32121 raft_consensus.cc:3060] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:14:40.805722 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.804502 32196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3364) took 2617 ms. Trace:
I20260709 13:14:40.806740 32196 rpcz_store.cc:276] 0709 13:14:38.185907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:38.195972 (+ 10065us) service_pool.cc:224] Handling call
0709 13:14:38.204377 (+  8405us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:38.469421 (+265044us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:38.469468 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:38.767617 (+298149us) log.cc:844] Serialized 52 byte log entry
0709 13:14:39.090596 (+322979us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:39.310381 (+219785us) log.cc:844] Serialized 14 byte log entry
0709 13:14:39.313392 (+  3011us) log.cc:844] Serialized 14 byte log entry
0709 13:14:39.587346 (+273954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:39.587458 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:40.758433 (+1170975us) spinlock_profiling.cc:243] Waited 31.9 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:14:40.802771 (+ 44338us) raft_consensus.cc:1685] finished
0709 13:14:40.802801 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:40.802933 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2430,"prepare.queue_time_us":602308,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":2269,"raft.queue_time_us":56970,"raft.run_cpu_time_us":370,"raft.run_wall_time_us":18726,"spinlock_wait_cycles":73318784,"thread_start_us":1000889,"threads_started":4,"wal-append.queue_time_us":377635}
I20260709 13:14:40.808918  4103 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:40.808866 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.809991 32196 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 16.
I20260709 13:14:40.810815 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.811316 32196 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:14:40.812067 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.791118  4075 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:40.812556 32196 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:14:40.812995  4075 raft_consensus.cc:697] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:40.813467 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.780881  3985 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025) with higher term. Message: Invalid argument: T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 9. Current term is 10.
I20260709 13:14:40.813920  4075 consensus_queue.cc:237] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:40.790902  4203 raft_consensus.cc:2804] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:40.814581 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.815047  4203 raft_consensus.cc:697] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 10 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:40.815673 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.816221 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.821744 32190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2371) took 1424 ms. Trace:
W20260709 13:14:40.821847 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 70619.8us
I20260709 13:14:40.787552  4177 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:40.822110 32190 rpcz_store.cc:276] 0709 13:14:39.397374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.815985 (+1418611us) service_pool.cc:224] Handling call
0709 13:14:40.821671 (+  5686us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:40.815922  4203 consensus_queue.cc:237] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:40.821097  3946 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:14:40.830932 32238 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:40.834345 32090 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:40.835546 32192 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:40.836910 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.838510 32090 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:40.839323 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.816234 32196 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:14:40.840173 32192 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:14:40.840773 32121 raft_consensus.cc:2468] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 5.
I20260709 13:14:40.842128 32090 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:40.842204 32238 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:40.843042  4113 raft_consensus.cc:2804] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:40.843470  4113 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:40.843825  4113 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:40.843998  4001 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:40.844995  4103 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:40.845484  4103 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:40.845592  4172 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:40.837581  3972 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:14:40.824038  4177 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:40.849691  4177 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:40.850898  4206 raft_consensus.cc:3055] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:40.851516  4206 raft_consensus.cc:740] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:40.853376 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.854161 32190 raft_consensus.cc:2393] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 7: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:40.854954 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.855572 32198 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:14:40.854997   369 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:40.841300 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.845989  4103 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:40.866783 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.867738 32192 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:14:40.868814 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.803592  4141 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:40.872116 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:40.881227 32198 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:40.881553 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.862399  3976 raft_consensus.cc:1064] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:14:40.873126 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.882325 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:40.890471 32196 raft_consensus.cc:2376] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12. Re-sending same reply.
I20260709 13:14:40.889695 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.891937 32190 raft_consensus.cc:2393] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 15: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:40.893815 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.895088  4113 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:40.896903 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:14:40.897361  4210 log.cc:927] Time spent T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:14:40.897612 32196 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:14:40.898523 32191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3393) took 1277 ms. Trace:
I20260709 13:14:40.898650 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.899550 32196 raft_consensus.cc:2393] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 12: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:40.899004 32191 rpcz_store.cc:276] 0709 13:14:39.621306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.610410 (+989104us) service_pool.cc:224] Handling call
0709 13:14:40.610750 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:40.613077 (+  2327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:40.613110 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:40.620081 (+  6971us) log.cc:844] Serialized 26 byte log entry
0709 13:14:40.700560 (+ 80479us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:40.700651 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.700714 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:40.898312 (+197598us) raft_consensus.cc:1685] finished
0709 13:14:40.898331 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:40.898470 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1671,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"thread_start_us":72392,"threads_started":1,"wal-append.queue_time_us":159884}
I20260709 13:14:40.862376  4109 consensus_queue.cc:1048] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:14:40.870757  4213 raft_consensus.cc:2804] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:40.903407 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.903492 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.909703 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.910077 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.911087 32190 raft_consensus.cc:2393] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 16: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:40.912135 32191 raft_consensus.cc:2393] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 9: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
W20260709 13:14:40.900458  3976 raft_consensus.cc:1068] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06: Unable to promote non-voter 94085cf341634eb686a95983b6b7f7e6: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:14:40.902932  3972 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.919546 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.920338 32191 raft_consensus.cc:2393] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 13: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:40.922629 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:40.924144 32198 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 8.
I20260709 13:14:40.927580 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.928485 32193 raft_consensus.cc:2410] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
W20260709 13:14:40.928931 32193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2390) took 1392 ms (client timeout 1792 ms). Trace:
W20260709 13:14:40.929324 32193 rpcz_store.cc:269] 0709 13:14:39.536817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.927306 (+1390489us) service_pool.cc:224] Handling call
0709 13:14:40.928874 (+  1568us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:40.930543   368 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:40.915655  4213 raft_consensus.cc:697] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 5 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:40.941958 32118 raft_consensus.cc:1240] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:14:40.923259  3972 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:40.869745  4206 consensus_queue.cc:260] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:40.947032 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:40.985196 32124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 3410) took 1038 ms. Trace:
I20260709 13:14:41.018311 32124 rpcz_store.cc:276] 0709 13:14:39.946443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.061862 (+115419us) service_pool.cc:224] Handling call
0709 13:14:40.079712 (+ 17850us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:40.104889 (+ 25177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:40.104919 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:40.104961 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:40.104994 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.984867 (+879873us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b5400300f54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:40.984943 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:40.985117 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57357056}
I20260709 13:14:40.950557 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:41.020552 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:40.950941  4189 raft_consensus.cc:2804] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:14:40.982659 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 138991us
I20260709 13:14:41.022724  4189 raft_consensus.cc:697] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 8 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
W20260709 13:14:41.021175 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 121906us
W20260709 13:14:40.956940 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:41.024883 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.929068  4166 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:40.955406 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:41.022966 32238 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:41.028543 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:41.034464 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:41.035053 32190 raft_consensus.cc:3060] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:41.035913  3972 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:41.037643 32193 raft_consensus.cc:1275] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:14:41.023921 32118 raft_consensus.cc:2368] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 4. Current term is 5.
I20260709 13:14:41.042793 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:41.000494  4178 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:41.045907 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:41.048326 32267 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:41.050540 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:41.048926  3972 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:41.053808 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:41.054744 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:41.092048 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:41.089422 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.094710  4226 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.089224 32118 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:14:41.095532 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:41.054721  4206 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:41.133152 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:41.135869 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:41.113061 32190 raft_consensus.cc:2468] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 8.
W20260709 13:14:41.098599 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.134473 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:41.132464 32268 raft_consensus.cc:2468] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 7.
I20260709 13:14:41.139501 32264 raft_consensus.cc:2393] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 10: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:41.089658 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:41.136101 32194 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
W20260709 13:14:41.140623 32194 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2397) took 1597 ms (client timeout 1734 ms). Trace:
W20260709 13:14:41.140820 32165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.140717 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:41.137748   368 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
W20260709 13:14:41.141144 32194 rpcz_store.cc:269] 0709 13:14:39.543306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.091139 (+1547833us) service_pool.cc:224] Handling call
0709 13:14:41.140544 (+ 49405us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:41.144681 32118 raft_consensus.cc:2368] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12.
I20260709 13:14:41.058179  3972 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:41.147768   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:41.094723  4141 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:41.159183 32199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54182 (request call id 3370) took 2867 ms (client timeout 1677 ms). Trace:
I20260709 13:14:41.153600 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:41.160456 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:14:41.160804 32165 connection.cc:256] RPC call timeout handler was delayed by -4.1568474700000024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1515s for a response
W20260709 13:14:41.161180 32165 connection.cc:256] RPC call timeout handler was delayed by -4.1424474699999791s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
W20260709 13:14:41.161772 32165 connection.cc:256] RPC call timeout handler was delayed by -4.002947469999981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
I20260709 13:14:41.161337 32118 raft_consensus.cc:2410] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 13:14:41.162410 32165 connection.cc:256] RPC call timeout handler was delayed by -3.97144746999993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17210000000000003s for a response
W20260709 13:14:41.164103 32165 connection.cc:256] RPC call timeout handler was delayed by -3.9093474699998296s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17900000000000002s for a response
W20260709 13:14:41.164603 32165 connection.cc:256] RPC call timeout handler was delayed by -3.8760474700000032s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
W20260709 13:14:41.165057 32165 connection.cc:256] RPC call timeout handler was delayed by -3.8490474699999595s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1857s for a response
W20260709 13:14:41.165611 32165 connection.cc:256] RPC call timeout handler was delayed by -3.7644474699998227s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19510000000000002s for a response
W20260709 13:14:41.166154 32165 connection.cc:256] RPC call timeout handler was delayed by -3.6870474699999249s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2037s for a response
W20260709 13:14:41.166630 32165 connection.cc:256] RPC call timeout handler was delayed by -3.5331474699999035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22080000000000002s for a response
W20260709 13:14:41.167088 32165 connection.cc:256] RPC call timeout handler was delayed by -3.5241474699998889s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2218s for a response
W20260709 13:14:41.167613 32165 connection.cc:256] RPC call timeout handler was delayed by -1.9041474699999981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4018s for a response
W20260709 13:14:41.159855 32199 rpcz_store.cc:269] 0709 13:14:38.279706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:38.334882 (+ 55176us) service_pool.cc:224] Handling call
0709 13:14:41.146935 (+2812053us) spinlock_profiling.cc:243] Waited 990 ms on lock 0x7b54000fa854. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:41.147061 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2277054720}
I20260709 13:14:41.169391   402 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:14:41.149365  4135 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.171924   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:41.023936  4189 consensus_queue.cc:237] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:14:41.176836 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.178661 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:41.179260 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:41.180352 32165 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:41.096508  4177 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:41.050211  3946 consensus_queue.cc:1048] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.113s
I20260709 13:14:41.194577 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:14:41.272143 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:41.278059  4216 log.cc:927] Time spent T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.328s	user 0.001s	sys 0.000s
I20260709 13:14:41.170471  3972 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:41.277834   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:41.279114 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:40.999519  4213 consensus_queue.cc:237] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:41.149894  4207 raft_consensus.cc:2804] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:41.177336   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:41.327054 32199 raft_consensus.cc:3055] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:14:41.280251 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 103031us
W20260709 13:14:41.281081  4150 log.cc:927] Time spent T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 2.081s	user 0.019s	sys 0.008s
I20260709 13:14:41.418632 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:41.467438 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:41.463614 32165 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:41.463718   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:41.464311 32199 raft_consensus.cc:740] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:41.465760  4154 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:41.292564  4220 consensus_queue.cc:1048] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.174s
W20260709 13:14:41.466604 32266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50584 (request call id 358) took 3321 ms (client timeout 1547 ms). Trace:
I20260709 13:14:41.138577  4226 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:41.469802 32119 raft_consensus.cc:2393] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 13: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
W20260709 13:14:41.476447   367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.420351  4172 consensus_queue.cc:1048] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:14:41.473249 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:41.291878  4008 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:14:41.475272 32266 rpcz_store.cc:269] 0709 13:14:38.145247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:38.146385 (+  1138us) service_pool.cc:224] Handling call
0709 13:14:41.465480 (+3319095us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54001f6b54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:41.466509 (+  1029us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2300102528}
I20260709 13:14:41.469166 32199 consensus_queue.cc:260] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:41.488281 32199 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:41.293957  4001 consensus_queue.cc:1059] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.203s
W20260709 13:14:41.514853 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 383430us
I20260709 13:14:41.182454  4135 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:14:41.514068 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:41.520506 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:41.527526 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 219081us
I20260709 13:14:41.529471 32089 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:41.531587 32199 raft_consensus.cc:1275] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:14:41.532986 32199 pending_rounds.cc:85] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 6
I20260709 13:14:41.533740 32089 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:41.533968 32199 pending_rounds.cc:107] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:14:41.535246 32199 raft_consensus.cc:2889] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:41.519857  3913 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:41.536430 32089 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:41.539323 32089 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:41.499370  4008 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:41.545337 32267 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 8.
I20260709 13:14:41.530987  4001 raft_consensus.cc:3055] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:41.559013 32199 raft_consensus.cc:1275] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:14:41.561877 32197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3363) took 3380 ms. Trace:
I20260709 13:14:41.561013 32199 raft_consensus.cc:1240] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:41.552402  4001 raft_consensus.cc:740] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:41.591334 32115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 3398) took 1869 ms. Trace:
I20260709 13:14:41.591955 32115 rpcz_store.cc:276] 0709 13:14:39.723204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:39.723362 (+   158us) service_pool.cc:224] Handling call
0709 13:14:39.838708 (+115346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:40.057149 (+218441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:41.588820 (+1531671us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54000988d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:41.591247 (+  2427us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":492842752}
I20260709 13:14:41.585387  4181 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 13:14:41.598928   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:41.562357 32197 rpcz_store.cc:276] 0709 13:14:38.181096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:38.181195 (+    99us) service_pool.cc:224] Handling call
0709 13:14:38.194487 (+ 13292us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:38.268147 (+ 73660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:38.268197 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:38.769620 (+501423us) log.cc:844] Serialized 52 byte log entry
0709 13:14:39.126930 (+357310us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:39.456773 (+329843us) log.cc:844] Serialized 14 byte log entry
0709 13:14:39.463658 (+  6885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:39.464039 (+   381us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:41.018450 (+1554411us) spinlock_profiling.cc:243] Waited 62.7 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:14:41.545513 (+527063us) raft_consensus.cc:1685] finished
0709 13:14:41.561644 (+ 16131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:41.561821 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6166,"prepare.queue_time_us":371234,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":71397,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":6839,"spinlock_wait_cycles":144324480,"thread_start_us":699629,"threads_started":3,"wal-append.queue_time_us":414177}
I20260709 13:14:41.546114  3913 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:41.591606  4075 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:41.591197  4039 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 5 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:14:41.608042  4218 log.cc:927] Time spent T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.431s	user 0.001s	sys 0.000s
I20260709 13:14:41.613258   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:41.628209  4177 leader_election.cc:290] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:41.617311  4001 consensus_queue.cc:260] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:41.615542  4172 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:41.616268  4075 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:14:41.656839  4234 log.cc:927] Time spent T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:14:41.613830  4238 raft_consensus.cc:2749] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:14:41.628484  4224 log.cc:927] Time spent T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:14:41.678524  4097 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:41.678814  4172 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:41.682480  4075 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:41.628763  4154 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:14:41.698101 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:41.699823 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 160559us
I20260709 13:14:41.703382 32089 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:41.629248  4240 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:41.672772  4207 raft_consensus.cc:697] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 8 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:41.705029 32089 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:14:41.702335  4231 log.cc:927] Time spent T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260709 13:14:41.709123 32237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.009s	sys 0.019s
W20260709 13:14:41.720098 32237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.009s	sys 0.019s
I20260709 13:14:41.699633  4172 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:41.717113 32089 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:41.717037 32236 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:41.704681  4001 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:41.725126 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:41.684345  3972 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:41.707080  4240 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:41.708501  4238 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:41.728343 32089 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:41.731927 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:41.732174 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:41.727080  3976 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:14:41.739949 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:41.740777  4253 consensus_queue.cc:1048] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:14:41.741398  4245 log.cc:927] Time spent T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:14:41.742455  4243 log.cc:927] Time spent T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:14:41.732029  4240 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:41.738055 32089 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:41.724952  4135 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:41.721485  4226 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:41.706784  4154 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:41.725538  4166 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.746913 32089 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:41.750521 32196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3397) took 1132 ms. Trace:
I20260709 13:14:41.751365  4246 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:41.731803  4238 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:41.751585 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:41.752351  4074 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:41.752449 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:41.756896  4113 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:41.757588 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:41.769454 32267 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:41.758980 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:41.759635 32194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3404) took 1122 ms. Trace:
W20260709 13:14:41.746502  4232 log.cc:927] Time spent T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:14:41.764492 32196 rpcz_store.cc:276] 0709 13:14:40.617679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.039489 (+421810us) service_pool.cc:224] Handling call
0709 13:14:41.039869 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:41.040153 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:14:41.134005 (+ 93852us) log.cc:844] Serialized 14 byte log entry
0709 13:14:41.744186 (+610181us) spinlock_profiling.cc:243] Waited 4.71 ms on lock 0x7b1800413140. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59be7ec0a 00007fb5a55be219 00007fb59bf06a40 00007fb59bf014e4 00007fb59bf01455 00007fb59efe9060 00007fb59effb716 00007fb59f00c287 00007fb59f00c208
0709 13:14:41.750071 (+  5885us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:41.750154 (+    83us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:41.750225 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:41.750314 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:41.750451 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":112907,"prepare.queue_time_us":272549,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":451438,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"spinlock_wait_cycles":10825984,"thread_start_us":244043,"threads_started":2,"wal-append.queue_time_us":393291}
I20260709 13:14:41.731905  4177 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:41.754526 32273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 2653) took 2254 ms. Trace:
I20260709 13:14:41.777472  4177 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:41.778041  4177 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:41.777518 32273 rpcz_store.cc:276] 0709 13:14:39.500432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:39.500565 (+   133us) service_pool.cc:224] Handling call
0709 13:14:39.500894 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:39.512875 (+ 11981us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:39.512914 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:39.513398 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 13:14:41.616508 (+2103110us) spinlock_profiling.cc:243] Waited 8.96 ms on lock 0x7b1800398fe0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bee6e07 00007fb5a4d41ab9 00007fb59bf0369b 00007fb59bf0193f 00007fb59bf03c02 00007fb59eb8b20b 00007fb59eb90d23 00007fb59eb910d1 00007fb59efaca0f
0709 13:14:41.674839 (+ 58331us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:41.674897 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:41.754125 (+ 79228us) spinlock_profiling.cc:243] Waited 5.74 ms on lock 0x7b54002b6bd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:41.754185 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:41.754249 (+    64us) raft_consensus.cc:1685] finished
0709 13:14:41.754265 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:41.754433 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16790,"raft.queue_time_us":5980,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":11462,"spinlock_wait_cycles":33846016,"thread_start_us":56751,"threads_started":1,"wal-append.queue_time_us":2168408}
I20260709 13:14:41.764389 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:41.726266  4242 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:41.770077 32268 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:41.780267  4242 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:41.791702  4242 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:41.773597 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 43769.8us
I20260709 13:14:41.769279  4074 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:41.775210 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:41.770052 32194 rpcz_store.cc:276] 0709 13:14:40.637085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.145024 (+507939us) service_pool.cc:224] Handling call
0709 13:14:41.163425 (+ 18401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:41.163924 (+   499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:41.163966 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:41.176889 (+ 12923us) log.cc:844] Serialized 26 byte log entry
0709 13:14:41.562300 (+385411us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:41.601977 (+ 39677us) log.cc:844] Serialized 14 byte log entry
0709 13:14:41.752394 (+150417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:41.752475 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:41.759404 (+  6929us) raft_consensus.cc:1685] finished
0709 13:14:41.759426 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:41.759570 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":163424,"prepare.queue_time_us":50244,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":159546,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":5696,"thread_start_us":142646,"threads_started":1,"wal-append.queue_time_us":499446}
I20260709 13:14:41.754089  4118 raft_consensus.cc:2749] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:41.776566  4113 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:41.746703  4247 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:41.781963  4154 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:41.801573 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:41.782410  4206 consensus_meta.cc:287] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6: Time spent flushing consensus metadata: real 0.642s	user 0.004s	sys 0.007s
I20260709 13:14:41.787177 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:41.802330 32273 raft_consensus.cc:2368] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 16. Current term is 17.
I20260709 13:14:41.789489 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:41.790226 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:41.791124 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:41.803921 32266 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 7.
I20260709 13:14:41.773612 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:41.797873 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 80914.6us
I20260709 13:14:41.798703 32267 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
W20260709 13:14:41.769219  4228 log.cc:927] Time spent T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.490s	user 0.000s	sys 0.002s
I20260709 13:14:41.760977  4008 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:41.802810 32193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3400) took 1179 ms. Trace:
I20260709 13:14:41.806242 32265 raft_consensus.cc:2393] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 12: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:41.801082  4074 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:41.807525 32270 raft_consensus.cc:2393] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 8: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:41.808375 32198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56926 (request call id 454) took 1608 ms. Trace:
I20260709 13:14:41.799541  4207 consensus_queue.cc:237] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:41.808838 32198 rpcz_store.cc:276] 0709 13:14:40.200177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.947954 (+747777us) service_pool.cc:224] Handling call
0709 13:14:40.980826 (+ 32872us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:40.981488 (+   662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:40.981529 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:40.984666 (+  3137us) log.cc:844] Serialized 574 byte log entry
0709 13:14:41.132318 (+147652us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:41.132373 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:41.132463 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:41.808134 (+675671us) raft_consensus.cc:1685] finished
0709 13:14:41.808155 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:41.808311 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2595,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":1130,"thread_start_us":113254,"threads_started":1,"wal-append.queue_time_us":189678}
I20260709 13:14:41.805395  4113 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:41.811142  4113 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:41.813000  3972 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:41.768855  4246 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:41.813817  4246 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:41.818053 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:41.806074 32193 rpcz_store.cc:276] 0709 13:14:40.623669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.044133 (+420464us) service_pool.cc:224] Handling call
0709 13:14:41.044459 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:41.044822 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:41.044855 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:41.045276 (+   421us) log.cc:844] Serialized 26 byte log entry
0709 13:14:41.291996 (+246720us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:41.700221 (+408225us) log.cc:844] Serialized 14 byte log entry
0709 13:14:41.800719 (+100498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:41.800843 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:41.800908 (+    65us) raft_consensus.cc:1685] finished
0709 13:14:41.800931 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:41.802724 (+  1793us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":166066,"prepare.queue_time_us":235458,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":56149,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":8185,"spinlock_wait_cycles":1720064,"thread_start_us":472311,"threads_started":3,"wal-append.queue_time_us":432899}
I20260709 13:14:41.769035  4238 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:41.807055 32239 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:41.832515 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:41.806864  4247 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:41.833813 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:41.835148 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.837349 32264 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:14:41.834240 32236 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:41.839627 32090 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:41.831764  3814 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
W20260709 13:14:41.840461 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 376918us
I20260709 13:14:41.840606  4226 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:41.840756  4074 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:41.843485 32165 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:41.847209 32090 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:41.848558 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:41.848248 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:41.872869 32090 leader_election.cc:400] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 16. Current term is 17.
I20260709 13:14:41.874886 32090 leader_election.cc:403] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:14:41.884641 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 137765us
I20260709 13:14:41.885481 32089 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:41.885991  4177 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:41.887195 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 52357.9us
I20260709 13:14:41.890240 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:41.890594 32190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3401) took 1266 ms. Trace:
I20260709 13:14:41.891364 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:14:41.892930 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 67031.3us
I20260709 13:14:41.891049 32190 rpcz_store.cc:276] 0709 13:14:40.624358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.137125 (+512767us) service_pool.cc:224] Handling call
0709 13:14:41.137692 (+   567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:41.137872 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:41.505106 (+367234us) log.cc:844] Serialized 14 byte log entry
0709 13:14:41.890172 (+385066us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:41.890248 (+    76us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:41.890308 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:41.890393 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:41.890529 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":144259,"prepare.queue_time_us":360875,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":3380,"raft.queue_time_us":145375,"raft.run_cpu_time_us":60,"raft.run_wall_time_us":60,"thread_start_us":585824,"threads_started":3,"wal-append.queue_time_us":176625}
I20260709 13:14:41.895955 32273 raft_consensus.cc:2393] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 15: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:41.853549  4008 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:41.838009  4247 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:41.901744 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:41.901939 32089 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:41.904444 32273 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:41.770098  4166 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:41.905906 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:41.909068 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:41.910765 32239 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:41.910758 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 67356.7us
I20260709 13:14:41.911919 32165 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:41.916740 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.917244 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:41.919870 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:41.927265 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:41.893416  4214 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:41.953136  4242 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:41.906446  3913 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:41.889739  4113 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
W20260709 13:14:41.964423 32070 auto_rebalancer.cc:893] Removing replace marker failed: Replica 6b3ed521ce8947db80c4b4828b355c06 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } } pending_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:41.965174   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:41.913398   399 raft_consensus.cc:1240] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 8 LEADER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:41.912096  4262 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:41.897372  4260 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:41.902333  3814 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:14:42.065748 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 163921us
I20260709 13:14:42.065656 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:42.109989 32089 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:14:42.109658   367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:42.068894  4166 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:42.049661  3972 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:42.072284 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:14:41.975219 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 63358.9us
I20260709 13:14:42.102031 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:42.113435   400 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:42.006197 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 95489us
W20260709 13:14:42.114159 32070 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for ddd7dfc158794e3ab7427d0b86b46c8d already in progress
I20260709 13:14:42.063979 32119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55358 (request call id 321) took 1295 ms. Trace:
I20260709 13:14:42.115159 32119 rpcz_store.cc:276] 0709 13:14:40.768452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.768618 (+   166us) service_pool.cc:224] Handling call
0709 13:14:42.063692 (+1295074us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b5400034dd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:42.063871 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1463024000}
I20260709 13:14:42.031414 32273 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
I20260709 13:14:40.778861 32269 rpcz_store.cc:276] 0709 13:14:39.517711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.595056 (+1077345us) service_pool.cc:224] Handling call
0709 13:14:40.595801 (+   745us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:40.596270 (+   469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:40.596307 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:40.597703 (+  1396us) log.cc:844] Serialized 487 byte log entry
0709 13:14:40.670801 (+ 73098us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:40.745167 (+ 74366us) log.cc:844] Serialized 14 byte log entry
0709 13:14:40.750899 (+  5732us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.751009 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:40.760243 (+  9234us) raft_consensus.cc:1685] finished
0709 13:14:40.760266 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:40.760419 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4617,"raft.queue_time_us":8235,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":22502,"thread_start_us":72605,"threads_started":1,"wal-append.queue_time_us":103281}
I20260709 13:14:41.982648 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:42.117166 32268 raft_consensus.cc:2368] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12.
I20260709 13:14:42.113983 32089 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:42.116005 32239 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:42.117924 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 245267us
I20260709 13:14:42.111675  3913 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:42.118139 32089 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:14:42.114636 32070 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for ddd7dfc158794e3ab7427d0b86b46c8d already in progress
I20260709 13:14:42.062338  4097 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:42.145673 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:42.138442 32239 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:42.123116 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:42.145227 32165 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:42.121287 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:42.135880 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:42.111052  4262 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:42.148111 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:42.118929 32090 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:14:42.032016  4103 consensus_meta.cc:287] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 1.143s	user 0.012s	sys 0.002s
I20260709 13:14:42.149101 32268 raft_consensus.cc:2393] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 8: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:14:42.148756 32270 raft_consensus.cc:2368] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 9. Current term is 10.
I20260709 13:14:42.177014 32273 raft_consensus.cc:1240] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:42.177234 32165 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:41.926715  4074 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:42.190759 32273 raft_consensus.cc:1240] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:41.993000  4261 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:42.195008 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:42.195916 32268 raft_consensus.cc:2410] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:14:42.189966  4262 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:42.201138 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:42.155916  4252 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:42.067441  4240 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:42.029326  4154 raft_consensus.cc:2804] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:42.179405  4258 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:42.189215 32269 raft_consensus.cc:1240] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:42.183787  4093 consensus_queue.cc:1048] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:14:42.126230  4166 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:41.975430  4008 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:14:42.145748  3913 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:42.233247 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:42.060384  4247 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:42.258790 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:42.148954  4134 consensus_queue.cc:1048] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:14:42.214049 32165 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:42.263259 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 49262.8us
I20260709 13:14:42.263962 32165 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:42.112972  4226 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:42.223311 32268 raft_consensus.cc:1217] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 7.5->[8.6-10.7]   Dedup: 10.7->[]
I20260709 13:14:42.266757 32268 raft_consensus.cc:1240] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 10. Current term is 11. Ops: [8.6-10.7]
I20260709 13:14:42.177464 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:42.267458 32264 raft_consensus.cc:1813] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Handling vote request from an unknown peer 113b5461952d47e0944d463ea4e32801
I20260709 13:14:42.267850 32264 raft_consensus.cc:2410] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:14:42.226056 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:42.071921  4246 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:14:42.227264 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 108437us
I20260709 13:14:42.218010  3939 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.209334  4259 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:42.199147  4103 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:42.212494  4154 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.249480   400 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:42.224068  4177 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:42.253451 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 134961us
I20260709 13:14:42.239373  3913 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:42.200775  4172 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:42.189366  4255 consensus_queue.cc:1048] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:14:42.254563  4274 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:42.228627  4268 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:42.210901  4238 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:42.176477  4097 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:42.261333 32270 raft_consensus.cc:1240] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:42.311924  4242 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:42.313603  4176 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:42.314118  4176 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:42.314450 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:42.314570  4176 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:42.270237 32090 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:42.316143  4273 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:14:42.262945  4264 log.cc:927] Time spent T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.121s	user 0.001s	sys 0.001s
I20260709 13:14:42.316371 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:42.276826  4240 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:42.279973 32089 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:42.318106  4178 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:42.318264  4238 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:42.318984 32089 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:42.272459  4271 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:42.280797  4270 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:42.298277 32267 raft_consensus.cc:1240] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:42.298769  4177 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.299170 32117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 3424) took 2141 ms. Trace:
W20260709 13:14:42.301879  4001 consensus_meta.cc:287] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.572s	user 0.005s	sys 0.005s
I20260709 13:14:42.274776  4261 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:14:42.279805  4154 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:42.278525  3939 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:42.271796  4258 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:42.279313 32236 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:42.315033 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:14:42.332898 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 53722.1us
I20260709 13:14:42.318187 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:42.273343 32165 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:42.284821  4113 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:42.320395 32089 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:42.296954 32272 raft_consensus.cc:2393] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 13: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
W20260709 13:14:42.316268 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 46104.6us
I20260709 13:14:42.326759 32118 raft_consensus.cc:1240] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:14:42.324213 32117 rpcz_store.cc:276] 0709 13:14:40.157920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.250565 (+ 92645us) service_pool.cc:224] Handling call
0709 13:14:40.265140 (+ 14575us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:40.408518 (+143378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:40.408547 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:40.408605 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:40.408649 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.298889 (+1890240us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b5400205b54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:42.298953 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:42.299108 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329263488}
I20260709 13:14:42.328999 32116 raft_consensus.cc:1240] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:42.329802 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:42.330588 32115 raft_consensus.cc:1275] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:14:42.320796  4271 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:42.333743 32121 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:14:42.323693  4240 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:14:42.348899 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 75643.9us
I20260709 13:14:42.328032  4177 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:42.322249  4268 raft_consensus.cc:697] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:42.340502  4107 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:42.419062 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:42.347941 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:42.419452  4268 consensus_queue.cc:237] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:42.354166  4094 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:42.421586 32123 raft_consensus.cc:1240] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:14:42.323630  4178 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.428746  4178 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:42.429177 32121 raft_consensus.cc:1275] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:14:42.356142 32089 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:14:42.431478 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 75411us
I20260709 13:14:42.432246 32089 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:42.434262 32089 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:42.435278 32089 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:42.436070  4267 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:42.436101 32089 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:42.366166   403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38164 (request call id 282) took 1223 ms. Trace:
I20260709 13:14:42.369513 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:42.356765  4176 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:42.358426  4258 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.358057  4113 raft_consensus.cc:2749] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:42.357520  4259 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:42.314502  4172 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:42.395706   399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38164 (request call id 279) took 1303 ms. Trace:
I20260709 13:14:42.397413  3939 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:42.401960  4262 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:42.416235 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:42.417044 32165 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:42.416134  4240 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:42.419193  4107 raft_consensus.cc:697] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:42.354955 32090 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:42.320963  4257 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:14:42.436625  4267 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:42.416775  4271 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:14:42.362244  4229 log.cc:927] Time spent T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.864s	user 0.002s	sys 0.000s
I20260709 13:14:42.436765  4001 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:42.458690 32089 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:42.454171   403 rpcz_store.cc:276] 0709 13:14:41.143096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.151251 (+  8155us) service_pool.cc:224] Handling call
0709 13:14:42.365313 (+1214062us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b58001e2498. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59beccb71 00007fb59becca22 00007fb5a4de5c09 00007fb5a3f3fee0 00007fb5a40090ab 00007fb5a4009131 00007fb5a3fcafc0 00007fb5a3fb5929 00007fb5a3fb53d2 00007fb59d52cbd4
0709 13:14:42.365528 (+   215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:42.365795 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:14:42.365826 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:42.365873 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:42.365920 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.365981 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:42.366103 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8101760}
W20260709 13:14:42.417682  4075 consensus_meta.cc:287] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.709s	user 0.011s	sys 0.000s
I20260709 13:14:42.455780  4273 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:42.463443   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 50240.8us
I20260709 13:14:42.480382 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:42.459753  4270 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:42.484176 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 129291us
I20260709 13:14:42.455926  4274 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:42.467126  4247 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:42.470269  4258 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:42.484458  4240 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:14:42.545501 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:42.586516 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:42.586869   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
W20260709 13:14:42.586911 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:42.497452 32239 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:42.490101 32119 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:42.542378 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:14:42.522323 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 105764us
I20260709 13:14:42.589202 32165 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:42.590827 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:42.591066 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:42.591652 32190 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:42.591975 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:42.591672 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:42.593377 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:14:42.588449 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 91108.2us
I20260709 13:14:42.595016 32193 raft_consensus.cc:1275] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:14:42.597419 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:42.593873 32195 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:14:42.600981 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:42.602231 32120 raft_consensus.cc:2393] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 15: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:42.525545 32021 catalog_manager.cc:5697] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:42.615949 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:42.602792 32195 raft_consensus.cc:1240] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:42.603773 32021 catalog_manager.cc:5697] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 9 to 10, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 10 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:42.624094   367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:42.622363 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:42.658182 32193 raft_consensus.cc:2393] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 8: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:14:42.604849 32239 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:42.659060   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:42.659734   369 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:42.660728 32021 catalog_manager.cc:5697] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 9 to 11, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 11 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:42.661919   403 raft_consensus.cc:1240] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:42.662989 32021 catalog_manager.cc:5697] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 8 to 9, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 9 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:42.668625 32021 catalog_manager.cc:5697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 9 to 10, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 10 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
W20260709 13:14:42.669894 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 211274us
I20260709 13:14:42.488224  4002 raft_consensus.cc:2804] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:42.673228 32199 raft_consensus.cc:2393] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 10: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:14:42.513195  4088 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:42.680096 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:42.488576  4267 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:42.492798  4259 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:14:42.690188 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 101050us
I20260709 13:14:42.701622 32165 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:42.585040  4172 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:42.713544 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:14:42.695561 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 90811.7us
I20260709 13:14:42.717016 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:42.668774  4214 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:42.669523  4207 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.492434   394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38176 (request call id 158) took 1663 ms. Trace:
I20260709 13:14:42.602174  4253 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:42.701563  4141 raft_consensus.cc:2804] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:42.602098  3985 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:42.584846  4274 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.728613  4122 raft_consensus.cc:2804] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:42.755686 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:42.753376  4274 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:42.730933  4074 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.735256  4177 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:42.726671 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:42.522002  4262 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:42.731823 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:42.768756 32265 raft_consensus.cc:1275] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:14:42.701112  4242 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:42.514565  4097 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:42.490665  4154 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:14:42.470722   399 rpcz_store.cc:276] 0709 13:14:41.092231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.098067 (+  5836us) service_pool.cc:224] Handling call
0709 13:14:41.158937 (+ 60870us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:42.120908 (+961971us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.395445 (+274537us) spinlock_profiling.cc:243] Waited 742 ms on lock 0x7b540068ae54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:42.395636 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1706848512}
I20260709 13:14:42.734786 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:42.747822  4268 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:42.739420 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:42.655234  3668 consensus_queue.cc:1048] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:14:42.585903  4075 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:42.742973  4166 consensus_queue.cc:1059] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:42.660743  4235 consensus_queue.cc:1059] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:14:42.745959  4233 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:42.745786  4271 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:42.746349  4258 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:14:42.746543  4275 log.cc:927] Time spent T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.281s	user 0.002s	sys 0.000s
I20260709 13:14:42.727898  4246 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:42.737553  4207 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:42.869825  4271 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:42.870175  4154 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:42.870891 32122 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:14:42.871394  4207 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:42.665845  4221 consensus_queue.cc:1059] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:14:42.872506  4221 raft_consensus.cc:3055] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:42.872556 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:42.872967  4221 raft_consensus.cc:740] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:42.767248  4257 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:42.873927  4221 consensus_queue.cc:260] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:42.874405  4257 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:42.875349  4221 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:42.753222 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 80272.1us
I20260709 13:14:42.763779 32273 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:14:42.740149   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:42.725838 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:42.801855  4242 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:42.881712  4075 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:42.882910  4242 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:42.828203  4002 raft_consensus.cc:697] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:42.884756  4002 consensus_queue.cc:237] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:42.886168  4127 consensus_queue.cc:1059] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:42.887104  4127 consensus_queue.cc:1243] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer 94085cf341634eb686a95983b6b7f7e6 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:14:42.887591  4127 raft_consensus.cc:3055] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:42.780294 32090 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:42.742640  4001 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:42.704602 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:14:42.895136 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 114990us
I20260709 13:14:42.895542 32121 raft_consensus.cc:2410] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:14:42.741519  4141 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:42.767887  4074 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:42.694551 32021 catalog_manager.cc:5697] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 8 to 9, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 9 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:42.750200  4214 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:42.759588  4122 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.761339  4259 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:14:42.768448  4281 log.cc:927] Time spent T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.307s	user 0.002s	sys 0.000s
I20260709 13:14:42.814085 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:14:42.944561 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 243001us
I20260709 13:14:42.828976 32115 raft_consensus.cc:1240] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:14:42.944902 32195 raft_consensus.cc:3060] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:42.829857 32267 raft_consensus.cc:1240] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 15. Current term is 16. Ops: []
I20260709 13:14:42.838673 32119 raft_consensus.cc:1240] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:14:42.843889   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:42.747670  4107 consensus_queue.cc:237] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:42.850260  4097 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:14:42.858232 32010 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.447s	user 0.005s	sys 0.027s
W20260709 13:14:42.858680  3913 consensus_meta.cc:287] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.547s	user 0.008s	sys 0.001s
I20260709 13:14:42.753687  3985 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:42.955392  3985 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:42.862790  4166 raft_consensus.cc:3055] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:42.956130  4166 raft_consensus.cc:740] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:42.957417  4166 consensus_queue.cc:260] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:42.958256 32120 raft_consensus.cc:1240] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:14:42.959087  4166 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:42.864557 32266 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:14:42.883719  4273 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:42.518543  4178 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:42.960896  4225 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.961512  4225 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:42.888880 32270 raft_consensus.cc:1240] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:42.963195 32118 raft_consensus.cc:1240] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
W20260709 13:14:42.895849   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 184308us
I20260709 13:14:42.964315   369 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:42.962803  4213 raft_consensus.cc:2955] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 10 LEADER]: Committing config change with OpId 9.8: config changed from index 5 to 8, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:42.817387 32123 raft_consensus.cc:1240] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:42.970836 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:42.971508 32269 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 7.
I20260709 13:14:42.970836 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:42.973507 32087 leader_election.cc:304] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:42.973822 32273 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 12.
I20260709 13:14:42.973919 32115 raft_consensus.cc:1240] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:42.975642 32115 raft_consensus.cc:1240] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:42.978665 32266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36084 (request call id 2684) took 1190 ms. Trace:
I20260709 13:14:42.979085 32266 rpcz_store.cc:276] 0709 13:14:41.788548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.824854 (+ 36306us) service_pool.cc:224] Handling call
0709 13:14:42.978471 (+1153617us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400305554. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:42.978569 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2371686784}
I20260709 13:14:42.980739  4088 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:42.983405  4178 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:42.984555  4273 consensus_queue.cc:1059] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:42.985721  4088 raft_consensus.cc:3055] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:42.986109  4088 raft_consensus.cc:740] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:42.987066  4088 consensus_queue.cc:260] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:42.994282  4088 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:42.994401  4225 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:14:43.001505 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 55489.1us
I20260709 13:14:42.834538  4279 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.898965  4075 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:42.904644  4242 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.938766  4257 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:43.007213 32116 raft_consensus.cc:1275] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:14:42.904927  4141 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:43.012362 32195 raft_consensus.cc:2468] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 5.
I20260709 13:14:42.939193  4122 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:43.021142 32165 leader_election.cc:400] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 4. Current term is 5.
I20260709 13:14:42.817345  4268 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:42.894709  4127 raft_consensus.cc:740] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:43.030956 32238 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:43.031875 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:43.059940 32195 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 7.
I20260709 13:14:42.905378  4001 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:43.029062 32271 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:43.045243 32165 leader_election.cc:403] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:14:43.062592 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:43.063326 32195 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:43.063616 32165 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:43.071689 32238 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:43.037040   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:43.073042  4292 raft_consensus.cc:2749] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 4. Current term is 5.
I20260709 13:14:43.077293  4289 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:43.029775  4242 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:43.077850  4289 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:43.078480  4289 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:43.073321 32165 leader_election.cc:400] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12.
I20260709 13:14:43.079792 32165 leader_election.cc:403] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:14:43.080101 32121 raft_consensus.cc:1275] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:14:43.026639  4008 consensus_meta.cc:287] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.766s	user 0.010s	sys 0.001s
I20260709 13:14:43.029754  3814 raft_consensus.cc:1064] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:14:43.064339 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:43.084863 32165 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:43.004688  3913 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:43.025756  4296 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:43.045853   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:42.939478  4214 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:43.085839 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 226599us
I20260709 13:14:43.083105 32195 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:43.126304 32165 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:43.126407 32238 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:43.083276  4103 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:43.082692  4235 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:14:43.120394  3814 raft_consensus.cc:1068] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06: Unable to promote non-voter 94085cf341634eb686a95983b6b7f7e6: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:14:43.136958 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:43.141283 32238 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:43.136318 32165 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:43.090569  4008 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 16. Current term is 17.
I20260709 13:14:43.148885  3939 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:43.120639  4217 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:43.155812 32197 raft_consensus.cc:2410] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:14:43.082948  4253 consensus_queue.cc:1059] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:14:43.162200 32238 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:43.140026  4258 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:43.142840  4261 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:43.023270  4279 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:43.213349 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:43.234298 32197 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 7.
I20260709 13:14:43.154282  4235 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:43.235270 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 73191.7us
W20260709 13:14:43.147806 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:43.166163  4292 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:43.169412  3814 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:43.153781  4267 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:43.209347  4242 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:14:43.275641   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 62275.8us
W20260709 13:14:43.262780 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 254778us
I20260709 13:14:43.256142  4235 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:43.295627 32117 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:14:43.229566  4298 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:43.299036 32195 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:14:43.312814 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:43.313397 32195 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:43.317108 32165 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:42.735280   394 rpcz_store.cc:276] 0709 13:14:40.829384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.839143 (+  9759us) service_pool.cc:224] Handling call
0709 13:14:40.876150 (+ 37007us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:40.909558 (+ 33408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:40.913966 (+  4408us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:40.950831 (+ 36865us) log.cc:844] Serialized 26 byte log entry
0709 13:14:41.171101 (+220270us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:41.178709 (+  7608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:41.279666 (+100957us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:42.361710 (+1082044us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:14:42.492090 (+130380us) raft_consensus.cc:1685] finished
0709 13:14:42.492119 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:42.492365 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5241,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":5023,"spinlock_wait_cycles":10802048,"thread_start_us":132590,"threads_started":1,"wal-append.queue_time_us":293358}
I20260709 13:14:43.303942 32238 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:43.235885  4074 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:43.306734   368 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:43.133747  4296 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:43.280460  4097 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:14:43.304597  4042 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.001s	sys 0.022s
I20260709 13:14:43.296450  3814 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:43.329612 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:43.335157 32194 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:43.335341 32165 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:43.336797   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 48860.6us
I20260709 13:14:43.311542   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:43.339488  4226 consensus_queue.cc:1059] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
W20260709 13:14:43.345594 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:43.348084 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:43.308947  4288 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.349231 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:43.349083  4288 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:43.350286 32198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7594a5601f24445092c404115861232c"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:14:43.350790 32198 raft_consensus.cc:606] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:43.351114 32198 raft_consensus.cc:614] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:43.351343  4288 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:43.333552   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:43.324806  4253 consensus_queue.cc:1059] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:14:43.355582  3736 raft_consensus.cc:3055] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:43.355974  3736 raft_consensus.cc:740] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:43.356036 32190 raft_consensus.cc:1275] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:14:43.320709  4258 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.358564 32190 raft_consensus.cc:1275] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:43.329133  4097 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:43.334300  4042 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.002s	sys 0.022s
I20260709 13:14:43.329074  4109 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:43.313781  4271 consensus_queue.cc:1048] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:14:43.323455  4290 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12.
I20260709 13:14:43.333276  4225 consensus_queue.cc:1059] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:14:43.364643  4226 consensus_queue.cc:1059] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:14:43.360219  3736 consensus_queue.cc:260] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:43.338176  3814 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:43.338389  4259 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:14:43.366278 32195 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:43.408286 32195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:14:43.408871 32195 raft_consensus.cc:606] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:43.409269 32195 raft_consensus.cc:614] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:14:43.406416 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:43.421082  4226 raft_consensus.cc:3055] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:43.423010  4226 raft_consensus.cc:740] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:43.423863  4226 consensus_queue.cc:260] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:43.424401  3736 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:43.425065  4226 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:43.343889  4103 consensus_queue.cc:1059] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:14:43.426101  4103 raft_consensus.cc:3055] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:43.426429  4103 raft_consensus.cc:740] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:43.427167  4103 consensus_queue.cc:260] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:43.428249  4103 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:43.365298  4288 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:43.432188  4296 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:43.363706  4255 raft_consensus.cc:3055] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:43.432897  4255 raft_consensus.cc:740] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:43.433913 32195 raft_consensus.cc:1275] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:14:43.433634  4255 consensus_queue.cc:260] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:14:43.384867 32238 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:43.455260 32194 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:14:43.457345 32194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a75997deb5a741f998b671928aad3637"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:14:43.458534 32194 raft_consensus.cc:606] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:43.458907 32194 raft_consensus.cc:614] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:14:43.466725 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 81923us
I20260709 13:14:43.383965  4097 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:43.383420  4214 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:43.381328  4293 log.cc:927] Time spent T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:14:43.472846  4225 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:43.378244  4189 consensus_queue.cc:1048] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.095s
I20260709 13:14:43.473523  4225 raft_consensus.cc:697] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:43.474396  4225 consensus_queue.cc:237] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:43.388200  4258 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:43.477943  4258 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:43.479404 32198 raft_consensus.cc:1275] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:14:43.367861  3913 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:43.390929  4279 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:43.378171  4221 consensus_meta.cc:287] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.000s
I20260709 13:14:43.434527  4255 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:43.381209  4298 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:43.381687  4253 raft_consensus.cc:3055] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:14:43.499661 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:43.502847 32198 raft_consensus.cc:1275] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:14:43.382772  4267 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:43.503218 32194 raft_consensus.cc:1275] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:14:43.376456  4307 raft_consensus.cc:2804] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:43.384956  4042 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.119s
I20260709 13:14:43.520550 32195 raft_consensus.cc:1275] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:14:43.424309  4141 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:43.504385  4305 consensus_queue.cc:1048] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:14:43.509387  4307 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:43.503811  4253 raft_consensus.cc:740] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:43.575243 32190 raft_consensus.cc:1240] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 7. Current term is 8. Ops: []
W20260709 13:14:43.558408  4213 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.020s	sys 0.051s
I20260709 13:14:43.371670 32010 maintenance_manager.cc:643] P ffbfb630fccf464dbfd0bffd795262f7: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 6.930s	user 0.198s	sys 0.076s Metrics: {"bytes_written":29684,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":128259,"dirs.run_cpu_time_us":374,"dirs.run_wall_time_us":3850,"drs_written":1,"lbm_read_time_us":980,"lbm_reads_lt_1ms":4,"lbm_write_time_us":75328,"lbm_writes_1-10_ms":3,"lbm_writes_10-100_ms":5,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":358161,"threads_started":2,"update_count":3,"wal-append.queue_time_us":399443}
W20260709 13:14:43.590432   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 252406us
I20260709 13:14:43.595682   369 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:43.628607 32195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:14:43.629451 32195 raft_consensus.cc:606] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:43.629864 32195 raft_consensus.cc:614] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:14:43.646211   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 50633.4us
I20260709 13:14:43.650178 32123 raft_consensus.cc:2955] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 5 to 8, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:43.574501  4307 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:43.651841 32268 raft_consensus.cc:1275] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:14:43.666368 32011 maintenance_manager.cc:419] P ffbfb630fccf464dbfd0bffd795262f7: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10857 bytes on disk
W20260709 13:14:43.645413  4213 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.027s	sys 0.059s
I20260709 13:14:43.686209 32192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3410) took 1094 ms. Trace:
W20260709 13:14:43.697727 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 362433us
I20260709 13:14:43.698851 32165 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:43.686810 32192 rpcz_store.cc:276] 0709 13:14:42.591551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.591746 (+   195us) service_pool.cc:224] Handling call
0709 13:14:42.592061 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:42.947460 (+355399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:42.947509 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:42.998126 (+ 50617us) log.cc:844] Serialized 26 byte log entry
0709 13:14:43.314849 (+316723us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:43.336339 (+ 21490us) log.cc:844] Serialized 14 byte log entry
0709 13:14:43.685727 (+349388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:43.685838 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:43.685901 (+    63us) raft_consensus.cc:1685] finished
0709 13:14:43.685921 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:43.686114 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106488,"prepare.queue_time_us":21214,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":14200,"raft.queue_time_us":235131,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":10030,"spinlock_wait_cycles":14336,"thread_start_us":807561,"threads_started":3,"wal-append.queue_time_us":476051}
I20260709 13:14:43.714351 32010 maintenance_manager.cc:643] P ffbfb630fccf464dbfd0bffd795262f7: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.045s	user 0.001s	sys 0.001s Metrics: {"cfile_init":1,"lbm_read_time_us":360,"lbm_reads_lt_1ms":4}
I20260709 13:14:43.669314  4298 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:43.722075 32165 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:43.713866  4274 consensus_meta.cc:287] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.944s	user 0.005s	sys 0.006s
I20260709 13:14:43.669173  4189 consensus_queue.cc:1059] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:14:43.743472 32165 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:43.750711 32165 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:43.731793  3985 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:43.752463  4214 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:43.753541  4290 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:43.752547  4258 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:43.758059 32117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56890 (request call id 3434) took 1430 ms. Trace:
I20260709 13:14:43.758616 32117 rpcz_store.cc:276] 0709 13:14:42.327287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.413510 (+ 86223us) service_pool.cc:224] Handling call
0709 13:14:43.757842 (+1344332us) spinlock_profiling.cc:243] Waited 749 ms on lock 0x7b54000343d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:43.757982 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1723063168}
W20260709 13:14:43.763195  4304 log.cc:927] Time spent T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:14:43.769181  4268 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:43.771446  4001 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:43.776880 32198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d002861120de41408d48712b6bd491e1"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:14:43.777529 32198 raft_consensus.cc:606] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:43.667413  4253 consensus_queue.cc:260] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:43.778033 32198 raft_consensus.cc:614] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:43.778707 32165 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:43.720659  4298 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:43.817164 32165 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:43.701426  4313 consensus_queue.cc:1059] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 13:14:43.697279  4294 consensus_queue.cc:1048] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.095s
W20260709 13:14:43.844358 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:43.861986 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:43.873449 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 56430.5us
I20260709 13:14:43.875090 32165 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:43.743081  4274 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:43.822395  4298 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:43.887665 32165 leader_election.cc:400] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12.
I20260709 13:14:43.857846  4253 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:43.893610 32165 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:43.900995 32165 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:43.902855 32165 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:43.837474  4279 raft_consensus.cc:2804] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:14:43.890213  4235 consensus_meta.cc:287] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.566s	user 0.011s	sys 0.000s
I20260709 13:14:43.905648 32165 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:43.908399 32165 leader_election.cc:400] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 9. Current term is 10.
I20260709 13:14:43.876390  4313 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:43.890697  4214 raft_consensus.cc:2749] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:14:43.917027   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 217014us
I20260709 13:14:43.919205 32090 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:14:43.919845 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:43.890468  4316 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:43.870391  4097 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:43.924081 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:43.925829 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:43.903237  4259 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:43.904842  4261 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:43.904781  3985 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:43.928280 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:43.930567 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:14:43.926427  4306 log.cc:927] Time spent T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.275s	user 0.000s	sys 0.001s
W20260709 13:14:43.941417  4319 log.cc:927] Time spent T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
W20260709 13:14:43.941740  4240 consensus_meta.cc:287] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 1.286s	user 0.012s	sys 0.000s
W20260709 13:14:43.929216  4289 consensus_meta.cc:287] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.850s	user 0.009s	sys 0.004s
I20260709 13:14:43.906890  4288 consensus_queue.cc:1059] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:14:43.946288  4097 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:43.917384  4313 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:43.912345  4235 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:43.951512  4122 consensus_meta.cc:287] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.872s	user 0.008s	sys 0.002s
I20260709 13:14:43.925767  4279 raft_consensus.cc:697] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:43.954200  3913 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:43.927621  4267 consensus_queue.cc:1059] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:14:43.955937 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:43.958705  4127 consensus_queue.cc:260] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:43.959481 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:43.961231 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:14:43.961557  4282 log.cc:927] Time spent T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:14:43.961864 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:43.962854 32270 raft_consensus.cc:1275] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:44.010030 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:43.963817  4042 consensus_queue.cc:1048] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:43.964748 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:14:43.965066  4320 log.cc:927] Time spent T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:14:43.969983 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:43.916626  4141 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:43.931320  4315 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:43.974227  4274 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:43.974347  4317 raft_consensus.cc:3055] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:14:43.976092  4270 consensus_meta.cc:287] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 1.319s	user 0.007s	sys 0.004s
I20260709 13:14:43.925455  4268 consensus_queue.cc:1059] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
W20260709 13:14:43.972270 32089 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 2.382s (SENT) [suppressed 18 similar messages]
I20260709 13:14:43.931505  4271 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:44.006999 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:44.011658 32265 raft_consensus.cc:2410] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:14:44.005256 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:44.013904 32270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:44.037214 32270 raft_consensus.cc:606] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:44.014828 32190 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:43.932107  4258 consensus_queue.cc:1059] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
W20260709 13:14:43.977521  3814 consensus_meta.cc:287] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.549s	user 0.003s	sys 0.008s
W20260709 13:14:44.032742 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 60525.1us
W20260709 13:14:44.023921  4103 consensus_meta.cc:287] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.585s	user 0.007s	sys 0.005s
W20260709 13:14:44.039057 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:43.983731  4240 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:43.984517  4289 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:44.043035 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:44.045435 32270 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:14:44.045836 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:14:44.046370  4235 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:44.046588   399 raft_consensus.cc:1240] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 8 LEADER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:44.047593 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:44.029345  4127 raft_consensus.cc:3060] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:44.043596 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:44.049034 32269 raft_consensus.cc:2368] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 13. Current term is 14.
I20260709 13:14:44.021868  4317 raft_consensus.cc:740] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:43.986708  4307 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:44.002679  3913 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:44.063197 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:44.066012 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.036641  4270 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:44.067660 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:44.042411  3814 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:44.068439 32196 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:44.070441  3814 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:44.071517 32267 raft_consensus.cc:2368] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8.
I20260709 13:14:44.075309 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:44.078994 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:44.079367  3913 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:44.079710 32195 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:44.080401  4001 raft_consensus.cc:3055] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:14:44.080876  4001 raft_consensus.cc:740] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:44.081737  4001 consensus_queue.cc:260] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:44.082939  4001 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:44.092794  4279 consensus_queue.cc:237] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:44.099200  4317 consensus_queue.cc:260] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:44.048431  4267 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:44.055222  4268 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:44.044059  4271 raft_consensus.cc:697] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:44.108932 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:44.117444 32123 raft_consensus.cc:1240] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:14:44.112267 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:44.117489 32117 raft_consensus.cc:1240] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:44.114028 32121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55358 (request call id 330) took 1423 ms. Trace:
I20260709 13:14:44.122500 32196 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:44.124993 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:44.132120 32123 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:44.134244 32123 raft_consensus.cc:1240] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:44.125823 32195 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:14:44.121976 32121 rpcz_store.cc:276] 0709 13:14:42.690374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.950308 (+259934us) service_pool.cc:224] Handling call
0709 13:14:43.007030 (+ 56722us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:43.080492 (+ 73462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:44.113816 (+1033324us) spinlock_profiling.cc:243] Waited 72.7 ms on lock 0x7b54002c92d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:44.113972 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167269248}
I20260709 13:14:44.127936 32118 raft_consensus.cc:1240] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:44.128232 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:44.129429 32124 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:14:44.131464 32190 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:14:44.139580 32273 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:44.135993 32116 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:44.147737 32122 raft_consensus.cc:1240] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:44.149457 32119 raft_consensus.cc:1240] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:44.150023  4240 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:44.150591  4240 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.151055  4240 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:44.114665  4315 raft_consensus.cc:3055] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:44.151849  4315 raft_consensus.cc:740] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:44.152912  4315 consensus_queue.cc:260] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:44.154284  4189 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:44.154866  4189 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:44.101166  4267 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:44.158623  4267 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:44.159744  4327 log.cc:927] Time spent T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:14:44.106835  4268 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:44.162216  4268 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:44.163525  4313 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:44.107600  4271 consensus_queue.cc:237] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:44.164680 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:44.166033  4307 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:44.109802 32239 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:14:44.169368 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 59629.5us
I20260709 13:14:44.175820 32264 raft_consensus.cc:1275] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:14:44.170287 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:14:44.098290  4255 consensus_meta.cc:287] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.595s	user 0.009s	sys 0.001s
I20260709 13:14:44.178910 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:44.180557 32266 raft_consensus.cc:2410] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:14:44.182264  4289 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:44.016884  4122 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:44.184211  4214 raft_consensus.cc:3055] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:44.179768  4253 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:14:44.184775  4214 raft_consensus.cc:740] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:44.185403  4253 raft_consensus.cc:697] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:44.185942  4240 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:44.186307  4253 consensus_queue.cc:237] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:44.100550  4317 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:44.190102  4322 log.cc:927] Time spent T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.287s	user 0.001s	sys 0.002s
W20260709 13:14:44.193902  4330 log.cc:927] Time spent T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:14:44.184260 32270 raft_consensus.cc:1240] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:44.197853 32199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3426) took 1337 ms. Trace:
I20260709 13:14:44.198432 32199 rpcz_store.cc:276] 0709 13:14:42.860848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.900133 (+ 39285us) service_pool.cc:224] Handling call
0709 13:14:42.900497 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:42.964144 (+ 63647us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:14:42.964491 (+   347us) log.cc:844] Serialized 14 byte log entry
0709 13:14:43.302707 (+338216us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:43.302832 (+   125us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:43.302951 (+   119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:44.196509 (+893558us) spinlock_profiling.cc:243] Waited 63.4 ms on lock 0x7b54002170d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:44.196572 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:44.197758 (+  1186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26060,"prepare.queue_time_us":629,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":26219,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":4655,"spinlock_wait_cycles":145820928,"thread_start_us":270258,"threads_started":1,"wal-append.queue_time_us":595496}
I20260709 13:14:44.196767  4274 raft_consensus.cc:3055] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:44.186067  4214 consensus_queue.cc:260] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:44.202159 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 291689us
I20260709 13:14:44.203042 32165 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:44.204072  4334 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:44.205480 32165 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:44.234000 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:44.171058  3913 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:44.237353 32271 raft_consensus.cc:1240] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:44.113611  4273 consensus_queue.cc:1048] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.121s
W20260709 13:14:44.257507   367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.258347 32165 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:44.184769  4122 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:44.260421 32165 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:44.200467  4274 raft_consensus.cc:740] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
W20260709 13:14:44.265056 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 178220us
I20260709 13:14:44.236101  4334 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:44.293601 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:44.294684 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:44.295198 32194 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:44.270186 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:44.290266 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:44.296659 32199 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:44.268605 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.298286 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:44.290694 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:44.291887 32195 raft_consensus.cc:1240] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 15. Current term is 16. Ops: [14.10-15.11]
I20260709 13:14:44.299588 32196 raft_consensus.cc:2468] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 8.
I20260709 13:14:44.288931  4290 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:44.265964  4336 raft_consensus.cc:3055] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:44.292893 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:14:44.307426 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 195207us
I20260709 13:14:44.307937 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:44.260555  4289 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:44.312158 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:44.302166 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:44.313407 32190 raft_consensus.cc:2393] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 14: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
W20260709 13:14:44.302111   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 371389us
I20260709 13:14:44.305644 32198 raft_consensus.cc:1275] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:14:44.264817  3985 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:44.309999 32117 raft_consensus.cc:1240] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:14:44.311003 32194 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:14:44.261965  4288 consensus_queue.cc:1059] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:14:44.297297  4261 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:44.258045  3913 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:44.319826 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:44.305362  4107 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:44.298899  4122 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.300518  4233 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.331797  4107 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:44.307108  4336 raft_consensus.cc:740] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:44.325600 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:44.326037 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:44.326411 32199 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:14:44.327015 32090 leader_election.cc:400] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 13. Current term is 14.
I20260709 13:14:44.326953 32238 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:44.302690  4206 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.337s	user 0.023s	sys 0.004s
I20260709 13:14:44.328181 32193 raft_consensus.cc:1240] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:44.370234   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:44.327768  4274 consensus_queue.cc:260] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:44.372036 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:44.357996   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:44.334537 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:44.375641 32116 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:14:44.335317 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:44.376442 32192 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:44.336032 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:44.325001 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:44.313952  4290 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:44.338311  4107 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:44.338361 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:44.356236  4317 consensus_queue.cc:1048] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:14:44.382694   403 raft_consensus.cc:1240] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:44.341967 32119 raft_consensus.cc:1240] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:14:44.349663 32264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50584 (request call id 377) took 1379 ms. Trace:
I20260709 13:14:44.383374 32264 rpcz_store.cc:276] 0709 13:14:42.969815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.972721 (+  2906us) service_pool.cc:224] Handling call
0709 13:14:42.973066 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:44.176246 (+1203180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:44.349374 (+173128us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400305f54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:44.349585 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2765230464}
I20260709 13:14:44.319722  3814 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:14:44.350374  3939 raft_consensus.cc:3055] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:14:44.354554 32122 raft_consensus.cc:1275] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:14:44.355922  4213 consensus_queue.cc:1048] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:44.356432  4141 consensus_queue.cc:1048] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:44.367920 32090 leader_election.cc:403] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:44.330643  4122 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:44.333770 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:44.391536  3939 raft_consensus.cc:740] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:14:44.372406 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 45520.4us
I20260709 13:14:44.414299  4122 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:44.413779  3939 consensus_queue.cc:260] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:44.416805  3939 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:44.416950  4336 consensus_queue.cc:260] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:44.418707  4336 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:44.422186 32196 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:44.423695  4290 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:44.425840  3913 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:44.427146  4298 consensus_meta.cc:287] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6: Time spent flushing consensus metadata: real 0.523s	user 0.007s	sys 0.003s
I20260709 13:14:44.373013 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:44.371914   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:44.429149   398 raft_consensus.cc:2393] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 8: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:14:44.429188  4274 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:44.380030 32115 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:44.339223  4189 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:44.381635 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:44.341173 32121 raft_consensus.cc:1240] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:14:44.403081   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:44.436223 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:44.390734 32087 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
W20260709 13:14:44.370563  4206 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.405s	user 0.023s	sys 0.004s
I20260709 13:14:44.331434  4233 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:44.439241 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 112285us
I20260709 13:14:44.440224 32124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56890 (request call id 3453) took 1946 ms. Trace:
I20260709 13:14:44.440743 32124 rpcz_store.cc:276] 0709 13:14:42.494106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.754199 (+260093us) service_pool.cc:224] Handling call
0709 13:14:44.435281 (+1681082us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400205654. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:44.440165 (+  4884us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3157616384}
W20260709 13:14:44.439633 32089 leader_election.cc:336] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.754s (SENT)
I20260709 13:14:44.446414 32089 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:44.446640 32196 raft_consensus.cc:2410] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 13:14:44.447526 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 56914.5us
I20260709 13:14:44.401679 32192 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:14:44.381417  4127 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:44.427736  4298 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:44.436990 32195 raft_consensus.cc:2368] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 12. Current term is 13.
I20260709 13:14:44.455503 32090 leader_election.cc:400] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8.
I20260709 13:14:44.457463 32116 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
W20260709 13:14:44.467221 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.470424 32090 leader_election.cc:403] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:14:44.472295 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:44.473181 32198 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:14:44.477164 32090 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:44.545166   400 raft_consensus.cc:1240] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:44.457320  3814 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.457146  4001 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:14:44.550077 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 73059.3us
I20260709 13:14:44.457139  4292 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:14:44.550575 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 80760.1us
I20260709 13:14:44.563225 32238 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:44.563827  4289 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:44.564041 32238 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:44.467887  3913 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:44.564960 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:44.565380 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:44.465078  4273 consensus_queue.cc:1059] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 13:14:44.471968  4127 raft_consensus.cc:697] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:44.557435  4268 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:44.554385 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:44.468866  4343 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 13. Current term is 14.
I20260709 13:14:44.556918 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:44.568689 32238 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:44.578578 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:44.579147 32195 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:44.573153 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:14:44.575521 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.559859  4292 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:44.543787  4271 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:44.477667  4122 consensus_queue.cc:1048] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.099s
I20260709 13:14:44.581702 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:44.576897 32198 raft_consensus.cc:2368] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8.
I20260709 13:14:44.585487 32199 raft_consensus.cc:1275] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:44.575032  4107 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:44.576210  4253 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:44.605129 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:44.605707  4233 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:44.607077 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:44.589768 32116 raft_consensus.cc:1240] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:44.594878 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:44.601665  4127 consensus_queue.cc:237] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:44.574504  4270 consensus_queue.cc:1059] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:14:44.610455 32115 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
W20260709 13:14:44.625883   367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.564946  3814 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:44.620414 32192 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:44.640030 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.640349 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:44.649061 32198 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:44.650748 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:44.620265 32195 raft_consensus.cc:2410] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:14:44.664639 32192 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:44.667559 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:44.669163 32198 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:44.578639  4317 consensus_queue.cc:1048] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:14:44.593891  4268 raft_consensus.cc:697] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:44.614373  3666 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:44.680512 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:44.625218  4008 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8.
I20260709 13:14:44.685603 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:44.624506  4090 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.657727  4107 raft_consensus.cc:697] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:44.589366  4271 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:44.658047  4253 raft_consensus.cc:697] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:44.713095  4107 consensus_queue.cc:237] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:44.713783 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:44.714540  4271 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:44.713804  4253 consensus_queue.cc:237] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:44.717250 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:44.719162 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:44.719242 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:44.719744  4268 consensus_queue.cc:237] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:44.721046 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:44.721522 32116 raft_consensus.cc:1240] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:44.722702 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:44.723208 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:44.723583 32197 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:44.674777  4337 raft_consensus.cc:3055] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:44.701660 32198 raft_consensus.cc:1240] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:44.704941 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:44.705176 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:44.708711 32117 raft_consensus.cc:1240] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:44.710378 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:44.735289 32190 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:44.712438 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:44.735298 32116 raft_consensus.cc:2393] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 14: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:44.738448 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:44.739490 32119 raft_consensus.cc:2393] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 14: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:44.729645 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:44.730585 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:44.732638 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:44.742985 32199 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:44.732832 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:44.744668 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:44.742023 32193 raft_consensus.cc:2376] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10. Re-sending same reply.
I20260709 13:14:44.745450 32117 raft_consensus.cc:2393] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 17: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:44.745677 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:44.757386 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:44.759075 32190 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:14:44.758170 32193 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:44.734892  4337 raft_consensus.cc:740] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:44.701332  3666 raft_consensus.cc:697] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:44.758649 32165 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:44.766028 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:44.765738 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:44.769474 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 182524us
I20260709 13:14:44.781646   399 raft_consensus.cc:1240] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:44.783640 32238 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:44.790197 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:44.790867 32197 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:44.791710 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:44.792268 32197 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:44.794131 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:44.794663 32193 raft_consensus.cc:2376] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17. Re-sending same reply.
I20260709 13:14:44.701138  4122 consensus_queue.cc:1059] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:14:44.796018  4225 raft_consensus.cc:2804] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:44.797999 32199 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:14:44.800352  3666 consensus_queue.cc:237] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:44.725087  4090 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:14:44.810329 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:44.812027 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:44.813000 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:44.813851 32264 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 17.
I20260709 13:14:44.815114 32198 raft_consensus.cc:1240] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: [12.9-13.10]
I20260709 13:14:44.815362 32264 raft_consensus.cc:1240] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:44.812858 32271 raft_consensus.cc:2410] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:14:44.817159 32264 raft_consensus.cc:1240] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:14:44.796872  4261 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:44.818212 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:44.820004 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:14:44.812788 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 112263us
I20260709 13:14:44.822108 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:44.822507 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:44.823429 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:44.823503 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:44.770874  4097 consensus_queue.cc:1059] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:14:44.824689 32273 raft_consensus.cc:2393] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 10: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:44.823917 32264 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:44.827332 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:44.827800 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:44.828394 32267 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:44.824862 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:44.832417 32268 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:44.822866 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:44.835243 32267 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 8.
I20260709 13:14:44.796350  3976 consensus_queue.cc:1048] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.029s
W20260709 13:14:44.837647  4349 log.cc:927] Time spent T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:14:44.796710  4307 consensus_queue.cc:1048] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:14:44.840728 32090 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:44.797339  4289 consensus_queue.cc:1059] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:14:44.844904 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:44.844051 32264 raft_consensus.cc:2468] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 8.
I20260709 13:14:44.843849 32165 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:44.818954  4225 raft_consensus.cc:697] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:14:44.846978  4346 log.cc:927] Time spent T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:14:44.822465  4298 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:44.833665  4166 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.833796  4257 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.834673  4315 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:44.865480  4225 consensus_queue.cc:237] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:44.869429 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:44.871065   369 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:44.847199  4240 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:14:44.872996 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.873013   369 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801
W20260709 13:14:44.852909  4345 log.cc:927] Time spent T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.269s	user 0.000s	sys 0.002s
W20260709 13:14:44.875036 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.878558 32238 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:44.879915 32238 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:44.851197  4292 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:44.780821  4337 consensus_queue.cc:260] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:44.875363  4303 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:44.879312  4261 raft_consensus.cc:3055] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:14:44.882927  4347 log.cc:927] Time spent T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.217s	user 0.001s	sys 0.001s
I20260709 13:14:44.879992  4240 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:44.880370  3814 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:44.891494 32266 raft_consensus.cc:2955] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 5 to 8, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:44.883905  4233 raft_consensus.cc:3055] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:44.934682   369 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:44.973790   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 71974.8us
I20260709 13:14:44.974578   369 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:44.875898  4257 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:44.885948  4255 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.883285  4288 raft_consensus.cc:2764] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:14:44.941118  3985 raft_consensus.cc:3055] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:14:44.948612 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 68740.6us
W20260709 13:14:44.948808 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 127463us
I20260709 13:14:44.949267  4127 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:44.958200  4214 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:44.875512  4166 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:44.963356  4226 raft_consensus.cc:993] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:14:44.896907  4261 raft_consensus.cc:740] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:44.966081  4090 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:44.967258  4337 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:44.939675  4240 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:44.885514  4213 raft_consensus.cc:2804] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:14:44.936519  4350 log.cc:927] Time spent T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
W20260709 13:14:44.978978 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.977079   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
W20260709 13:14:44.983534 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 139730us
I20260709 13:14:44.973286  4233 raft_consensus.cc:740] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:44.980929  4307 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:14:44.988189  4318 log.cc:927] Time spent T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 1.119s	user 0.004s	sys 0.000s
I20260709 13:14:45.010589  4261 consensus_queue.cc:260] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:44.988807  3985 raft_consensus.cc:740] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:45.019130  4166 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:44.997888  4127 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:45.021122  4288 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:45.008786  4358 consensus_queue.cc:1059] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:14:45.026714  4362 raft_consensus.cc:1081] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Signalling peer fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:14:45.044555  4357 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.027640   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:44.986102  4305 raft_consensus.cc:2804] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:44.986296  4268 consensus_queue.cc:1059] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:14:45.038686 32198 raft_consensus.cc:2955] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 5 to 8, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:45.052965  4213 raft_consensus.cc:697] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 8 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:44.991263  4255 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:45.046537 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.992224 32239 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
W20260709 13:14:45.053087 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 93951.4us
I20260709 13:14:45.033779  4257 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:45.063445 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:45.056603 32165 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:45.122854 32089 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:45.057281 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:45.055207 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:45.125243 32264 raft_consensus.cc:2393] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 11: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:45.125243 32089 leader_election.cc:400] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 12. Current term is 13.
W20260709 13:14:45.082410 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.027647   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
W20260709 13:14:45.129976 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 73536.5us
I20260709 13:14:45.081096  4253 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:45.130834 32165 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:45.131177 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:45.131820 32199 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:45.090528  4127 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:45.138731 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:45.141222 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 149078us
I20260709 13:14:45.063191  4292 consensus_queue.cc:1059] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:14:45.150483 32165 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:45.153214 32089 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:45.155215 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:45.156427 32199 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:14:45.157730 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:45.158708 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:45.107375  4307 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.163960 32089 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:45.089946  4122 consensus_queue.cc:1059] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:14:45.137717  4261 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:45.154744  4366 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:45.143287  4305 raft_consensus.cc:697] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 8 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:45.097720  4288 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:45.162604  4273 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:45.210420 32191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56926 (request call id 468) took 2317 ms. Trace:
I20260709 13:14:45.171911  4257 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:45.170979  4267 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:14:45.170130  4268 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.214771 32191 rpcz_store.cc:276] 0709 13:14:42.892674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.374756 (+482082us) service_pool.cc:224] Handling call
0709 13:14:43.375057 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:43.375369 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:43.375395 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:43.375863 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:14:43.585812 (+209949us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:14:43.585855 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:43.585915 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:44.847246 (+1261331us) spinlock_profiling.cc:243] Waited 6.86 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:14:45.176442 (+329196us) raft_consensus.cc:1685] finished
0709 13:14:45.176475 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:45.210323 (+ 33848us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":54087,"raft.run_cpu_time_us":45,"raft.run_wall_time_us":45,"spinlock_wait_cycles":15766784,"thread_start_us":209582,"threads_started":1,"wal-append.queue_time_us":364786}
I20260709 13:14:45.186108  3939 consensus_queue.cc:1059] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:14:45.187093  4377 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:45.106280  4357 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:45.172248  4292 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:45.263955 32191 raft_consensus.cc:1240] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:45.175060  4307 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:45.221769  4257 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:45.250101 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 100398us
I20260709 13:14:45.169618  4233 consensus_queue.cc:260] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:45.319999  4233 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:45.320232  4368 log.cc:927] Time spent T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
W20260709 13:14:45.321813  4365 log.cc:927] Time spent T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
W20260709 13:14:45.324235  4370 log.cc:927] Time spent T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:14:45.329320  4375 log.cc:927] Time spent T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:14:45.330132 32194 raft_consensus.cc:1240] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:45.257056  3913 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:14:45.313360  4364 log.cc:927] Time spent T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 13:14:45.264467  4366 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:45.348771 32239 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:45.356385 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 192491us
I20260709 13:14:45.358536 32089 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:45.305498  3976 raft_consensus.cc:3055] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:45.331182  4257 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:45.361215  3976 raft_consensus.cc:740] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:45.362167  3976 consensus_queue.cc:260] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:45.364248 32089 leader_election.cc:400] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 7 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8.
I20260709 13:14:45.241943  4213 consensus_queue.cc:237] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:45.365345 32089 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:45.357545  4366 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:45.366580 32089 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:14:45.368378  4376 log.cc:927] Time spent T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:14:45.370049   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:45.370723   395 raft_consensus.cc:1813] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Handling vote request from an unknown peer 113b5461952d47e0944d463ea4e32801
I20260709 13:14:45.371286   395 raft_consensus.cc:2393] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 13: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:14:45.364148  4267 raft_consensus.cc:2749] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:45.297029  4268 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:45.420439 32196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2449) took 1125 ms. Trace:
I20260709 13:14:45.421060 32196 rpcz_store.cc:276] 0709 13:14:44.292081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:44.312994 (+ 20913us) service_pool.cc:224] Handling call
0709 13:14:45.417143 (+1104149us) spinlock_profiling.cc:243] Waited 44.1 ms on lock 0x7b54001d38d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:45.417414 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101374208}
W20260709 13:14:45.424937 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 58414.8us
I20260709 13:14:45.426026 32089 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:45.385301  4366 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:45.430652 32089 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:45.390017  4235 consensus_queue.cc:1059] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:14:45.386291  3913 consensus_queue.cc:1048] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
W20260709 13:14:45.440932 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 292392us
I20260709 13:14:45.412009  4383 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:45.458434 32165 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:45.416474  4386 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:14:45.459030   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 88898.3us
I20260709 13:14:45.466616 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:45.470919 32191 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:45.431878  4267 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:45.409821  4381 consensus_queue.cc:1059] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:14:45.431454  4255 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:45.357003  4305 consensus_queue.cc:237] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:14:45.480835 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:45.516479 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 85941.6us
I20260709 13:14:45.518385 32089 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:14:45.523319 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.465005  4366 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:45.474680  4386 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:14:45.531430 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.515698  4001 raft_consensus.cc:3055] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:45.530664 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:45.536129 32121 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 13.
I20260709 13:14:45.516894  4097 raft_consensus.cc:3055] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:14:45.523645  4303 consensus_meta.cc:287] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6: Time spent flushing consensus metadata: real 0.625s	user 0.011s	sys 0.000s
I20260709 13:14:45.535717 32238 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:45.545101 32238 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:45.515730  4377 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:45.525538  4384 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
W20260709 13:14:45.548209 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 90268us
I20260709 13:14:45.555040 32165 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:45.545933  4378 log.cc:927] Time spent T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:14:45.539249  4001 raft_consensus.cc:740] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:45.537067  4386 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:45.542583  4097 raft_consensus.cc:740] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:45.569733  4097 consensus_queue.cc:260] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:45.571161  4097 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:45.547086  4267 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:45.548882  4303 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:14:45.582616 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 64353.7us
I20260709 13:14:45.583220 32165 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:45.534087  4366 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:45.583357 32089 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
W20260709 13:14:45.573824  4337 consensus_meta.cc:287] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.527s	user 0.007s	sys 0.000s
I20260709 13:14:45.561710  4235 raft_consensus.cc:2804] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:14:45.598549 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 53542.6us
I20260709 13:14:45.599606 32238 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:45.601317 32089 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:45.603588 32089 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:14:45.585041  4336 consensus_meta.cc:287] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6: Time spent flushing consensus metadata: real 1.166s	user 0.016s	sys 0.000s
I20260709 13:14:45.573166  4307 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:45.590114  4273 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:45.586469  4357 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:14:45.599573  4315 consensus_meta.cc:287] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.726s	user 0.012s	sys 0.000s
I20260709 13:14:45.592679  3666 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:45.555200  4377 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:45.589738  4394 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:14:45.649962 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 66811.8us
I20260709 13:14:45.615942  4337 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:45.599115  4235 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:45.641453 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 264864us
I20260709 13:14:45.653180 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:45.611675  4398 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:45.559711  4384 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:45.658880  4253 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:45.659543  4253 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:45.659884  4384 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:14:45.658867  4371 log.cc:927] Time spent T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 13:14:45.661834 32270 raft_consensus.cc:1240] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:14:45.663575  4387 log.cc:927] Time spent T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 13:14:45.664947  4373 log.cc:927] Time spent T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
W20260709 13:14:45.671752  4127 consensus_meta.cc:287] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.000s
I20260709 13:14:45.673715 32165 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:45.684046  4253 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:45.645694  4268 leader_election.cc:290] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:45.634088  4403 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:45.673615  4235 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:45.719390  4240 consensus_meta.cc:287] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.674s	user 0.007s	sys 0.003s
I20260709 13:14:45.695755 32165 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
W20260709 13:14:45.698870  4261 consensus_meta.cc:287] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.505s	user 0.011s	sys 0.000s
I20260709 13:14:45.692083  4392 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:45.645278  4383 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:45.645818  4001 consensus_queue.cc:260] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:45.633128  4267 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:45.683637  4315 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:14:45.706674 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 103181us
I20260709 13:14:45.651194  3666 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:45.709364 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 58525.2us
W20260709 13:14:45.709968 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 51110.7us
I20260709 13:14:45.712502  4253 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:45.660501  4384 raft_consensus.cc:2749] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:14:45.733814 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 57908us
I20260709 13:14:45.672319  4127 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:45.651856  4394 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:45.740953 32089 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:45.699571  4402 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:45.719986  4240 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:45.740947  4214 consensus_meta.cc:287] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.738s	user 0.007s	sys 0.006s
I20260709 13:14:45.740243  4261 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:45.760556  4384 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.767208  4384 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:45.770354  4384 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:45.771528  4261 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:45.760740  4408 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:45.752859  4394 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:45.762920  4292 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.736129  4257 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:45.765403 32238 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:45.761538  4415 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.748144  3666 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:45.775147 32239 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:45.776358  4360 raft_consensus.cc:3055] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:45.777420  4240 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:45.761448  4315 consensus_queue.cc:1059] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:45.786597 32239 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:45.759968  4001 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:45.791128  3736 raft_consensus.cc:2804] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:45.796090  4406 consensus_queue.cc:1059] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:14:45.796144  3736 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:45.796977  3736 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:45.796268  4357 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:45.778237  4384 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:45.785058  4097 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:45.751950  4392 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:45.794984  4360 raft_consensus.cc:740] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:45.782575  4292 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:45.808099  4097 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:45.808750  4366 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:45.810956  4384 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:45.821327  4261 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:45.828943  4257 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:45.832274  4097 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:14:45.891770 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 150668us
I20260709 13:14:45.915009 32192 raft_consensus.cc:1275] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:14:45.917732 32193 raft_consensus.cc:1240] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: [12.9-13.10]
I20260709 13:14:45.918311 32196 raft_consensus.cc:1240] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:45.994642 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:45.995123  4305 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.995675 32192 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:45.996129 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:45.919790 32195 raft_consensus.cc:1275] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:14:45.926120 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 122130us
I20260709 13:14:45.933017 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:45.955060   399 raft_consensus.cc:1240] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 8 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:45.955871  4240 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:45.956967  4261 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:45.794217  4415 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:45.838979  4377 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:45.853178  4384 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:45.841784  4392 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:45.859026  4394 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:45.965915  4127 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:45.846957  4360 consensus_queue.cc:260] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:45.850694  4386 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.002185  4353 raft_consensus.cc:3055] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:46.010596  4240 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:46.009652  4261 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.019520  4360 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:46.019726  4394 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:46.023342   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:46.049593   398 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:14:46.049602 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:46.050732 32123 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:14:46.053128 32162 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:46.056813 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:46.057324 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:46.057988 32123 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:14:46.058442 32120 raft_consensus.cc:2468] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 5.
I20260709 13:14:46.058758  4253 consensus_queue.cc:1048] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:46.060987  4390 consensus_queue.cc:1048] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:46.061476  4392 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:46.008011 32089 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:46.024879   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:46.025753   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:46.028126  4240 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:46.017225 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:46.064285  4392 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.066874  4410 raft_consensus.cc:2749] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:14:46.065392 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 73178.2us
I20260709 13:14:46.068039 32195 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:46.068706 32089 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:46.061007  4225 consensus_queue.cc:1059] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:14:46.072511  4410 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:46.073215  4410 raft_consensus.cc:697] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:46.073513 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:46.011827 32266 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 13.
I20260709 13:14:46.036887 32124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55358 (request call id 336) took 1455 ms. Trace:
I20260709 13:14:46.037272  4386 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:46.037591 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:46.038463  4261 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:46.039006 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:46.040664  4353 raft_consensus.cc:740] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:46.041137  4127 consensus_queue.cc:1048] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:46.043699 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:46.045112   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:46.045599 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:46.047114 32196 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:46.024284   395 raft_consensus.cc:1240] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:46.075918 32124 rpcz_store.cc:276] 0709 13:14:44.581376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:44.581525 (+   149us) service_pool.cc:224] Handling call
0709 13:14:44.640365 (+ 58840us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:44.725485 (+ 85120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:44.725535 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:44.725633 (+    98us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:14:44.725688 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:46.024621 (+1298933us) spinlock_profiling.cc:243] Waited 84.8 ms on lock 0x7b54002c88d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:46.025132 (+   511us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:46.036654 (+ 11522us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195111296}
I20260709 13:14:45.996526  4305 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:46.093886 32121 raft_consensus.cc:2393] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 13: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:46.075556  4357 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.098953   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:46.102766 32267 raft_consensus.cc:1275] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:14:46.102502  4357 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.105654   394 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:14:46.107612 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:46.108871 32121 raft_consensus.cc:2393] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 13: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:46.108747 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:46.109390 32264 raft_consensus.cc:2393] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 13: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:46.109948 32123 raft_consensus.cc:2393] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 13: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:46.112932 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:46.114313 32122 raft_consensus.cc:2393] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 13: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:46.115206 32195 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:46.115965  4415 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:46.116976   396 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:46.118578   400 raft_consensus.cc:1240] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:46.108284  4357 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:46.124941 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:46.126030  4392 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:46.129956 32120 raft_consensus.cc:1240] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:46.130384  4240 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.074918  4410 consensus_queue.cc:237] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.134232 32198 raft_consensus.cc:1275] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:14:46.135687 32198 pending_rounds.cc:85] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 7
I20260709 13:14:46.131368  4261 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:46.136722  4261 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.137048 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:46.136073 32198 pending_rounds.cc:107] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:14:46.137509   369 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:46.142753  4305 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:46.142856  4409 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:46.143600  4409 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:46.144217  4409 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:46.139384 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:46.148447 32196 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:46.150508  4392 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:46.151436  4392 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.152325 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:46.154004 32192 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:46.141230 32198 raft_consensus.cc:2889] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:46.159526 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:46.156229 32122 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:46.161607 32119 raft_consensus.cc:1275] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:14:46.163198 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:46.164111 32267 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 15.
I20260709 13:14:46.139835  4261 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:46.174111 32196 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 12.
I20260709 13:14:46.154906  4394 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.182385 32264 raft_consensus.cc:1240] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:14:46.185359  4424 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:46.185458 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:46.188007 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:46.194271 32119 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 13.
I20260709 13:14:46.195025 32190 raft_consensus.cc:1275] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:46.191604  4423 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.193279  4425 consensus_queue.cc:1048] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:14:46.191493 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:46.195391  4292 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:46.195817  4290 consensus_queue.cc:1059] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:46.199872 32121 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:46.179782 32124 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:56890
I20260709 13:14:46.188658 32120 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:14:46.187037   369 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:46.207085 32124 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:46.207629 32124 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:46.220008   368 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:46.221565  4317 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:46.221979 32193 raft_consensus.cc:1275] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:14:46.222061  4317 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:46.222646  4317 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:46.200286  4261 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:46.223445 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 155023us
I20260709 13:14:46.209652  4424 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:46.246577 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:46.253300 32270 raft_consensus.cc:1240] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 12. Current term is 13. Ops: []
W20260709 13:14:46.254405   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 67836.9us
I20260709 13:14:46.240556  4424 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:46.252244 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:46.259251  4410 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.265092  4410 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.265529  3736 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.258495  4400 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:46.267540  4410 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:46.239238  4394 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.273254 32089 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:46.273591  4394 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:46.274094  4392 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:46.274387  4394 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:46.275141 32089 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:46.279058  4386 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:46.280669 32119 raft_consensus.cc:1275] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:14:46.264473 32264 raft_consensus.cc:1275] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:46.283907 32123 raft_consensus.cc:1275] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:14:46.284999 32089 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:46.287739 32267 raft_consensus.cc:1240] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:46.288455 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:46.270689 32238 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:46.270982  4240 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:46.228264  4423 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.270263 32165 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:46.289191 32115 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:46.297057 32198 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:46.268325  3736 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:46.245873  4261 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.299077 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:46.302484 32089 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:46.308980 32118 raft_consensus.cc:1275] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:14:46.309145 32236 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:46.309468 32118 pending_rounds.cc:85] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d: Aborting all ops after (but not including) 7
I20260709 13:14:46.310370 32118 pending_rounds.cc:107] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:14:46.310657 32118 raft_consensus.cc:2889] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:46.264528  4408 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:46.310588 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:46.305953 32165 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:46.315913 32192 raft_consensus.cc:1240] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 14. Current term is 15. Ops: []
W20260709 13:14:46.311975 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 82499.2us
I20260709 13:14:46.318118  4001 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:46.318953  4335 consensus_queue.cc:1048] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:14:46.320693  4288 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:46.320935 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:46.322682 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:46.323621 32116 raft_consensus.cc:2393] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 13: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:46.324803 32122 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:46.305794  4290 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:46.331523 32162 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
W20260709 13:14:46.334040  4235 consensus_meta.cc:287] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.619s	user 0.013s	sys 0.006s
I20260709 13:14:46.337647 32267 raft_consensus.cc:1240] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:46.339649 32118 raft_consensus.cc:1240] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:46.341010  4289 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:46.341409  4366 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:46.342617 32165 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:46.342841  4261 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:46.343602 32121 raft_consensus.cc:1240] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:14:46.344393 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:14:46.344725  3666 consensus_meta.cc:287] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.552s	user 0.013s	sys 0.005s
I20260709 13:14:46.379791  3666 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.345147  4288 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:46.346107  4423 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:46.346547  4290 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:46.347273 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:46.316737  4390 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:46.348613 32119 raft_consensus.cc:1275] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:14:46.349936  4409 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:46.350831 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:46.350632  4097 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.351831 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:46.352900 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:46.354384 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:46.354730 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:46.355643 32191 raft_consensus.cc:1240] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: [12.9-13.10]
I20260709 13:14:46.355763 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:46.327682 32238 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:46.367326 32120 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:46.366968 32124 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.366016  4366 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:46.369082  4127 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:46.366174  4289 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.371430 32115 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:46.372689 32165 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:46.373049 32196 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:46.376816  4258 raft_consensus.cc:2764] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:14:46.376886 32089 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:46.377475  4235 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:14:46.411212  4235 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:46.413100  3814 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:46.413687  3814 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:46.416016  3814 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:46.416193  4343 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:46.416931  4343 raft_consensus.cc:697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:46.378903 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:46.369340 32118 raft_consensus.cc:3055] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:46.418679  3985 consensus_queue.cc:260] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:46.419435 32118 raft_consensus.cc:740] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:46.419894  3985 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:46.421348 32165 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:46.390576  4240 consensus_queue.cc:1059] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:46.366565  4394 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:46.391180  4410 consensus_queue.cc:1048] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:46.365000  4001 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:46.392958 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:46.397117 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:46.404838  4366 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:46.408797 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 50795.5us
I20260709 13:14:46.419054 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:46.380829  4288 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:46.423168  4255 raft_consensus.cc:3055] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:14:46.423339 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 116731us
I20260709 13:14:46.452742  4255 raft_consensus.cc:740] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:46.453258 32238 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:46.453878  4255 consensus_queue.cc:260] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.389953  3666 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:46.455054  4255 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:46.428737 32196 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
W20260709 13:14:46.452773 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.395545  4390 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:46.396008  4290 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:46.458186  4390 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:46.459637 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:46.460876 32121 raft_consensus.cc:2393] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 15: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:46.461273  4097 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:46.461886 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:46.463352 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:46.464716  4001 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:46.436980 32124 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:46.433363  4423 raft_consensus.cc:2804] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:14:46.438174 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.435818  4343 consensus_queue.cc:237] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.438934 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:46.439229  4288 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:46.444497 32119 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:46.445942  4240 consensus_queue.cc:1243] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer 6b3ed521ce8947db80c4b4828b355c06 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:14:46.447556  4353 consensus_queue.cc:260] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.449937  4274 raft_consensus.cc:3055] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:46.419780   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:46.466571 32116 pending_rounds.cc:85] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d: Aborting all ops after (but not including) 8
I20260709 13:14:46.485623 32116 pending_rounds.cc:107] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d: Aborting uncommitted NO_OP operation due to leader change: 10.9
W20260709 13:14:46.483968 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 62714.9us
I20260709 13:14:46.443693  3736 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:46.485985 32116 raft_consensus.cc:2889] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:46.466625  4127 raft_consensus.cc:697] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:14:46.501097 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 47986.2us
I20260709 13:14:46.468972  4394 raft_consensus.cc:697] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:46.507943 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:46.510303  4384 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:46.510574   399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38184 (request call id 356) took 1493 ms. Trace:
I20260709 13:14:46.511377  4289 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:46.511132  4384 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.511636  4408 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:46.511979  3939 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.512215  4408 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.512619  3939 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.514329  4408 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:46.511075   399 rpcz_store.cc:276] 0709 13:14:45.017330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.017499 (+   169us) service_pool.cc:224] Handling call
0709 13:14:45.017860 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:46.005358 (+987498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:46.506909 (+501551us) spinlock_profiling.cc:243] Waited 936 ms on lock 0x7b54009ab354. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:46.510476 (+  3567us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2153472896}
I20260709 13:14:46.514855  3939 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:46.517817  4423 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:46.518558  4261 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:46.519047  4415 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:46.526080  4403 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.531067  3913 consensus_queue.cc:1059] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:46.530857 32118 consensus_queue.cc:260] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.533376 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:46.534634 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:46.535409 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:46.541420 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:46.576850 32124 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 17.
I20260709 13:14:46.542220   394 raft_consensus.cc:2393] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 13: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:14:46.543037  4409 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:46.544123  4001 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:14:46.546947 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 51421.7us
I20260709 13:14:46.485008  4274 raft_consensus.cc:740] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:46.588896 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:46.550164 32165 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:46.490773  4258 raft_consensus.cc:2804] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:14:46.553885  4298 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.125s	user 0.011s	sys 0.005s
I20260709 13:14:46.514132  3666 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:46.577735 32270 raft_consensus.cc:2393] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 9: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:46.579111 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:46.573107 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:46.537197  4353 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:14:46.584400 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.591681 32165 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:46.494675  4410 consensus_queue.cc:1059] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:14:46.592891  4235 consensus_queue.cc:1048] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:46.594190  4109 consensus_queue.cc:1048] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:46.597046 32191 raft_consensus.cc:1275] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:14:46.600378 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:46.601663 32121 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:46.545557  4394 consensus_queue.cc:237] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.568792  4423 raft_consensus.cc:3060] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:46.569108  4289 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:46.615448  4403 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.632898  4289 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.635170  4289 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:46.635718  4122 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.612819  4415 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.566036  3736 raft_consensus.cc:697] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:46.614745 32117 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 15.
I20260709 13:14:46.617646 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:46.621847 32165 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:46.627435  4008 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.574216  4317 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:14:46.611580  4298 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.181s	user 0.012s	sys 0.005s
I20260709 13:14:46.627967 32267 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 15.
I20260709 13:14:46.628446 32199 raft_consensus.cc:2410] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:14:46.628747  4127 consensus_queue.cc:237] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.629585   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:46.631109 32238 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:46.649935 32193 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:46.635200 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:46.602777  4258 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:46.616356  4408 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:46.655184 32165 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:46.614693  4383 consensus_queue.cc:1059] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:14:46.670359 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:46.664376 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:46.671489 32190 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:46.641945  3666 raft_consensus.cc:697] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:14:46.675666 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 94110.3us
I20260709 13:14:46.676878 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:46.613338  4261 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.680281 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:46.614142  4424 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:46.671690 32191 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:14:46.680634 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:46.659951  3985 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:46.684119 32089 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:46.663197  4292 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.667114  4258 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:46.674142  4403 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:46.639889  4122 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:46.696404 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:46.705854 32121 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 14.
I20260709 13:14:46.709821  4377 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:46.710503 32272 raft_consensus.cc:3055] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:46.711042 32272 raft_consensus.cc:740] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:46.710474  4377 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:46.707593 32117 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
I20260709 13:14:46.686851  4289 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:46.715245 32238 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:46.734818 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:46.736459   369 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:46.738293  4415 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:46.739215 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:46.739405  4261 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:46.683528  4008 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.741703 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:46.742645  4008 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:46.742854 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:46.714589  3736 consensus_queue.cc:237] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.743978 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:46.744655  4434 log.cc:927] Time spent T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:14:46.745390  4397 raft_consensus.cc:3055] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:46.745857  4397 raft_consensus.cc:740] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:46.689589  3985 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:46.747279  4438 log.cc:927] Time spent T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:14:46.746959  4397 consensus_queue.cc:260] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.747959 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:46.748138  4397 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:46.749260 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:46.749909 32194 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:46.747493  3985 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:46.752669  4406 consensus_queue.cc:1048] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.163s
I20260709 13:14:46.753710  4443 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:46.756358 32267 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:46.668556  4390 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:46.757802  4317 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:46.757959 32267 raft_consensus.cc:1275] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:14:46.707194  4366 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:46.759166  4390 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:46.760533  4366 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:46.760918 32264 raft_consensus.cc:2393] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 14: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
W20260709 13:14:46.761415 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 95426.2us
I20260709 13:14:46.761771 32124 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:14:46.762459  4408 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.763077  4408 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:46.765102  3666 consensus_queue.cc:237] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:46.765928 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 50775.4us
I20260709 13:14:46.767426  4166 raft_consensus.cc:2804] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:46.768044  4166 raft_consensus.cc:697] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:46.768994  4166 consensus_queue.cc:237] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.769873   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:46.770722   399 raft_consensus.cc:2393] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 14: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:14:46.712678  4292 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:14:46.786927 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 110534us
I20260709 13:14:46.733949 32272 consensus_queue.cc:260] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.788666 32199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54182 (request call id 3483) took 1672 ms. Trace:
I20260709 13:14:46.790076   399 raft_consensus.cc:1240] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:46.790455  4424 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:46.792837  4298 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:46.792999 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:46.808564 32124 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:46.793207  4367 consensus_queue.cc:1048] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:46.717295  4403 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:46.803768 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:46.813383 32196 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:46.795711 32199 rpcz_store.cc:276] 0709 13:14:45.116627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.158507 (+ 41880us) service_pool.cc:224] Handling call
0709 13:14:46.788403 (+1629896us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54000fa854. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:46.788572 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3377873152}
I20260709 13:14:46.791919  4274 consensus_queue.cc:260] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:46.821058 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:46.744042  4288 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.720692  4410 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:46.809947  4292 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:46.810384  4383 consensus_queue.cc:1048] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:46.811076  4396 consensus_queue.cc:1048] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:46.834743 32089 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:46.832408 32120 raft_consensus.cc:2393] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 13: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:46.836632  4274 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:46.832743  4400 consensus_queue.cc:1048] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:14:46.837651  4122 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:46.840499   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:46.815941  4403 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:46.841449  4235 consensus_queue.cc:1059] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:46.867578 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:46.867942  3985 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.869045  4292 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:46.869613  4292 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.870260  3985 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:46.842347  4444 log.cc:927] Time spent T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:14:46.870867  3985 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:46.871395  3985 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.871683  4292 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:46.872695 32165 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:14:46.873236 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 58103.6us
I20260709 13:14:46.850085 32190 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:14:46.873548  4424 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:46.874461  4424 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:46.874948  4424 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:46.807948  4008 consensus_queue.cc:1059] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:14:46.828562  4298 raft_consensus.cc:697] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 14 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:46.858464  4288 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:46.858713  4403 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:46.859839  3976 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:46.867740  4271 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:14:46.868605 32117 raft_consensus.cc:2393] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 12: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:46.853837 32194 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:46.853076 32193 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:14:46.876950 32165 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:46.898842 32124 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 14.
I20260709 13:14:46.910650 32196 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 14.
I20260709 13:14:46.911755   369 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:46.868311  4290 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:46.921242 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:46.922031 32196 raft_consensus.cc:2393] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 13: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:46.889123  4360 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:46.921095 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:46.926608 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:46.923906   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:46.923162 32238 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:14:46.927134 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 50222.4us
I20260709 13:14:46.935686 32120 raft_consensus.cc:2368] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 13. Current term is 14.
I20260709 13:14:46.915973  4292 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:46.942744  4382 raft_consensus.cc:3055] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:46.943370  4382 raft_consensus.cc:740] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:46.905968  4383 consensus_queue.cc:1048] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:14:46.952473 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:46.953742 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:46.968161 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:46.968897 32117 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:46.969427 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:46.970645 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:46.971376 32124 raft_consensus.cc:2393] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 13: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:46.973065   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:46.973755   394 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:46.975222 32162 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:46.937026  4255 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:46.939807  4408 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:46.982298 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:46.966126 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:46.983649 32192 raft_consensus.cc:2368] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 13. Current term is 14.
I20260709 13:14:46.984076 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:46.976780  4213 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:46.945233  4292 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:46.986351 32117 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
I20260709 13:14:46.946079   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:46.994681  3985 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:46.977161  4255 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:46.991045 32238 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:46.986049  4288 raft_consensus.cc:2804] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:46.983124  4271 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.006101 32115 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 17.
I20260709 13:14:46.944502  4382 consensus_queue.cc:260] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:47.003479  4008 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.013192  4008 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:47.015691  4008 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:47.016831 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:46.999650  4213 raft_consensus.cc:697] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 14 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:47.019711  4423 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:46.995299  4292 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:46.999917  4290 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:47.005381  4255 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:47.018908  4213 consensus_queue.cc:237] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:47.076107 32195 raft_consensus.cc:1240] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:47.010160  4288 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:47.093686 32119 consensus_meta.cc:287] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.596s	user 0.011s	sys 0.003s
I20260709 13:14:47.094123 32119 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:14:46.987090  4298 consensus_queue.cc:237] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:14:47.160452 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.161634 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:47.094951  4288 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:47.177326 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:47.189158 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 222438us
I20260709 13:14:47.189970 32238 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:47.191111 32238 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:47.192051  4235 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:47.192787  4235 raft_consensus.cc:697] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:47.193866  4235 consensus_queue.cc:237] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:47.194264  4407 raft_consensus.cc:2804] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:47.195019  4407 raft_consensus.cc:697] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:47.197222  4382 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:47.196185  4407 consensus_queue.cc:237] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:14:47.028999  4271 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:47.192174 32238 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:47.209672  4258 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:47.213513  4362 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:47.215631  4258 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:47.097538  4383 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:47.217594  4362 raft_consensus.cc:697] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:14:47.218550  4456 log.cc:927] Time spent T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:14:47.218847  4362 consensus_queue.cc:237] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:47.241037 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:47.234630 32238 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:47.256400 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:47.257304 32194 raft_consensus.cc:2368] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 14. Current term is 15.
I20260709 13:14:47.220340  4423 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:14:47.260543 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.282176 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:14:47.282737 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 299574us
I20260709 13:14:47.286420 32192 raft_consensus.cc:2393] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 13: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:47.293215  4384 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:47.297676  4090 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:47.299170  4357 consensus_queue.cc:1048] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:47.279397  4122 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.306088 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:47.316830 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:47.318017 32194 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:47.315207  4122 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:47.346484  4377 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:47.353781 32116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 3509) took 1067 ms. Trace:
I20260709 13:14:47.354211 32116 rpcz_store.cc:276] 0709 13:14:46.286839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.324496 (+ 37657us) service_pool.cc:224] Handling call
0709 13:14:46.382910 (+ 58414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:46.507937 (+125027us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:46.507985 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:46.559987 (+ 52002us) log.cc:844] Serialized 26 byte log entry
0709 13:14:46.813698 (+253711us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:46.833160 (+ 19462us) log.cc:844] Serialized 14 byte log entry
0709 13:14:46.833425 (+   265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:46.900965 (+ 67540us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b1800355c60. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bf04522 00007fb59bf067c1 00007fb59bf06779 00007fb59bf06709 00007fb59bf066d1 00007fb59bf059cd 000000000038f354 000000000038f199 00007fb59bee783a
0709 13:14:47.353524 (+452559us) spinlock_profiling.cc:243] Waited 83.4 ms on lock 0x7b54002c97d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:47.353565 (+    41us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:47.353595 (+    30us) raft_consensus.cc:1685] finished
0709 13:14:47.353603 (+     8us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:47.353725 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19817,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":295,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":81,"spinlock_wait_cycles":217552128,"thread_start_us":174927,"threads_started":1,"wal-append.queue_time_us":379355}
I20260709 13:14:47.358091 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:14:47.428208 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.403146  4424 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:47.442955  4386 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.443704  4386 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:47.446213  4386 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:47.455346 32194 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:47.458463 32198 raft_consensus.cc:1275] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:47.458775 32194 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:47.460956 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:14:47.434465  3976 consensus_meta.cc:287] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.528s	user 0.011s	sys 0.002s
I20260709 13:14:47.462704   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:47.476747   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:47.509488 32118 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:47.504151 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:47.500383 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:47.478163  4450 log.cc:927] Time spent T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.170s	user 0.001s	sys 0.001s
I20260709 13:14:47.525702 32268 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:14:47.531526 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:47.532325 32194 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:14:47.478276  4122 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:47.496345  4360 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:47.539000 32197 raft_consensus.cc:1240] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:14:47.491613  4396 raft_consensus.cc:3055] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:47.479615  4366 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.551908 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:47.533576  4289 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.521076  4288 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:47.564986 32197 raft_consensus.cc:1275] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:47.560353 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:47.543174  4360 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:47.543604  4396 raft_consensus.cc:740] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:47.568385 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:47.569684 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:47.577775 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:47.578577 32272 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:47.569386 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:47.582024 32264 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:47.583735 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:47.562107  4407 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.584753 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:47.557003  4235 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:47.586541   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 209519us
I20260709 13:14:47.551687  4366 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:47.592919 32197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:14:47.593556 32238 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:47.593418  4097 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:47.594312  4406 consensus_queue.cc:1048] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:47.599407 32118 raft_consensus.cc:1275] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:14:47.600081 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:47.608708 32197 raft_consensus.cc:606] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:47.614285 32118 pending_rounds.cc:85] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d: Aborting all ops after (but not including) 8
I20260709 13:14:47.614471 32197 raft_consensus.cc:614] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:47.611369  4235 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:47.612339 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:47.583642  3976 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.603647  4271 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:47.566679  4289 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:47.614655 32118 pending_rounds.cc:107] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:14:47.623142 32118 raft_consensus.cc:2889] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:47.607777 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:47.624017 32270 raft_consensus.cc:2410] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:14:47.568563  4292 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:47.626242 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:47.626554 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:47.627378 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:47.627636 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:47.627774  4288 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:47.628046 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:47.628654 32267 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
I20260709 13:14:47.629426 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:47.619869  4458 log.cc:927] Time spent T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
W20260709 13:14:47.631163   399 consensus_meta.cc:287] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6: Time spent flushing consensus metadata: real 0.622s	user 0.007s	sys 0.003s
I20260709 13:14:47.631577   399 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:14:47.634143  4366 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:47.637403 32118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 3515) took 1321 ms. Trace:
I20260709 13:14:47.638723 32162 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:47.639137 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:47.639777 32194 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:47.610234  4424 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:47.637773 32118 rpcz_store.cc:276] 0709 13:14:46.316104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.368782 (+ 52678us) service_pool.cc:224] Handling call
0709 13:14:46.369195 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:46.530233 (+161038us) spinlock_profiling.cc:243] Waited 61.9 ms on lock 0x7b540035e420. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59ef6f06f 00007fb59efe7f60 00007fb59efe97de 00007fb59eff3b49 00007fb59eff4416 00007fb59eff0d8f 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62
0709 13:14:46.870383 (+340150us) spinlock_profiling.cc:243] Waited 49.1 ms on lock 0x7b58004d6cd0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59ef4d0aa 00007fb59efcf447 00007fb59efe7fe7 00007fb59efe97de 00007fb59eff3b49 00007fb59eff4416 00007fb59eff0d8f 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4
0709 13:14:47.508680 (+638297us) spinlock_profiling.cc:243] Waited 8.06 ms on lock 0x7b540035e420. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59ef66a1d 00007fb59ef4d1a4 00007fb59efcf447 00007fb59efe7fe7 00007fb59efe97de 00007fb59eff3b49 00007fb59eff4416 00007fb59eff0d8f 00007fb59eff083e 00007fb5a3fb5419
0709 13:14:47.637117 (+128437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:47.637346 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":273834880}
I20260709 13:14:47.643641 32089 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:47.645677 32195 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:14:47.623090  4122 consensus_queue.cc:1048] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:14:47.647377 32272 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:14:47.622982  3666 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:47.655264 32267 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 17.
I20260709 13:14:47.657972 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:47.658856 32197 raft_consensus.cc:2410] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:14:47.658738 32165 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:47.590678  4407 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:47.662442 32272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36084 (request call id 2748) took 1118 ms. Trace:
I20260709 13:14:47.640499  4461 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.665160 32165 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:47.666297 32270 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 15.
I20260709 13:14:47.667163 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:47.664167 32272 rpcz_store.cc:276] 0709 13:14:46.550739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.550886 (+   147us) service_pool.cc:224] Handling call
0709 13:14:46.710336 (+159450us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b540017dca0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59ef68dc0 00007fb59eff4e18 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:47.355587 (+645251us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b540017dca0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59ef66a1d 00007fb59ef4d1a4 00007fb59efcf447 00007fb59efe7fe7 00007fb59efe97de 00007fb59eff527c 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591
0709 13:14:47.578417 (+222830us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b5800456ed0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59ef4d0aa 00007fb59efcf447 00007fb59efe7fe7 00007fb59efe97de 00007fb59eff527c 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c
0709 13:14:47.654911 (+ 76494us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":611675520}
I20260709 13:14:47.672827 32165 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:47.640481  4307 consensus_queue.cc:1059] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:14:47.659502  4271 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:47.674230 32197 raft_consensus.cc:1240] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:47.638671  3976 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:47.676666 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 50904.8us
I20260709 13:14:47.620033  4396 consensus_queue.cc:260] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:47.661139  4377 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:47.660694  3666 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:47.663498  4290 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.680436 32197 raft_consensus.cc:1275] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:14:47.682272 32165 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:47.665278  4366 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:14:47.674666  4403 consensus_meta.cc:287] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.737s	user 0.012s	sys 0.000s
I20260709 13:14:47.672827   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:47.670763  4288 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:47.698040  4396 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:47.698498  4097 consensus_queue.cc:1059] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:47.698967  4289 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:47.700343 32197 raft_consensus.cc:1240] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:47.720707  4423 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:47.726717  4235 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:47.728210  4407 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:47.721873   399 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:47.731012  4477 log.cc:927] Time spent T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:14:47.731631  4360 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:47.733093 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:47.719264  4377 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:47.734419 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:14:47.735200  4455 log.cc:927] Time spent T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.639s	user 0.009s	sys 0.005s
I20260709 13:14:47.735067 32193 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:14:47.736677 32271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 2750) took 1185 ms. Trace:
I20260709 13:14:47.737071 32267 raft_consensus.cc:1275] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:14:47.737461 32267 pending_rounds.cc:85] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06: Aborting all ops after (but not including) 9
I20260709 13:14:47.737901 32267 pending_rounds.cc:107] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:14:47.738248 32267 raft_consensus.cc:2889] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:47.737025 32271 rpcz_store.cc:276] 0709 13:14:46.551551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.551697 (+   146us) service_pool.cc:224] Handling call
0709 13:14:46.588567 (+ 36870us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:46.621248 (+ 32681us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:46.621290 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:46.637389 (+ 16099us) log.cc:844] Serialized 26 byte log entry
0709 13:14:46.877747 (+240358us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:46.877863 (+   116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:46.877941 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:47.719542 (+841601us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:14:47.736375 (+ 16833us) raft_consensus.cc:1685] finished
0709 13:14:47.736395 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:47.736606 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":461,"raft.queue_time_us":5345,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":20265,"spinlock_wait_cycles":37090688,"thread_start_us":239903,"threads_started":1,"wal-append.queue_time_us":347894}
I20260709 13:14:47.740206  4097 raft_consensus.cc:3055] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:47.740731  4097 raft_consensus.cc:740] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:47.741545  4097 consensus_queue.cc:260] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:47.742748  4097 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:47.743686  4410 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.744218  4410 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:47.746263  3913 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.738510 32193 raft_consensus.cc:1240] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:47.748045 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:47.700865 32194 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:14:47.701504  4366 raft_consensus.cc:697] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 13 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:47.702229  4290 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:47.702428  4471 consensus_queue.cc:1048] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:14:47.752123 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.695626  3666 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:47.702975 32089 leader_election.cc:400] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 13. Current term is 14.
I20260709 13:14:47.673313  4461 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:47.686342  4384 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:47.705892 32090 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:47.706372  4386 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:47.707967  4255 consensus_meta.cc:287] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.547s	user 0.007s	sys 0.003s
I20260709 13:14:47.708442 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:47.708770  4403 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:47.710032 32268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36080 (request call id 2299) took 1638 ms (client timeout 1527 ms). Trace:
I20260709 13:14:47.711284 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:47.712618 32191 raft_consensus.cc:1240] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:47.735312  4377 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:47.675812  4424 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:47.716745  4274 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.748986 32118 raft_consensus.cc:2393] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 11: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:47.753718 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:47.754232 32089 leader_election.cc:403] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:14:47.703680  4292 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:47.754902 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:47.759266 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:47.760207 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:47.749044  3913 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:47.761909 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:47.766196 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:47.800936 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:47.845578 32272 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:47.847566 32119 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:47.851583 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:47.853049  4384 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.853556  4384 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:47.854537 32269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50584 (request call id 403) took 1255 ms. Trace:
I20260709 13:14:47.854924 32120 raft_consensus.cc:1240] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:47.854892 32269 rpcz_store.cc:276] 0709 13:14:46.598871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.751256 (+152385us) service_pool.cc:224] Handling call
0709 13:14:46.751541 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:46.804396 (+ 52855us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:46.804427 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:46.804996 (+   569us) log.cc:844] Serialized 26 byte log entry
0709 13:14:46.930519 (+125523us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:46.930577 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:47.854167 (+923590us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b5400416254. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:47.854212 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:47.854254 (+    42us) raft_consensus.cc:1685] finished
0709 13:14:47.854268 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:47.854479 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5667,"raft.queue_time_us":7523,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":126,"spinlock_wait_cycles":46892416,"thread_start_us":125062,"threads_started":1,"wal-append.queue_time_us":363619}
I20260709 13:14:47.857249 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:47.846079 32268 rpcz_store.cc:269] 0709 13:14:46.072068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.085302 (+ 13234us) service_pool.cc:224] Handling call
0709 13:14:47.709876 (+1624574us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b5400296154. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:47.709972 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3219185024}
I20260709 13:14:47.856339 32120 raft_consensus.cc:1240] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:47.785995 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:47.787415 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:47.881493 32193 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:14:47.852275 32196 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:14:47.858295  4471 consensus_queue.cc:1059] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:14:47.859323 32266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36084 (request call id 2738) took 1548 ms. Trace:
I20260709 13:14:47.859848 32265 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:47.870184  4410 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:47.870697 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:47.892247 32266 rpcz_store.cc:276] 0709 13:14:46.311234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.311393 (+   159us) service_pool.cc:224] Handling call
0709 13:14:47.859110 (+1547717us) spinlock_profiling.cc:243] Waited 617 ms on lock 0x7b54001581d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:47.859251 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1418146560}
I20260709 13:14:47.894832 32269 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:47.872282  3976 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:47.857479  4366 consensus_queue.cc:237] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:47.862907 32264 raft_consensus.cc:1240] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:47.864097 32198 raft_consensus.cc:1275] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:47.864440 32121 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:47.856977  4271 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:47.865891 32117 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:47.866315 32123 raft_consensus.cc:2393] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 15: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:47.866954 32124 raft_consensus.cc:2393] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 10: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:47.878153  3666 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:47.880116 32194 raft_consensus.cc:1275] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:47.786320 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:47.881618 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:47.798456 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:47.893344 32265 raft_consensus.cc:606] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:47.901356 32265 raft_consensus.cc:614] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:47.852319  4288 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:47.905356  3666 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:47.901378 32271 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:47.905923 32190 raft_consensus.cc:2368] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 15. Current term is 16.
I20260709 13:14:47.906387 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:47.863168  3913 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:47.830687  4235 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:47.915357 32194 raft_consensus.cc:1240] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 17. Current term is 18. Ops: [17.8-17.8]
W20260709 13:14:47.917488 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 211675us
I20260709 13:14:47.897548  4424 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:47.920918  4353 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.911s	user 0.008s	sys 0.013s
I20260709 13:14:47.902534  4475 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.921335  4290 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:47.867555  4407 consensus_queue.cc:1048] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:14:47.831105  4386 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:47.924249 32090 leader_election.cc:304] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:47.925544  4424 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:47.933511 32117 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:14:47.934441   399 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
I20260709 13:14:47.936528  4461 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:14:47.937592 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.937770 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:47.953665 32121 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:47.892516  4255 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:47.930413  4353 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.008s	sys 0.014s
I20260709 13:14:47.902845  4274 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:47.946034 32190 raft_consensus.cc:1275] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:14:47.972219 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:47.949800  4406 raft_consensus.cc:3055] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:47.978420 32123 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:47.939949 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 111013us
I20260709 13:14:47.964655 32191 raft_consensus.cc:1275] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:47.979331 32195 raft_consensus.cc:1275] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:14:47.966346 32119 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:14:47.979522 32165 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:47.969216  4317 raft_consensus.cc:3055] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:47.981083  4317 raft_consensus.cc:740] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:47.981766  4274 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:47.982400  4271 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:47.982069  4317 consensus_queue.cc:260] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:47.983014  4271 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:47.983341  4317 raft_consensus.cc:3060] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:47.983531  4271 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:47.985913 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:47.986208 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:47.986994 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:47.986990 32118 raft_consensus.cc:2393] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 14: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:14:47.987578 32119 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:47.985914  4406 raft_consensus.cc:740] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:47.990332  4406 consensus_queue.cc:260] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:47.974036 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:47.991456  4406 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:47.991618 32117 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
W20260709 13:14:47.992949 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.994786  4271 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:14:47.995831 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 315223us
I20260709 13:14:47.986174 32116 raft_consensus.cc:1240] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:47.996737 32089 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:47.998037 32089 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:47.998725  4386 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:47.998860  4274 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:47.998953 32117 raft_consensus.cc:1240] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:47.999473  4360 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:48.000862  4274 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:48.001217 32123 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:48.002285 32089 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:47.952878  4384 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:48.004470 32115 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
I20260709 13:14:48.005394 32190 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:14:48.007020  4298 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:14:48.008347 32190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:14:48.008898 32190 raft_consensus.cc:606] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:48.009202 32190 raft_consensus.cc:614] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:47.998220 32116 raft_consensus.cc:1240] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 13:14:48.010988 32121 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
W20260709 13:14:48.011394 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.010988 32271 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
I20260709 13:14:47.972282 32090 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:48.013729 32119 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:14:48.014686 32121 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:48.015658 32270 raft_consensus.cc:1240] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 10. Current term is 11. Ops: []
W20260709 13:14:48.017151 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 44931.8us
I20260709 13:14:48.017475 32165 leader_election.cc:400] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 13. Current term is 14.
I20260709 13:14:47.922593  4235 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:48.019261 32165 leader_election.cc:403] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:14:48.019455 32121 raft_consensus.cc:1275] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:48.028705 32165 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:48.032269  4288 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:48.023237 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:48.017045  3913 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 13. Current term is 14.
I20260709 13:14:48.034657  4235 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:48.035732 32165 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:48.036875 32121 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:14:48.014258  4384 raft_consensus.cc:2749] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:14:48.017243  4274 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:48.044979 32119 raft_consensus.cc:1275] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:14:48.089737 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 53682.6us
I20260709 13:14:48.045375  4480 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:48.047284 32090 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:47.941711  4475 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:48.053438  4403 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:48.062147  4255 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:48.064114 32116 raft_consensus.cc:1275] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:48.065091 32117 raft_consensus.cc:1240] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:48.070604   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:48.074033 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:48.074837   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:48.075670 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:48.107926 32197 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:48.078035 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:48.108803 32195 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:48.038406  4271 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:14:48.076469 32162 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:48.087826 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:14:48.088747 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 86543.7us
W20260709 13:14:48.089042 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.091583 32268 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:14:48.090996 32165 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:48.040261  4366 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 13. Current term is 14.
I20260709 13:14:48.094708 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:48.092880  4290 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:48.104115 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:48.104651  4475 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:48.095069 32239 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:48.126366 32239 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:48.105680 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:48.107117 32191 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:14:48.121853 32089 leader_election.cc:400] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 14. Current term is 15.
I20260709 13:14:48.128891 32089 leader_election.cc:403] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:14:48.119059 32165 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:48.130707 32165 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:48.099444 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:48.134332 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:48.135596 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:48.132102 32165 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:48.136164 32117 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:48.135004  4271 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:48.120416  4403 raft_consensus.cc:2804] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:48.136889 32165 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:48.145205 32198 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:48.123700  4410 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:48.153918 32198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a75997deb5a741f998b671928aad3637"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:14:48.139329  4377 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:48.159147 32198 raft_consensus.cc:606] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:48.159610 32198 raft_consensus.cc:614] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:48.161936 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:48.155186 32165 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:48.163668  4289 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:48.164139  4289 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:48.164554  4289 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:48.172348 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:48.173255 32270 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:14:48.135504  4292 raft_consensus.cc:2749] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:14:48.137748  4235 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:14:48.179064 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:48.178381 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 61576.6us
I20260709 13:14:48.139793  4255 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:48.162595 32191 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:48.145376  4274 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 14. Current term is 15.
I20260709 13:14:48.139591  4290 raft_consensus.cc:697] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:48.181093  4377 raft_consensus.cc:697] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 13 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:48.185494 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:48.158367  4271 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:48.181491  4097 consensus_queue.cc:1048] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:14:48.186663 32199 raft_consensus.cc:1240] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:48.192232 32089 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:48.193331 32198 raft_consensus.cc:1240] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:48.191720 32116 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:14:48.196018 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:48.196280 32165 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:48.158625  4410 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:48.178779  4423 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:48.196995 32195 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 18.
I20260709 13:14:48.197546 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:48.202474 32270 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:14:48.196653 32271 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:48.161768  4403 raft_consensus.cc:697] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 11 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:48.201059 32089 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:48.191404  3976 consensus_queue.cc:1059] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:14:48.207034 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:48.160763  4406 consensus_queue.cc:1059] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:14:48.160506  4353 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:14:48.211560 32165 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:48.161355  4360 consensus_queue.cc:1048] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:14:48.188779  4255 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:48.220481 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:14:48.222710 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 175524us
I20260709 13:14:48.198443  4366 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:48.187368  4461 consensus_queue.cc:1048] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:14:48.179849  4424 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:48.201872  4410 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:48.261433 32190 raft_consensus.cc:2393] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 11: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:48.235715 32090 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:48.208312  4292 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:48.208134  4384 raft_consensus.cc:2764] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:14:48.238972 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:48.275276 32116 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:48.218967  4288 raft_consensus.cc:2804] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:48.238008  4255 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:48.231952  4274 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:48.243392  4366 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:48.278779 32271 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:14:48.287456 32197 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
W20260709 13:14:48.296072 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 60411.5us
I20260709 13:14:48.278468  4480 raft_consensus.cc:697] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:48.256748  4290 consensus_queue.cc:237] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:48.311787  4423 raft_consensus.cc:697] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 12 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
W20260709 13:14:48.306020 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 105049us
I20260709 13:14:48.302906  4292 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:48.259351  4377 consensus_queue.cc:237] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:48.262081  4403 consensus_queue.cc:237] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:48.304411  3913 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:48.304844  4490 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:48.306348  4271 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:48.339291 32123 raft_consensus.cc:1275] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:14:48.317101 32089 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:48.297588  4274 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:48.341897 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 130716us
I20260709 13:14:48.342049  4271 consensus_queue.cc:1059] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:48.342455  4490 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:48.342748 32165 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:48.342927  4490 raft_consensus.cc:697] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:48.343032  4271 raft_consensus.cc:3055] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:48.344007 32165 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:48.344381 32089 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:48.326318  3913 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:48.346719  4498 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:48.346840  3913 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:48.347389  4498 raft_consensus.cc:697] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 15 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:48.348347  4498 consensus_queue.cc:237] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:48.352679 32165 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:48.355175 32165 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:48.359896 32117 raft_consensus.cc:1275] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:14:48.329056  4488 log.cc:927] Time spent T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:14:48.370182 32117 raft_consensus.cc:1275] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:14:48.325839  4366 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:48.373359 32089 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:48.376082 32165 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:48.466538 32165 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:48.365975  4292 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:48.364030  4271 raft_consensus.cc:740] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:48.556910 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:48.577863 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:48.578725 32264 raft_consensus.cc:1240] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:48.599642 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:48.449558  4499 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:48.608220 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:14:48.608666 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 221888us
I20260709 13:14:48.609177 32121 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 13.
I20260709 13:14:48.609820 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:14:48.613394   367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.613577 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:48.614527 32273 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:14:48.616482  4289 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:48.616899  4496 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:48.617511  4496 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:48.617975  4496 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:48.618876  4289 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:48.619577  4289 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:48.619957  4289 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:48.620572 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:48.627561  4423 consensus_queue.cc:237] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:48.628711  4490 consensus_queue.cc:237] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:48.631425 32270 raft_consensus.cc:1275] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:14:48.631844  3913 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:48.632328 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:48.632423 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:48.644840  4499 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:48.645591  4358 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.646077  4497 raft_consensus.cc:2749] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:48.539474  4292 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:48.623883  4255 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:48.653626 32272 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:14:48.663187 32090 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:48.673123 32121 raft_consensus.cc:1275] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:14:48.538982  4366 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:48.674147  4289 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:48.712898 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 49788.4us
I20260709 13:14:48.721894 32119 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:14:48.717703 32090 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:48.706723  4292 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:48.705785  3913 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:48.714804  4366 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:48.706488  4499 raft_consensus.cc:697] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:48.538457  4480 consensus_queue.cc:237] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:48.746224 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 136509us
I20260709 13:14:48.738529  4502 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:48.752640 32165 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:48.693393  4358 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:48.743043  4366 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:14:48.763886 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 390590us
I20260709 13:14:48.764882 32089 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:48.766324 32089 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:48.755868  4502 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:48.716926  4271 consensus_queue.cc:260] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:48.773787 32089 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:48.785995 32089 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:48.762459  4500 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:48.786793  4498 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.789243  4498 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:48.791536  4498 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:48.796877  4510 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:48.797436  4510 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:48.797780  4510 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:48.804857  4271 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:48.813498  4255 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:48.789086  4499 consensus_queue.cc:237] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:48.824023 32089 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:14:48.824746 32116 consensus_meta.cc:287] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.547s	user 0.007s	sys 0.003s
I20260709 13:14:48.770313  4377 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:48.832307 32116 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:14:48.756776  4497 consensus_queue.cc:1059] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:14:48.833745  4358 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:14:48.847112 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.860971   369 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:48.859339 32239 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:14:48.927795 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 64116.8us
I20260709 13:14:48.916707 32239 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:48.834255  4377 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:48.860814  4508 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:14:48.956866 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 93769.1us
I20260709 13:14:48.901288  4497 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:48.929144  4255 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:48.959894   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:48.957568  4507 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:48.933080  4407 consensus_queue.cc:1059] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:14:48.932638  4496 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:48.970371  4255 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:48.992352 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:48.984368  4109 raft_consensus.cc:3055] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:48.975646  4290 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:48.980334  4508 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:49.007774   400 raft_consensus.cc:1275] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:14:48.987439  4497 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:48.989692  4498 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.000722  4255 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:48.993436  4511 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
W20260709 13:14:49.023247   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 167500us
I20260709 13:14:49.000996   399 raft_consensus.cc:2468] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:14:49.031169 32194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:14:49.004604  4109 raft_consensus.cc:740] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:49.044349 32192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3539) took 1526 ms. Trace:
I20260709 13:14:49.047667  4274 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:49.042173  4423 consensus_queue.cc:1048] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:14:49.048197  4288 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:14:49.045282 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 221176us
W20260709 13:14:49.055902 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 127410us
I20260709 13:14:49.090193 32238 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:49.057314 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:49.058239 32119 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:49.063376 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:49.039549 32194 raft_consensus.cc:606] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:49.081712 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:49.094444 32194 raft_consensus.cc:614] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:49.094846 32089 leader_election.cc:400] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 15. Current term is 16.
I20260709 13:14:49.095194 32089 leader_election.cc:403] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:14:49.077643  4511 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:49.096228  4274 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 15. Current term is 16.
W20260709 13:14:49.072374   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 211464us
W20260709 13:14:49.075259  4491 log.cc:927] Time spent T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.786s	user 0.006s	sys 0.006s
I20260709 13:14:49.006422  4500 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:49.097823 32089 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:49.009316  4400 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:14:49.027873  4386 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.992s	user 0.011s	sys 0.021s
I20260709 13:14:49.076397 32192 rpcz_store.cc:276] 0709 13:14:47.518190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:47.677938 (+159748us) service_pool.cc:224] Handling call
0709 13:14:47.971793 (+293855us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:47.972123 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:47.972150 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:48.018531 (+ 46381us) log.cc:844] Serialized 26 byte log entry
0709 13:14:48.065487 (+ 46956us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b4800002958. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a3f1aaa1 00007fb5a3f11b37 00007fb5a3f119ca 00007fb5a400926f 00007fb5a4008f37 00007fb5a401d55c 00007fb5a401d508 00007fb5a401d488 00007fb5a401d443 00007fb5a401c6ec 00007fb5a2f46a96
0709 13:14:48.214375 (+148888us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:48.214435 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:48.214531 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:48.321266 (+106735us) raft_consensus.cc:1685] finished
0709 13:14:48.321286 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:49.044093 (+722807us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b54000fb250. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff08ad 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:49.044243 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23652,"raft.queue_time_us":5848,"raft.run_cpu_time_us":2296,"raft.run_wall_time_us":80808,"spinlock_wait_cycles":732574336,"thread_start_us":161445,"threads_started":1,"wal-append.queue_time_us":234678}
W20260709 13:14:49.098997 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 138807us
I20260709 13:14:49.099718   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:49.101178  4480 raft_consensus.cc:2804] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:49.093101  4494 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:49.009793  4290 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:49.119774  4290 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:49.120389  4515 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:49.120909  4515 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:49.121248  4515 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:49.127636  4510 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:49.130620  4292 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:49.133466  4424 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:49.134478 32022 catalog_manager.cc:5697] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 9 to 10, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4), now has a pending config: VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1), VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2), VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3), VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 10 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:14:49.137305  4512 log.cc:927] Time spent T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
W20260709 13:14:49.138463  4386 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.102s	user 0.013s	sys 0.021s
W20260709 13:14:49.141153 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 51030.8us
I20260709 13:14:49.101526 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:49.142279 32115 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:49.091866  3913 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:49.116937  4377 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:49.108871   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:49.016570  4498 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:49.141155 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:49.158129  3976 consensus_queue.cc:1059] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:49.160926  4109 consensus_queue.cc:260] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:49.092082  4288 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:49.163151 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:49.080175  4514 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.098088  4511 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:49.169008 32118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 3537) took 1182 ms. Trace:
I20260709 13:14:49.182657 32124 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:49.184222 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:49.217782 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:49.215155 32118 rpcz_store.cc:276] 0709 13:14:47.986727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:47.987857 (+  1130us) service_pool.cc:224] Handling call
0709 13:14:48.090036 (+102179us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:48.090411 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:48.090437 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:48.096276 (+  5839us) log.cc:844] Serialized 26 byte log entry
0709 13:14:48.199174 (+102898us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:48.199212 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:48.199285 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:49.074507 (+875222us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:14:49.098364 (+ 23857us) raft_consensus.cc:1685] finished
0709 13:14:49.098389 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:49.168817 (+ 70428us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54002c9cd0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff08ad 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:49.168945 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11600,"raft.queue_time_us":397,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":3183,"spinlock_wait_cycles":238605824,"thread_start_us":95767,"threads_started":1,"wal-append.queue_time_us":168284}
I20260709 13:14:49.185451 32090 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:49.188417 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:49.149474  4360 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:49.207695 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:49.216297 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:49.220538 32194 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:14:49.139672  4400 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:49.212061 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:49.140615  4480 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:49.209206 32264 raft_consensus.cc:1240] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:49.222054 32087 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:49.227000 32197 raft_consensus.cc:1275] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:14:49.224733 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:49.225028 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:49.228440 32195 raft_consensus.cc:2393] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 14: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:49.098162  4500 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:49.238649 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:49.112150  4490 consensus_queue.cc:1048] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
W20260709 13:14:49.232769 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 47455us
I20260709 13:14:49.242573 32090 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:49.233481 32089 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:14:49.243364   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 210237us
I20260709 13:14:49.287936 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:49.288980 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:49.289623 32193 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 18.
I20260709 13:14:49.290485 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:49.295655 32115 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 18.
I20260709 13:14:49.296500 32115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56890 (request call id 3558) took 1230 ms. Trace:
I20260709 13:14:49.297685 32115 rpcz_store.cc:276] 0709 13:14:48.065804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:49.101257 (+1035453us) service_pool.cc:224] Handling call
0709 13:14:49.296421 (+195164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:49.299120 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:49.300863 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:49.205963  4526 consensus_queue.cc:1048] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.134s
I20260709 13:14:49.303084 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:49.205291  4097 consensus_queue.cc:1059] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:14:49.192950  4353 consensus_queue.cc:1048] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:14:49.170042  4289 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:49.292474  4499 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:49.226747  4360 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:49.230729  4480 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:49.231719  4400 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:49.239205  4508 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:49.293494  4497 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:49.293159  4507 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:49.318874 32199 raft_consensus.cc:2393] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 6: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:49.245748  4521 raft_consensus.cc:2804] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:49.308876  4122 consensus_queue.cc:1048] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:14:49.321844 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:49.300526  4292 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:49.211450  4343 consensus_queue.cc:1048] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 13:14:49.386613  4122 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:49.387187  4122 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:49.292022  4516 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:14:49.222671  4514 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:49.385479 32118 raft_consensus.cc:2393] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 12: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:49.393311 32196 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:14:49.350997  4360 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:49.375281  4507 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:49.402089  4496 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:49.343304  4317 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:14:49.375499  4521 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
W20260709 13:14:49.411319   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 167200us
I20260709 13:14:49.419536 32199 raft_consensus.cc:1240] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:14:49.421953 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:49.381570  4235 raft_consensus.cc:3055] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:49.427635 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:49.431182 32118 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:49.351230  4528 consensus_queue.cc:1048] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.093s
W20260709 13:14:49.433854 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 264100us
I20260709 13:14:49.354054  4499 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:49.437299 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 219080us
I20260709 13:14:49.412889  4507 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:49.426367  4521 raft_consensus.cc:3060] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:49.429463  4235 raft_consensus.cc:740] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:49.449575 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:49.450239 32118 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 15.
I20260709 13:14:49.450248 32165 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:49.443823  4542 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:49.446023  4271 consensus_meta.cc:287] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.640s	user 0.011s	sys 0.002s
W20260709 13:14:49.516484 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 75404us
W20260709 13:14:49.515126 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 79074.8us
W20260709 13:14:49.516707 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 66642.3us
I20260709 13:14:49.519472 32165 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:49.522264 32238 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:49.524629 32115 raft_consensus.cc:2410] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:14:49.526073 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:49.526546 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:49.528066 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:14:49.538844  4518 log.cc:927] Time spent T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
I20260709 13:14:49.552210 32264 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:14:49.542248  4500 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:49.544469  4292 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:14:49.523900  4520 log.cc:927] Time spent T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.330s	user 0.001s	sys 0.000s
W20260709 13:14:49.521008  4519 log.cc:927] Time spent T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
I20260709 13:14:49.520802  4496 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:49.578792  4511 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:49.579068  4496 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:49.579435  4511 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:49.579650  4496 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:49.581791  4496 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:49.582312   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:49.583395  4528 consensus_queue.cc:1048] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:14:49.545410  4522 log.cc:927] Time spent T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.240s	user 0.001s	sys 0.001s
I20260709 13:14:49.450734  4513 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:49.547328  4499 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:49.612866  4499 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.613428  4499 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:14:49.615718  4499 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:49.612239  4500 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:49.617445  4500 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:49.556486  4410 consensus_meta.cc:287] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 1.294s	user 0.012s	sys 0.002s
I20260709 13:14:49.618698  4410 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:49.619791 32124 raft_consensus.cc:2368] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12.
W20260709 13:14:49.620047  4366 consensus_meta.cc:287] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.837s	user 0.000s	sys 0.009s
I20260709 13:14:49.620796  4410 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:49.622159  4289 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:49.626807 32124 raft_consensus.cc:1275] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:14:49.628682  4097 consensus_queue.cc:1048] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:49.523684  4545 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:49.523276  4542 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:49.629621  4545 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:49.548679  4122 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:49.513901  4423 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:49.634379   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:49.634351  4423 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:49.517730  4353 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:49.636966  4353 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:14:49.637868  4547 log.cc:927] Time spent T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:14:49.639407  4513 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:49.639955  4353 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:49.586738  4384 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:49.548342  4514 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:49.543282  4530 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.450559  4510 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:49.640348  4515 consensus_meta.cc:287] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.519s	user 0.005s	sys 0.002s
I20260709 13:14:49.653708   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:49.656916  4530 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:49.554220 32117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 3569) took 1294 ms. Trace:
I20260709 13:14:49.654188   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:49.658890  4513 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:49.657835 32117 rpcz_store.cc:276] 0709 13:14:48.259472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:48.423653 (+164181us) service_pool.cc:224] Handling call
0709 13:14:48.424442 (+   789us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:49.041529 (+617087us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b1800287c80. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59eb994bc 00007fb59bee748b 00007fb5a4d41ab9 00007fb59bf0369b 00007fb59bf0193f 00007fb59bf01455 00007fb59efe9060 00007fb59efe9bfb 00007fb59eff464b
0709 13:14:49.041687 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:49.041711 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:49.042302 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 13:14:49.243183 (+200881us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:49.243445 (+   262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:49.244235 (+   790us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:49.549569 (+305334us) raft_consensus.cc:1685] finished
0709 13:14:49.549598 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:49.554136 (+  4538us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":305053,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":6929,"spinlock_wait_cycles":3105536,"thread_start_us":404768,"threads_started":2,"wal-append.queue_time_us":378401}
I20260709 13:14:49.659116  4530 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:49.659801  4480 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:49.559594 32272 raft_consensus.cc:2393] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 11: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:49.521718  4498 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:49.571652  4288 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:49.565142  4235 consensus_queue.cc:260] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:49.662842  4288 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:49.575978  4109 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:14:49.576757 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 56311.1us
I20260709 13:14:49.611161  4403 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:14:49.603698  4538 log.cc:927] Time spent T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.078s	user 0.001s	sys 0.001s
I20260709 13:14:49.526144 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:14:49.603823  4535 log.cc:927] Time spent T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.148s	user 0.001s	sys 0.001s
I20260709 13:14:49.603494  4292 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:49.665087 32238 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:49.576082  4507 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:49.636034  4400 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:49.669878 32165 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:49.648537  4502 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:49.655339  4511 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:49.620050  4500 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:49.674436 32238 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:49.649755  4423 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:49.650118  4545 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:49.666147  4515 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:49.673538  4407 consensus_queue.cc:1059] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:14:49.679996  4407 raft_consensus.cc:3055] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:49.678118  4288 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:49.682091  4507 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:49.680356  4407 raft_consensus.cc:740] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:49.683617  4407 consensus_queue.cc:260] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:49.680352  4497 raft_consensus.cc:2749] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:49.684774   396 raft_consensus.cc:2368] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14.
I20260709 13:14:49.685065  4407 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:49.668962  4403 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:49.687104  4403 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:49.687526  4541 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:49.689478  4545 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:49.690136  4545 raft_consensus.cc:697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:49.675168  4539 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:49.691009  4539 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:49.691385 32238 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:49.691222  4545 consensus_queue.cc:237] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:49.692323  4122 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:49.692948  4122 raft_consensus.cc:697] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:49.693365  4539 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:49.693949  4122 consensus_queue.cc:237] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:49.695191   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:49.677367 32165 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:49.683903  4360 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:49.677513 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 93574.4us
I20260709 13:14:49.673777  4353 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:49.620496  4366 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:49.708765 32165 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:49.710791 32165 leader_election.cc:400] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12.
I20260709 13:14:49.711158 32165 leader_election.cc:403] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:14:49.717725  4403 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:49.718257  4403 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:49.718652  4403 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:49.719247  4292 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:49.719902  4292 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:49.720279  4292 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:49.723383 32165 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:49.724874  4288 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.725409  4288 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:49.726037  4511 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:49.726455  4511 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:49.726859  4511 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:49.727608  4288 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:49.734711 32266 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
W20260709 13:14:49.721484   369 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.30.63.3:36651 timed out after 1.610s (SENT) [suppressed 13 similar messages]
I20260709 13:14:49.743043 32190 raft_consensus.cc:1240] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 14. Current term is 15. Ops: []
W20260709 13:14:49.749217 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 44854.9us
I20260709 13:14:49.703474  4353 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:14:49.750735 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 44733.2us
I20260709 13:14:49.729679  4406 consensus_queue.cc:1048] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:14:49.728153  4288 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:49.736805  4423 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:49.729314  4292 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:49.736250  4498 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.757808 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:14:49.756002  4255 consensus_meta.cc:287] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.680s	user 0.007s	sys 0.004s
I20260709 13:14:49.753858  4353 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:49.737627  4500 consensus_queue.cc:1048] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:14:49.756263  4515 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:49.774895 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:49.759209  4288 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:49.795243  4360 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:49.762239  4498 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:49.797101  4542 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:49.798022  4498 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:49.820374   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 98915us
I20260709 13:14:49.769706  4255 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:49.800244  4521 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:49.810964  4480 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:49.823500 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 69063.3us
I20260709 13:14:49.819875  4400 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:49.829542 32239 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:14:49.855952 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 105331us
I20260709 13:14:49.867245 32238 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:49.884474 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 55009.2us
I20260709 13:14:49.885258 32239 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:49.831239  4366 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:49.838025  4521 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:49.833858  4255 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:49.845121  4288 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:49.886915  4500 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.898031  4403 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:49.907642  4403 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:49.908957  4490 raft_consensus.cc:3055] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:49.890955  4097 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:49.915638 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:49.915057 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:49.965037 32196 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:14:49.965574 32195 raft_consensus.cc:2393] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 6: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:49.915423 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:49.916046 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:49.966084 32192 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:49.888819  4514 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:49.915781 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:49.909585  4490 raft_consensus.cc:740] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:49.916275 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:49.967849 32191 raft_consensus.cc:2393] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 11: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:49.972251 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:49.979928 32271 raft_consensus.cc:2368] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 10. Current term is 11.
I20260709 13:14:49.978147 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:49.979071 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:49.976500 32268 raft_consensus.cc:1275] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:49.981866 32268 raft_consensus.cc:1275] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 8. (term mismatch)
I20260709 13:14:49.982187 32268 pending_rounds.cc:85] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06: Aborting all ops after (but not including) 7
I20260709 13:14:49.982508 32268 pending_rounds.cc:107] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06: Aborting uncommitted NO_OP operation due to leader change: 17.8
I20260709 13:14:49.982808 32268 raft_consensus.cc:2889] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:49.987452 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:49.989404 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:49.990722 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:49.993692 32268 raft_consensus.cc:2368] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 13. Current term is 14.
I20260709 13:14:49.915377 32266 raft_consensus.cc:1275] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:14:49.995491 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:49.999028 32266 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:14:49.912755  4271 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:50.011142 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:50.003674   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:50.008606  4384 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:49.976027  3913 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:50.016901  4384 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:50.017488  3913 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:50.019804   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:50.020655  4366 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:50.021505  4366 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:50.006922 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:50.026027 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:49.912353  4515 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:50.007738 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:49.909821  4097 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:50.004185 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 560602us
I20260709 13:14:50.050014 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:50.013403 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:50.007054 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:50.052656 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:50.000880 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:49.903158  4557 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:49.914484  4541 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:50.063915 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:50.065147 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:50.065856 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 49813.2us
I20260709 13:14:50.067391 32196 raft_consensus.cc:1240] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:50.068842 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:49.913564  4551 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:50.071242 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:50.058139 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:50.024259  4366 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:50.060140 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:49.955149  4500 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:50.069677 32194 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:50.008348  4289 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:50.077481 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:50.071347 32197 raft_consensus.cc:1275] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:50.019829  4384 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:50.078145 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:49.915477  4353 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:50.019928  3913 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:50.088198 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:50.056030  4097 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:50.093211 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:14:50.094348 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 44335.4us
I20260709 13:14:50.096778 32165 leader_election.cc:400] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 10. Current term is 11.
I20260709 13:14:50.027972  4424 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:50.101259 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:50.105065 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:50.170099 32271 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:50.100703 32124 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 13.
I20260709 13:14:50.135069 32192 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:50.072052  4541 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:50.130322 32190 raft_consensus.cc:1275] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:14:50.157682 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:50.177855 32123 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:50.071115  4514 raft_consensus.cc:697] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:14:50.156833 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 70535.2us
I20260709 13:14:50.084178  4499 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:14:50.026976  4271 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:50.160192 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:50.164376 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:50.128571 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:50.166466 32089 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:50.166862 32165 leader_election.cc:403] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:14:50.163069 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:50.099563  4497 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:50.160575 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:50.129917  4384 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:50.191183 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 94629.5us
I20260709 13:14:50.193007 32269 raft_consensus.cc:2393] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 11: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:50.157132  4573 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:50.100606  4366 consensus_queue.cc:1048] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:14:50.197319 32264 raft_consensus.cc:2393] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 14: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:50.197675 32165 leader_election.cc:400] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 13. Current term is 14.
I20260709 13:14:50.201716 32165 leader_election.cc:403] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:14:50.096484  4289 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:50.169064  4480 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:50.206238 32089 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:50.168883  4274 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:50.210840 32123 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 14.
I20260709 13:14:50.212836 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:50.077340  4557 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:50.219059 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:50.219985 32191 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:50.090880  4551 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:50.108024  4490 consensus_queue.cc:260] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:50.161089  4542 consensus_queue.cc:1048] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:14:50.181685  4424 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:50.200462  4554 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:50.242765 32271 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:50.291749 32264 raft_consensus.cc:1240] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:50.349826   400 raft_consensus.cc:1275] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:14:50.280633 32272 raft_consensus.cc:1275] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:14:50.359680 32089 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:14:50.362182 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 164495us
I20260709 13:14:50.391044 32165 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:50.291268  4508 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:50.282106  4574 log.cc:927] Time spent T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
W20260709 13:14:50.319921  4537 log.cc:927] Time spent T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.775s	user 0.000s	sys 0.002s
W20260709 13:14:50.281628  4568 log.cc:927] Time spent T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
W20260709 13:14:50.285056  4570 log.cc:927] Time spent T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 13:14:50.311506  4511 consensus_meta.cc:287] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.584s	user 0.005s	sys 0.004s
W20260709 13:14:50.314338  4423 consensus_meta.cc:287] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.555s	user 0.010s	sys 0.000s
W20260709 13:14:50.287386  4553 log.cc:927] Time spent T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.597s	user 0.004s	sys 0.000s
I20260709 13:14:50.307499  4514 consensus_queue.cc:237] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:14:50.206840   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 97919.6us
I20260709 13:14:50.390278  3913 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:50.317730  4235 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:50.416724 32089 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:50.395802 32165 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:50.311439  4396 raft_consensus.cc:3055] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:50.226987  4410 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:50.353753  4581 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:50.290820  4500 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:50.278916  4569 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:50.478506   369 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
W20260709 13:14:50.471913 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 76209.6us
I20260709 13:14:50.213560  4497 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:50.218111  4502 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:50.284745  4579 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 10. Current term is 11.
W20260709 13:14:50.493237 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:50.308382  4557 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:50.407824  4490 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:50.428512  4577 log.cc:927] Time spent T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:14:50.440266  4423 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12.
I20260709 13:14:50.233551  4274 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:50.428943   399 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 16 LEARNER]: Advancing to term 18
I20260709 13:14:50.227921  4480 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:50.440837  4290 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:50.450791  4511 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:50.489295  4502 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:50.450834  4499 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:50.440773  4353 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:50.457037  4521 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:50.206075  4384 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:50.457603  4343 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:14:50.487247  4461 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.007s	sys 0.017s
I20260709 13:14:50.457315  4386 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:50.472934  4396 raft_consensus.cc:740] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:50.428797  4507 consensus_queue.cc:1059] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:14:50.526620 32116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 3570) took 1588 ms. Trace:
I20260709 13:14:50.397586  4585 consensus_queue.cc:1048] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.105s
I20260709 13:14:50.495675 32117 raft_consensus.cc:1240] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:50.527844   394 raft_consensus.cc:2468] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 6.
I20260709 13:14:50.536288  4502 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:50.559314  4507 raft_consensus.cc:3055] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:14:50.559016  4572 consensus_queue.cc:1175] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6b3ed521ce8947db80c4b4828b355c06" responder_term: 12 status { last_received { term: 11 index: 8 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:14:50.559755 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:50.559937  4507 raft_consensus.cc:740] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:50.560563 32117 raft_consensus.cc:2393] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 11: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:50.560930  4507 consensus_queue.cc:260] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:50.561419 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:50.561856 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:50.562247 32117 raft_consensus.cc:2393] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 14: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:50.563032 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:50.562903  4396 consensus_queue.cc:260] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:50.564059  4396 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:50.212731  4573 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:50.565052  4424 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:50.566143  4573 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:50.568215  4274 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:50.535403  4292 consensus_meta.cc:287] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.772s	user 0.010s	sys 0.001s
I20260709 13:14:50.568835  4292 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:50.570827  4292 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:50.571583 32198 raft_consensus.cc:1240] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 15. Current term is 16. Ops: [13.7-15.8]
I20260709 13:14:50.545651  4343 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:50.573019  4343 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:50.391089  4554 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:50.497509  4271 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:50.498209  3913 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:50.576745  4554 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:50.397240  4508 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:50.544381 32115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56884 (request call id 2365) took 1321 ms. Trace:
I20260709 13:14:50.523975  4557 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:50.577590 32115 rpcz_store.cc:276] 0709 13:14:49.212930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:49.298799 (+ 85869us) service_pool.cc:224] Handling call
0709 13:14:50.533928 (+1235129us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b5400204c54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:50.534070 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":473585024}
I20260709 13:14:50.578859  4508 leader_election.cc:290] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:50.496229 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:50.579660 32119 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:50.553269 32194 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:50.556355 32118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 3574) took 1606 ms. Trace:
I20260709 13:14:50.582155 32118 rpcz_store.cc:276] 0709 13:14:48.949712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:49.514763 (+565051us) service_pool.cc:224] Handling call
0709 13:14:49.549224 (+ 34461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:49.914474 (+365250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:49.914503 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:49.914986 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:14:50.007888 (+ 92902us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:50.007971 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:50.008094 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:50.556073 (+547979us) raft_consensus.cc:1685] finished
0709 13:14:50.556094 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:50.556297 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":415545,"raft.queue_time_us":405549,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":92394,"threads_started":1,"wal-append.queue_time_us":161798}
I20260709 13:14:50.534940  4289 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:50.533484 32273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 2774) took 1019 ms. Trace:
I20260709 13:14:50.549237  4521 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:50.545780  4410 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:50.561331  4497 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:50.562126  4507 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:50.564031 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:50.576381  3913 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:50.528431  4532 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:50.480070  4581 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:50.559247  4583 log.cc:927] Time spent T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:14:50.488417  4569 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:50.553112 32116 rpcz_store.cc:276] 0709 13:14:48.940193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:48.941225 (+  1032us) service_pool.cc:224] Handling call
0709 13:14:48.941678 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:48.941996 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:48.942039 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:48.942645 (+   606us) log.cc:844] Serialized 26 byte log entry
0709 13:14:49.394021 (+451376us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:49.394186 (+   165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:49.404157 (+  9971us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:50.319617 (+915460us) spinlock_profiling.cc:243] Waited 4.83 ms on lock 0x7b24001965f8. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59bd8a9c4 00007fb59bd88acb 00007fb59bf43dc9 00007fb59bf43a55 00007fb59bf4309d 00007fb59eb7510e 00007fb59eb8c88c 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221
0709 13:14:50.520251 (+200634us) raft_consensus.cc:1685] finished
0709 13:14:50.520275 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:50.526551 (+  6276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11112320,"thread_start_us":419765,"threads_started":1,"wal-append.queue_time_us":489268}
W20260709 13:14:50.545951  4461 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.007s	sys 0.017s
I20260709 13:14:50.588840  4529 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:50.555658  4386 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:50.541131  4499 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.589356  4525 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:14:50.616026 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:50.616628 32191 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:14:50.619064 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:50.621922 32199 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:50.542779  4290 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:50.585006 32273 rpcz_store.cc:276] 0709 13:14:49.514595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:49.520840 (+  6245us) service_pool.cc:224] Handling call
0709 13:14:49.549596 (+ 28756us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:49.576854 (+ 27258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:49.576885 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:49.577386 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:14:49.674450 (+ 97064us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:49.674497 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:49.674585 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:50.286874 (+612289us) spinlock_profiling.cc:243] Waited 7.81 ms on lock 0x7b2400257b28. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59bd8a9c4 00007fb59bd88acb 00007fb59bf43dc9 00007fb59bf43a55 00007fb59bf4309d 00007fb59eb7510e 00007fb59eb8c88c 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221
0709 13:14:50.528777 (+241903us) raft_consensus.cc:1685] finished
0709 13:14:50.528806 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:50.533414 (+  4608us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22512,"raft.queue_time_us":28070,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":132,"spinlock_wait_cycles":17967488,"thread_start_us":96661,"threads_started":1,"wal-append.queue_time_us":112256}
I20260709 13:14:50.622069  4423 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:50.666009 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:50.666802 32192 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:14:50.669843 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:50.671084  4581 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:50.671440  4423 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:50.673727  4423 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:50.673940 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:50.674678 32192 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:50.675761 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:50.678144  4569 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:50.678695 32195 raft_consensus.cc:1240] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9. Ops: []
W20260709 13:14:50.679221 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:50.682130  3913 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:50.684899   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:50.685604 32089 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:50.687290 32116 raft_consensus.cc:1240] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:50.625044  4289 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:14:50.631680   396 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38164 (request call id 310) took 1753 ms (client timeout 2086 ms). Trace:
I20260709 13:14:50.665972  4377 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 13. Current term is 14.
I20260709 13:14:50.721797   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:50.722651   395 raft_consensus.cc:2468] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 6.
I20260709 13:14:50.722983  3976 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:50.723637  4528 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:50.668669  4532 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:14:50.721815   396 rpcz_store.cc:269] 0709 13:14:48.865497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:48.901422 (+ 35925us) service_pool.cc:224] Handling call
0709 13:14:49.108676 (+207254us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b58001e2498. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59beccb71 00007fb59becca22 00007fb5a4de5c09 00007fb5a3f3fee0 00007fb5a40090ab 00007fb5a4009131 00007fb5a3fb70a0 00007fb5a3fb6984 00007fb59d5316d4 00007fb59d531662
0709 13:14:50.585604 (+1476928us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b54005cc454. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:50.618767 (+ 33163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1199865600}
I20260709 13:14:50.706144  3913 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:50.723664  3976 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:50.671126  4290 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:50.726831  3913 raft_consensus.cc:697] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:50.724174  4528 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:50.618324  4410 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:51.007951 32089 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:50.746304 32236 leader_election.cc:400] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Vote denied by peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025) with higher term. Message: Invalid argument: T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14.
W20260709 13:14:51.009228 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 270482us
I20260709 13:14:50.664108  4499 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:50.740140 32162 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
W20260709 13:14:51.014773 32162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 274721us
I20260709 13:14:50.666145  4525 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:50.774098  4521 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:50.734257  4541 consensus_meta.cc:287] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.001s
W20260709 13:14:50.728348  4097 consensus_meta.cc:287] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.565s	user 0.009s	sys 0.001s
I20260709 13:14:51.023640 32089 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:50.727286  4496 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:50.735150  4480 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:50.760797  4532 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:50.921948  4497 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:50.921802  4508 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.044292 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:50.730397  4384 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:51.013484  4274 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:50.924186  4511 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:50.667943  4529 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:51.024099  4525 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:51.020942  4122 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.020444  3976 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:50.922425  4271 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.050009 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:51.069372 32272 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:14:51.018467  4586 raft_consensus.cc:2804] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:51.053427 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:51.063580 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:51.034655  4521 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:51.030277  4097 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:51.040376  4539 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.058413 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:51.037987  4591 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:50.727838  3913 consensus_queue.cc:237] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:50.744282  4289 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:51.029670  4541 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:51.063500   399 consensus_meta.cc:287] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6: Time spent flushing consensus metadata: real 0.535s	user 0.009s	sys 0.000s
I20260709 13:14:51.090301 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:51.061682  4122 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:51.055842  4274 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:51.097307 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:51.041699  4494 consensus_queue.cc:1048] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:14:51.116333 32165 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:51.087280 32268 raft_consensus.cc:2393] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 12: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:51.039706  4496 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:51.048703  4497 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:51.054699  4508 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:51.122426 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:51.334005 32199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2527) took 1420 ms. Trace:
I20260709 13:14:51.344224 32196 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:51.034533 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:51.175182 32265 raft_consensus.cc:2393] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 14: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
W20260709 13:14:51.347324 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 231070us
W20260709 13:14:51.343199 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 100583us
W20260709 13:14:51.353550 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:51.175161 32090 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:51.138545   369 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:14:51.356907   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 218440us
I20260709 13:14:51.359543 32087 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:51.344880 32199 rpcz_store.cc:276] 0709 13:14:49.913317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:49.916012 (+  2695us) service_pool.cc:224] Handling call
0709 13:14:51.333749 (+1417737us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b5400337054. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:51.333924 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1268774144}
W20260709 13:14:51.163148 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:51.177205 32191 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 8.
I20260709 13:14:51.072290  4586 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:51.077802  4343 consensus_meta.cc:287] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.504s	user 0.007s	sys 0.003s
W20260709 13:14:51.400363 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 225266us
I20260709 13:14:51.071923  4521 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:51.284231 32022 catalog_manager.cc:5697] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 5 to 7, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 7 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:51.407672 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:14:51.411440 32192 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.008s	sys 0.016s
W20260709 13:14:51.413852 32192 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.008s	sys 0.016s
I20260709 13:14:51.414980 32192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3594) took 1303 ms. Trace:
W20260709 13:14:51.115700  4527 log.cc:927] Time spent T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 1.708s	user 0.000s	sys 0.005s
I20260709 13:14:51.409711 32090 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:14:51.123102  4592 log.cc:927] Time spent T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 13:14:51.249218  4601 log.cc:927] Time spent T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
W20260709 13:14:51.216449  4593 log.cc:927] Time spent T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
W20260709 13:14:51.250057  4594 log.cc:927] Time spent T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:14:51.415727 32192 rpcz_store.cc:276] 0709 13:14:50.111614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.680174 (+568560us) service_pool.cc:224] Handling call
0709 13:14:50.680464 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:50.680677 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:14:50.686105 (+  5428us) log.cc:844] Serialized 14 byte log entry
0709 13:14:51.414520 (+728415us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:51.414588 (+    68us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:51.414652 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:51.414758 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:51.414912 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3044,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"thread_start_us":727999,"threads_started":1}
I20260709 13:14:51.252005   399 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEARNER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:14:51.118402  4551 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:51.124986  4555 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.342589  4410 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:51.434638 32264 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:14:51.174274   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:51.412563  4511 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:51.135819   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:51.342407  4529 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:51.438481 32119 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:14:51.341796  4289 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:51.418418 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:51.349642  4386 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:51.138700  4480 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:51.398607  4513 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.394907  4274 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:51.184252  4581 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:51.089519  4271 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:51.155560  4403 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:51.433972  4545 consensus_queue.cc:1048] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:14:51.407071  4582 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:14:51.470269 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 430792us
I20260709 13:14:51.284521  4353 consensus_queue.cc:1059] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.152s
I20260709 13:14:51.115900  3976 consensus_queue.cc:1059] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.316s
I20260709 13:14:51.422049  4521 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:51.413659  4572 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:14:51.412534  4586 raft_consensus.cc:3060] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:51.412058  4498 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:51.106235  4539 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:51.535959  4539 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:51.105911  4591 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:51.537351  4587 log.cc:927] Time spent T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.965s	user 0.010s	sys 0.015s
I20260709 13:14:51.488933   399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38164 (request call id 315) took 1140 ms. Trace:
I20260709 13:14:51.540642   399 rpcz_store.cc:276] 0709 13:14:50.346256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.348301 (+  2045us) service_pool.cc:224] Handling call
0709 13:14:50.382898 (+ 34597us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:51.465212 (+1082314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:51.486735 (+ 21523us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:51.541369  4496 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:51.542673  4508 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:51.543848   369 leader_election.cc:336] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Timed out: RequestConsensusVote RPC to 127.30.63.3:36651 timed out after 1.610s (SENT)
I20260709 13:14:51.545737 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:51.546164 32121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55358 (request call id 366) took 1461 ms. Trace:
I20260709 13:14:51.531302 32115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 3585) took 1031 ms. Trace:
W20260709 13:14:51.488379 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 134335us
I20260709 13:14:51.490262  4511 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:51.491259 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 131868us
I20260709 13:14:51.546546 32121 rpcz_store.cc:276] 0709 13:14:50.084666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.086875 (+  2209us) service_pool.cc:224] Handling call
0709 13:14:50.087189 (+   314us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:50.102493 (+ 15304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:50.102523 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:50.103067 (+   544us) log.cc:844] Serialized 52 byte log entry
0709 13:14:50.474975 (+371908us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:50.521685 (+ 46710us) log.cc:844] Serialized 14 byte log entry
0709 13:14:50.522003 (+   318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:50.522113 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:51.342286 (+820173us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b18000ab0a0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bf043f3 00007fb59bf067c1 00007fb59bf06779 00007fb59bf06709 00007fb59bf066d1 00007fb59bf059cd 000000000038f354 000000000038f199 00007fb59bee783a
0709 13:14:51.536755 (+194469us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:14:51.545953 (+  9198us) raft_consensus.cc:1685] finished
0709 13:14:51.545976 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:51.546105 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35496,"prepare.queue_time_us":45051,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":20202,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":42245,"spinlock_wait_cycles":57150720,"thread_start_us":282798,"threads_started":1,"wal-append.queue_time_us":381131}
I20260709 13:14:51.572642 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:14:51.493031 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 91194.2us
I20260709 13:14:51.423745  4343 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:51.288444  4528 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:51.498536 32193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2528) took 1585 ms. Trace:
I20260709 13:14:51.487754  4410 raft_consensus.cc:2804] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:51.497162  4529 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:51.496035  4290 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:51.519372 32197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3580) took 1453 ms. Trace:
I20260709 13:14:51.522787 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:51.521632 32120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55358 (request call id 357) took 3206 ms. Trace:
I20260709 13:14:51.481956  4555 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:51.507896  4581 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:51.528640  4207 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:51.529191  4271 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:51.529431  4598 log.cc:927] Time spent T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
W20260709 13:14:51.529572  4490 consensus_meta.cc:287] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 1.004s	user 0.011s	sys 0.000s
W20260709 13:14:51.530041  4600 log.cc:927] Time spent T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:14:51.530202  4122 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:51.498399  4480 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:51.530637  4596 log.cc:927] Time spent T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
W20260709 13:14:51.530777  4235 consensus_meta.cc:287] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 1.043s	user 0.012s	sys 0.000s
W20260709 13:14:51.531309  4599 log.cc:927] Time spent T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:14:51.532743  4498 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:51.534232 32119 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:14:51.538405  4591 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:51.513159  4541 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:51.512650  4097 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:51.553918 32115 rpcz_store.cc:276] 0709 13:14:50.499546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.578731 (+ 79185us) service_pool.cc:224] Handling call
0709 13:14:50.579145 (+   414us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:50.579644 (+   499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:50.579683 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:50.580963 (+  1280us) log.cc:844] Serialized 52 byte log entry
0709 13:14:50.856943 (+275980us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:50.857001 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:50.857112 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:51.531073 (+673961us) raft_consensus.cc:1685] finished
0709 13:14:51.531098 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:51.531240 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9938,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"thread_start_us":275462,"threads_started":1,"wal-append.queue_time_us":468512}
I20260709 13:14:51.561522 32022 catalog_manager.cc:5697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 14 to 16, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 16 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:14:51.502303  4513 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:51.506467  4386 consensus_queue.cc:1048] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:14:51.579226 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:51.508540  4403 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:14:51.589321 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 170451us
I20260709 13:14:51.678632 32090 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:51.579183 32193 rpcz_store.cc:276] 0709 13:14:49.913592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:49.916402 (+  2810us) service_pool.cc:224] Handling call
0709 13:14:49.916721 (+   319us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:49.960710 (+ 43989us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:49.960738 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:49.961273 (+   535us) log.cc:844] Serialized 52 byte log entry
0709 13:14:50.093391 (+132118us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:50.166156 (+ 72765us) log.cc:844] Serialized 14 byte log entry
0709 13:14:51.247488 (+1081332us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b18002ec420. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bee6e07 00007fb5a4d41ab9 00007fb59bf0369b 00007fb59bf0193f 00007fb59bf01455 00007fb59efe9060 00007fb59effb716 00007fb59f00c287 00007fb59f00c208
0709 13:14:51.476352 (+228864us) log.cc:844] Serialized 14 byte log entry
0709 13:14:51.491523 (+ 15171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:51.491656 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:51.498153 (+  6497us) raft_consensus.cc:1685] finished
0709 13:14:51.498184 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:51.498461 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11971,"prepare.queue_time_us":72497,"prepare.run_cpu_time_us":177,"prepare.run_wall_time_us":7513,"raft.queue_time_us":141686,"raft.run_cpu_time_us":379,"raft.run_wall_time_us":36332,"spinlock_wait_cycles":37076736,"thread_start_us":285086,"threads_started":2,"wal-append.queue_time_us":173884}
W20260709 13:14:51.590653 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:51.591748 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:51.681799 32195 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:14:51.601778 32197 rpcz_store.cc:276] 0709 13:14:50.065558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.162761 (+ 97203us) service_pool.cc:224] Handling call
0709 13:14:50.165446 (+  2685us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:50.216019 (+ 50573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:50.216050 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:50.396503 (+180453us) log.cc:844] Serialized 26 byte log entry
0709 13:14:50.618101 (+221598us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:50.618142 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:50.618208 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:51.519108 (+900900us) raft_consensus.cc:1685] finished
0709 13:14:51.519135 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:51.519303 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":118009,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":123,"thread_start_us":176624,"threads_started":2,"wal-append.queue_time_us":310010}
I20260709 13:14:51.615298 32117 raft_consensus.cc:1240] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:51.618378 32199 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:51.588038  4539 raft_consensus.cc:3055] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:51.618078 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:51.620172  3976 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.002s
W20260709 13:14:51.591770  4514 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.025s	user 0.009s	sys 0.023s
W20260709 13:14:51.619508 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 268370us
I20260709 13:14:51.588649  4572 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:51.692070 32239 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:51.622845  4271 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:51.623436  4602 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:51.624733 32089 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:51.641817  4497 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:51.588351  4508 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:51.616201  4290 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:51.649597 32194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3586) took 1577 ms. Trace:
I20260709 13:14:51.652688 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:51.602007 32120 rpcz_store.cc:276] 0709 13:14:48.310715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:48.571286 (+260571us) service_pool.cc:224] Handling call
0709 13:14:48.571858 (+   572us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:48.834636 (+262778us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:48.834667 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:48.850405 (+ 15738us) log.cc:844] Serialized 26 byte log entry
0709 13:14:49.089937 (+239532us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:49.089977 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:49.090052 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:51.115226 (+2025174us) spinlock_profiling.cc:243] Waited 4.89 ms on lock 0x7b2400196688. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59bd8a9c4 00007fb59bd88acb 00007fb59bf43dc9 00007fb59bf43a55 00007fb59bf4309d 00007fb59eb7510e 00007fb59eb8c88c 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221
0709 13:14:51.508342 (+393116us) raft_consensus.cc:1685] finished
0709 13:14:51.508374 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:51.516810 (+  8436us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":106626,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":14841,"spinlock_wait_cycles":11241344,"thread_start_us":349156,"threads_started":2,"wal-append.queue_time_us":413395}
W20260709 13:14:51.690714  4514 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.124s	user 0.009s	sys 0.025s
I20260709 13:14:51.667748  4573 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.697134  4572 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:51.687711 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:14:51.674883  4502 consensus_meta.cc:287] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 1.112s	user 0.010s	sys 0.002s
I20260709 13:14:51.651692  4498 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:51.690809  4541 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
W20260709 13:14:51.688565   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 204562us
I20260709 13:14:51.648242  4480 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:51.709913  4122 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:51.691444 32238 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:51.645064  4490 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:51.667258 32271 raft_consensus.cc:1275] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:51.706126 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:51.710148 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:51.646538 32118 raft_consensus.cc:1275] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:14:51.711972 32115 raft_consensus.cc:2368] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 13. Current term is 14.
I20260709 13:14:51.689009  4529 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:14:51.692926  4609 log.cc:927] Time spent T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:14:51.686209  4539 raft_consensus.cc:740] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:51.708302 32194 rpcz_store.cc:276] 0709 13:14:50.072052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.582767 (+510715us) service_pool.cc:224] Handling call
0709 13:14:50.583182 (+   415us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:50.583622 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:50.583647 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:50.584279 (+   632us) log.cc:844] Serialized 52 byte log entry
0709 13:14:51.005094 (+420815us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:51.005142 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:51.005210 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:51.649376 (+644166us) raft_consensus.cc:1685] finished
0709 13:14:51.649395 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:51.649538 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":250615,"threads_started":1,"wal-append.queue_time_us":632064}
I20260709 13:14:51.723371 32121 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:14:51.712261 32239 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:51.711211  4573 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:51.644534  4581 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:14:51.736792 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 45439.5us
I20260709 13:14:51.725674  4497 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:51.757364 32270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50584 (request call id 423) took 1845 ms (client timeout 1610 ms). Trace:
I20260709 13:14:51.757652  4497 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:51.757890 32270 rpcz_store.cc:269] 0709 13:14:49.911634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:49.915826 (+  4192us) service_pool.cc:224] Handling call
0709 13:14:51.757129 (+1841303us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b54000f0d54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:51.757287 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4013854080}
I20260709 13:14:51.759724 32198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56926 (request call id 536) took 1134 ms. Trace:
I20260709 13:14:51.760372 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:51.760133 32198 rpcz_store.cc:276] 0709 13:14:50.628296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.177747 (+549451us) service_pool.cc:224] Handling call
0709 13:14:51.217063 (+ 39316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:51.645615 (+428552us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:51.645643 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:51.645681 (+    38us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:14:51.645709 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:51.759489 (+113780us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b54001d42d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:51.759534 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:51.759645 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":985090944}
I20260709 13:14:51.761427 32116 raft_consensus.cc:2393] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 11: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:51.705838  3913 consensus_queue.cc:1059] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:14:51.762337 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:51.735594  4461 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.763067  3913 raft_consensus.cc:3055] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:51.763476  3913 raft_consensus.cc:740] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:51.756737 32238 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:51.763499  4461 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:51.765439 32238 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:51.743997  4521 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:51.731600  4494 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:51.767185 32238 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:51.767616  4494 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:51.768052  4494 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:51.768937 32238 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:51.769652  4353 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:51.770923  4511 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:51.772046  4555 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:51.734311  4122 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:51.714047  4602 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:51.772825  4122 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:51.769647  4343 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:51.774652  4602 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:51.707652  4271 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:51.775105   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:51.745682 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:51.776943   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:51.777518  4271 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:51.746368 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:51.778769 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:51.779294 32115 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:51.746891  4539 consensus_queue.cc:260] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:51.723812  4508 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:51.739409  4097 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:51.748773  4109 raft_consensus.cc:3055] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:51.734452  4541 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:51.749922 32196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56926 (request call id 537) took 1093 ms. Trace:
W20260709 13:14:51.768088  4507 consensus_meta.cc:287] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 1.140s	user 0.004s	sys 0.007s
I20260709 13:14:51.751295  4490 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:51.754954  4403 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:51.803524 32119 raft_consensus.cc:2410] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:14:51.755034  4529 raft_consensus.cc:697] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:51.765578  4569 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:51.777416 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:51.799968 32087 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:51.745951 32123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 3596) took 1086 ms. Trace:
I20260709 13:14:51.744138 32124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 3584) took 1244 ms. Trace:
I20260709 13:14:51.809557 32115 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
I20260709 13:14:51.797309  4545 raft_consensus.cc:2749] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:14:51.760047  4525 consensus_meta.cc:287] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6: Time spent flushing consensus metadata: real 0.672s	user 0.007s	sys 0.000s
I20260709 13:14:51.731154  4614 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.767982  4605 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:51.750716  4613 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:51.796975   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:51.836772  4494 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:51.838107 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:51.838749 32119 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
I20260709 13:14:51.798516 32238 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:51.839241  4494 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:51.799031 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 174352us
I20260709 13:14:51.796748 32196 rpcz_store.cc:276] 0709 13:14:50.658564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.395206 (+736642us) service_pool.cc:224] Handling call
0709 13:14:51.395646 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:51.699000 (+303354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:51.699038 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:51.699080 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:51.699110 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:51.749671 (+ 50561us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b54002116d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:51.749730 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:51.749861 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":697006336}
I20260709 13:14:51.839612 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:51.726205  4502 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:51.739145  4410 raft_consensus.cc:697] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 6 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:51.805860 32117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 3593) took 1253 ms. Trace:
I20260709 13:14:51.733152  4207 raft_consensus.cc:697] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 14 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:51.840507 32119 raft_consensus.cc:2393] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 12: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:51.858531  4207 consensus_queue.cc:237] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:51.859333 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:51.861122 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:51.810695 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:51.910808 32119 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:14:51.911556 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:51.913080 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:51.807540 32123 rpcz_store.cc:276] 0709 13:14:50.659432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.685649 (+ 26217us) service_pool.cc:224] Handling call
0709 13:14:50.685922 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:51.030277 (+344355us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:14:51.042501 (+ 12224us) log.cc:844] Serialized 14 byte log entry
0709 13:14:51.283824 (+241323us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b1800131d40. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bee6e07 00007fb5a4d41ab9 00007fb59bf0369b 00007fb59bf0193f 00007fb59bf03c02 00007fb59eb8b20b 00007fb59eb90d23 00007fb59eb9123a 00007fb59effba2a
0709 13:14:51.514977 (+231153us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:51.515025 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:51.515074 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:51.745711 (+230637us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b5400205654. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:51.745770 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:51.745894 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49171,"prepare.queue_time_us":12022,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":2703,"raft.queue_time_us":17863,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":3176,"spinlock_wait_cycles":795983872,"thread_start_us":213009,"threads_started":1,"wal-append.queue_time_us":519124}
I20260709 13:14:51.812615 32122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55358 (request call id 367) took 1727 ms. Trace:
I20260709 13:14:51.813638 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:51.809105 32124 rpcz_store.cc:276] 0709 13:14:50.499288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.568400 (+ 69112us) service_pool.cc:224] Handling call
0709 13:14:50.577436 (+  9036us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:50.625373 (+ 47937us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:50.625459 (+    86us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:50.628077 (+  2618us) log.cc:844] Serialized 52 byte log entry
0709 13:14:51.048265 (+420188us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:51.048304 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:51.743697 (+695393us) spinlock_profiling.cc:243] Waited 41.9 ms on lock 0x7b5400097ed4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:51.743752 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:51.743805 (+    53us) raft_consensus.cc:1685] finished
0709 13:14:51.743822 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:51.744070 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8292,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":28666,"spinlock_wait_cycles":96401280,"thread_start_us":378012,"threads_started":1,"wal-append.queue_time_us":582284}
I20260709 13:14:51.763039 32116 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
I20260709 13:14:51.810599  4507 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:51.820931  4508 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:51.796312  4109 raft_consensus.cc:740] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:51.920290 32271 raft_consensus.cc:1275] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:14:51.920763  4109 consensus_queue.cc:260] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:51.922099  4109 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:51.923743 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:51.827996 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 255979us
I20260709 13:14:51.848766 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:14:51.844164  4617 log.cc:927] Time spent T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:14:51.841703  4502 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:51.863337  4410 consensus_queue.cc:237] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:51.850555  4497 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:51.845875 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:14:51.939379   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 238225us
I20260709 13:14:51.939941 32121 raft_consensus.cc:2393] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 14: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:51.866523 32117 rpcz_store.cc:276] 0709 13:14:50.552616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.627057 (+ 74441us) service_pool.cc:224] Handling call
0709 13:14:50.627423 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:51.686454 (+1059031us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:51.805596 (+119142us) spinlock_profiling.cc:243] Waited 986 ms on lock 0x7b54003f43d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:51.805789 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2267395968}
I20260709 13:14:51.940742 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:51.808292 32087 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
W20260709 13:14:51.873390 32191 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2539) took 1260 ms (client timeout 1606 ms). Trace:
I20260709 13:14:51.764300  3913 consensus_queue.cc:260] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:51.874782 32265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36080 (request call id 2358) took 1869 ms. Trace:
W20260709 13:14:51.875324 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 76868.1us
I20260709 13:14:51.885108  4529 consensus_queue.cc:237] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:51.831297   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:51.888990  4403 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.891537  4541 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:51.894320  4573 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:51.831700  4525 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:51.895191  4290 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:51.805258  4235 consensus_queue.cc:1059] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 13:14:51.896771  4499 consensus_meta.cc:287] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.875s	user 0.006s	sys 0.006s
I20260709 13:14:51.978732  4499 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:51.981412  4499 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:51.896924  4490 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:51.897359  4461 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:51.826107  4539 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:51.986622 32190 raft_consensus.cc:1240] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:51.799849  4586 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:51.988955 32190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2536) took 1506 ms. Trace:
I20260709 13:14:51.990882  4586 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:51.901966  4521 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:51.873755  4122 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:51.905823   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:51.993950  4122 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:51.911675 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:51.994938 32119 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 18.
I20260709 13:14:51.995424 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:51.995967 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:51.872350  4569 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:51.819157   400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38176 (request call id 180) took 1200 ms. Trace:
I20260709 13:14:51.996766  4569 raft_consensus.cc:697] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:51.996723   400 rpcz_store.cc:276] 0709 13:14:50.619168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.619286 (+   118us) service_pool.cc:224] Handling call
0709 13:14:50.658728 (+ 39442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:50.692667 (+ 33939us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:50.692696 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:51.565787 (+873091us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b2c000f6648. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59d8eaa11 00007fb59d8fa372 00007fb59f02ca01 00007fb59eff143a 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2
0709 13:14:51.587932 (+ 22145us) log.cc:844] Serialized 26 byte log entry
0709 13:14:51.727457 (+139525us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:51.727482 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:51.727528 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:51.818852 (+ 91324us) raft_consensus.cc:1685] finished
0709 13:14:51.818874 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:51.819092 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38919,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":20877,"spinlock_wait_cycles":4273024,"thread_start_us":72695,"threads_started":1,"wal-append.queue_time_us":214641}
I20260709 13:14:51.997735  4569 consensus_queue.cc:237] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:51.989373 32190 rpcz_store.cc:276] 0709 13:14:50.482127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.692916 (+210789us) service_pool.cc:224] Handling call
0709 13:14:51.011897 (+318981us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:51.987191 (+975294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:51.988614 (+  1423us) spinlock_profiling.cc:243] Waited 974 ms on lock 0x7b54000b3454. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:51.988869 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2241082112}
I20260709 13:14:51.916476 32120 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
I20260709 13:14:52.001214 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:52.002292 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:52.003268 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:52.003981   394 raft_consensus.cc:1240] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:52.004101  3913 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:52.005267   394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38176 (request call id 179) took 1390 ms. Trace:
I20260709 13:14:52.005625   394 rpcz_store.cc:276] 0709 13:14:50.615320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.617623 (+  2303us) service_pool.cc:224] Handling call
0709 13:14:50.669792 (+ 52169us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:52.004447 (+1334655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:52.005035 (+   588us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400728154. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:52.005214 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3067840256}
I20260709 13:14:52.007664 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:51.955518  4545 consensus_queue.cc:1059] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:14:52.009436  4290 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:52.009851  4545 raft_consensus.cc:3055] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:52.010006  4290 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:52.011114  4235 raft_consensus.cc:3055] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:14:52.011559  4235 raft_consensus.cc:740] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:51.931984 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:52.012894 32116 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:14:52.012462  4235 consensus_queue.cc:260] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:52.013516  4513 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:52.013840 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:52.013975  4235 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:52.014447 32116 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:14:52.014707  4572 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:52.015333 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:51.933535 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:52.017091   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:52.017458 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:52.017678   395 raft_consensus.cc:3060] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:52.018707 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:52.019294 32118 raft_consensus.cc:1813] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Handling vote request from an unknown peer 113b5461952d47e0944d463ea4e32801
I20260709 13:14:52.019835 32118 raft_consensus.cc:2393] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 14: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:14:51.914443 32122 rpcz_store.cc:276] 0709 13:14:50.084992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.087538 (+  2546us) service_pool.cc:224] Handling call
0709 13:14:50.087812 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:50.221487 (+133675us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:50.221533 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:50.280390 (+ 58857us) log.cc:844] Serialized 26 byte log entry
0709 13:14:51.542422 (+1262032us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b1800417040. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bee6e07 00007fb5a4d41ab9 00007fb59bf0369b 00007fb59bf0193f 00007fb59bf03c02 00007fb59eb8b20b 00007fb59eb90d23 00007fb59eb910d1 00007fb59efaca0f
0709 13:14:51.619178 (+ 76756us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:14:51.676466 (+ 57288us) log.cc:844] Serialized 14 byte log entry
0709 13:14:51.676744 (+   278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:51.812287 (+135543us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54002e2f54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:51.812342 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:51.812384 (+    42us) raft_consensus.cc:1685] finished
0709 13:14:51.812397 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:51.812531 (+   134us) inbound_call.cc:177] Queueing success response
0709 13:14:51.852470 (+ 39939us) spinlock_profiling.cc:243] Waited 8.28 ms on lock 0x7b1800417040. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bf043f3 00007fb59bf067c1 00007fb59bf06779 00007fb59bf06709 00007fb59bf066d1 00007fb59bf059cd 000000000038f354 000000000038f199 00007fb59bee783a
Metrics: {"prepare.queue_time_us":58564,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":2925,"raft.queue_time_us":1806,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":43733,"spinlock_wait_cycles":561655296,"thread_start_us":76579,"threads_started":1,"wal-append.queue_time_us":1412781}
I20260709 13:14:51.936913 32022 catalog_manager.cc:5697] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 7 to 9, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New cstate: current_term: 12 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:14:51.943614 32265 rpcz_store.cc:276] 0709 13:14:50.004981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.057839 (+ 52858us) service_pool.cc:224] Handling call
0709 13:14:51.874525 (+1816686us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54001586d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:51.874702 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2490914560}
W20260709 13:14:51.942934 32191 rpcz_store.cc:269] 0709 13:14:50.612691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.662925 (+ 50234us) service_pool.cc:224] Handling call
0709 13:14:51.873173 (+1210248us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b54001bb054. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:51.873316 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1165257088}
I20260709 13:14:51.946004 32115 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:14:51.947160 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:51.928154 32089 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:51.950711 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:51.955760 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:51.962714 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:51.963857 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:52.012301  4290 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:51.969866 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 161652us
I20260709 13:14:51.874498  4614 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:51.971155   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:51.975639 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:51.977912  4626 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:51.996217 32199 raft_consensus.cc:2393] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 11: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:51.917748  4274 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:52.010394  4545 raft_consensus.cc:740] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:51.931257 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:51.938450 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:52.016386 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:51.966316 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:14:51.948460 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 196896us
W20260709 13:14:52.265044 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 336948us
I20260709 13:14:52.039062 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:52.249099 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.266059 32197 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:14:52.208663  4461 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:52.266865  4461 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:52.249554 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.052179 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:52.268989  4461 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:52.037187 32022 catalog_manager.cc:5697] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 11 to 12, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 12 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:52.269940 32194 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 16.
I20260709 13:14:52.271031 32119 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:52.020675 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:52.273092 32120 raft_consensus.cc:2410] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:14:52.273471 32117 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:14:52.275599 32121 raft_consensus.cc:1240] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:52.265213 32123 raft_consensus.cc:2393] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 12: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:52.277586 32117 raft_consensus.cc:1275] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:52.284505 32239 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:52.039672 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 93050.5us
I20260709 13:14:52.285681 32117 raft_consensus.cc:1240] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:52.278510 32123 raft_consensus.cc:1240] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:52.274261 32120 raft_consensus.cc:1275] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
I20260709 13:14:52.280762 32119 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:14:52.008327 32270 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
I20260709 13:14:52.289557 32118 raft_consensus.cc:1275] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:52.040457 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.290098 32089 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:52.301170 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.264462 32124 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:52.085562 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:52.317533 32265 raft_consensus.cc:2410] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:14:52.040031 32268 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:14:52.319702 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:52.321964 32193 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:52.226539  4513 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:52.327993 32022 catalog_manager.cc:5697] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 16 to 18, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 18 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:52.329572 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:52.239566   395 raft_consensus.cc:2468] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 7.
W20260709 13:14:52.334851 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:52.278189  4614 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:52.338227 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:52.320363 32122 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:14:52.282060  4545 consensus_queue.cc:260] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:51.956508  4403 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:52.228950 32224 heartbeater.cc:646] Failed to heartbeat to 127.30.63.62:38793 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.30.63.62:38793 timed out after 15.000s (SENT)
I20260709 13:14:52.315680 32264 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:14:52.198925  4572 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:52.037366  4525 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:52.335840 32197 raft_consensus.cc:2410] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 19 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:14:52.337387  4274 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:52.319911 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:52.340371 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:52.375752 32190 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:52.341248 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:52.341954 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:52.037494  4581 consensus_queue.cc:1059] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.306s
I20260709 13:14:52.377585 32192 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:14:52.344488 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:52.299058  3913 raft_consensus.cc:2804] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:52.344508 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:14:52.379359   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 218456us
I20260709 13:14:52.378756 32195 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:52.380553 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.351709 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:14:52.352900 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 62883.8us
I20260709 13:14:52.396543 32265 raft_consensus.cc:2368] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 12. Current term is 13.
W20260709 13:14:52.354554 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 68298.2us
W20260709 13:14:52.353794 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 69358.9us
W20260709 13:14:52.356215 32021 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49550 (request call id 259) took 15451 ms (client timeout 15000 ms). Trace:
W20260709 13:14:52.330955   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 372709us
I20260709 13:14:52.356907  4097 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:52.361184  4545 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:52.399511 32239 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:52.364897   396 raft_consensus.cc:1240] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 14 LEADER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:52.367275  4343 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:52.374445 32193 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:14:52.397377 32124 raft_consensus.cc:2410] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:14:52.359261 32162 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:52.375131  4626 raft_consensus.cc:476] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Not starting pre-election -- already a leader
W20260709 13:14:52.417315 32162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 58161.7us
I20260709 13:14:52.419759 32190 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:14:52.410040 32089 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:52.420172 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:52.408268 32165 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:52.410555 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:52.401480 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.338284  4513 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:52.438482   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:52.439671   368 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:52.423055 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:52.423844 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:52.425345 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:52.445827 32119 raft_consensus.cc:2393] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 15: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:52.427040 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:52.447516  4502 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:52.448148 32089 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:52.448001  4502 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:52.428687 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:52.430410  4290 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:14:52.481251 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 64186.1us
I20260709 13:14:52.431175 32199 raft_consensus.cc:1240] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:52.431710 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:52.482681 32123 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:14:52.432168  4586 raft_consensus.cc:3055] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:52.432500  4480 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:52.433506 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:52.485921 32197 raft_consensus.cc:2393] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 15: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:52.433719 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.434552 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.435034  4625 consensus_queue.cc:1059] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:14:52.487124 32267 raft_consensus.cc:2393] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 15: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:52.435868 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:52.435324 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.441282 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:52.448772  4573 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:52.449324 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.500773 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.501144  4605 consensus_queue.cc:1048] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:52.502312 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.503038 32265 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:52.450013 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.508199 32266 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
I20260709 13:14:52.509161 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.450292  4626 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:52.450642 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:52.450699 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.515291 32196 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:52.451413 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:52.451719  4497 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:52.451423   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:52.454005 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:52.414651  4343 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:52.455734 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:52.522054 32118 raft_consensus.cc:2368] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 13. Current term is 14.
I20260709 13:14:52.470023  4581 raft_consensus.cc:2804] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:52.456681  4513 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:52.485409  4586 raft_consensus.cc:740] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:52.457350  4207 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:14:52.457789  4403 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:52.458501 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:52.422300 32165 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:52.483269 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:52.484249 32264 raft_consensus.cc:1275] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:52.435312 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:52.548816 32273 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:52.488854 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:52.490095 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:52.418862  4122 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:14:52.504666  4480 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:52.418294  4541 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:52.491124 32269 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
I20260709 13:14:52.507234 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:52.449792 32089 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:14:52.578843 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 129105us
I20260709 13:14:52.531142  4605 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
W20260709 13:14:52.551113  4410 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.019s	sys 0.032s
I20260709 13:14:52.511158 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:52.376214  4572 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:52.513103 32272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 2368) took 1423 ms. Trace:
I20260709 13:14:52.588071 32272 rpcz_store.cc:276] 0709 13:14:51.089859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.892283 (+802424us) service_pool.cc:224] Handling call
0709 13:14:51.892796 (+   513us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:51.893328 (+   532us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:51.893383 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:51.893970 (+   587us) log.cc:844] Serialized 26 byte log entry
0709 13:14:52.083024 (+189054us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:52.083123 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:52.083222 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:52.512840 (+429618us) raft_consensus.cc:1685] finished
0709 13:14:52.512865 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:52.513034 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14206,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":10811,"thread_start_us":188578,"threads_started":1,"wal-append.queue_time_us":616758}
I20260709 13:14:52.589932 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.514334 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.590480 32272 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:14:52.516358 32122 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:14:52.591357 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.591534 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:52.592960 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.596345 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.597137 32268 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:52.530354  4097 consensus_queue.cc:1059] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:14:52.519897 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:52.519954 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.518138 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.518607   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:52.695873 32273 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:14:52.528362 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:52.696957 32199 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:52.697043 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.698208 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.699129  4097 consensus_queue.cc:1243] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer 94085cf341634eb686a95983b6b7f7e6 log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:14:52.699700  4097 raft_consensus.cc:3055] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:52.700037  4097 raft_consensus.cc:740] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:52.529320  4497 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:52.700908  4097 consensus_queue.cc:260] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:52.702323  4097 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:52.428241 32191 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:14:52.534855 32195 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:52.481364  4290 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:52.537122 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:52.490248  4569 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
W20260709 13:14:52.518787  4289 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.016s	sys 0.026s
I20260709 13:14:52.513489  4573 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:52.421067  4274 consensus_queue.cc:1059] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.114s
I20260709 13:14:52.518584  4626 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:52.566519 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:52.555284 32117 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 15.
I20260709 13:14:52.566162 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:52.570490 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:52.738497 32124 raft_consensus.cc:2393] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 11: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:52.530652  4343 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:52.571491 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:52.729377  4289 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.016s	sys 0.026s
I20260709 13:14:52.581111 32089 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:14:52.765133 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 184095us
I20260709 13:14:52.766136 32089 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:52.510210 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.509794 32266 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:52.585392 32123 raft_consensus.cc:2376] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11. Re-sending same reply.
I20260709 13:14:52.584213 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:52.767864 32119 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:14:52.767974 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.587570 32197 raft_consensus.cc:1240] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:52.768602 32266 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 16.
I20260709 13:14:52.599794 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:52.600663 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:14:52.587025  4410 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.019s	sys 0.032s
I20260709 13:14:52.776428 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:52.778864 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:52.381721  3913 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:52.586555  4529 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:52.731257  4573 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:52.566112  4555 consensus_queue.cc:1059] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:14:52.592594  4605 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:52.630703 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.624045  4586 consensus_queue.cc:260] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:52.790825  4586 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:52.791283  4605 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:52.583220  4541 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:52.642823 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.653146 32196 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:52.704726 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.705428 32198 raft_consensus.cc:1240] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:52.630890  4499 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:52.706910 32270 raft_consensus.cc:1240] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:52.707887 32194 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:52.727842  4490 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:52.739534 32121 raft_consensus.cc:2393] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 14: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:52.578915 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:52.757160 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:52.399022 32021 rpcz_store.cc:269] 0709 13:14:36.904450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:36.909005 (+  4555us) service_pool.cc:224] Handling call
0709 13:14:52.355972 (+15446967us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:43.657108 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:43.773456 (+116348us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:43.773507 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:14:43.773528 (+    21us) tablet.cc:662] Decoding operations
0709 13:14:43.774517 (+   989us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:43.774587 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:43.774626 (+    39us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:14:43.775308 (+   682us) tablet.cc:701] Row locks acquired
0709 13:14:43.775329 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:14:43.775515 (+   186us) write_op.cc:270] Start()
0709 13:14:43.775652 (+   137us) write_op.cc:276] Timestamp: P: 1783602883775456 usec, L: 0
0709 13:14:43.775679 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:14:43.782122 (+  6443us) log.cc:844] Serialized 2442 byte log entry
0709 13:14:44.411583 (+629461us) op_driver.cc:464] REPLICATION: finished
0709 13:14:44.696678 (+285095us) write_op.cc:301] APPLY: starting
0709 13:14:44.727570 (+ 30892us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:45.985680 (+1258110us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:45.985904 (+   224us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:46.346949 (+361045us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:46.347324 (+   375us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:14:46.347388 (+    64us) write_op.cc:312] APPLY: finished
0709 13:14:46.347895 (+   507us) log.cc:844] Serialized 65 byte log entry
0709 13:14:46.501510 (+153615us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:46.590167 (+ 88657us) write_op.cc:454] Released schema lock
0709 13:14:46.609071 (+ 18904us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:46.756318 (+147247us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:46.756357 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":945,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":267737,"apply.run_cpu_time_us":52883,"apply.run_wall_time_us":1995975,"cfile_cache_hit":22,"cfile_cache_hit_bytes":23045,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6222,"cfile_init":2,"lbm_read_time_us":258018,"lbm_reads_1-10_ms":2,"lbm_reads_10-100_ms":10,"num_ops":6,"prepare.queue_time_us":542951,"prepare.run_cpu_time_us":4870,"prepare.run_wall_time_us":194952,"replication_time_us":626909,"thread_start_us":565468,"threads_started":3,"wal-append.queue_time_us":290304,"wal-append.run_cpu_time_us":1853,"wal-append.run_wall_time_us":1149100}]]}
I20260709 13:14:52.770694 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:52.730186  4290 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:52.592958  4403 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:52.781388  4529 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:52.816023 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.816968 32264 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:14:52.781370  3913 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:52.732646  4502 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:52.740254  4626 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:52.772840  4274 raft_consensus.cc:3055] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:52.806273  4541 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:52.819200  4499 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:52.737203  4569 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:52.811965  4490 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:52.811805  4403 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:52.823505  4529 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:52.854063 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:52.860903 32194 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:14:52.861999 32192 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:14:52.841275  4502 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:52.843678  4274 raft_consensus.cc:740] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:52.875351 32264 raft_consensus.cc:1275] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:14:52.847349  4550 raft_consensus.cc:3055] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:52.893365 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:52.895351 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 353321us
I20260709 13:14:52.858525  4403 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:14:52.898082 32116 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.005s	sys 0.017s
W20260709 13:14:52.900879 32116 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.005s	sys 0.018s
I20260709 13:14:52.901257 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:52.902468 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 480182us
I20260709 13:14:52.903383 32165 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:14:52.904812 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 382187us
W20260709 13:14:52.862844 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 339378us
I20260709 13:14:52.906872 32239 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:52.909852 32165 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:52.866948  4502 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:52.908026 32238 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:52.912653 32239 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:52.916661 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.917482 32270 raft_consensus.cc:2393] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 14: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
W20260709 13:14:52.923861 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 218706us
I20260709 13:14:52.890694  4550 raft_consensus.cc:740] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:52.934444 32194 raft_consensus.cc:1275] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:14:52.938329 32165 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:52.903018  4521 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:52.943822 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:52.950312  4569 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:52.923293  4502 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:52.951555  4550 consensus_queue.cc:260] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:52.957091  4274 consensus_queue.cc:260] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:52.958922  4274 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:52.967171 32165 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:52.979030 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.981984 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:52.914914  4545 consensus_queue.cc:1059] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:14:52.946849   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:53.011929 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:52.969146  4646 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:52.985702  4461 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:52.985292  4569 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:52.979380  4572 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:52.986487  4235 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:53.031621 32270 raft_consensus.cc:1275] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:14:53.038694 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 272655us
I20260709 13:14:53.039083 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:53.049496 32087 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:53.055362   395 raft_consensus.cc:1240] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:53.015882  4655 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:53.026957  4461 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:53.073601 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:53.077104 32090 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
W20260709 13:14:53.083529 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:53.063973 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:53.085136 32264 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
W20260709 13:14:53.086419 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 173870us
I20260709 13:14:53.057729  4614 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:53.058909  4235 raft_consensus.cc:697] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:53.063349  4655 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:53.029075  4646 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:53.100831 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 133778us
I20260709 13:14:53.071072  4569 raft_consensus.cc:3055] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:53.078600  4461 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:53.070331 32116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55358 (request call id 378) took 1071 ms. Trace:
I20260709 13:14:53.125043 32116 rpcz_store.cc:276] 0709 13:14:51.998508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:52.329202 (+330694us) service_pool.cc:224] Handling call
0709 13:14:52.346946 (+ 17744us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:52.348019 (+  1073us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:14:52.901418 (+553399us) log.cc:844] Serialized 14 byte log entry
0709 13:14:53.069833 (+168415us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:53.069911 (+    78us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:53.069983 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.070082 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:53.070249 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30957,"prepare.queue_time_us":566831,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"thread_start_us":673180,"threads_started":2}
I20260709 13:14:53.123411 32165 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:53.123499 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:53.105849 32239 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:53.136137 32238 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:14:53.121675  4658 log.cc:927] Time spent T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:14:53.102476  4490 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:53.121233  4499 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:53.103945  4653 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:53.122067   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:53.147873 32196 raft_consensus.cc:1275] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:14:53.124485  4569 raft_consensus.cc:740] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:53.125871  4572 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:53.156814  4572 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:14:53.158476  4290 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.159291  4572 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:53.159935  4572 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:14:53.150522 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 73567.2us
I20260709 13:14:53.160379  4669 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:53.173730  4669 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:53.174305  4669 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:53.156190  4646 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:53.177943 32272 raft_consensus.cc:1275] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:14:53.178352 32272 pending_rounds.cc:85] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06: Aborting all ops after (but not including) 9
I20260709 13:14:53.178588 32272 pending_rounds.cc:107] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:14:53.179096 32272 raft_consensus.cc:2889] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:53.178555  4569 consensus_queue.cc:260] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.180253  4569 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:53.124891  4614 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.127821  4659 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:14:53.134011  3913 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.156827  4541 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.162810  4626 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.168147  4650 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:53.183679   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:53.213286  4678 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.213577   395 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:53.213903  4678 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.164111  4274 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:53.215077  4514 raft_consensus.cc:1064] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:14:53.191205  4490 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:53.124781  4655 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:53.192147  4674 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:53.164929  4290 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:53.204633 32120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55358 (request call id 376) took 1207 ms. Trace:
W20260709 13:14:53.205719 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 67241us
I20260709 13:14:53.211095  3913 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:53.211683  4626 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:53.211436  4403 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.212764  4614 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:53.201399  4499 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:14:53.258459  4550 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:53.215031  4274 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:53.160439  4572 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.259109  4274 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:53.260691  4572 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:53.192791  4235 consensus_queue.cc:237] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.224191  4490 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.218549 32090 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:53.262804  4490 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:53.225193 32273 raft_consensus.cc:2393] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 16: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:53.204814  4289 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:53.235241 32087 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:53.235973  4513 consensus_queue.cc:1059] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:53.237159  4529 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.240000 32115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 2389) took 1586 ms. Trace:
I20260709 13:14:53.242390  4497 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:14:53.225615  4514 raft_consensus.cc:1068] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06: Unable to promote non-voter 94085cf341634eb686a95983b6b7f7e6: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:14:53.239270  4573 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.248853   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:53.219987  4654 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:53.252135  4605 raft_consensus.cc:3055] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:53.196962  4343 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.225926 32120 rpcz_store.cc:276] 0709 13:14:51.997275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:52.314927 (+317652us) service_pool.cc:224] Handling call
0709 13:14:52.349727 (+ 34800us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:52.350251 (+   524us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:14:52.792872 (+442621us) log.cc:844] Serialized 14 byte log entry
0709 13:14:53.203923 (+411051us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:53.204036 (+   113us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:14:53.204124 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.204256 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:53.204513 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54318,"prepare.queue_time_us":611060,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":4845,"raft.queue_time_us":5268,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":127,"thread_start_us":803655,"threads_started":2,"wal-append.queue_time_us":414870}
I20260709 13:14:53.240398  4669 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.256493  4678 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:53.263206 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 55981.5us
W20260709 13:14:53.264838 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 159057us
I20260709 13:14:53.267850 32115 rpcz_store.cc:276] 0709 13:14:51.654146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:52.265146 (+611000us) service_pool.cc:224] Handling call
0709 13:14:52.265541 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:52.342871 (+ 77330us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:14:52.728712 (+385841us) log.cc:844] Serialized 14 byte log entry
0709 13:14:53.017933 (+289221us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:53.018395 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:14:53.018526 (+   131us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:53.018560 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.239580 (+221020us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b5400204754. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:53.239633 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:53.239685 (+    52us) raft_consensus.cc:1685] finished
0709 13:14:53.239790 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:53.239941 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65394,"prepare.queue_time_us":522120,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":5883,"raft.queue_time_us":65755,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":15362,"spinlock_wait_cycles":9504512,"thread_start_us":583221,"threads_started":2,"wal-append.queue_time_us":381425}
I20260709 13:14:53.270988 32165 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:53.271520 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 135479us
I20260709 13:14:53.263340  4490 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:53.275465 32194 raft_consensus.cc:1240] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:53.283393 32165 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:53.282008 32090 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:53.273785  4572 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:53.286264 32165 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:53.287554  4586 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:53.289340  4674 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:53.289753  4480 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:53.289909  4678 raft_consensus.cc:2764] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:14:53.274012  4653 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:14:53.287379  4109 consensus_queue.cc:1059] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:53.278620  4605 raft_consensus.cc:740] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:53.291115  4109 raft_consensus.cc:3055] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:53.292014  4109 raft_consensus.cc:740] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:53.292639  4572 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:53.292491  4605 consensus_queue.cc:260] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.293387 32165 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:53.293574  4605 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:53.293135  4109 consensus_queue.cc:260] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.294204 32090 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:53.294734  4109 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:53.293130  4572 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:53.296555   365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:53.296866  4290 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:14:53.275957  4683 consensus_queue.cc:1048] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:14:53.299898  4541 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:53.301983  4678 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:53.285534  4685 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:53.286191 32239 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:53.306526 32090 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:53.308035 32090 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:53.309057 32090 leader_election.cc:304] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:53.310123 32165 leader_election.cc:400] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 13. Current term is 14.
I20260709 13:14:53.312493 32165 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:14:53.279633  4581 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.002s	sys 0.009s
I20260709 13:14:53.263917  4502 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.314379 32165 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:53.304776 32238 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:53.315963 32090 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:53.270145  4499 consensus_queue.cc:1048] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:14:53.317051 32090 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:53.318977  4652 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:53.318975  4650 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:53.319789  4652 raft_consensus.cc:697] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:53.319820  4650 raft_consensus.cc:697] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:53.320822 32115 raft_consensus.cc:1240] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:53.323273  4650 consensus_queue.cc:237] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.320849  4652 consensus_queue.cc:237] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.328478 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:53.329602 32165 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:53.330314 32238 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:53.330576 32165 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:53.284061   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:53.336297  4396 consensus_queue.cc:1048] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:53.337257  4290 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:53.337642  4573 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:53.332895 32165 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:53.338411  4655 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.339015 32165 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:53.339365  4403 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:53.332291  4670 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:53.340013  4403 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:53.334684  4683 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:53.335244 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:53.335757  4674 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:53.335649  4274 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.336212  4669 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:53.303222  4681 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.013s
W20260709 13:14:53.315701  4581 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.002s	sys 0.010s
W20260709 13:14:53.341197   365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:53.340425 32165 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:53.348114 32238 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:53.317557  3913 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:53.351258  4674 raft_consensus.cc:697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 11 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:53.354763  4581 raft_consensus.cc:697] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:53.361603  4502 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:53.361328  4581 consensus_queue.cc:237] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:53.351457 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:53.365758  4461 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.329216  4490 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:53.368008  4461 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:53.340649  4403 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:53.314132  4513 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:53.316776  4653 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:53.330091  4497 consensus_queue.cc:1059] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:14:53.315459  4626 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:53.276420  4684 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:14:53.354116 32090 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:53.317471  4685 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:53.334715 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:53.356787 32165 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:53.356032  4521 consensus_queue.cc:1048] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:14:53.359097  4343 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:53.366168 32117 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:53.348001  4683 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:53.408463  4529 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:53.381284  4653 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:53.406848  4685 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:53.399755  4681 consensus_queue.cc:1059] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:14:53.408545 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:53.377269 32191 raft_consensus.cc:1240] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:53.373629 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:53.315523  4480 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:53.424823  4480 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:53.425248  4480 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:53.379638  4403 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:53.426930  4403 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:53.384394 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:53.384920 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:53.408842  4683 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:53.390599  4627 consensus_queue.cc:1048] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:14:53.360050  4674 consensus_queue.cc:237] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.409721  4653 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:53.387652 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:53.388473 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:53.441861 32193 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:53.441988 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:53.355849  4669 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:14:53.449249 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:53.340364  4655 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:53.391757 32115 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:53.393270 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:53.329160  4410 consensus_queue.cc:1048] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:14:53.397096 32119 raft_consensus.cc:2393] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 13: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:53.452419 32272 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 14.
I20260709 13:14:53.432240 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:53.397003 32239 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:53.454053 32121 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:53.380709  4235 consensus_queue.cc:1048] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:14:53.373685  4499 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:14:53.445250 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 88526.5us
W20260709 13:14:53.400616 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 46584.1us
I20260709 13:14:53.466579 32165 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:53.467157 32090 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:53.413070  4685 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:14:53.458226 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 61304.9us
I20260709 13:14:53.409811  4274 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:53.476809 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:53.478124 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:53.479149 32272 raft_consensus.cc:2393] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 12: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:53.484117 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:53.486299 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:53.490465 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:14:53.497399 32165 connection.cc:256] RPC call timeout handler was delayed by -1.0175025589999223s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.197s for a response
I20260709 13:14:53.497550  4687 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.501466 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:53.553936 32267 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:53.502430 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:53.474248 32089 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:53.555135 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:53.556246 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 82111.2us
W20260709 13:14:53.556658 32165 connection.cc:256] RPC call timeout handler was delayed by -1.0049025589999019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19840000000000002s for a response
I20260709 13:14:53.557382 32089 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:53.511435 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:53.558493 32121 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:14:53.556067 32264 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
I20260709 13:14:53.511783  4410 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:53.513896 32239 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:53.414456  4681 raft_consensus.cc:3055] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:53.411564  4614 raft_consensus.cc:3055] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:53.510169 32090 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:53.413275  4490 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:53.538213 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:53.456923  4684 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:53.546893 32193 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:53.550231 32117 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:53.551730 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:53.559653 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:53.560505 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:53.470194  4669 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:53.518707  4290 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:53.563657 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:53.565157 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:53.565318 32089 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:14:53.581475 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 67679.9us
I20260709 13:14:53.583364 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:53.599236 32089 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:53.588874 32119 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
I20260709 13:14:53.599999 32239 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:53.595515 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 85442.8us
I20260709 13:14:53.589273 32121 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:53.604985 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:53.606758 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:53.608227 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:53.609454 32268 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:53.611052 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:53.612396 32239 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:53.613483 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:53.614703 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:53.621037 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:53.622002 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:53.622498 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:53.622757 32117 raft_consensus.cc:2393] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 15: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:53.622002 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:53.624380 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:53.570454  4670 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.625890 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:53.616154 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:53.628108  4502 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:53.566074  4410 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:53.582100  4614 raft_consensus.cc:740] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:53.626583 32268 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 16.
I20260709 13:14:53.632004 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:53.570905  4681 raft_consensus.cc:740] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:53.584435  4626 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:53.640985 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:53.654860 32268 raft_consensus.cc:1240] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:53.588414  4343 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:53.642347 32267 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 15.
I20260709 13:14:53.641034 32264 raft_consensus.cc:1240] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:14:53.657436 32090 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:53.643076 32239 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:53.587430  4650 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:53.644481 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:53.639278 32272 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:53.645306 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:53.666419 32269 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:53.567988  4687 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.600994  4513 raft_consensus.cc:3055] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:14:53.657414 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:53.657725 32121 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 19.
I20260709 13:14:53.647646  4410 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:53.679479 32121 raft_consensus.cc:1275] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:14:53.681277 32121 raft_consensus.cc:1240] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:53.622196  4682 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:53.663817 32090 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:53.609320  4521 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:53.640043  4514 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:53.622284  3913 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:53.670475   369 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:53.652009  4502 raft_consensus.cc:697] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:53.669276  4396 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:53.674573  4573 raft_consensus.cc:2804] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:53.647015  4670 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:53.674202  4513 raft_consensus.cc:740] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:53.679077  4343 raft_consensus.cc:697] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:53.695214  4627 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:53.708822 32090 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:14:53.735080  4693 log.cc:927] Time spent T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:14:53.739964  4681 consensus_queue.cc:260] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.740917  4513 consensus_queue.cc:260] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.760896  4513 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:53.762247  4670 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:53.746959  4572 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:53.719028  4573 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:53.748808  4502 consensus_queue.cc:237] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.694952  4514 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:14:53.765859 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 57134.2us
I20260709 13:14:53.754892  4343 consensus_queue.cc:237] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.707686  4657 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:14:53.765689 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 208131us
I20260709 13:14:53.701311  4403 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.768385 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:53.769424 32192 raft_consensus.cc:2393] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 14: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:53.766276  4573 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:53.771179 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:53.772679 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:53.775269 32269 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:53.775888 32122 raft_consensus.cc:1240] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 15. Current term is 16. Ops: [14.10-15.11]
I20260709 13:14:53.776482 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:53.777136 32122 raft_consensus.cc:1240] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 18. Current term is 19. Ops: [18.8-18.8]
I20260709 13:14:53.777621 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:53.778371 32197 raft_consensus.cc:2393] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 9: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:53.775058 32090 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:53.732357  3913 raft_consensus.cc:697] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 13 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:53.780964 32191 raft_consensus.cc:1240] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:53.781337 32124 raft_consensus.cc:1240] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:53.781756 32122 raft_consensus.cc:1240] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:14:53.788228 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:53.788326 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:53.789616 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:53.790334 32191 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 16.
I20260709 13:14:53.791185 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:53.792232 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:53.768695  4626 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:53.804207 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:53.789937 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:53.804677 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:53.805809 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:53.767803  4514 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:53.806732 32197 raft_consensus.cc:2393] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 11: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:53.807132 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:53.807710 32192 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:53.808909 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:53.809397 32192 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:53.814734 32197 raft_consensus.cc:1240] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:53.829241 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:53.833218 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:53.834316 32197 raft_consensus.cc:2393] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 15: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:53.804046  4657 raft_consensus.cc:2804] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:53.836205 32192 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:53.814139  4626 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:53.840149   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 149869us
I20260709 13:14:53.840727 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:53.792825  4678 consensus_queue.cc:1059] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:14:53.733064  4614 consensus_queue.cc:260] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:53.854192  4614 raft_consensus.cc:3060] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:53.857714 32116 raft_consensus.cc:1275] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:14:53.858965  4480 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.859897 32117 raft_consensus.cc:1240] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
W20260709 13:14:53.861152 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:53.866742 32116 raft_consensus.cc:1240] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:53.850232 32165 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:53.851171  3913 consensus_queue.cc:237] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.837028  4657 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:53.839574  4490 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:53.842269  4626 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:53.886229 32090 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:14:53.879246  4692 log.cc:927] Time spent T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 13:14:53.895153  4683 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.898147  4678 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:53.910019  4683 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:53.908257  4682 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:14:53.915524  4696 log.cc:927] Time spent T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:14:53.878590  4396 raft_consensus.cc:697] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:53.879122  4521 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:53.910981  4550 consensus_queue.cc:1048] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:14:53.890762  4490 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:53.940275 32265 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:14:53.988811 32238 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:53.989349 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:53.969204 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 119048us
I20260709 13:14:53.879962  4657 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:53.997197 32165 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:53.943295  4653 consensus_meta.cc:287] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.505s	user 0.006s	sys 0.002s
I20260709 13:14:54.004849 32165 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:53.974848  4701 log.cc:927] Time spent T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.100s	user 0.002s	sys 0.000s
I20260709 13:14:54.004685   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:53.937320  4687 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:53.987176  4480 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:54.022528 32165 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:54.014835  4499 consensus_queue.cc:1048] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:14:53.937959  4403 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:54.023859   399 raft_consensus.cc:2393] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 14: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:14:54.023921 32165 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:54.024133  4403 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:54.024637  4499 raft_consensus.cc:2804] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:54.025064  4499 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:54.025491  4499 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:54.027539  4514 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:53.992420  4669 consensus_queue.cc:1059] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:14:54.017722  4290 consensus_queue.cc:1048] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:14:54.029239  4650 raft_consensus.cc:3055] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:53.943733   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:53.994434  4555 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:53.966812  4659 raft_consensus.cc:3055] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:53.970253  4490 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:54.034404 32165 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:54.048731 32165 leader_election.cc:400] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 12. Current term is 13.
I20260709 13:14:54.049026 32165 leader_election.cc:403] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:14:53.955314  4521 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:54.036837 32198 raft_consensus.cc:1240] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:53.936403  4685 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:54.015188   396 raft_consensus.cc:1240] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:14:54.039125  4654 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:14:54.044704   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
W20260709 13:14:54.046105 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:54.041292  4659 raft_consensus.cc:740] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:54.046717  4651 raft_consensus.cc:1064] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:14:54.035825 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:54.018175  4653 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:54.021406  4586 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:54.086462 32239 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:54.059254 32198 raft_consensus.cc:1240] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:54.042893  4572 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:54.032828  4650 raft_consensus.cc:740] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:54.013404  4683 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:14:54.037618  4403 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:54.054316  4555 raft_consensus.cc:697] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:54.036607  4274 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
W20260709 13:14:54.066439 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:54.066551 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:54.038559  4678 raft_consensus.cc:697] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
W20260709 13:14:54.049876 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:54.049515  4514 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:54.109721 32122 raft_consensus.cc:1275] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:54.050909  4289 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:14:54.090428  4671 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:54.091498 32238 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:54.091863  4461 consensus_queue.cc:1048] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:54.092149  4109 consensus_queue.cc:1059] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:54.054476  4687 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 12. Current term is 13.
I20260709 13:14:53.954919  4396 consensus_queue.cc:237] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:54.069953  4499 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:54.102739 32197 raft_consensus.cc:1240] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:54.113260 32123 raft_consensus.cc:1240] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:54.116410 32121 raft_consensus.cc:1240] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 16. Current term is 17. Ops: []
W20260709 13:14:54.135519 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 44287.4us
I20260709 13:14:54.118562 32122 raft_consensus.cc:1240] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:54.119359 32195 raft_consensus.cc:1275] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:14:54.086421  4605 consensus_queue.cc:1059] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
W20260709 13:14:54.087282  4651 raft_consensus.cc:1068] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06: Unable to promote non-voter 94085cf341634eb686a95983b6b7f7e6: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:14:54.086422  3913 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.121793  4274 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:54.145123  4274 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:54.120908 32116 raft_consensus.cc:1275] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:14:54.149963 32120 raft_consensus.cc:1240] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:54.125625 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:54.098623  4684 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:14:54.102726 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 212975us
I20260709 13:14:54.137959 32121 raft_consensus.cc:1240] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:54.155004  4109 consensus_queue.cc:1059] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:54.141479  4650 consensus_queue.cc:260] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:54.149334  4514 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:54.155671  4539 consensus_queue.cc:1059] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:54.155901  3913 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:54.163018  4682 raft_consensus.cc:3055] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:54.163108  4499 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:54.131318  4659 consensus_queue.cc:260] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:54.170019 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:54.183480 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 54737.9us
I20260709 13:14:54.171604 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:54.184724 32266 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:54.172320 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:54.169059 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:54.177904 32090 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:54.160228  4410 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:54.156364  4521 leader_election.cc:290] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:54.189993  3913 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:54.190723  4659 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:54.191913  4274 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:54.192539  4274 raft_consensus.cc:697] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 13 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
W20260709 13:14:54.193732  4698 log.cc:927] Time spent T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.455s	user 0.002s	sys 0.000s
I20260709 13:14:54.197726  4605 raft_consensus.cc:3055] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:54.198297  4605 raft_consensus.cc:740] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:54.199267  4605 consensus_queue.cc:260] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:54.200294  4605 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:54.200763  4514 raft_consensus.cc:3055] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:54.197839  4653 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:54.184391  4657 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:54.218305  4410 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:54.218976 32115 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
I20260709 13:14:54.220480 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:54.208349 32266 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17.
I20260709 13:14:54.231168 32090 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:54.221187 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:54.193639  4274 consensus_queue.cc:237] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:54.202207  4650 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:54.182123  4682 raft_consensus.cc:740] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:54.234405  4513 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:14:54.234225  4573 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:54.225898 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 177297us
I20260709 13:14:54.221683  4514 raft_consensus.cc:740] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:54.197855  4685 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:54.244228  4697 log.cc:927] Time spent T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.510s	user 0.003s	sys 0.000s
I20260709 13:14:54.246286 32165 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:54.227829  4717 raft_consensus.cc:3055] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:54.245405 32269 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
W20260709 13:14:54.279386  4699 log.cc:927] Time spent T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.540s	user 0.000s	sys 0.002s
I20260709 13:14:54.280288  4634 consensus_queue.cc:1059] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:14:54.288571  4573 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:54.293625 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:54.202034  4555 consensus_queue.cc:237] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:54.297552 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 51347.9us
I20260709 13:14:54.183046  4678 consensus_queue.cc:237] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:54.296196 32090 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:54.290442  4717 raft_consensus.cc:740] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:54.269822  4513 raft_consensus.cc:697] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:54.322309 32165 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:54.327332 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 189598us
I20260709 13:14:54.317715 32269 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:54.302608  4674 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:54.304847  4671 raft_consensus.cc:697] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 19 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:54.335168 32165 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:54.336826 32090 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:54.337095 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:54.338613 32268 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:54.342386 32165 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:54.328112  4573 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:54.323674  4685 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:54.343787  4653 raft_consensus.cc:2804] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:54.346393  4671 consensus_queue.cc:237] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 18.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:54.348839  4717 consensus_queue.cc:260] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:54.356029 32268 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:54.355244 32165 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:54.358214 32090 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:54.333197  4657 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:54.341753  3913 raft_consensus.cc:2804] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:54.362996 32165 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:54.355607  4653 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:54.353964  4720 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:54.355701  4499 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:54.392602  4653 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:54.395074 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:54.364609  4573 raft_consensus.cc:697] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:54.338304  4514 consensus_queue.cc:260] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:54.324214  4682 consensus_queue.cc:260] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:54.392211 32165 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:54.371574  4683 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:54.380319  4659 raft_consensus.cc:2804] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:14:54.438664 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 46516.5us
I20260709 13:14:54.442916 32165 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:54.364188  4685 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:54.381850  4709 consensus_queue.cc:1048] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:14:54.391498  4717 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:54.397174  4674 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:54.447746 32165 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:54.396095  3913 raft_consensus.cc:697] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:54.461357 32165 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:54.463151 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:54.444446  4499 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:54.458192  4724 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.450942  4720 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:54.436564  4683 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:54.454794  4659 raft_consensus.cc:697] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:54.471737 32165 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:54.462790  4403 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:54.392330  4626 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:54.485918 32165 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:54.468781  4514 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:54.416646  4513 consensus_queue.cc:237] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:54.468502  4674 raft_consensus.cc:697] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 13 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:54.473845  4586 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:54.490962  4290 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:54.491501  4573 consensus_queue.cc:237] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:54.493086  4730 log.cc:927] Time spent T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:14:54.478072  4724 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:54.482085  4683 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:54.510053 32089 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:54.529515 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:14:54.530074 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:54.530817 32089 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:54.531936 32089 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:14:54.489082  4725 log.cc:927] Time spent T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:14:54.526441  4274 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.535311 32270 raft_consensus.cc:1240] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:14:54.513227 32268 raft_consensus.cc:1275] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:54.535560  4274 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:54.538031  4274 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:54.517092 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:54.541741 32269 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:54.518287  4659 consensus_queue.cc:237] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:54.518682  3913 consensus_queue.cc:237] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:54.525583  4720 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:14:54.552531 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:54.553000 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:54.553369 32270 raft_consensus.cc:1240] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:14:54.554214 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:54.554967 32272 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:54.556352 32264 raft_consensus.cc:1240] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:14:54.557713 32266 raft_consensus.cc:2393] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 15: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:54.526947  4290 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:54.559566 32089 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:54.560711 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:54.561497 32089 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:54.561867 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:54.521991  4685 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:54.523442  4653 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:54.532554 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:54.533784 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:54.545557 32115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56884 (request call id 2431) took 1068 ms. Trace:
I20260709 13:14:54.577827 32115 rpcz_store.cc:276] 0709 13:14:53.476991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.538109 (+ 61118us) service_pool.cc:224] Handling call
0709 13:14:54.545396 (+1007287us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b54002c9cd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:54.545500 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1427237632}
I20260709 13:14:54.541977  4410 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:54.541579  4343 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:54.562501 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:54.565838 32087 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:54.570112  4274 consensus_queue.cc:1048] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:54.570616  4724 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:54.570726  4502 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:54.571337 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:54.546737 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:54.581147 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:54.549940  4605 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.569646  4550 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.579080  4720 raft_consensus.cc:697] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 15 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:54.589603 32269 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:14:54.594201 32115 raft_consensus.cc:1275] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:14:54.596436 32239 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:54.592461 32272 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:14:54.586396 32116 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 15.
I20260709 13:14:54.585098 32089 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:54.592540 32265 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:14:54.600080 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:54.601001 32090 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:54.602370 32271 raft_consensus.cc:1240] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:14:54.568560  4290 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:54.611860  4497 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:54.612371  4122 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:14:54.604496  4550 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:54.584411  4614 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:54.615483 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:14:54.622713 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:54.623068 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:54.625458 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:54.626334 32116 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:14:54.628299 32239 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:54.629217  4720 consensus_queue.cc:237] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:54.630228  4736 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.630784  4736 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:54.584367  4545 consensus_queue.cc:1059] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:14:54.629793  4681 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:54.583910  4712 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:54.632977  4736 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:54.615041  4410 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:54.637012  4410 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:54.637168 32165 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:54.637488  4410 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:54.638960 32165 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:54.602824  4572 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:54.652659 32193 raft_consensus.cc:1275] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:14:54.604677  4709 consensus_queue.cc:1059] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:14:54.602607  4684 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:54.653271 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:54.662292 32191 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:14:54.655282 32196 raft_consensus.cc:1275] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:54.663262 32165 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:54.645138 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:54.664345 32197 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 18.
I20260709 13:14:54.665153  4743 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:14:54.665956   368 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:54.667389  4634 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:54.667759  4634 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:54.668187 32165 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:54.668082  4634 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:54.670231  4743 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:54.670760  4743 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:54.671205  4743 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:54.689417  4653 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:54.690258  4653 consensus_queue.cc:1059] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:54.693502   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:54.682242  4743 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:54.695497  4743 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:54.696038  4743 raft_consensus.cc:3055] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:14:54.696394  4743 raft_consensus.cc:740] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
W20260709 13:14:54.697299 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 47316.7us
W20260709 13:14:54.711387  4691 log.cc:927] Time spent T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.976s	user 0.002s	sys 0.002s
I20260709 13:14:54.601783  4605 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:54.653342  4403 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:54.661734  4654 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:54.633622  4724 consensus_queue.cc:1048] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:14:54.697616   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:54.698227  4684 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:54.680943  4634 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:54.706951  4743 consensus_queue.cc:260] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:54.728477  4719 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.708096  4652 raft_consensus.cc:3055] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:14:54.623749  4721 consensus_queue.cc:1048] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 13:14:54.715185   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:54.712769  4669 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:14:54.732081 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 147046us
I20260709 13:14:54.615762  4674 consensus_queue.cc:237] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:54.760867 32089 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:54.732841  4719 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:54.759305  4669 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:54.777117  4669 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:54.767659  4290 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:54.768675  4626 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:54.721402  4410 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:54.789901 32089 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:54.794839  4710 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:54.799893  4710 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:54.800832  4550 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:14:54.801719  4744 log.cc:927] Time spent T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.064s	user 0.003s	sys 0.000s
I20260709 13:14:54.803081  4634 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:54.744395  4652 raft_consensus.cc:740] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:54.804625 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:54.807104 32190 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Advancing to term 20
W20260709 13:14:54.808399 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 81047.4us
I20260709 13:14:54.810134 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:54.811017 32122 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:54.813839 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:54.814616 32122 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:54.734166  4681 consensus_queue.cc:1048] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:14:54.816176 32264 raft_consensus.cc:1240] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 19 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 18. Current term is 19. Ops: []
W20260709 13:14:54.820981 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 93861.6us
I20260709 13:14:54.808944   395 raft_consensus.cc:2368] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 19. Current term is 20.
I20260709 13:14:54.822605 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:54.824559 32089 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:54.824939 32199 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 14.
I20260709 13:14:54.827474 32239 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:54.797372  4109 consensus_queue.cc:1048] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:14:54.813041   396 raft_consensus.cc:1275] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:14:54.832728 32239 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:54.830093 32089 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:54.839926  4626 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:54.842828 32089 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:14:54.847929 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 164073us
I20260709 13:14:54.849954  4748 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:54.850484  4748 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:54.850837  4748 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:54.851291  4745 consensus_queue.cc:1059] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:54.851557 32190 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 20.
I20260709 13:14:54.827538  4605 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:54.856606 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:54.873100 32089 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:54.856283 32165 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:54.874629 32165 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:54.836232  4671 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:54.834621  4739 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:14:54.883922 32089 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:54.886080 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:54.891999 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:54.893435 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:54.894093 32193 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:14:54.895470 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:54.896008 32193 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
I20260709 13:14:54.897399 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:54.898142 32193 raft_consensus.cc:2368] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10.
I20260709 13:14:54.925287 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:54.925992 32190 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:54.873740  4687 consensus_queue.cc:1059] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:14:54.836048  4569 consensus_queue.cc:1048] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:14:54.929067 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:54.930137 32193 raft_consensus.cc:2368] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12.
I20260709 13:14:54.931890 32199 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:14:54.883023  4659 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:54.937902 32199 raft_consensus.cc:1275] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:54.888621  4671 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:54.939383 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:54.883587  4745 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:54.946548 32198 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:54.939038 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:14:54.944594 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 56393us
I20260709 13:14:54.842301  4683 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:54.872210  4403 consensus_queue.cc:1059] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:14:54.949601 32268 raft_consensus.cc:1240] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:54.954638 32122 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:14:54.955746 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:54.955945 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:54.956007 32190 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:54.958063 32089 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:54.896677  4573 raft_consensus.cc:2749] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:14:54.969118 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:54.970594 32119 raft_consensus.cc:2393] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 19: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:54.966995 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:54.921932  4626 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:54.973084 32089 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:54.950382  4671 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:54.978938 32089 leader_election.cc:400] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10.
I20260709 13:14:54.980118 32089 leader_election.cc:400] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12.
W20260709 13:14:54.983844 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:54.967017  4720 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:14:54.882511  4652 consensus_queue.cc:260] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:54.977420  4659 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:54.966387  4681 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:54.981843  4710 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:54.991735  4756 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:54.993965  4290 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:54.996726  4573 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.995730  4659 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:54.988022  4657 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
W20260709 13:14:55.021401  4752 log.cc:927] Time spent T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:14:55.016726  4756 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:55.030102   368 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:55.030618  4756 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:55.031126   368 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:55.033063  4634 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:55.033779 32199 raft_consensus.cc:3055] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:55.034135 32199 raft_consensus.cc:740] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:55.034890  4550 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:14:55.035427  4550 raft_consensus.cc:697] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 20 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:54.994206  4626 consensus_queue.cc:1048] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:14:55.003551  4710 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:55.038692 32270 raft_consensus.cc:1275] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:55.039252 32272 raft_consensus.cc:1275] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:55.039587 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:55.015966 32165 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:55.046096 32273 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:55.042955 32267 raft_consensus.cc:1275] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:55.041770 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:55.049259 32269 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:55.033483  4634 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:55.002671  4681 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:55.019407  4659 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:55.011704  4403 consensus_queue.cc:1059] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:14:55.053149  4710 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:55.087002 32273 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
W20260709 13:14:55.061064 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 73224.5us
I20260709 13:14:55.083786 32269 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17.
I20260709 13:14:55.104668 32198 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17.
I20260709 13:14:55.019711  4684 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:55.110265 32090 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:14:55.111147   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 79196.2us
W20260709 13:14:55.105181 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 89288.7us
I20260709 13:14:55.117306 32165 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:55.117899 32090 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:55.065431  4634 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:55.120997  4745 raft_consensus.cc:697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 15 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:55.020530  4573 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:55.125830  4513 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:14:55.132629 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:55.061527  4657 consensus_queue.cc:1048] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:14:55.065272  4521 consensus_queue.cc:1048] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:14:55.122195  4739 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:55.097414  4502 consensus_queue.cc:1048] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:14:55.148871  4756 consensus_queue.cc:1059] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:14:55.159793 32165 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:55.161146 32165 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:55.150941  4499 consensus_meta.cc:287] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.678s	user 0.011s	sys 0.002s
I20260709 13:14:55.161957  4499 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:55.162689  4499 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:14:55.162833  4586 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:55.163400  4499 raft_consensus.cc:2804] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:55.163647  4586 raft_consensus.cc:697] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:55.163861  4499 raft_consensus.cc:697] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 12 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:55.108022  4550 consensus_queue.cc:237] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:55.166297 32165 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:55.141703  4683 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:55.173055  4681 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:55.126364  4669 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:55.152093  4513 raft_consensus.cc:697] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:55.139045  4758 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:55.164798  4586 consensus_queue.cc:237] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:55.143915  4747 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.222172  4745 consensus_queue.cc:237] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:55.229864  4684 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:55.199427  4654 consensus_queue.cc:1059] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:14:55.234673  4513 consensus_queue.cc:237] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:55.235589  4682 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:55.236652  4499 consensus_queue.cc:237] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:55.170048  4739 raft_consensus.cc:697] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:55.241743  4739 consensus_queue.cc:237] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:55.242660  4109 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:55.243425  4109 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:55.207845  4720 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:14:55.257545 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 91330us
W20260709 13:14:55.257892 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:55.260440  4109 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:55.262089 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:55.263849 32191 raft_consensus.cc:1275] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:55.264149  4683 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:55.264878  4683 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.265317  4683 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:55.267387  4683 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:55.269403 32271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 2843) took 1100 ms. Trace:
I20260709 13:14:55.269832 32271 rpcz_store.cc:276] 0709 13:14:54.169285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.169530 (+   245us) service_pool.cc:224] Handling call
0709 13:14:54.169849 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:54.602896 (+433047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.269136 (+666240us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b5400296654. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:55.269335 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":993986816}
I20260709 13:14:55.273458  4720 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:55.213570  4681 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:55.277858  4671 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:55.278141  4681 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:55.279476 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:55.280129  4671 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:55.280267 32122 raft_consensus.cc:2393] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 10: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:55.280838 32124 raft_consensus.cc:1275] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:14:55.281188 32124 pending_rounds.cc:85] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d: Aborting all ops after (but not including) 6
I20260709 13:14:55.281390 32124 pending_rounds.cc:107] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:14:55.281630 32124 raft_consensus.cc:2889] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:55.281963 32181 tablet_service.cc:1558] Processing DeleteTablet for tablet 64767c8d367b4cc1b7e2ffbcbf73ce29 with delete_type TABLET_DATA_TOMBSTONED (TS 113b5461952d47e0944d463ea4e32801 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:46032
W20260709 13:14:55.251703  4514 consensus_meta.cc:287] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.723s	user 0.005s	sys 0.007s
I20260709 13:14:55.292873 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:14:55.293138 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 156254us
I20260709 13:14:55.293357 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:55.293762 32124 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 19.
I20260709 13:14:55.294823 32117 raft_consensus.cc:1275] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:14:55.295269 32117 pending_rounds.cc:85] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d: Aborting all ops after (but not including) 7
I20260709 13:14:55.289996 32165 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:55.294869 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:55.295517 32117 pending_rounds.cc:107] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:14:55.283102 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:55.295800 32117 raft_consensus.cc:2889] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:55.300881  4657 consensus_queue.cc:1048] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:55.307682 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:55.314723 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:55.319110 32194 raft_consensus.cc:3055] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:14:55.319763 32194 raft_consensus.cc:740] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:55.321597 32121 raft_consensus.cc:2393] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 17: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:55.276376  4720 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:55.322317 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:55.323525 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:55.325590 32123 raft_consensus.cc:1275] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:14:55.327299 32191 raft_consensus.cc:1275] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:55.332120  4573 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:55.320506 32194 consensus_queue.cc:260] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:55.333807 32194 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:55.280144  4681 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:14:55.341044 32022 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59534 (request call id 123) took 12631 ms (client timeout 15000 ms). Trace:
I20260709 13:14:55.308512  4760 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:14:55.344389 32194 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:14:55.349138 32194 pending_rounds.cc:85] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 10
I20260709 13:14:55.349241 32121 raft_consensus.cc:1240] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 18. Current term is 19. Ops: [18.8-18.8]
I20260709 13:14:55.349485 32194 pending_rounds.cc:107] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:14:55.349936 32194 raft_consensus.cc:2889] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:55.311707  4683 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:14:55.257691  4748 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:55.252734  4747 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:55.461642 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:55.462459 32271 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:55.463541 32273 raft_consensus.cc:1275] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:14:55.464237 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:55.462478 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:55.464936 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:55.339668  4720 consensus_queue.cc:1048] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.127s
I20260709 13:14:55.466709  4289 consensus_queue.cc:1048] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:55.467026 32268 raft_consensus.cc:1240] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:55.467136 32267 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:14:55.352547 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:55.468650 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:55.468756 32194 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:14:55.469722 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:55.469050  4748 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:55.322060  4758 consensus_queue.cc:1048] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 13:14:55.473012 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:55.481884 32194 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:55.355120 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:55.473412 32271 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:55.484647 32124 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:55.361776 32192 raft_consensus.cc:1240] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 12 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:55.475345 32165 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:55.490484 32271 raft_consensus.cc:1240] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:55.495985 32194 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:55.498136 32165 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:55.410261  4669 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:55.542644 32270 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
W20260709 13:14:55.542856 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 44833.9us
I20260709 13:14:55.540546 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:55.351224  4764 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:55.545409 32165 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:55.545429 32194 raft_consensus.cc:2393] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 20: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:14:55.545554 32124 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 20.
W20260709 13:14:55.495023  4740 log.cc:927] Time spent T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:14:55.407598  4681 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.551025 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:55.552484 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:55.553138 32124 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:55.559583 32120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 3636) took 2182 ms. Trace:
I20260709 13:14:55.559986 32120 rpcz_store.cc:276] 0709 13:14:53.377204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.630363 (+253159us) service_pool.cc:224] Handling call
0709 13:14:53.630618 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:54.156766 (+526148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.559347 (+1402581us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b54003f43d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:55.559527 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1193827200}
I20260709 13:14:55.560570 32165 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:55.561378 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:14:55.570251 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 70761.5us
I20260709 13:14:55.574910 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:55.575199 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:55.461160  4499 consensus_queue.cc:1059] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
W20260709 13:14:55.341760 32022 rpcz_store.cc:269] 0709 13:14:42.734385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.742456 (+  8071us) service_pool.cc:224] Handling call
0709 13:14:55.335503 (+12593047us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:52.953543 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:52.954517 (+   974us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:52.954593 (+    76us) write_op.cc:435] Acquired schema lock
0709 13:14:52.954613 (+    20us) tablet.cc:662] Decoding operations
0709 13:14:52.956133 (+  1520us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:52.956238 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:52.956276 (+    38us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:14:52.959247 (+  2971us) tablet.cc:701] Row locks acquired
0709 13:14:52.959304 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:14:52.959514 (+   210us) write_op.cc:270] Start()
0709 13:14:52.959682 (+   168us) write_op.cc:276] Timestamp: P: 1783602892959431 usec, L: 0
0709 13:14:52.959710 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:14:53.026748 (+ 67038us) log.cc:844] Serialized 2781 byte log entry
0709 13:14:53.303414 (+276666us) op_driver.cc:464] REPLICATION: finished
0709 13:14:53.756870 (+453456us) write_op.cc:301] APPLY: starting
0709 13:14:53.756999 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:53.873927 (+116928us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:53.874023 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:54.097341 (+223318us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:54.134412 (+ 37071us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:14:54.138871 (+  4459us) write_op.cc:312] APPLY: finished
0709 13:14:54.183170 (+ 44299us) log.cc:844] Serialized 65 byte log entry
0709 13:14:54.208980 (+ 25810us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:54.224240 (+ 15260us) write_op.cc:454] Released schema lock
0709 13:14:54.229383 (+  5143us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:54.236071 (+  6688us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:54.236105 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4719754,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":453140,"apply.run_cpu_time_us":13977,"apply.run_wall_time_us":479193,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29267,"num_ops":6,"prepare.queue_time_us":521316,"prepare.run_cpu_time_us":20319,"prepare.run_wall_time_us":220049,"raft.queue_time_us":85376,"raft.run_cpu_time_us":108165,"raft.run_wall_time_us":318958,"replication_time_us":343520,"thread_start_us":785347,"threads_started":4,"wal-append.queue_time_us":166497,"wal-append.run_cpu_time_us":15042,"wal-append.run_wall_time_us":2004862}]]}
I20260709 13:14:55.575706 32120 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:55.575580 32116 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:55.549137  4289 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:55.549615  4720 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.597504 32124 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:55.600936 32124 raft_consensus.cc:1275] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:14:55.541963  4683 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:55.606994 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:55.578680  4770 log.cc:927] Time spent T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 13:14:55.629347  4513 consensus_queue.cc:1059] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:14:55.636094  4747 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:55.636787  4747 consensus_queue.cc:1048] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:55.640929  4720 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:55.641512  4290 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:55.642184  4290 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:55.643533  4720 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:55.644014  4710 consensus_meta.cc:287] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.518s	user 0.007s	sys 0.000s
I20260709 13:14:55.629611  4684 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:55.649227 32116 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:55.590278  4745 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:14:55.653321  4684 raft_consensus.cc:697] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
W20260709 13:14:55.646073  4634 consensus_meta.cc:287] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6: Time spent flushing consensus metadata: real 0.506s	user 0.005s	sys 0.003s
I20260709 13:14:55.559427  4681 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:55.577951  4614 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:14:55.644629  4290 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:55.626350  4687 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:14:55.679013 32266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36080 (request call id 2399) took 1150 ms (client timeout 1511 ms). Trace:
W20260709 13:14:55.680143 32266 rpcz_store.cc:269] 0709 13:14:54.529109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.529270 (+   161us) service_pool.cc:224] Handling call
0709 13:14:55.678663 (+1149393us) spinlock_profiling.cc:243] Waited 27.4 ms on lock 0x7b54002b66d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:55.678918 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63004544}
W20260709 13:14:55.662729  4773 log.cc:927] Time spent T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:14:55.557852  4764 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:55.656832  4684 consensus_queue.cc:237] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:55.658424  4739 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:55.644552  4710 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:55.699139  4207 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.689049  4687 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:55.711678  4207 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:55.714253  4207 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:55.716037  4703 raft_consensus.cc:3055] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:55.716553  4703 raft_consensus.cc:740] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:55.716920  4724 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.717478  4724 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:55.719676  4724 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:55.719959  4764 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:55.720728 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:55.721760  4681 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:55.715523 32238 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:55.722972  4743 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:55.725684  4764 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
W20260709 13:14:55.726120 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:55.726593 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:55.726504  4758 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:55.726331  4764 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:55.732064 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:55.733733 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:55.666095  4634 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:55.738628 32162 leader_election.cc:400] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025) with higher term. Message: Invalid argument: T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 19. Current term is 20.
I20260709 13:14:55.739657 32162 leader_election.cc:403] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:55.752725 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:55.755218 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:55.754914  4289 consensus_queue.cc:1059] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:14:55.759579 32193 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:14:55.727064  4758 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:55.731845  4502 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:55.759136  4289 raft_consensus.cc:3055] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:55.760566  4764 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:55.761996  4289 raft_consensus.cc:740] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:55.752633  4719 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:55.754827  4785 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:55.763181  4785 raft_consensus.cc:697] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:55.762876  4289 consensus_queue.cc:260] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:55.764101  4289 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:55.760928 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:55.765969 32238 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:55.766054 32193 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:14:55.702268  4739 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:55.771394 32238 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:55.735891  4745 consensus_queue.cc:1048] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:14:55.752911  4760 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025) with higher term. Message: Invalid argument: T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 19. Current term is 20.
I20260709 13:14:55.770434 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:55.779417  4207 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:55.805393 32120 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:14:55.811496  4634 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:55.774710  4720 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.777117  4687 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:55.764086  4785 consensus_queue.cc:237] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:55.838491  4555 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:55.840554 32087 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.30.63.4:40025 timed out after 1.710s (SENT) [suppressed 24 similar messages]
I20260709 13:14:55.770440  4502 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:55.811828  4207 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:55.837132  4748 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:14:55.953537 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 357821us
I20260709 13:14:56.008462 32239 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
W20260709 13:14:56.029418 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:55.894610  4758 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:56.030833  4122 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:55.835332  4720 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:56.005143  4781 tablet_replica.cc:333] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:14:56.004004  4748 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:56.037720  4122 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:56.046684  4783 log.cc:927] Time spent T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
W20260709 13:14:56.047838  4784 log.cc:927] Time spent T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.234s	user 0.000s	sys 0.000s
I20260709 13:14:56.050376  4761 raft_consensus.cc:3055] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:56.053345  4541 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:55.894019  4555 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:14:56.071364 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 500355us
I20260709 13:14:56.064719  4122 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:56.043476  4776 log.cc:927] Time spent T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.351s	user 0.001s	sys 0.001s
W20260709 13:14:56.037056  4682 consensus_meta.cc:287] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.801s	user 0.009s	sys 0.009s
I20260709 13:14:56.083209 32265 raft_consensus.cc:1275] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:14:56.066748  4748 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:56.086906 32266 raft_consensus.cc:1275] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:14:56.070405  4761 raft_consensus.cc:740] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:56.104331  4573 raft_consensus.cc:3055] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:56.105034  4573 raft_consensus.cc:740] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:56.105975  4573 consensus_queue.cc:260] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:56.106781  4502 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:56.107023  4573 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:56.109841  4659 consensus_meta.cc:287] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 1.002s	user 0.012s	sys 0.000s
I20260709 13:14:56.110523  4659 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:56.111896 32117 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 14.
I20260709 13:14:56.112197  4207 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:56.117913  4659 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:56.093204  3913 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:56.119639  3913 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:56.121803  3913 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:56.122658  4802 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:56.124506  4802 raft_consensus.cc:697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:14:56.123327 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 114949us
I20260709 13:14:56.118274  4555 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:56.129585  4781 raft_consensus.cc:2243] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.130676  4781 raft_consensus.cc:2272] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.137478 32239 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:56.074254  4541 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:56.147315 32198 raft_consensus.cc:1240] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 14. Current term is 15. Ops: []
W20260709 13:14:56.169064 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.139453  4739 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:56.173810 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 402528us
I20260709 13:14:56.125756  4802 consensus_queue.cc:237] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:56.170817 32195 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.009s	sys 0.027s
W20260709 13:14:56.178561 32195 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.010s	sys 0.027s
I20260709 13:14:56.178655 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:14:56.181995 32272 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.016s	sys 0.027s
W20260709 13:14:56.182363 32272 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.016s	sys 0.027s
I20260709 13:14:56.182480 32198 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:14:56.187371 32190 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.021s	sys 0.040s
W20260709 13:14:56.187726 32190 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.021s	sys 0.040s
I20260709 13:14:56.141706  4572 consensus_queue.cc:1048] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:14:56.141644  4555 consensus_queue.cc:1048] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:14:56.205618 32194 raft_consensus.cc:1240] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:56.167430  4396 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:56.172894  4669 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:56.214419  4653 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:56.207523  4683 consensus_meta.cc:287] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.005s
I20260709 13:14:56.176676  4410 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:56.168388  4502 consensus_queue.cc:1048] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:14:56.186935  4739 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:56.226295   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:56.205018  4755 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:56.229147   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:56.233755  4787 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:56.259897 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:56.261847 32117 raft_consensus.cc:2468] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 7.
I20260709 13:14:56.224957   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:56.263164  4709 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:56.227941  4683 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:56.215735  4396 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:56.266605   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:56.167430  4761 consensus_queue.cc:260] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:56.256177  4550 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.868s	user 0.017s	sys 0.015s
I20260709 13:14:56.223415  4653 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:56.278139 32198 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 15.
W20260709 13:14:56.557683 32087 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.000s	sys 0.018s
W20260709 13:14:56.591089 32087 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.000s	sys 0.019s
W20260709 13:14:56.591898 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 751274us
I20260709 13:14:56.598995 32236 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
W20260709 13:14:56.600900 32268 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.011s	sys 0.034s
W20260709 13:14:56.601504 32268 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.012s	sys 0.034s
I20260709 13:14:56.288498   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:56.561785 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:56.603145 32117 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:56.306730   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
W20260709 13:14:56.277120  4550 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.018s	sys 0.016s
I20260709 13:14:56.565346 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:56.609508 32119 raft_consensus.cc:2393] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 12: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:56.613581  4502 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:56.614797  4396 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:56.615896  4396 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:56.361574  4586 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.014s	sys 0.027s
I20260709 13:14:56.500638  4653 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:56.617493  4586 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.014s	sys 0.027s
W20260709 13:14:56.617430  4573 consensus_meta.cc:287] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.510s	user 0.009s	sys 0.012s
I20260709 13:14:56.584807 32194 raft_consensus.cc:1240] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:56.559540 32122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 3672) took 1009 ms. Trace:
I20260709 13:14:56.505116  4748 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:56.583849 32195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2608) took 1266 ms. Trace:
I20260709 13:14:56.265905  4709 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:56.343668  4541 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:56.619599 32195 rpcz_store.cc:276] 0709 13:14:55.317361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.317503 (+   142us) service_pool.cc:224] Handling call
0709 13:14:55.330291 (+ 12788us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:55.336972 (+  6681us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:55.337005 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:55.343749 (+  6744us) log.cc:844] Serialized 26 byte log entry
0709 13:14:56.179344 (+835595us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:56.179406 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:56.179506 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:56.583264 (+403758us) raft_consensus.cc:1685] finished
0709 13:14:56.583318 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:56.583654 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6257,"raft.queue_time_us":6771,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":8338,"thread_start_us":766333,"threads_started":1,"wal-append.queue_time_us":926649}
W20260709 13:14:56.434206  4719 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.003s	sys 0.025s
I20260709 13:14:56.622239  4748 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:56.277770  4720 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:56.623369  4748 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:56.582201 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.241286  4739 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:56.340845  4670 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:56.622320  4709 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:56.619202 32122 rpcz_store.cc:276] 0709 13:14:55.549526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.551202 (+  1676us) service_pool.cc:224] Handling call
0709 13:14:55.554515 (+  3313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:55.569447 (+ 14932us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:55.569478 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:55.584799 (+ 15321us) log.cc:844] Serialized 26 byte log entry
0709 13:14:56.150701 (+565902us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:56.150757 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:56.150850 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:56.558561 (+407711us) raft_consensus.cc:1685] finished
0709 13:14:56.558635 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:56.559178 (+   543us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14558,"raft.queue_time_us":15391,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":13029,"thread_start_us":496223,"threads_started":1,"wal-append.queue_time_us":722200}
I20260709 13:14:56.582084 32190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2606) took 1319 ms. Trace:
I20260709 13:14:56.625588  4670 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:56.627424  4739 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:56.626418 32190 rpcz_store.cc:276] 0709 13:14:55.262622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.288949 (+ 26327us) service_pool.cc:224] Handling call
0709 13:14:55.311281 (+ 22332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:55.311668 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:55.311709 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:55.337574 (+ 25865us) log.cc:844] Serialized 26 byte log entry
0709 13:14:56.188143 (+850569us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:56.188188 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:56.188259 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:56.581345 (+393086us) raft_consensus.cc:1685] finished
0709 13:14:56.581407 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:56.581789 (+   382us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":571,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":19059,"thread_start_us":774994,"threads_started":1,"wal-append.queue_time_us":961835}
W20260709 13:14:56.503314  4743 consensus_meta.cc:287] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.780s	user 0.011s	sys 0.002s
I20260709 13:14:56.275579  4727 consensus_queue.cc:1059] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.070s
I20260709 13:14:56.614804  4502 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:56.581812 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:56.630028 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.290534  4761 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:56.237603  4755 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:56.624414  4748 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:56.514544  4781 ts_tablet_manager.cc:1916] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:56.257045  4787 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:14:56.486378  4792 log.cc:927] Time spent T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:14:56.680127 32236 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:56.317718  4788 log.cc:927] Time spent T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:14:56.682952 32272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 2866) took 1192 ms. Trace:
I20260709 13:14:56.683712 32272 rpcz_store.cc:276] 0709 13:14:55.490208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.490333 (+   125us) service_pool.cc:224] Handling call
0709 13:14:55.490620 (+   287us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:55.541206 (+ 50586us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:55.541235 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:55.551589 (+ 10354us) log.cc:844] Serialized 52 byte log entry
0709 13:14:56.182721 (+631132us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:56.182757 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:56.182828 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:56.682188 (+499360us) raft_consensus.cc:1685] finished
0709 13:14:56.682242 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:56.682667 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49639,"raft.queue_time_us":50263,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":8571,"thread_start_us":536326,"threads_started":1,"wal-append.queue_time_us":718367}
I20260709 13:14:56.631665  4758 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:56.686236  4758 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:56.649389 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:56.688527  4812 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:56.270569  4801 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:56.689793  4396 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:56.690354  4801 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:56.649933  4670 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:56.692737  4720 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:56.693683  4720 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:56.696949  4709 raft_consensus.cc:1064] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:14:56.670121 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:56.670354  4614 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:56.702296  4614 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:56.703136  4787 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:56.642140  4541 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:56.650300  4586 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:56.705725  4586 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:56.707154  4748 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:56.685302 32269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 2862) took 1220 ms. Trace:
I20260709 13:14:56.696332  4720 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:14:56.715799 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.709297  4396 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:56.717545 32120 raft_consensus.cc:1240] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:56.718248  4396 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:56.721804 32270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36080 (request call id 2418) took 1257 ms. Trace:
I20260709 13:14:56.722306 32270 rpcz_store.cc:276] 0709 13:14:55.463894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.464004 (+   110us) service_pool.cc:224] Handling call
0709 13:14:56.721346 (+1257342us) spinlock_profiling.cc:243] Waited 77.6 ms on lock 0x7b5400416754. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:56.721564 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178588032}
I20260709 13:14:56.723273  4755 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:56.685796  4743 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:56.724822 32264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 2408) took 2143 ms. Trace:
I20260709 13:14:56.724768  4743 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:56.725353 32264 rpcz_store.cc:276] 0709 13:14:54.581451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.581605 (+   154us) service_pool.cc:224] Handling call
0709 13:14:54.581868 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:54.821675 (+239807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:56.724196 (+1902521us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b54001860d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:56.724575 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":538373376}
I20260709 13:14:56.726030  4711 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:56.727658  4743 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:56.730062   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:56.727159  4711 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:56.738549 32165 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:56.739154   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:56.739938  4796 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:56.720140 32199 consensus_queue.cc:260] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:56.724385  4572 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:56.719988  4396 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:56.730950  4573 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:56.746982  4572 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:56.845184 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:56.860774  4614 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:56.861115  4502 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:56.862386 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 185358us
I20260709 13:14:56.863415 32236 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:56.857532 32199 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:56.864483  4682 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:56.866050  4703 consensus_queue.cc:260] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:56.867453  4703 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:56.869124 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:56.708225 32269 rpcz_store.cc:276] 0709 13:14:55.464429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.465621 (+  1192us) service_pool.cc:224] Handling call
0709 13:14:55.465963 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:55.481846 (+ 15883us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:55.481876 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:55.482344 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:14:55.935607 (+453263us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:55.935670 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.935772 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:56.684732 (+748960us) raft_consensus.cc:1685] finished
0709 13:14:56.684815 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:56.685090 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19714,"raft.queue_time_us":29504,"raft.run_cpu_time_us":1466,"raft.run_wall_time_us":42960,"spinlock_wait_cycles":34432,"thread_start_us":378518,"threads_started":1,"wal-append.queue_time_us":654675}
I20260709 13:14:56.861143 32123 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:56.874794  4396 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:56.876945 32120 raft_consensus.cc:1240] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:14:56.877152 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:56.877923 32122 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:14:56.857038  4720 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:56.883270 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:56.884027 32123 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:56.884140 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:14:56.843991  4122 consensus_meta.cc:287] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.757s	user 0.010s	sys 0.007s
I20260709 13:14:56.884753 32124 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:14:56.789986  4801 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:56.878322 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:56.888211 32117 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 15.
I20260709 13:14:56.832368  4743 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:56.889267 32116 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:56.884768   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:56.890134 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:56.891355 32122 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:56.892741  4586 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:56.896027  4572 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:56.896821  4573 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:56.897538   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:56.899554  4573 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:56.883283   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:56.900960   396 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:56.887269  4626 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:56.905877 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:56.906405  4711 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:56.906962 32116 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:14:56.907903  4652 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:56.908349 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:56.905521  4626 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:56.880203  4720 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:56.899475   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
W20260709 13:14:56.928249 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 190135us
I20260709 13:14:56.792913  4796 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:56.900981  4743 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:56.933935  4796 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:56.935472  4757 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:14:56.936110 32122 raft_consensus.cc:1275] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:56.937449 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:56.926688  4720 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:56.957892  4745 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:56.960353  4745 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:56.935539  4743 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:56.918664  4122 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:56.978794  4122 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:56.979297 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:56.980273 32120 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:14:56.982861 32124 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:14:56.985766 32273 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 17.
I20260709 13:14:56.988817  4799 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:56.989617  4799 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:56.997445  4626 leader_election.cc:290] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:56.996367 32192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2610) took 1678 ms. Trace:
I20260709 13:14:56.999518 32192 rpcz_store.cc:276] 0709 13:14:55.317888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.321334 (+  3446us) service_pool.cc:224] Handling call
0709 13:14:55.321627 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.489762 (+168135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:56.995906 (+1506144us) spinlock_profiling.cc:243] Waited 39.9 ms on lock 0x7b54002a7e54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:56.996192 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91880192}
I20260709 13:14:56.997440  4799 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:14:57.015398 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.022636 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:57.028508  4710 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:57.029281 32124 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:14:57.028998  4586 consensus_queue.cc:1059] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 18.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:57.030143  4586 consensus_queue.cc:1243] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer 6b3ed521ce8947db80c4b4828b355c06 log is divergent from this leader: its last log entry 19.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:14:57.030779 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 49347.8us
I20260709 13:14:57.024650 32122 raft_consensus.cc:2468] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
I20260709 13:14:57.044229 32236 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:57.049319 32199 raft_consensus.cc:1275] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:14:57.049727 32199 pending_rounds.cc:85] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 7
W20260709 13:14:57.054188 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 70668.6us
I20260709 13:14:57.052166 32199 pending_rounds.cc:107] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:14:57.058954 32199 raft_consensus.cc:2889] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:57.059068 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:57.059917 32199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2602) took 2112 ms. Trace:
I20260709 13:14:57.060256 32199 rpcz_store.cc:276] 0709 13:14:54.947140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.947406 (+   266us) service_pool.cc:224] Handling call
0709 13:14:54.947713 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.033676 (+ 85963us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b5400368420. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59ef68dc0 00007fb59eff31c0 00007fb59eff4231 00007fb59eff0d8f 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c
0709 13:14:56.718896 (+1685220us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b5400368420. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59ef6f06f 00007fb59efe7f60 00007fb59efe97de 00007fb59eff3b49 00007fb59eff4416 00007fb59eff0d8f 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62
0709 13:14:57.059608 (+340712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.059844 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":321492096}
I20260709 13:14:57.061707 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:57.062529 32124 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
W20260709 13:14:57.066696  4674 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:14:57.069983 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:57.070767 32269 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:14:57.071569 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:57.072510 32264 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:14:57.073957 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:57.075130 32270 raft_consensus.cc:2368] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 14. Current term is 15.
I20260709 13:14:57.078269  4760 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.078938  4760 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:57.079593  4555 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:57.080204  4555 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.080621  4555 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:57.081247 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:57.085021 32117 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:57.086632  4758 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:57.088266  4650 raft_consensus.cc:3055] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:57.088753  4650 raft_consensus.cc:740] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:57.089977  4650 consensus_queue.cc:260] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:57.091044 32273 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36080 (request call id 2419) took 1626 ms (client timeout 1706 ms). Trace:
W20260709 13:14:57.091634 32273 rpcz_store.cc:269] 0709 13:14:55.464156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.464434 (+   278us) service_pool.cc:224] Handling call
0709 13:14:57.090786 (+1626352us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54002b6bd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:57.090963 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3484630272}
I20260709 13:14:57.094807 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:57.095207  4781 ts_tablet_manager.cc:1929] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.8
I20260709 13:14:57.095510 32122 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:57.096004  4781 log.cc:1199] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 113b5461952d47e0944d463ea4e32801: Deleting WAL directory at /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-1-root/wals/64767c8d367b4cc1b7e2ffbcbf73ce29
I20260709 13:14:57.095536 32239 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:57.102017 32115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 3662) took 2537 ms. Trace:
I20260709 13:14:57.102103 32239 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:57.103546  4762 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:57.102499 32115 rpcz_store.cc:276] 0709 13:14:54.564962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.596859 (+ 31897us) service_pool.cc:224] Handling call
0709 13:14:54.616021 (+ 19162us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:54.635829 (+ 19808us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:14:54.814449 (+178620us) log.cc:844] Serialized 14 byte log entry
0709 13:14:54.815593 (+  1144us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:54.815649 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:54.815704 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.030367 (+214663us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b18003b2cc0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bf043f3 00007fb59bf067c1 00007fb59bf06779 00007fb59bf06709 00007fb59bf066d1 00007fb59bf059cd 000000000038f354 000000000038f199 00007fb59bee783a
0709 13:14:56.557922 (+1527555us) spinlock_profiling.cc:243] Waited 3.32 ms on lock 0x7b18003b2cc0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bed22a6 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419
0709 13:14:57.101632 (+543710us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b54004123d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:57.101676 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.101834 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":179256,"prepare.queue_time_us":179324,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":1029,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"spinlock_wait_cycles":59416704}
I20260709 13:14:57.105965  4745 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:57.091228  4650 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:57.109846  4545 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:57.110339  4545 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.110718  4545 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:14:57.112885  4823 log.cc:927] Time spent T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:14:57.119146 32090 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:57.122063  4781 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46032 (request call id 4) took 1844 ms. Trace:
W20260709 13:14:57.126461 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:57.127319 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:57.164794 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.131368 32193 raft_consensus.cc:3055] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:57.133132   368 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:57.133333  4545 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:57.133873  4625 consensus_queue.cc:1059] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:57.134687  4555 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:57.134824  4743 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.138978  4761 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.141810  4760 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:57.137187  4499 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.146126  4657 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.147245  4712 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:57.145758  4709 consensus_queue.cc:237] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 9, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:57.148845  4710 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
W20260709 13:14:57.149639 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.149857  4274 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:57.210171  4274 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:57.153316  4720 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:57.165990 32239 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:14:57.213145 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 47245us
I20260709 13:14:57.214761 32239 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:57.215590  4653 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.166529 32193 raft_consensus.cc:740] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:57.216285  4653 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:57.216825  4712 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:57.216995 32193 consensus_queue.cc:260] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:57.218109 32193 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:57.218905  4653 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:57.219290  4712 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:57.219688  4513 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:57.219900  4657 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:57.164390  4781 rpcz_store.cc:276] 0709 13:14:55.277609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.281698 (+  4089us) service_pool.cc:224] Handling call
0709 13:14:55.777140 (+495442us) ts_tablet_manager.cc:1151] Deleting tablet 64767c8d367b4cc1b7e2ffbcbf73ce29
0709 13:14:55.813676 (+ 36536us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:14:56.994696 (+1181020us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:57.094955 (+100259us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:57.121655 (+ 26700us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33075,"tablet-delete.queue_time_us":487617,"thread_start_us":250516,"threads_started":1}
I20260709 13:14:57.221101  4762 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:14:57.221457 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.221629  4762 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.222643  4762 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:57.222834  4657 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:57.203405 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 84467.1us
I20260709 13:14:57.208307  4786 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.179844 32122 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
W20260709 13:14:57.222222 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:57.201834   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 68914.3us
I20260709 13:14:57.233222 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:57.214675  4720 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:57.238901 32239 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:57.239809 32239 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:57.246421 32090 leader_election.cc:400] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 14. Current term is 15.
I20260709 13:14:57.246748 32090 leader_election.cc:403] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:57.235209 32008 catalog_manager.cc:5028] TS 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): tablet 64767c8d367b4cc1b7e2ffbcbf73ce29 (table test-workload [id=9b9dc20f98e547b59efac9c530f28125]) successfully deleted
I20260709 13:14:57.252337  4735 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:57.252630  4659 consensus_queue.cc:1048] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:14:57.253000  4735 raft_consensus.cc:697] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 15 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:57.253541  4555 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:57.254221 32268 raft_consensus.cc:1240] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:57.254079  4735 consensus_queue.cc:237] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:57.255996  4545 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:57.255932  4747 consensus_queue.cc:1048] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:14:57.256842  4755 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:57.250582  4122 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:57.258721  3913 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:57.258809  4122 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.259243  3913 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:57.259335  4122 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:57.259757  3913 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:57.262374 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:57.243851  4274 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:57.263046 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:57.262243 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:57.264645 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:57.266386 32239 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:57.267324  4801 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:57.269035  4801 raft_consensus.cc:2804] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:57.269491  4801 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:57.269920  4801 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:57.274061  4755 raft_consensus.cc:697] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:57.220402  4513 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:57.241189  4789 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:14:57.280059   368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.237272  4653 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.243299  4760 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:57.285256 32008 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 52072.5us
I20260709 13:14:57.234184  4743 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:57.234386  4761 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:14:57.290343 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 64972.7us
I20260709 13:14:57.241045  4724 consensus_queue.cc:1059] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:14:57.281405  4789 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.296120 32193 raft_consensus.cc:1275] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:14:57.241457  4499 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:57.235752  4786 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:57.308823 32199 raft_consensus.cc:1240] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:57.281205  4755 consensus_queue.cc:237] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:57.309537  4653 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:57.309876   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:57.309876 32193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3667) took 1625 ms. Trace:
I20260709 13:14:57.311918   369 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:57.293658  4659 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 14. Current term is 15.
I20260709 13:14:57.312817 32267 raft_consensus.cc:1275] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:14:57.316756 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 50884.5us
W20260709 13:14:57.317327  4685 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:14:57.325510 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:57.246210  4710 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:57.338600 32193 rpcz_store.cc:276] 0709 13:14:55.684872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.817388 (+132516us) service_pool.cc:224] Handling call
0709 13:14:55.893369 (+ 75981us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.131124 (+1237755us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b54000c97a0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59ef68dc0 00007fb59eff31c0 00007fb59eff4231 00007fb59eff0d8f 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c
0709 13:14:57.302596 (+171472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.309811 (+  7215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5085056}
I20260709 13:14:57.306305  4789 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:57.344309   396 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:14:57.347468  4710 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:57.345181 32271 raft_consensus.cc:2368] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 14. Current term is 15.
I20260709 13:14:57.348279   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:57.348803  4207 raft_consensus.cc:2804] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:57.355155   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
W20260709 13:14:57.355432  4829 log.cc:927] Time spent T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:14:57.345448 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:57.349115   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:57.362543 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:57.363193 32197 raft_consensus.cc:2393] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 12: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:57.363363 32196 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:57.364090  4710 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:14:57.356972 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 166289us
I20260709 13:14:57.359813 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:57.302549  4760 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:14:57.351686  4207 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:57.368989   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:57.377779 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:57.378300  4710 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:57.378942 32239 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:57.379431 32197 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:14:57.383860 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:57.379014  4207 raft_consensus.cc:3060] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:57.395452 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:14:57.412293 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.423116 32269 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:14:57.424702  4235 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:57.425266  4653 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:57.425437  4671 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.426141  4671 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:57.425314  4235 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.428529  4235 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:57.428975  4761 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:57.434150 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:57.434917 32194 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:57.437090 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:57.437151 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:57.437768 32198 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:57.438702 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:57.439333 32198 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:14:57.441329  4235 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:57.441777  4774 raft_consensus.cc:3055] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:14:57.442235  4774 raft_consensus.cc:740] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:57.442596  4499 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:57.443182  4774 consensus_queue.cc:260] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:57.444775  4774 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:57.444643 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:57.446317 32191 raft_consensus.cc:1240] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:57.447645 32191 raft_consensus.cc:1240] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:57.443697 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:57.449379 32191 raft_consensus.cc:1275] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:57.393050  4710 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:57.452776   368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.453962  4769 raft_consensus.cc:3055] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:57.454437  4769 raft_consensus.cc:740] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:57.455469  4769 consensus_queue.cc:260] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:57.456247  4786 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:57.461350  4760 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:57.461807 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:57.462476 32190 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:14:57.463424 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:57.463747 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:57.478477   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 56724.8us
I20260709 13:14:57.464282 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:57.404628  4545 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.476272 32197 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:14:57.437171 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:57.478197 32266 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
W20260709 13:14:57.492187 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 91094.7us
I20260709 13:14:57.496773 32087 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:57.497140 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:57.497555  3913 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:57.516211 32269 raft_consensus.cc:2368] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 for earlier term 12. Current term is 13.
I20260709 13:14:57.511667 32194 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:14:57.467567  4513 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:57.518356 32196 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:14:57.468037  4769 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:57.474951   398 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEARNER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:14:57.476091  4710 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:57.489085  4743 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:57.546906 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:57.550729   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:57.466589  4762 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:57.554816 32197 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
W20260709 13:14:57.554709 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 58120.1us
W20260709 13:14:57.557942 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 51197us
I20260709 13:14:57.556102 32197 pending_rounds.cc:85] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 10
I20260709 13:14:57.583719  3913 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:57.585958 32197 pending_rounds.cc:107] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:14:57.586375 32197 raft_consensus.cc:2889] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:57.548125  4796 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:57.590279 32118 raft_consensus.cc:1240] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:57.590420 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:57.591611 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:57.592098 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:57.592717 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:57.593624 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:57.595069 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:57.597012 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:57.597638 32265 raft_consensus.cc:2468] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
I20260709 13:14:57.598476 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:57.599594 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:57.600206 32265 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:57.601094 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:57.602602 32270 raft_consensus.cc:1240] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:57.552155  4671 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:57.603961 32270 raft_consensus.cc:1217] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 11.7->[12.8-12.8]   Dedup: 12.8->[]
I20260709 13:14:57.612211 32265 raft_consensus.cc:1275] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:57.613528 32265 raft_consensus.cc:1240] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:57.617296 32193 raft_consensus.cc:1240] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:57.618441 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:57.619685 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:57.620280 32193 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:14:57.620398  4762 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:57.621210 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:57.621282 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:57.622105 32193 raft_consensus.cc:2393] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 19: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:57.622527 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:57.623107 32192 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:14:57.623956 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:14:57.625406 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:57.625969 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:57.626277  4837 log.cc:927] Time spent T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.289s	user 0.002s	sys 0.000s
I20260709 13:14:57.626484   396 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:57.604408 32270 raft_consensus.cc:1240] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:14:57.627463 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:57.628224 32199 raft_consensus.cc:2368] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 14. Current term is 15.
I20260709 13:14:57.550511  4545 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:57.628750  4499 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.629045 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:57.629618 32199 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 15.
I20260709 13:14:57.629427  4499 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:57.630419  4545 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:57.630779 32199 raft_consensus.cc:1240] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:57.632020 32199 raft_consensus.cc:1275] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:14:57.620684 32019 catalog_manager.cc:5697] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 7 to 9, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 9 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:57.621115 32194 raft_consensus.cc:3055] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:57.588320 32239 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:57.634197 32268 raft_consensus.cc:1240] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 13. Current term is 14. Ops: []
W20260709 13:14:57.635532 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 47289us
I20260709 13:14:57.632036 32090 leader_election.cc:400] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 14. Current term is 15.
I20260709 13:14:57.636711 32090 leader_election.cc:403] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:57.622913 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:57.634619 32194 raft_consensus.cc:740] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:57.541942  4659 consensus_queue.cc:1059] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:14:57.638703 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:14:57.639366   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 54777.7us
I20260709 13:14:57.641944 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:14:57.644277 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 62727.9us
I20260709 13:14:57.634802 32236 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:57.631969  4499 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:57.654814  3913 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:14:57.655009   368 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:14:57.657020 32195 raft_consensus.cc:2368] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 14. Current term is 15.
I20260709 13:14:57.653604  4545 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:57.642305 32194 consensus_queue.cc:260] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:57.658730  4545 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.659186  4545 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:57.659286 32194 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:57.645285  4650 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:14:57.661299  4461 consensus_queue.cc:1048] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:57.664911  4659 raft_consensus.cc:3055] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:57.665455  4659 raft_consensus.cc:740] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:57.665642 32197 raft_consensus.cc:1240] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:57.666531  4659 consensus_queue.cc:260] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:57.667882  4659 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:57.638284  4674 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:57.672533  4674 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:57.672835 32019 catalog_manager.cc:5697] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 9 to 10, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 10 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:57.674871  4674 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:57.674808 32019 catalog_manager.cc:5697] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 9 to 10, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 10 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
W20260709 13:14:57.677107 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.678773 32198 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:14:57.680271 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:57.683058 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:57.687124 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:57.689590 32192 raft_consensus.cc:2410] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 20 because replica has last-logged OpId of term: 18 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
W20260709 13:14:57.697400 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.677632  4762 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:57.697113 32238 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:57.700361 32198 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:14:57.690181 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:57.704098 32199 raft_consensus.cc:1275] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:57.700095 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:14:57.706959 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:57.713110 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 57420.1us
I20260709 13:14:57.714186 32087 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:57.714795 32190 raft_consensus.cc:1275] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:14:57.701241 32019 catalog_manager.cc:5697] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:57.608430  4207 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:57.655747  4122 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:57.656811  4789 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:57.650055  4573 consensus_queue.cc:1048] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:14:57.725236 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:57.726868 32239 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:57.740255 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:57.707371  4586 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:57.741427 32267 raft_consensus.cc:2368] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12.
I20260709 13:14:57.741786 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:57.724485  4774 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:57.696128  4786 consensus_queue.cc:1059] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:14:57.739017 32090 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:57.744457 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:57.746915 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:57.722792  4674 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:57.743191  4586 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:57.735024  4712 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:14:57.752492 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 55470.5us
I20260709 13:14:57.774825 32238 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:57.760141 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.761286  4555 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:57.762115  4634 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:57.763659  4586 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:57.756443 32264 raft_consensus.cc:1240] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:14:57.737733   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:57.735841  4762 raft_consensus.cc:697] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:57.777505  4634 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.780468 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:57.784090 32196 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:14:57.785336  3913 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 14. Current term is 15.
I20260709 13:14:57.781390 32019 catalog_manager.cc:5697] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 10 to 11, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 11 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:57.786319 32019 catalog_manager.cc:5697] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 11 to 12, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 12 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:57.752543  4710 raft_consensus.cc:2804] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:57.737854  4796 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
W20260709 13:14:57.791812 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:57.798941 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.788702 32019 catalog_manager.cc:5697] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:57.774381   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:57.805616 32194 raft_consensus.cc:1275] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:14:57.809253 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 95113.9us
I20260709 13:14:57.813500 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:57.814267 32122 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:57.785017  4634 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:14:57.818864 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 44126.6us
I20260709 13:14:57.785228  4235 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:57.798115  4710 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.826231  4721 raft_consensus.cc:2804] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:57.826674  4555 raft_consensus.cc:697] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:57.826836 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:57.827589 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:57.851959 32124 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:57.828325 32120 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:14:57.830232 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:57.853138 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:57.853585 32123 raft_consensus.cc:2410] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:14:57.836247   398 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
I20260709 13:14:57.837782  4207 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:57.839696 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:57.840778  4684 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:57.843114 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:57.822664 32019 catalog_manager.cc:5697] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 10 to 11, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 11 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:57.848192 32238 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:57.782015  4674 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
W20260709 13:14:57.824347  4669 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.449s	user 0.047s	sys 0.036s
W20260709 13:14:57.891606 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 129219us
W20260709 13:14:57.883040  4801 consensus_meta.cc:287] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.604s	user 0.012s	sys 0.000s
I20260709 13:14:57.851606  4710 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:57.903862 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:57.904558 32019 catalog_manager.cc:5697] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:57.905208  4545 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:57.906183 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:57.907866  4625 raft_consensus.cc:3055] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:57.908200  4657 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:57.676545  4711 consensus_queue.cc:1175] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "113b5461952d47e0944d463ea4e32801" responder_term: 12 status { last_received { term: 12 index: 8 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:14:57.940604 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:57.901165  4671 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:57.908563  4712 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.909265 32197 raft_consensus.cc:1240] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:57.917209  4573 consensus_queue.cc:1048] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:57.910215 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:57.910550 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:57.913772  4396 consensus_queue.cc:1059] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:14:58.010440 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:58.043088 32266 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:57.890894  4684 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:57.890817 32194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:14:58.049216 32194 raft_consensus.cc:606] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:58.049664 32194 raft_consensus.cc:614] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:57.914445  4555 consensus_queue.cc:237] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:57.915377  4569 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:14:57.851194  4721 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:57.896543  4669 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.669s	user 0.048s	sys 0.036s
I20260709 13:14:57.936652 32124 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:14:58.056602 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:57.948693 32019 catalog_manager.cc:5697] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:58.057408 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:57.949899 32238 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:58.036746 32122 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
W20260709 13:14:58.038733 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.010985 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:58.041395 32190 raft_consensus.cc:2393] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 15: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:14:57.937397  4625 raft_consensus.cc:740] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:58.054244 32267 raft_consensus.cc:1275] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:14:58.054224   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 332050us
I20260709 13:14:57.948690  4653 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.948962  4671 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:57.952132  4755 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:58.056252  4721 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:58.069737 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:57.936476  4801 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:14:58.095615 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:58.135629 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.134661 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:58.135493 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:14:58.136947 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 187122us
I20260709 13:14:58.139094 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:58.149016  4634 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:58.151368 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:58.152532 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:58.152369 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:58.012487  4235 consensus_queue.cc:1048] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:14:58.157544 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:58.159035 32190 raft_consensus.cc:1275] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:14:58.056425  4669 raft_consensus.cc:697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:58.071439  4671 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:58.158725 32089 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:57.962407  4657 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:58.152694  4109 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:58.169781 32271 raft_consensus.cc:1240] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:58.164011 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:58.183738 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:58.185585 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:58.186479 32124 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:58.153358  4789 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:58.166446 32122 raft_consensus.cc:3060] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:58.070715  4653 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:58.177748 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:58.047389  4762 consensus_queue.cc:237] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:58.221439 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:58.223380 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:58.195123   396 raft_consensus.cc:2393] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 16: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
W20260709 13:14:58.229904  4854 log.cc:927] Time spent T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:14:58.230611  4711 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:14:58.231400 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.233134 32269 raft_consensus.cc:1217] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 19 LEADER]: Deduplicated request from leader. Original: 15.7->[18.8-18.8]   Dedup: 18.8->[]
I20260709 13:14:58.233501  4634 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:58.233669 32269 raft_consensus.cc:1240] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 19 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 18. Current term is 19. Ops: [18.8-18.8]
I20260709 13:14:58.141984  4712 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:58.237392 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:58.238734 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:58.240036 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:58.242156 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:58.240028 32266 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 15.
I20260709 13:14:58.205593  4669 consensus_queue.cc:237] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:58.261659 32118 raft_consensus.cc:2368] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12.
I20260709 13:14:58.207788  4801 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:58.166334  4755 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:58.212117 32122 raft_consensus.cc:2468] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 8.
I20260709 13:14:58.213320  4545 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:58.214248  4674 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:58.218734  4653 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:58.184257  4659 consensus_meta.cc:287] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.516s	user 0.008s	sys 0.003s
W20260709 13:14:58.294620  4844 log.cc:927] Time spent T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.341s	user 0.000s	sys 0.001s
I20260709 13:14:58.219358 32120 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:14:58.297055  3913 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.297663 32117 raft_consensus.cc:2410] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:14:58.262646 32019 catalog_manager.cc:5697] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 10 to 11, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 11 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:58.250298 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:58.301816 32124 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:58.251883 32239 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:14:58.254642 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 89898.3us
W20260709 13:14:58.306429 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:58.306979 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:58.307299 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.308576  3913 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:58.309262 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 57495.7us
I20260709 13:14:58.309876  4122 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:58.310473  4122 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:58.310925  4122 raft_consensus.cc:697] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:58.311780  4122 consensus_queue.cc:237] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:58.312933  3913 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:58.314738   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:58.315107   369 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:58.319072 32019 catalog_manager.cc:5697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 10 to 12, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 12 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:58.320860 32019 catalog_manager.cc:5697] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 11 to 12, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 12 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:14:58.329223 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:58.330310  4532 raft_consensus.cc:2804] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:58.330497 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:58.331660 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:58.332212 32120 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:58.333129   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:58.335031  4539 consensus_queue.cc:1048] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:58.329224   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:58.341926 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:58.342397  4671 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:58.344213 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:58.344975 32269 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
I20260709 13:14:58.345858 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:58.346300  4671 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:58.347141 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:58.352909 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:58.354084 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:58.354449 32191 raft_consensus.cc:1240] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:58.354573 32197 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:14:58.355396 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:58.356889 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:58.357429 32194 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:14:58.359225  4712 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:58.366242 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:58.367151 32116 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:14:58.367661 32124 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 18.
I20260709 13:14:58.344273 32265 raft_consensus.cc:1240] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:58.342542 32117 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:58.369498 32239 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:58.378438   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 50500.5us
I20260709 13:14:58.348268 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:58.384404 32239 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:58.265892  4235 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.103s
I20260709 13:14:58.404734 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:58.206190  4856 log.cc:927] Time spent T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:14:58.273862 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:58.410316 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:58.406366 32238 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:58.276187   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:58.277509 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:58.283071 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:58.283818  4625 consensus_queue.cc:260] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:58.417164 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:58.287657 32121 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:14:58.389119 32019 catalog_manager.cc:5697] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 10 to 11, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 11 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:58.418607 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:58.419451 32019 catalog_manager.cc:5697] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 13 to 15, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 15 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:58.260288 32119 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:14:58.421736 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:58.405372 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:58.407598 32194 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
W20260709 13:14:58.415544 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.419488 32190 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:58.428063 32270 raft_consensus.cc:2393] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 11: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:58.397665 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:58.422348 32119 raft_consensus.cc:1240] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:14:58.430035 32192 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:58.434510 32122 raft_consensus.cc:1240] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:14:58.434775 32119 raft_consensus.cc:1275] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:14:58.435240 32119 pending_rounds.cc:85] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d: Aborting all ops after (but not including) 7
I20260709 13:14:58.435535 32119 pending_rounds.cc:107] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:14:58.435822 32119 raft_consensus.cc:2889] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:58.416761  4539 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:58.408740  4671 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:14:58.439103 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 292326us
I20260709 13:14:58.441129 32089 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:58.443138 32089 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:58.464310  3913 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:58.465989 32089 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:58.466876  3913 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:58.467233  3913 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:58.467578  3913 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:58.467803  4755 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:58.468437  4671 raft_consensus.cc:697] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:58.469333  4671 consensus_queue.cc:237] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:58.443639 32269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:14:58.473811 32089 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:58.440303 32119 raft_consensus.cc:1240] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:58.382896  4621 consensus_queue.cc:1048] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:14:58.420697  4532 raft_consensus.cc:697] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 8 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:58.431757  4625 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:58.450604 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:14:58.451354  4736 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.001s	sys 0.033s
I20260709 13:14:58.452842  4712 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:58.453845  4861 consensus_queue.cc:1059] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:58.431983  4545 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:58.457218 32197 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 18.
I20260709 13:14:58.460305 32270 raft_consensus.cc:1240] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:14:58.460631 32122 raft_consensus.cc:1217] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Deduplicated request from leader. Original: 15.7->[18.8-18.8]   Dedup: 18.8->[]
I20260709 13:14:58.490962 32122 raft_consensus.cc:1240] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 18. Current term is 19. Ops: [18.8-18.8]
I20260709 13:14:58.439801 32236 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:58.492298 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 52585.6us
I20260709 13:14:58.434212  4789 consensus_queue.cc:1059] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:14:58.463184 32115 raft_consensus.cc:1217] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 13 LEADER]: Deduplicated request from leader. Original: 11.7->[12.8-12.8]   Dedup: 12.8->[]
I20260709 13:14:58.498286 32115 raft_consensus.cc:1240] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 13 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:14:58.475216 32089 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:58.456144  4710 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:58.480988 32195 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:58.481433 32117 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:14:58.505486 32115 raft_consensus.cc:1275] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:14:58.504377 32124 raft_consensus.cc:1240] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 13:14:58.483865  4736 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.001s	sys 0.033s
I20260709 13:14:58.481487 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:58.473853 32269 raft_consensus.cc:606] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:58.483907 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:58.483137  4659 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:58.478121  3913 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:58.515641   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:58.520937 32193 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:58.483176 32116 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:14:58.540818 32196 raft_consensus.cc:1275] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:14:58.541247 32121 raft_consensus.cc:1240] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 13. Current term is 15. Ops: []
I20260709 13:14:58.542346 32116 raft_consensus.cc:1275] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:14:58.522905 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 229233us
W20260709 13:14:58.529665 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 54525.5us
I20260709 13:14:58.550197 32089 leader_election.cc:400] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 14. Current term is 15.
I20260709 13:14:58.522677  4755 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:14:58.515892  4774 consensus_meta.cc:287] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.733s	user 0.012s	sys 0.000s
I20260709 13:14:58.550550 32089 leader_election.cc:403] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:14:58.533125  3913 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:58.554715  4868 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:58.556063  4721 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:58.557129 32119 raft_consensus.cc:1240] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:58.557300  4541 raft_consensus.cc:3055] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:58.573226  3913 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 14. Current term is 15.
W20260709 13:14:58.572449 32165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.596115 32264 raft_consensus.cc:2393] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 13: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:14:58.571215  4774 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:58.573179  4541 raft_consensus.cc:740] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:58.613212 32120 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
W20260709 13:14:58.609280 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 59236.2us
I20260709 13:14:58.615096 32089 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:58.617347 32089 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:14:58.621440   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 293413us
I20260709 13:14:58.624078  3913 consensus_queue.cc:1048] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:58.624895 32089 leader_election.cc:400] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 14. Current term is 15.
W20260709 13:14:58.630837 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.633033 32089 leader_election.cc:304] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:58.633451  4541 consensus_queue.cc:260] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:58.634616  4541 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:58.634653 32089 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:58.636356  4626 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:58.636799  4626 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:58.637303  4626 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:58.638262 32089 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:14:58.640848  4864 log.cc:927] Time spent T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:14:58.641263 32193 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:14:58.641556 32087 leader_election.cc:304] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:58.622555  4861 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:58.645514 32193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:14:58.645776  4274 consensus_queue.cc:1048] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:58.646404 32193 raft_consensus.cc:606] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:58.646854 32193 raft_consensus.cc:614] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:58.576103  4532 consensus_queue.cc:237] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:58.650467  4861 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:58.650599  4711 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:58.654552 32190 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
W20260709 13:14:58.656612 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:58.658394 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 116521us
I20260709 13:14:58.659233 32089 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:58.664822 32165 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:58.642355  4710 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:58.678984  3913 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:58.639520  4573 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:58.688992 32198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d002861120de41408d48712b6bd491e1"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:14:58.691983 32198 raft_consensus.cc:606] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:58.692530 32198 raft_consensus.cc:614] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:58.623391  4513 consensus_queue.cc:1059] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:14:58.697577 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:58.671072  4711 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:58.684324  4653 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.717303 32195 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 16.
I20260709 13:14:58.670969  4274 consensus_queue.cc:1048] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
W20260709 13:14:58.723971 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 64839.3us
I20260709 13:14:58.687811  4868 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:14:58.741066 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.734982  4274 consensus_queue.cc:1243] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer 113b5461952d47e0944d463ea4e32801 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:14:58.763476 32195 raft_consensus.cc:1240] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:58.768903   369 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:58.719899  4674 raft_consensus.cc:2804] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:58.776644 32118 raft_consensus.cc:1240] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:58.735957  4868 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:14:58.784623  4867 log.cc:927] Time spent T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:14:58.728271  4653 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:58.774183  4674 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
W20260709 13:14:58.793577 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 164078us
I20260709 13:14:58.795457 32165 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:58.782823  4634 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:58.798451 32195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:14:58.799067 32195 raft_consensus.cc:606] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:58.799376 32195 raft_consensus.cc:614] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:58.806704  4657 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:58.791352  4674 raft_consensus.cc:3060] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:58.804754 32192 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:14:58.813499 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:58.815549 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:14:58.820886 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.821672  4761 raft_consensus.cc:2804] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:58.821836  4653 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:58.822132  4761 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:58.822563  4761 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:58.827999  4659 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:14:58.829448 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.846977   396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38176 (request call id 203) took 1152 ms. Trace:
I20260709 13:14:58.847559   396 rpcz_store.cc:276] 0709 13:14:57.694507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.696040 (+  1533us) service_pool.cc:224] Handling call
0709 13:14:58.846695 (+1150655us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b5400129dd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:58.846879 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":849829760}
I20260709 13:14:58.855846   395 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
I20260709 13:14:58.858009 32162 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
W20260709 13:14:58.873256  4886 log.cc:927] Time spent T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 13:14:58.903256  4878 log.cc:927] Time spent T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:14:58.956264  4684 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:58.939563  4626 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:58.862300  4890 raft_consensus.cc:2804] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:58.957233  4890 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:58.943176  4761 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:58.957683  4890 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:58.943691 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 148278us
I20260709 13:14:58.959298  4761 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:14:58.959986 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.960721  4684 consensus_queue.cc:1048] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:58.962399  4761 consensus_queue.cc:1059] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:58.962914 32165 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:58.963387  4894 raft_consensus.cc:3055] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:58.963801  4894 raft_consensus.cc:740] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:58.948339  4674 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:58.952870  4868 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:58.968308 32165 leader_election.cc:400] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12.
I20260709 13:14:58.971174 32165 leader_election.cc:403] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:58.970253  4893 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:58.992003  4893 consensus_queue.cc:1059] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:58.993382  4653 raft_consensus.cc:3055] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:14:58.993958  4653 raft_consensus.cc:740] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:14:58.995087  4653 consensus_queue.cc:260] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:58.995759  4674 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:59.015545  4674 consensus_queue.cc:1048] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:14:59.021584  4881 log.cc:927] Time spent T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.224s	user 0.006s	sys 0.009s
I20260709 13:14:59.026245 32124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 2464) took 1194 ms. Trace:
I20260709 13:14:59.026726 32124 rpcz_store.cc:276] 0709 13:14:57.832071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.421186 (+589115us) service_pool.cc:224] Handling call
0709 13:14:58.504045 (+ 82859us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:58.508518 (+  4473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:59.026000 (+517482us) spinlock_profiling.cc:243] Waited 81.9 ms on lock 0x7b5400206550. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff08ad 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:59.026176 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188360576}
W20260709 13:14:59.034588   368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.039476 32194 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:14:59.039973 32194 pending_rounds.cc:85] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 8
I20260709 13:14:59.040262 32194 pending_rounds.cc:107] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:14:59.042997 32272 raft_consensus.cc:1240] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12. Ops: []
W20260709 13:14:59.057153 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.059057  4235 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:59.059672  4235 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:59.062060 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.063223  4651 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:14:59.063804  4651 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:59.066928  4710 raft_consensus.cc:3055] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:59.067317  4651 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:58.998960  4605 raft_consensus.cc:3055] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:58.976723  4761 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12.
I20260709 13:14:59.067965  4605 raft_consensus.cc:740] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:59.002883 32121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 2469) took 1169 ms. Trace:
I20260709 13:14:58.996541  4712 raft_consensus.cc:3055] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:14:59.014745  4862 log.cc:927] Time spent T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.418s	user 0.003s	sys 0.000s
I20260709 13:14:58.992895  4894 consensus_queue.cc:260] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:59.068943 32121 rpcz_store.cc:276] 0709 13:14:57.833665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.431971 (+598306us) service_pool.cc:224] Handling call
0709 13:14:58.539809 (+107838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:58.552362 (+ 12553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:59.002639 (+450277us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54003f4dd0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff08ad 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:59.002816 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247282944}
I20260709 13:14:59.070111  4894 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:59.014745  4801 raft_consensus.cc:993] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:14:59.071791  4801 raft_consensus.cc:1081] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Signalling peer fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:14:59.071998 32118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 2462) took 1240 ms. Trace:
I20260709 13:14:59.072440 32118 rpcz_store.cc:276] 0709 13:14:57.831406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.413217 (+581811us) service_pool.cc:224] Handling call
0709 13:14:58.413620 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:58.777102 (+363482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:59.071746 (+294644us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b54000339d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:59.071921 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":827610880}
I20260709 13:14:59.004470  4890 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:59.074607  4868 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:59.074977  4890 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:59.077663  4396 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:14:59.078253  4396 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:59.065114  4721 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:59.067377  4710 raft_consensus.cc:740] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:59.040510 32194 raft_consensus.cc:2889] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:59.089224 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:59.053391   368 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:59.095333 32121 raft_consensus.cc:1275] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:59.069188  4605 consensus_queue.cc:260] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:59.100165 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:59.101837 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:14:59.102465 32192 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:59.102672 32193 raft_consensus.cc:1240] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:14:59.106411 32193 raft_consensus.cc:1275] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:59.107753 32193 raft_consensus.cc:1275] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:59.110046  4396 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:14:59.111090  4801 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:59.112195 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:59.113458 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:59.114061 32268 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:59.114619 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:59.115200 32265 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:14:59.116012 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:59.118181  4800 consensus_queue.cc:1048] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:59.120034   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:14:59.120884   395 raft_consensus.cc:2393] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 15: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:59.122663 32239 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:59.124076 32239 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:59.104980  4795 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:59.151944  4795 raft_consensus.cc:697] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 16 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:59.153052  4795 consensus_queue.cc:237] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:59.124516 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:14:59.069137  4712 raft_consensus.cc:740] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:59.156891 32115 raft_consensus.cc:2376] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15. Re-sending same reply.
I20260709 13:14:59.157562  4712 consensus_queue.cc:260] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:59.158449  4653 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:59.158949  4712 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:59.130033  4710 consensus_queue.cc:260] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:59.161120  4710 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:59.130887 32264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36080 (request call id 2445) took 1119 ms. Trace:
I20260709 13:14:59.131279  4721 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:14:59.162619  3913 consensus_queue.cc:1175] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6b3ed521ce8947db80c4b4828b355c06" responder_term: 14 status { last_received { term: 14 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 14 index: 10 } }
I20260709 13:14:59.163139  4721 raft_consensus.cc:697] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:59.164163  4721 consensus_queue.cc:237] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:59.131935 32267 raft_consensus.cc:1240] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 12. Current term is 13. Ops: [12.9-12.9]
W20260709 13:14:59.133170  4882 log.cc:927] Time spent T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.263s	user 0.008s	sys 0.000s
I20260709 13:14:59.133859  4235 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:14:59.134641 32271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50584 (request call id 460) took 1731 ms. Trace:
I20260709 13:14:59.135099 32272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 2905) took 1090 ms. Trace:
I20260709 13:14:59.172245 32272 rpcz_store.cc:276] 0709 13:14:58.044302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.159375 (+115073us) service_pool.cc:224] Handling call
0709 13:14:58.159755 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:59.053120 (+893365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:59.134876 (+ 81756us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b540014c654. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:59.135042 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2030766976}
I20260709 13:14:59.173305 32124 raft_consensus.cc:1240] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:59.174230 32118 raft_consensus.cc:1240] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:59.141301  4396 consensus_queue.cc:1048] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:59.142103 32238 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:59.146750   395 raft_consensus.cc:1240] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 8 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:59.171134 32271 rpcz_store.cc:276] 0709 13:14:57.403716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.409528 (+  5812us) service_pool.cc:224] Handling call
0709 13:14:57.447280 (+ 37752us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:58.188105 (+740825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:59.134375 (+946270us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x7b5400068954. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:14:59.134573 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1654162688}
I20260709 13:14:59.178555 32238 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:59.147684  4796 consensus_queue.cc:1059] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:59.147773 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:14:59.148675 32268 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:14:59.149755   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:59.181653   402 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:59.150080   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:59.151091   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:14:59.162490 32264 rpcz_store.cc:276] 0709 13:14:58.011676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.056275 (+ 44599us) service_pool.cc:224] Handling call
0709 13:14:59.130605 (+1074330us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b5400305a54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:59.130807 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1235346688}
I20260709 13:14:59.167311  3913 consensus_queue.cc:1059] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:59.185619  3913 raft_consensus.cc:3055] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:59.186017  3913 raft_consensus.cc:740] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:59.186992  3913 consensus_queue.cc:260] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:59.188143 32124 raft_consensus.cc:1275] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:14:59.184274 32238 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:59.178558  4671 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:59.167376 32090 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:14:59.167909   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 73108.7us
I20260709 13:14:59.170063 32192 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:14:59.175063 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:59.194664  3913 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:59.194851 32267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 2904) took 1150 ms. Trace:
W20260709 13:14:59.168747 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 44781.9us
I20260709 13:14:59.206737 32087 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:14:59.199338 32267 rpcz_store.cc:276] 0709 13:14:58.043981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.062724 (+ 18743us) service_pool.cc:224] Handling call
0709 13:14:59.131622 (+1068898us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:59.170612 (+ 38990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:59.194658 (+ 24046us) spinlock_profiling.cc:243] Waited 997 ms on lock 0x7b5400305a50. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff08ad 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:14:59.194795 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2292205312}
I20260709 13:14:59.184273  4235 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:59.185372  4868 raft_consensus.cc:3055] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:59.184597  4801 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:59.189426 32118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:56890
I20260709 13:14:59.235466 32090 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:59.199913  4651 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:59.224478 32118 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:59.245231 32118 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:59.214026  4539 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.210309  4513 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:59.250984  3913 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.215935  4274 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:59.216295  4868 raft_consensus.cc:740] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
W20260709 13:14:59.262313 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.233656  4605 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:59.264758  3913 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:59.222414  4109 consensus_queue.cc:1048] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:14:59.252257  4657 raft_consensus.cc:2804] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:59.252681  4513 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:59.247644  4801 raft_consensus.cc:697] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:14:59.298867 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 296039us
W20260709 13:14:59.299077 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:59.308390 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.313267 32165 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:14:59.254691  4711 consensus_queue.cc:1059] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
W20260709 13:14:59.317834 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:59.320619 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.292555  4651 raft_consensus.cc:697] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:59.254817  4539 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:59.323009 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 272718us
I20260709 13:14:59.310302  4513 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:59.330581 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:59.333482 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:59.334618 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:59.294044  4789 consensus_queue.cc:1048] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:14:59.336691 32198 raft_consensus.cc:1240] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:59.313743  4657 raft_consensus.cc:697] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:59.338699 32272 raft_consensus.cc:1240] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 15. Current term is 16. Ops: []
I20260709 13:14:59.340538 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:59.345112 32124 raft_consensus.cc:1240] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 15. Current term is 16. Ops: []
I20260709 13:14:59.350332 32123 raft_consensus.cc:1275] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:14:59.354805 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:59.355327 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.329631  4684 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:59.354321 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:14:59.367883 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 124969us
I20260709 13:14:59.370453 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:59.326187  4626 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:59.373739 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:59.374672 32089 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:14:59.338306  4861 raft_consensus.cc:3055] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:59.325960  4893 consensus_queue.cc:1059] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
W20260709 13:14:59.395467 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 140886us
I20260709 13:14:59.408360 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:59.409926 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:59.410718 32269 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:14:59.404443 32239 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:14:59.381999  4891 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:14:59.412442 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:59.406172 32270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 2912) took 1107 ms. Trace:
I20260709 13:14:59.354483  4767 consensus_queue.cc:1059] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:14:59.381631  4861 raft_consensus.cc:740] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:59.397274  4626 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:59.340972  4868 consensus_queue.cc:260] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:59.407563 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:59.433001 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:59.413550 32270 rpcz_store.cc:276] 0709 13:14:58.288530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.502778 (+214248us) service_pool.cc:224] Handling call
0709 13:14:58.523192 (+ 20414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:58.523430 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:14:59.223711 (+700281us) log.cc:844] Serialized 14 byte log entry
0709 13:14:59.393907 (+170196us) log.cc:844] Serialized 14 byte log entry
0709 13:14:59.394107 (+   200us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:59.394150 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:59.394204 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:59.394272 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:59.396182 (+  1910us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":458974,"prepare.queue_time_us":440998,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":61,"raft.queue_time_us":19007,"raft.run_wall_time_us":3222,"spinlock_wait_cycles":27101696,"thread_start_us":395853,"threads_started":2}
I20260709 13:14:59.432921 32272 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:14:59.400821  4274 raft_consensus.cc:697] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:14:59.415993  4235 raft_consensus.cc:697] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:59.462046  4274 consensus_queue.cc:237] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:59.465109  4861 consensus_queue.cc:260] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:59.466392  4235 consensus_queue.cc:237] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:59.394847  4795 consensus_queue.cc:1048] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
W20260709 13:14:59.434428 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 57412.2us
I20260709 13:14:59.436478  4671 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:59.413333  4774 consensus_queue.cc:1048] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 13:14:59.514262  4904 log.cc:927] Time spent T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:14:59.517611 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.435894  4853 consensus_queue.cc:1059] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.048s
W20260709 13:14:59.531023  4901 log.cc:927] Time spent T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:14:59.508953  4555 consensus_queue.cc:1048] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:14:59.536769 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 58460.7us
I20260709 13:14:59.469871  4657 consensus_queue.cc:237] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:59.540215  4861 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:59.544508 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.398799  4801 consensus_queue.cc:237] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:59.555171  4634 raft_consensus.cc:3055] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:14:59.556444 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:59.584312 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 158422us
W20260709 13:14:59.563445  4905 log.cc:927] Time spent T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:14:59.571574 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 174278us
I20260709 13:14:59.436936  4122 consensus_queue.cc:1059] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.099s
I20260709 13:14:59.597332 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:59.432531  4891 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:59.602231  3913 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:59.470386  4109 consensus_queue.cc:1059] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.118s
I20260709 13:14:59.607721 32115 raft_consensus.cc:2393] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 16: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:14:59.573583  4671 raft_consensus.cc:697] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:59.622488 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:59.587363  4634 raft_consensus.cc:740] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:14:59.441951  4651 consensus_queue.cc:237] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:14:59.634292  4897 log.cc:927] Time spent T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7: Append to log took a long time: real 0.261s	user 0.002s	sys 0.000s
I20260709 13:14:59.596786  4569 consensus_queue.cc:1048] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:14:59.641390   402 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:59.638970 32118 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
W20260709 13:14:59.644629  4903 log.cc:927] Time spent T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.171s	user 0.001s	sys 0.001s
I20260709 13:14:59.647837 32118 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:14:59.649220  4902 log.cc:927] Time spent T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
W20260709 13:14:59.651011  4906 log.cc:927] Time spent T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:14:59.654495  4539 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:14:59.656426 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 62932.1us
I20260709 13:14:59.658046 32239 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:59.661068  4908 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:59.661243   396 raft_consensus.cc:1275] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:14:59.661999 32118 raft_consensus.cc:1275] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:59.662789  4513 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:59.664902 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:59.665875 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:59.668473 32124 raft_consensus.cc:1240] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:59.682971 32269 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:14:59.642359  4917 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.695542 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:14:59.696545 32116 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:14:59.685065  4917 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:59.699537 32238 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
W20260709 13:14:59.703811 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 121249us
W20260709 13:14:59.718998 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.712869  4555 raft_consensus.cc:2804] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:14:59.721483 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 155622us
I20260709 13:14:59.724258 32239 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:59.695747  4634 consensus_queue.cc:260] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:59.751744 32239 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:14:59.720499  4513 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:14:59.711205  4671 consensus_queue.cc:237] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:59.757009  4650 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:59.750602  4651 consensus_queue.cc:1048] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
W20260709 13:14:59.778892  4712 consensus_meta.cc:287] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.619s	user 0.014s	sys 0.000s
I20260709 13:14:59.781625  4634 raft_consensus.cc:3060] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:59.803771  4926 log.cc:927] Time spent T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:14:59.773339  4555 raft_consensus.cc:697] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:59.772317  4921 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:59.819952 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:59.823195  4924 log.cc:927] Time spent T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:14:59.814816  4921 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:14:59.828226  4626 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:59.829599  4789 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:59.829681  4555 consensus_queue.cc:237] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:59.789016  4915 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.112s
W20260709 13:14:59.831368 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 79756.3us
I20260709 13:14:59.842165 32239 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:59.847349  4891 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:59.850279 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.858871  4917 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:14:59.859866 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.868920 32115 raft_consensus.cc:1240] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:59.871973 32117 raft_consensus.cc:1275] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:14:59.883507 32122 raft_consensus.cc:1275] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:14:59.889814  4916 raft_consensus.cc:3055] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:59.890549  4916 raft_consensus.cc:740] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:59.893916  4541 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.894550  4541 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:14:59.900906 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:59.901559 32268 raft_consensus.cc:3055] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:59.901839 32268 raft_consensus.cc:740] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:14:59.902544 32268 consensus_queue.cc:260] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:14:59.903430 32268 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:59.909613 32199 raft_consensus.cc:1240] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 10. Current term is 11. Ops: []
W20260709 13:14:59.870334  4927 log.cc:927] Time spent T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:14:59.862728  4235 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:59.911900 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:14:59.927842 32272 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:59.934065 32268 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
W20260709 13:14:59.932293 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:59.867883  4721 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.018s	sys 0.028s
I20260709 13:14:59.936313 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:14:59.937222 32090 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:14:59.945607 32194 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:14:59.927668  4235 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:59.935977  4721 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.019s	sys 0.028s
I20260709 13:14:59.964044 32122 raft_consensus.cc:1240] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: []
W20260709 13:14:59.974228   367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.947651  4932 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:14:59.964913  4235 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:59.967957  4923 raft_consensus.cc:2804] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:59.951226  4795 consensus_queue.cc:1059] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:14:59.983882  4772 consensus_queue.cc:1059] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:15:00.013504 32117 raft_consensus.cc:1240] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:00.016678  4717 consensus_queue.cc:1048] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:15:00.000671  4932 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:00.025980  4684 raft_consensus.cc:697] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 15 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:00.026185  4893 consensus_queue.cc:1243] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer 94085cf341634eb686a95983b6b7f7e6 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:15:00.027040  4684 consensus_queue.cc:237] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:00.027314  4932 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:00.030416  4760 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.030886  4760 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:00.043143 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:00.043555 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.044902  4653 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.045400  4653 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:00.046788  4930 log.cc:927] Time spent T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.211s	user 0.002s	sys 0.000s
I20260709 13:15:00.047545  4653 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:00.048072  4653 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.007596  4923 raft_consensus.cc:697] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 13 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:00.053941  4674 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.054534  4674 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:00.054216  4923 consensus_queue.cc:237] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:15:00.063426 32162 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:00.076831 32198 raft_consensus.cc:1275] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:15:00.090046 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:00.091065 32197 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:15:00.092547 32196 raft_consensus.cc:3055] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:00.093137 32196 raft_consensus.cc:740] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
W20260709 13:15:00.094429 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:00.121251 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.083266  4761 raft_consensus.cc:2804] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:00.123301 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:00.115734 32196 consensus_queue.cc:260] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:00.083963  4674 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:00.129323 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:00.135776   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 127775us
I20260709 13:15:00.136273  4945 raft_consensus.cc:3055] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:00.140311  4945 raft_consensus.cc:740] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:00.140554   398 raft_consensus.cc:1275] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:15:00.141688  4945 consensus_queue.cc:260] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:00.143626  4945 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:00.155892 32197 raft_consensus.cc:1240] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:15:00.048503  4653 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:00.157823 32196 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:00.121790  4760 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:00.166352 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:00.167732   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:00.167018 32199 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:15:00.165772 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:00.169160 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:00.170521 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:00.171193 32199 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:00.173059  4861 consensus_meta.cc:287] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.573s	user 0.013s	sys 0.000s
I20260709 13:15:00.173396  4910 consensus_queue.cc:1048] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:00.173784 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:00.174350 32197 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:15:00.176685 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.162245  4541 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:00.184118 32197 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:15:00.206939 32197 raft_consensus.cc:1240] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:15:00.207718 32272 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:15:00.158397  4761 raft_consensus.cc:697] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:00.209220 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:00.212378 32122 raft_consensus.cc:1240] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 13 LEADER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:00.217670 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:00.247964  4923 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:00.269852 32196 raft_consensus.cc:1275] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:15:00.271162 32196 pending_rounds.cc:85] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 10
I20260709 13:15:00.272862 32196 pending_rounds.cc:107] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:15:00.273391 32196 raft_consensus.cc:2889] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:00.277575 32199 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:15:00.279495 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:00.279990 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:00.281045 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:00.281464 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:00.282086 32197 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:00.283020 32199 raft_consensus.cc:1240] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:00.248719  4923 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:00.285481 32199 pending_rounds.cc:85] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 7
I20260709 13:15:00.289291 32165 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:00.290391 32199 pending_rounds.cc:107] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:15:00.290869 32199 raft_consensus.cc:2889] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:00.293195  4653 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:00.295939  4761 consensus_queue.cc:237] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:00.301865 32165 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:00.303722  3913 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.307679  3913 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:00.311193  3913 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:00.314072  4653 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:00.315722 32165 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:00.317305 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:00.318758 32165 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:00.287886  4710 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:00.307328  4684 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:00.329272 32197 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:15:00.347205  4923 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:00.347687 32090 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:15:00.349483  4789 consensus_meta.cc:287] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.516s	user 0.002s	sys 0.010s
I20260709 13:15:00.349926  4789 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:00.354015  4919 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.354382 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:00.354595  4919 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:00.356720  4919 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:00.358604  4923 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:00.359222  4923 raft_consensus.cc:697] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:00.360242   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:00.360275  4923 consensus_queue.cc:237] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:00.361080  4916 consensus_queue.cc:260] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:00.362149  4916 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:00.365202 32115 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:00.366281  4780 raft_consensus.cc:3055] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:00.366761  4780 raft_consensus.cc:740] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:00.320271  4653 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:00.367753  4780 consensus_queue.cc:260] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:00.360980   398 raft_consensus.cc:2468] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:15:00.369364 32190 raft_consensus.cc:3055] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:00.375185 32190 raft_consensus.cc:740] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:00.376221 32190 consensus_queue.cc:260] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:00.377429 32190 raft_consensus.cc:3060] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:00.385259  4912 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:00.385883  4912 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:00.369953  4235 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:00.404014 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:00.372192 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 53513.3us
I20260709 13:15:00.340829  4710 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:00.349260 32196 raft_consensus.cc:1240] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:00.322093  4946 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:15:00.371836 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.413623 32236 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:00.405740 32193 raft_consensus.cc:1240] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:00.415688 32193 raft_consensus.cc:1275] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:15:00.408915 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 159363us
I20260709 13:15:00.417479 32165 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:00.388455  4912 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:00.419696 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:00.420368 32196 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:15:00.422057 32193 raft_consensus.cc:1275] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:15:00.429104 32190 raft_consensus.cc:1275] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:00.424718  4919 raft_consensus.cc:2804] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:00.434991 32165 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:00.436887 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:00.437140  4710 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:00.437698  4890 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:15:00.440724 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.405119  4780 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:00.443140 32115 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:15:00.453183  4605 raft_consensus.cc:3055] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:00.453697  4605 raft_consensus.cc:740] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:00.454754  4605 consensus_queue.cc:260] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:00.456019  4605 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:15:00.456707 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:00.448634  4893 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:15:00.446295  4919 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.464838  4919 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:00.467976  4921 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:15:00.468708 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.472180 32118 raft_consensus.cc:1275] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:15:00.474040 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.474115 32124 raft_consensus.cc:1275] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:15:00.474728   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:00.475165 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:15:00.476249 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.476462 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:00.477226 32117 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:15:00.478235 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:00.478811 32122 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
W20260709 13:15:00.480208  4965 log.cc:927] Time spent T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:15:00.481148 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 46258.5us
I20260709 13:15:00.481839 32165 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:00.484099 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:00.483054 32165 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:00.489030 32165 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:00.486682 32267 raft_consensus.cc:1275] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:15:00.508822 32268 raft_consensus.cc:1275] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:15:00.511467 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:00.518721 32165 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:00.523744 32165 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:00.529865 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:00.505204  4890 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:00.527010 32165 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:00.484768  4761 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:00.505657  4893 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:15:00.550560  4922 log.cc:927] Time spent T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.740s	user 0.002s	sys 0.002s
I20260709 13:15:00.519057  4946 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:00.554781 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:15:00.559049 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.559548 32165 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:00.525684  4684 raft_consensus.cc:2764] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:15:00.529258  4653 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:00.566084 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:00.566653 32268 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
I20260709 13:15:00.518767  4122 consensus_queue.cc:1048] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
W20260709 13:15:00.567430 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:00.574182 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:00.590997 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:00.586796 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.563220 32090 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:00.584858 32165 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:00.546622  4109 consensus_queue.cc:1059] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:15:00.525328  4671 consensus_queue.cc:1048] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:15:00.594503  4235 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:00.596837  4913 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:00.586539  4893 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:00.532833  4909 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:15:00.563100  4899 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:00.562551  4931 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.580176  4625 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:00.569710  4868 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:15:00.616981 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 52258.6us
I20260709 13:15:00.590482  4894 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:00.620560 32165 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:00.624204 32238 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:00.612535  4684 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.632479 32165 leader_election.cc:400] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12.
I20260709 13:15:00.589789  4912 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:15:00.591650  4634 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:15:00.635013  4761 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:00.637437 32165 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:00.618621  4893 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:00.624990  4931 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:00.613835  4914 consensus_queue.cc:1048] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
W20260709 13:15:00.640261  4961 log.cc:927] Time spent T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:15:00.622713  4789 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:15:00.624706  4760 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:00.614055  4795 consensus_queue.cc:1048] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:15:00.621112  4908 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:00.612237  4274 consensus_queue.cc:1048] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:15:00.634963  4569 raft_consensus.cc:3055] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:00.660769 32238 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:00.645547 32090 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:00.629714  4625 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:00.666859  4913 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:00.666038  4569 raft_consensus.cc:740] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:00.668632  4913 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:00.669200  4913 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:00.669636  4569 consensus_queue.cc:260] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:00.671120  4569 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:00.675036  4625 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:00.675714 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:00.677017  4919 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:00.667143  4908 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:00.677250 32199 raft_consensus.cc:2393] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 19: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:00.680922  4943 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:15:00.681449   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:00.680917  4919 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:00.641616  4684 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:00.684660   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:00.685271   398 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:00.686619  4684 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:00.688447  4274 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.688632  4650 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:00.648959  4894 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:00.689045 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:00.689770 32265 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 19.
W20260709 13:15:00.690402 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 56442.3us
I20260709 13:15:00.691102 32165 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:00.693591 32165 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:00.694619 32165 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:00.680325  4908 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:00.697954 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:00.698604 32116 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 19.
I20260709 13:15:00.665736  4755 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:00.690040  4913 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:00.697772  4801 consensus_queue.cc:1048] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
W20260709 13:15:00.707618 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.710572 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:00.710927 32239 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:00.711356 32199 raft_consensus.cc:2393] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 15: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:00.712073 32198 raft_consensus.cc:1275] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:15:00.713182   369 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:00.713366 32265 raft_consensus.cc:1275] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:15:00.713366 32193 raft_consensus.cc:1275] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:15:00.712431 32198 pending_rounds.cc:85] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 9
I20260709 13:15:00.714347 32198 pending_rounds.cc:107] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:15:00.714598 32198 raft_consensus.cc:2889] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:00.716779 32124 raft_consensus.cc:1275] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:15:00.667310  4879 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:15:00.719744   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:00.722759 32124 raft_consensus.cc:1275] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:15:00.724151 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:00.724797 32117 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:00.701728  4755 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:00.726238 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.725203 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:00.729568 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:00.730129 32195 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:15:00.728416 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:00.712721  4894 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:00.709841  4684 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:00.689065  4274 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:00.746709 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:00.717123  4761 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:00.716647  4919 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:00.773483 32238 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:00.737730  4755 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:00.744980  4780 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:00.795425  4931 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:00.719497  4555 consensus_queue.cc:1048] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:15:00.716372  4801 consensus_queue.cc:1048] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:15:00.724321  4899 consensus_queue.cc:1048] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:15:00.747599  4894 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:00.777925  4919 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:00.819397 32195 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:15:00.796888  4605 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:00.799474  4780 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:15:00.829686 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.814975 32117 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:15:00.835434 32089 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:00.842588 32089 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:00.815567  4894 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:00.823343  4919 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:00.853561 32089 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:00.844508  4780 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:00.814896  4513 consensus_queue.cc:1048] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
W20260709 13:15:00.856500 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 76740.5us
I20260709 13:15:00.847669  4626 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:00.862397 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:00.863059 32195 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:15:00.844508  4921 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:15:00.858852 32165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.824815  4122 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:15:00.828258  4760 consensus_queue.cc:1059] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
W20260709 13:15:00.870813 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 142420us
I20260709 13:15:00.874042 32195 pending_rounds.cc:85] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 8
I20260709 13:15:00.874395 32195 pending_rounds.cc:107] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:15:00.874647 32195 raft_consensus.cc:2889] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:00.877250  4760 consensus_queue.cc:1243] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer fcfc3281929645969ecedbb0c0af759d log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:15:00.878012  4760 raft_consensus.cc:3055] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:00.878436  4760 raft_consensus.cc:740] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:00.879532  4760 consensus_queue.cc:260] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:00.883213  4921 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:00.868157  4626 raft_consensus.cc:697] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:00.885859  4626 consensus_queue.cc:237] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:00.891757  4971 log.cc:927] Time spent T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:15:00.894922  4894 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:00.899477  4929 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.900256  4929 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:00.902201  4760 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:00.905344  4274 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:00.912365   398 raft_consensus.cc:2468] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:15:00.936877  4894 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:00.943306 32165 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:00.944672  4890 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:00.945237  4890 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:00.947387  4890 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:00.949893 32165 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:00.951746  4674 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:00.955071 32165 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:00.956478 32190 raft_consensus.cc:1275] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:15:00.953924  4755 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:00.949239  4894 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.955575  4890 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:00.965637  4868 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.968848  4653 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:00.970244  4929 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:00.975725  4780 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:00.980947  4868 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:00.982733 32165 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:00.951892  4626 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:00.988992 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 135561us
I20260709 13:15:00.998184 32165 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:00.999677 32089 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:00.999984 32165 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:00.961488  4919 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:01.003356 32089 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:01.006734 32165 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:01.013760 32089 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:00.968312  4894 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:01.018718  4923 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:15:01.020457 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 148064us
W20260709 13:15:01.006685  4980 log.cc:927] Time spent T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:15:01.018571  4674 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:01.002496  4653 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:01.005728  4982 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:01.006258  4890 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:01.031188 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:01.009056  4946 raft_consensus.cc:2764] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:15:01.033346 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:01.035523 32118 raft_consensus.cc:1275] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:15:01.009249  4657 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:01.039448 32123 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 15.
I20260709 13:15:01.031613 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:01.040992  4569 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:01.041749 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:01.041915  4541 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:15:01.043015  4978 log.cc:927] Time spent T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:15:01.048036 32118 pending_rounds.cc:85] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d: Aborting all ops after (but not including) 8
I20260709 13:15:01.049602 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:01.061439 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:01.073462 32118 pending_rounds.cc:107] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:15:01.073896 32118 raft_consensus.cc:2889] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:01.062383 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:01.006491  4626 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:01.079329 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:01.079784 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:01.036705  4513 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:01.081017 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:01.084359 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:01.081671 32165 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:01.085199 32193 raft_consensus.cc:2393] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 15: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:01.085367 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:01.083333 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:01.086421 32165 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:01.087888 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:01.089491 32120 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:15:01.093261 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:01.094162 32193 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 16.
I20260709 13:15:01.095386 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:01.089831 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:01.085984 32194 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
I20260709 13:15:01.097983 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:01.098141 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:01.098595 32194 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:15:01.099009 32122 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:15:01.099179 32199 raft_consensus.cc:2393] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 15: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:01.102144 32194 raft_consensus.cc:1275] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:15:01.077517  4541 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:01.100467  4899 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:01.109637  4912 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.121163  4919 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:01.121722  4912 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:01.097738  4513 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:01.127326  4513 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:01.128031  4899 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.128499  4899 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:01.115950  4868 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:01.135114 32195 raft_consensus.cc:2410] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:15:01.136508  4795 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.137125  4795 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:01.139624  4795 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:01.141748 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:01.142457 32195 raft_consensus.cc:2468] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 9.
I20260709 13:15:01.143945  4893 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:01.153461 32194 raft_consensus.cc:1275] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:15:01.118530  4984 log.cc:927] Time spent T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.127s	user 0.000s	sys 0.002s
I20260709 13:15:01.161396 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:01.162024 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:01.166014 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:01.162103 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:01.162966 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:01.163343 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:01.167092 32268 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 15.
W20260709 13:15:01.164252 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 77985.9us
I20260709 13:15:01.164548 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:01.166179 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:01.166373 32267 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:15:01.171849 32089 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:01.173512 32267 raft_consensus.cc:1275] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:15:01.175408 32265 raft_consensus.cc:1240] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:15:01.177814 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:01.121163  4894 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:01.151881  4912 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:01.181833 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:01.185702 32267 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:15:01.186189 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:01.190060 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:01.190577  4626 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:01.164671  4755 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:01.201454 32117 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 19.
I20260709 13:15:01.205746 32089 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:01.208806 32089 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:01.209302 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:01.209802  4626 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:01.232086  4946 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:01.235170  4710 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:01.235855  4710 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.236310  4710 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:15:01.240346 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 77558.2us
I20260709 13:15:01.240736  4894 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:01.243516 32165 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:01.245780 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:01.246716 32165 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:01.211184  4868 raft_consensus.cc:2749] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:01.249300 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:01.249976 32117 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 15.
I20260709 13:15:01.250218  4541 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:01.250747  4913 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:01.251402  4780 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:01.259076 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:01.264338 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:01.265287 32193 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:01.223814 32089 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:01.269749 32267 raft_consensus.cc:2368] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 15. Current term is 16.
I20260709 13:15:01.269905 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:15:01.269384 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 45635.7us
I20260709 13:15:01.272825 32089 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:01.274395 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:01.275395 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:01.276136 32264 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
I20260709 13:15:01.277925 32268 raft_consensus.cc:1275] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:15:01.278749 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:01.279547 32196 raft_consensus.cc:2393] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 19: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:01.285945 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:01.280365 32089 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:01.289614 32191 raft_consensus.cc:1240] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:01.296131 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:15:01.298451 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 51828.8us
I20260709 13:15:01.270354  4894 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:01.274068  4913 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:01.308876 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:01.303627 32193 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:15:01.302898 32089 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:01.305274 32165 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:01.310508  4913 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.297515  4945 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.288853  4868 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:15:01.401729 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 96557.4us
W20260709 13:15:01.402508 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 99721.8us
I20260709 13:15:01.299386  4923 raft_consensus.cc:2804] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:01.405447 32238 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:01.299178  4893 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:01.410147 32165 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:01.411082 32238 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:15:01.392095  4977 log.cc:927] Time spent T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:15:01.417742 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:01.419214 32165 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:01.413229 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:01.421097 32270 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:15:01.407320  4998 consensus_queue.cc:1048] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:15:01.423247  4755 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:01.404731  4913 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:01.393795  4626 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:01.393512  4513 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:01.406853  4657 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:01.307418  4929 consensus_queue.cc:1048] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.115s
W20260709 13:15:01.417382  4989 log.cc:927] Time spent T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:15:01.407150  4946 raft_consensus.cc:2749] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:01.414724  4923 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.418172  4982 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:01.418081  4541 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:15:01.457482   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 62487.9us
I20260709 13:15:01.427528  4674 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:01.463975   368 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:01.464865  5004 raft_consensus.cc:2804] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:01.465283  5004 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.465634  5004 raft_consensus.cc:3060] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:01.430905  4755 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.478603 32271 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 19.
I20260709 13:15:01.428772  4997 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:01.480252 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:01.480576 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:01.446349  4513 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:01.481556 32165 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:01.484162  4999 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:01.487437 32238 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:01.488744  4912 consensus_queue.cc:1059] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:01.461699  4923 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:15:01.491866  4994 log.cc:927] Time spent T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 13:15:01.437021  4684 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:01.414143  4945 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:01.438095  4916 consensus_queue.cc:1048] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.081s
W20260709 13:15:01.537045 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 49671.6us
I20260709 13:15:01.474634  4996 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:01.494704  4755 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:01.460947  4893 consensus_queue.cc:1048] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 13:15:01.445227  4626 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:01.553980   369 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:01.536123  4674 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:01.517373  4541 raft_consensus.cc:697] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:01.560655   402 raft_consensus.cc:1275] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:15:01.558662 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 129675us
I20260709 13:15:01.564015 32090 leader_election.cc:400] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 15. Current term is 16.
I20260709 13:15:01.564544 32090 leader_election.cc:403] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:15:01.541569  4684 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.542743  4789 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:01.477716  4982 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:01.559085  4674 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.567757  4943 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:01.565388  4912 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.567989  4684 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:01.578294  4998 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.578079  4653 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:01.553136  4996 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:01.583391  4929 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:01.582929  4789 raft_consensus.cc:697] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:01.618438  4943 raft_consensus.cc:697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 19 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:01.586359  4674 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:15:01.653352 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 81826.5us
I20260709 13:15:01.654697 32090 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:01.596766  4912 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:01.645752  4899 consensus_meta.cc:287] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.517s	user 0.008s	sys 0.004s
I20260709 13:15:01.630324  4653 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:01.634133  4541 consensus_queue.cc:237] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:01.660532  5016 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:01.689756 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:01.698942 32236 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:01.628434  4998 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:01.704553  4998 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:01.696777  4513 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:01.708670  4943 consensus_queue.cc:237] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:01.698064  4945 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:01.714200  4912 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:01.716017  4653 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:01.730567 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:01.719729 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:01.727722 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:01.744288 32269 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
W20260709 13:15:01.743247 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 81547.2us
I20260709 13:15:01.747671 32090 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:01.747671 32165 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:01.749519 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:01.750196 32196 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:15:01.750250 32191 raft_consensus.cc:1240] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:01.670460  4899 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:01.724982  5012 log.cc:927] Time spent T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 13:15:01.725539  5011 log.cc:927] Time spent T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:15:01.720880  4916 raft_consensus.cc:2804] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:01.693322  5016 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:01.763624   369 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:01.723021  4996 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:01.768489 32195 raft_consensus.cc:2368] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 15. Current term is 16.
I20260709 13:15:01.723444  4982 leader_election.cc:290] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:01.776814 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:01.777869 32121 raft_consensus.cc:2393] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 13: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
W20260709 13:15:01.760499  5001 log.cc:927] Time spent T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:15:01.781770 32238 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:01.681798  4789 consensus_queue.cc:237] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:01.763187  4946 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:01.716485  4710 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:01.720608  5015 consensus_queue.cc:1048] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:15:01.764060  4626 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:01.752470  4653 consensus_queue.cc:1048] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:15:01.767710  5016 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:01.801918   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:01.788103  4982 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.792130  4946 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:01.720425  5004 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:01.804738  5030 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:15:01.832959 32239 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.017s	sys 0.015s
W20260709 13:15:01.833484 32239 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.017s	sys 0.015s
W20260709 13:15:01.833874 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 811787us
I20260709 13:15:01.817240  4919 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:01.820747  4946 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:01.816732  4998 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:01.849601 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:01.849840 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:01.851785 32269 raft_consensus.cc:1275] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:15:01.852855 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:01.817238  5028 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:15:01.853612 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 46821.1us
I20260709 13:15:01.861747 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:01.814713  4913 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:01.842777  4235 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:01.878511   402 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:15:01.877102 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:01.881352 32119 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:01.819984  4982 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:01.888846  5024 log.cc:927] Time spent T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 13:15:01.889964  5023 log.cc:927] Time spent T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:15:01.892218  4913 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:01.859624  4919 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:01.878093  4235 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:01.898132 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 62787.6us
I20260709 13:15:01.860940  5028 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.909665 32119 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:15:01.877425  5008 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:01.917565  5028 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:01.917865  5008 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:01.919956  5008 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:01.921631  4569 consensus_queue.cc:1048] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:01.924273  4919 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:01.884421  4916 raft_consensus.cc:697] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:01.926832  4982 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:01.927559  4916 consensus_queue.cc:237] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:01.931399 32165 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:01.933779 32123 raft_consensus.cc:1240] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:15:01.935366 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:01.935904 32119 raft_consensus.cc:1240] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
W20260709 13:15:01.912206 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 46180.7us
I20260709 13:15:01.913321  4674 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:01.874406  4969 consensus_queue.cc:1059] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:15:01.914074  5004 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 10 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:01.868938  4998 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:01.916605  4235 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:01.896365  4755 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:01.938865 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:01.939378 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:01.954058 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:01.958389  4710 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:01.958545  4674 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:01.959328 32193 raft_consensus.cc:1240] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:15:01.947244  4982 consensus_queue.cc:1048] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
W20260709 13:15:01.962852 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 56224us
I20260709 13:15:01.967064 32198 raft_consensus.cc:3060] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:01.967370 32119 raft_consensus.cc:2368] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 15. Current term is 16.
I20260709 13:15:01.974385 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:01.974869 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:01.975087 32119 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:15:01.975868 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:01.976286 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:01.976719 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:01.977375 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:01.975900 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:01.978608 32272 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:01.968134 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:01.981091 32236 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:01.959973  5028 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:01.962745  4671 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.965922  4786 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.965623  4893 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:01.965236  4899 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:02.038679 32272 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
W20260709 13:15:02.005311 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 66903.4us
I20260709 13:15:01.999450  5035 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:01.988646  4684 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:02.016260   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:02.071233 32239 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:02.038915  4674 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:02.038115  4929 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 15. Current term is 16.
I20260709 13:15:02.017294  4669 raft_consensus.cc:2804] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:02.085826 32198 raft_consensus.cc:2468] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 10.
I20260709 13:15:02.095778 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:02.096628 32197 raft_consensus.cc:2368] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10.
I20260709 13:15:02.107239  4998 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:02.055394  5035 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:02.114187 32199 raft_consensus.cc:2393] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 13: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
W20260709 13:15:02.107834  4923 consensus_meta.cc:287] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.565s	user 0.007s	sys 0.003s
W20260709 13:15:02.087208  5025 log.cc:927] Time spent T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:15:02.016208  4671 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:02.105394  4674 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:02.134554 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:02.070302  4801 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:02.019526  4786 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:02.050019  4650 consensus_queue.cc:1059] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:15:02.056648  4109 consensus_queue.cc:1059] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:15:02.097028  4669 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:02.162899 32116 raft_consensus.cc:2393] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 16: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:02.138396   398 raft_consensus.cc:2368] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10.
I20260709 13:15:02.179440  4786 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:02.181661  5036 log.cc:927] Time spent T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260709 13:15:02.183868  5042 log.cc:927] Time spent T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:15:02.188700  5027 log.cc:927] Time spent T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:15:02.191632  4671 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:15:02.193418  5026 log.cc:927] Time spent T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:15:02.194829  5038 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:02.195011  4684 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:02.137305  4923 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:02.196105  4755 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:02.197182  4109 raft_consensus.cc:3055] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:02.215006  4109 raft_consensus.cc:740] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:02.215957  4109 consensus_queue.cc:260] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:02.217155  4109 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:02.220276  5028 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:02.220985   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:02.221681   398 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:15:02.221792  5035 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:02.197731  4923 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:02.199512 32119 raft_consensus.cc:1240] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:15:02.199782  4931 raft_consensus.cc:3055] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:15:02.224978  5002 log.cc:927] Time spent T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:15:02.225080  4931 raft_consensus.cc:740] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:02.226133  4931 consensus_queue.cc:260] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:02.227535  4931 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:02.145459  4801 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:02.229880  4801 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:15:02.201866  4995 log.cc:927] Time spent T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.768s	user 0.004s	sys 0.000s
I20260709 13:15:02.205515 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:02.232193 32118 raft_consensus.cc:2393] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 13: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:02.232687 32124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 2504) took 1162 ms. Trace:
I20260709 13:15:02.232792  4657 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:02.233353  4657 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:02.220997  5003 log.cc:927] Time spent T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:15:02.236099 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:02.236111 32236 leader_election.cc:400] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025) with higher term. Message: Invalid argument: T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10.
I20260709 13:15:02.233078 32124 rpcz_store.cc:276] 0709 13:15:01.069869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.074331 (+  4462us) service_pool.cc:224] Handling call
0709 13:15:01.074767 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:01.075136 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:01.075182 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:01.075712 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:15:01.255111 (+179399us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:01.255169 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:01.255262 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:02.201177 (+945915us) spinlock_profiling.cc:243] Waited 3.51 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:15:02.232381 (+ 31204us) raft_consensus.cc:1685] finished
0709 13:15:02.232402 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:02.232623 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2447,"raft.queue_time_us":758,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":11022,"spinlock_wait_cycles":8064384,"thread_start_us":176141,"threads_started":1,"wal-append.queue_time_us":325719}
I20260709 13:15:02.253459 32236 leader_election.cc:403] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:02.168745  4669 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:02.272928 32268 raft_consensus.cc:2393] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 13: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
W20260709 13:15:02.273923 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 60957us
I20260709 13:15:02.277616 32236 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:02.274869  4671 raft_consensus.cc:3055] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:02.273861  4923 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:02.280201  4555 raft_consensus.cc:3060] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:15:02.286182  4755 raft_consensus.cc:2804] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:02.305680 32265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 2476) took 1060 ms. Trace:
W20260709 13:15:02.306993 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 233699us
I20260709 13:15:02.314057 32239 leader_election.cc:400] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 15. Current term is 16.
I20260709 13:15:02.314482 32239 leader_election.cc:403] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:15:02.293416  4671 raft_consensus.cc:740] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:02.323235 32239 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:02.325265 32089 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:02.306088 32265 rpcz_store.cc:276] 0709 13:15:01.245739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.245947 (+   208us) service_pool.cc:224] Handling call
0709 13:15:01.271609 (+ 25662us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:01.271810 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:01.290249 (+ 18439us) log.cc:844] Serialized 14 byte log entry
0709 13:15:02.140025 (+849776us) spinlock_profiling.cc:243] Waited 5.2 ms on lock 0x7b180024c5e0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bee6e07 00007fb5a4d41ab9 00007fb59bf0369b 00007fb59bf0193f 00007fb59bf03c02 00007fb59eb8b20b 00007fb59eb90d23 00007fb59eb9123a 00007fb59effba2a
0709 13:15:02.305364 (+165339us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:02.305413 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:02.305455 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:02.305523 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:02.305628 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18309,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":2810,"spinlock_wait_cycles":11967232,"thread_start_us":165095,"threads_started":1}
I20260709 13:15:02.304077  4755 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:02.304231  4893 raft_consensus.cc:697] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
W20260709 13:15:02.321698  5016 consensus_meta.cc:287] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.504s	user 0.011s	sys 0.000s
I20260709 13:15:02.317008  4801 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 15. Current term is 16.
I20260709 13:15:02.294322  4946 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:02.300220  4923 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:02.330236  4879 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:02.327886  5015 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:02.325536  4996 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:02.335217  4755 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:02.333215  4513 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:15:02.365598 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.334513  5031 consensus_queue.cc:1048] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:15:02.393630 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:02.394573 32124 raft_consensus.cc:2393] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 13: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:02.394394 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:02.395839 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:02.401347  4674 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:02.372885  5015 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:02.396718  5031 consensus_queue.cc:1243] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer 113b5461952d47e0944d463ea4e32801 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:15:02.405896  4893 consensus_queue.cc:237] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:02.407447  4946 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:02.410430  4235 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:02.392603  4671 consensus_queue.cc:260] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:02.363329  5016 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:02.414301 32121 raft_consensus.cc:1240] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:02.371554  4996 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:02.421039 32192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56926 (request call id 614) took 1712 ms. Trace:
I20260709 13:15:02.429409 32192 rpcz_store.cc:276] 0709 13:15:00.708184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:00.709151 (+   967us) service_pool.cc:224] Handling call
0709 13:15:00.709395 (+   244us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:01.413534 (+704139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:01.413573 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:01.423115 (+  9542us) log.cc:844] Serialized 26 byte log entry
0709 13:15:01.832236 (+409121us) spinlock_profiling.cc:243] Waited 6.02 ms on lock 0x7b1800423100. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bee6e07 00007fb5a4d41ab9 00007fb59bf0369b 00007fb59bf0193f 00007fb59bf03c02 00007fb59eb8b20b 00007fb59eb90d23 00007fb59eb910d1 00007fb59efaca0f
0709 13:15:01.878468 (+ 46232us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:15:01.878546 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:02.420725 (+542179us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b54002111d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:15:02.420775 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:02.420818 (+    43us) raft_consensus.cc:1685] finished
0709 13:15:02.420831 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:02.420969 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":563,"raft.queue_time_us":139,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":10741,"spinlock_wait_cycles":1613955200,"thread_start_us":45872,"threads_started":1,"wal-append.queue_time_us":593208}
I20260709 13:15:02.412555  4235 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:15:02.438894  5006 log.cc:927] Time spent T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.777s	user 0.002s	sys 0.000s
I20260709 13:15:02.441277  4755 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:02.443718  4755 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:02.444064 32194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3794) took 1214 ms. Trace:
I20260709 13:15:02.444458 32194 rpcz_store.cc:276] 0709 13:15:01.229923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.270622 (+ 40699us) service_pool.cc:224] Handling call
0709 13:15:01.270954 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:01.280160 (+  9206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:01.280194 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:01.287038 (+  6844us) log.cc:844] Serialized 26 byte log entry
0709 13:15:01.540347 (+253309us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:15:01.540391 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:01.540467 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:02.438426 (+897959us) spinlock_profiling.cc:243] Waited 3.65 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:15:02.443773 (+  5347us) raft_consensus.cc:1685] finished
0709 13:15:02.443796 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:02.444002 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":130,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":8026,"spinlock_wait_cycles":8402816,"thread_start_us":131643,"threads_started":1,"wal-append.queue_time_us":285496}
I20260709 13:15:02.446828 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:02.447517 32117 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:15:02.450278 32195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54182 (request call id 3787) took 1281 ms (client timeout 1562 ms). Trace:
W20260709 13:15:02.450716 32195 rpcz_store.cc:269] 0709 13:15:01.169170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.184327 (+ 15157us) service_pool.cc:224] Handling call
0709 13:15:02.450055 (+1265728us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b54002107d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:15:02.450193 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1333809408}
I20260709 13:15:02.456444 32117 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:15:02.458384  4274 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:02.460871  4274 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:02.461843 32239 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:02.463658  4274 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:02.460883   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:02.464856  4912 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:02.454233  5021 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:02.477589  4912 raft_consensus.cc:697] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:02.477533  5021 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:02.478642  4912 consensus_queue.cc:237] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:02.480032  5021 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:15:02.482376 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 227622us
I20260709 13:15:02.486331  5050 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:02.486599   368 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:02.486908  5050 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:02.489657  4674 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:02.490217  4674 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:02.492575 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:02.493410 32195 raft_consensus.cc:2393] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 11: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:02.494310 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:02.494684 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:02.494907 32195 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 11.
I20260709 13:15:02.495357  4996 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:15:02.496042  5055 log.cc:927] Time spent T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:15:02.496104 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:02.496945 32116 raft_consensus.cc:2368] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 13. Current term is 14.
I20260709 13:15:02.498513 32199 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:15:02.484560  4555 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025) with higher term. Message: Invalid argument: T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10.
I20260709 13:15:02.505921 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:02.506178  5050 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:02.506633 32194 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:15:02.511255 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:02.511554 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:02.512059 32267 raft_consensus.cc:2393] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 13: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:01.639782 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:02.496863 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:02.517731 32192 raft_consensus.cc:2393] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 13: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:02.518150 32165 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:02.490084  4795 raft_consensus.cc:2804] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:02.519532  4795 raft_consensus.cc:697] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 10 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:02.520052 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:02.520421  4795 consensus_queue.cc:237] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:02.521445 32022 catalog_manager.cc:5697] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 7 to 8, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 8 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:02.492355  4674 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:02.523356 32022 catalog_manager.cc:5697] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 7 to 8, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 8 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:02.526997 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:02.511791 32122 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:15:02.528968   368 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:02.549979 32238 leader_election.cc:400] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10.
W20260709 13:15:02.534638 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 50133.7us
I20260709 13:15:02.551433 32238 leader_election.cc:400] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 15. Current term is 16.
I20260709 13:15:02.551733 32165 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:02.555020   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 117835us
I20260709 13:15:02.556188 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:02.565202 32269 raft_consensus.cc:2468] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 10.
I20260709 13:15:02.567466 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:02.571264 32265 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 11.
I20260709 13:15:02.568815 32267 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:15:02.574410   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:02.576331 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:02.576952 32190 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:02.577338 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:02.578755 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:02.580091 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:02.573858   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:02.590061 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:02.591162 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:02.597961 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:02.599812 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:02.601341   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:02.602371   402 raft_consensus.cc:2368] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10.
I20260709 13:15:02.546912  4999 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.607750 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:02.604377 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:02.609915 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:02.573108  4899 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:02.573392  5050 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.574007  4653 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:02.617569 32238 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:02.618865 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:02.612277 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:02.613363 32192 raft_consensus.cc:2393] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 11: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:02.533944  4669 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:02.615018 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:15:02.616616   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 44163.2us
I20260709 13:15:02.626621 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:02.627918  4894 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.630343 32199 raft_consensus.cc:2393] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 13: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:02.627923 32190 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:15:02.627341 32238 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:02.592891  4946 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:02.643653 32165 leader_election.cc:400] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 13. Current term is 14.
I20260709 13:15:02.644017 32165 leader_election.cc:403] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:15:02.641149 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:02.642458 32238 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:02.609934  4893 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:02.646070 32196 raft_consensus.cc:1275] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:15:02.646085 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:02.644379 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:02.625375  5061 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.596568  4957 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:15:02.648788 32268 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:15:02.636087  4908 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:15:02.781282 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 137749us
I20260709 13:15:02.614035  4999 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:02.859715  4999 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:02.864642 32165 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:02.870301  4684 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:02.871091  4684 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:02.645328  4998 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:02.649662  4605 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:15:02.850225  5062 log.cc:927] Time spent T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:15:02.647891  4946 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:02.856262 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 137038us
I20260709 13:15:02.860337  4999 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:02.871449  4789 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:02.816813 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:02.626540  5050 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:15:02.887245 32270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 2478) took 1260 ms. Trace:
W20260709 13:15:03.014351   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 396568us
I20260709 13:15:03.014546 32270 rpcz_store.cc:276] 0709 13:15:01.627176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.627399 (+   223us) service_pool.cc:224] Handling call
0709 13:15:01.627702 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:01.721150 (+ 93448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:01.721198 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:01.721688 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:15:01.771320 (+ 49632us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:01.771379 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:02.886739 (+1115360us) spinlock_profiling.cc:243] Waited 92.9 ms on lock 0x7b54002fd0d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:15:02.886819 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:02.886887 (+    68us) raft_consensus.cc:1685] finished
0709 13:15:02.886907 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:02.887176 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1435,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":96,"spinlock_wait_cycles":213748096,"thread_start_us":49192,"threads_started":1,"wal-append.queue_time_us":250931}
I20260709 13:15:02.816524  4997 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 13. Current term is 14.
I20260709 13:15:02.724884  4908 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:02.642143  4894 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:02.966503 32121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 2512) took 1056 ms. Trace:
I20260709 13:15:02.650238  4893 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:02.980015  5065 log.cc:927] Time spent T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:15:02.816869  4899 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:02.897583  4755 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:02.654873  5061 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:03.011111 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 100317us
I20260709 13:15:02.931322  4999 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:03.011737 32123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 3822) took 1024 ms. Trace:
W20260709 13:15:03.031407 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 167082us
I20260709 13:15:03.029623 32121 rpcz_store.cc:276] 0709 13:15:01.910146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.910302 (+   156us) service_pool.cc:224] Handling call
0709 13:15:01.913191 (+  2889us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:02.428967 (+515776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:02.966109 (+537142us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b54003f43d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:15:02.966414 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1151994240}
I20260709 13:15:03.040352 32165 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:03.008399  5070 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:03.038975 32123 rpcz_store.cc:276] 0709 13:15:01.987154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.987371 (+   217us) service_pool.cc:224] Handling call
0709 13:15:01.987686 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:02.109190 (+121504us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:02.109223 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:02.109267 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:02.109300 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:02.967925 (+858625us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b5400032854. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:15:03.011565 (+ 43640us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:03.011682 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":278989568}
I20260709 13:15:03.029213  4908 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:03.027251  4539 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:03.054392 32190 raft_consensus.cc:1275] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:15:03.069595  5015 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:03.073457  4997 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:03.073952  4997 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:03.074324  4997 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:03.075980  4916 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
W20260709 13:15:03.077160 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.082221 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:03.082728 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:03.085562 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:03.087329 32123 raft_consensus.cc:2393] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 14: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:03.025743  4789 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:03.090781 32087 leader_election.cc:400] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Vote denied by peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025) with higher term. Message: Invalid argument: T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10.
I20260709 13:15:03.039844  4899 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:03.091254 32087 leader_election.cc:403] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:03.094575 32120 raft_consensus.cc:1275] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:03.128021  4669 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:03.128327  4893 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:03.128680  5070 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:03.129251  5070 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:03.131505  5070 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:03.040073  4755 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:03.076541  4916 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:03.132879 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:03.133095  4999 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:03.134176  4755 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:03.134577  5061 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:03.078085  4539 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:03.135339  4916 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:03.136080  4894 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:03.137992  4684 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:15:03.087384   396 consensus_meta.cc:287] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6: Time spent flushing consensus metadata: real 0.622s	user 0.008s	sys 0.008s
I20260709 13:15:03.140153  4789 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:03.140426   396 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:15:03.141414  4946 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:03.146298 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 55735.1us
I20260709 13:15:03.136128  4899 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:03.168673 32087 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:03.199806  5061 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:03.136518  4539 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:03.163326  4929 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:15:03.199164  4800 raft_consensus.cc:2804] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:03.218895 32122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56890 (request call id 3811) took 1284 ms. Trace:
I20260709 13:15:03.219313 32122 rpcz_store.cc:276] 0709 13:15:01.934973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.935144 (+   171us) service_pool.cc:224] Handling call
0709 13:15:03.218666 (+1283522us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b54003f57d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:15:03.218827 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1303163776}
I20260709 13:15:03.220577 32118 raft_consensus.cc:1275] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:15:03.291513 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:03.300194 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:03.300940 32265 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:15:03.330792 32090 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:03.334405 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:03.278111  4684 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.277882  4946 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:03.360095 32199 raft_consensus.cc:1275] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:15:03.351634  4513 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:03.470679  4957 consensus_queue.cc:1048] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:03.387964  4513 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:03.490895 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 444442us
I20260709 13:15:03.373982  4997 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:03.486153   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 441356us
I20260709 13:15:03.518002 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:03.375638  4684 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:03.529985 32265 raft_consensus.cc:1275] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:03.531634 32124 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:15:03.379278  4946 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:03.428448  5004 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.602898 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:03.490839  4987 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:03.494378  4513 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:03.584805  5077 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:03.602726  4894 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:03.629876  4653 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:03.609927  5076 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:03.658074 32165 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:03.610574 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 67505.4us
I20260709 13:15:03.493134  5028 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:03.494688  5035 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:03.657101  5077 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:03.666730  5077 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:03.667330  5076 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:03.668808  5035 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:03.669528  5076 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:03.670137  5084 consensus_queue.cc:1059] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:03.671002  5084 raft_consensus.cc:3055] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:15:03.651079   399 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.000s	sys 0.035s
I20260709 13:15:03.671039  5035 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:03.671491  5084 raft_consensus.cc:740] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
W20260709 13:15:03.672140   399 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.000s	sys 0.035s
I20260709 13:15:03.642778  4893 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:03.673117   399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38176 (request call id 219) took 1088 ms. Trace:
I20260709 13:15:03.673188  4893 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:03.675549  4893 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:03.662628  4894 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:03.678411  4894 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:03.662772  4653 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:03.681349  4653 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:03.629354  4800 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.609763  4999 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:03.672369  5084 consensus_queue.cc:260] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:03.703557 32273 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.003s	sys 0.004s
W20260709 13:15:03.704084 32273 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.004s	sys 0.004s
I20260709 13:15:03.673761   399 rpcz_store.cc:276] 0709 13:15:02.584381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.592714 (+  8333us) service_pool.cc:224] Handling call
0709 13:15:02.647385 (+ 54671us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:02.790831 (+143446us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:15:03.041967 (+251136us) log.cc:844] Serialized 14 byte log entry
0709 13:15:03.672615 (+630648us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:03.672693 (+    78us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:03.672766 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:03.672863 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:03.673020 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":371812,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":9391,"raft.queue_time_us":22918,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":802069,"threads_started":2}
I20260709 13:15:03.468786  5031 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
W20260709 13:15:03.610395   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 56744.8us
I20260709 13:15:03.694523  4800 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:03.763469  4946 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:03.764672  5081 log.cc:927] Time spent T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:15:03.602010  5004 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:03.690235  5007 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:03.701933  5076 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:03.686203  5028 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:03.662159  4987 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:03.767005 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 102790us
W20260709 13:15:03.796859 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.779892  5084 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:03.707401  4999 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:03.766927   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 44147.3us
W20260709 13:15:03.816545  4929 consensus_meta.cc:287] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.604s	user 0.011s	sys 0.000s
I20260709 13:15:03.797122  4946 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:03.774596  5071 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:15:03.773590  5082 consensus_queue.cc:1048] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:15:03.772795  5031 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:03.784510  5007 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:03.857692  4929 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025) with higher term. Message: Invalid argument: T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10.
I20260709 13:15:03.883828 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:03.882925  4539 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.889690  4999 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:03.889595  4539 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:03.878724  5061 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.901080 32124 raft_consensus.cc:2468] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 10.
I20260709 13:15:03.700305 32165 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:03.903412 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 203185us
W20260709 13:15:03.779960 32239 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.001s	sys 0.046s
W20260709 13:15:03.911612 32239 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.001s	sys 0.046s
I20260709 13:15:03.861455  4946 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:03.911929 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 832190us
I20260709 13:15:03.887310  4684 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:03.910753  4653 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:03.917397  4894 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.959733 32196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56926 (request call id 637) took 1071 ms. Trace:
I20260709 13:15:03.961313  4539 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:15:03.932808  4908 consensus_meta.cc:287] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.853s	user 0.009s	sys 0.003s
I20260709 13:15:03.961725  5021 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:03.962412  4908 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:03.962656  5021 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:03.964851  4894 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:03.967200  4894 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:03.968258 32270 raft_consensus.cc:1240] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:03.969432  5021 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:03.960381 32196 rpcz_store.cc:276] 0709 13:15:02.888189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.889617 (+  1428us) service_pool.cc:224] Handling call
0709 13:15:02.890497 (+   880us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:02.891185 (+   688us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:15:02.930019 (+ 38834us) log.cc:844] Serialized 14 byte log entry
0709 13:15:03.269326 (+339307us) log.cc:844] Serialized 14 byte log entry
0709 13:15:03.269488 (+   162us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:03.332670 (+ 63182us) log.cc:844] Serialized 574 byte log entry
0709 13:15:03.332892 (+   222us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:03.332947 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:03.333041 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:03.959370 (+626329us) raft_consensus.cc:1685] finished
0709 13:15:03.959404 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:03.959642 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":38914,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":42861,"raft.queue_time_us":179558,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":70792,"spinlock_wait_cycles":13799680,"thread_start_us":231933,"threads_started":1,"wal-append.queue_time_us":458343}
W20260709 13:15:03.961357  5085 log.cc:927] Time spent T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:15:03.970937  4908 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:03.973308  4913 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:03.974112  4913 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:03.977753  4913 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:03.978634  4913 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:03.979857  5021 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:03.980991  5021 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:03.981922  4913 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:03.911069  5076 consensus_queue.cc:1048] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:15:03.911484  5061 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:15:03.959950  4970 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:04.000876  5082 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.001485  5082 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:04.002766  4923 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.003372  4923 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:04.003765  5082 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:04.004104  4684 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:04.004627  4684 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:04.005040 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:03.950464  5087 consensus_queue.cc:1059] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:15:03.936902  5028 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:03.948153  5004 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.016273  5021 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.018162  4946 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.022534  4800 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:04.023279  5050 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.024035  5050 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:04.001479  5061 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.033784 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:04.034705 32271 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:04.026721  4946 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:04.037067 32193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3803) took 2442 ms. Trace:
I20260709 13:15:04.037293  4946 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:04.044195  5007 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.045426  5076 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:04.046087  5076 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:04.026194  4800 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.048952  5076 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:04.003801  4923 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:04.037493 32193 rpcz_store.cc:276] 0709 13:15:01.594727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.599382 (+  4655us) service_pool.cc:224] Handling call
0709 13:15:01.599716 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:01.972133 (+372417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:04.036799 (+2064666us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b54002a7454. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:15:04.037007 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":826353920}
I20260709 13:15:04.052842  4946 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.027335  4999 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:04.010085  4970 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:04.061276  5016 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.062572 32272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 2991) took 1050 ms. Trace:
I20260709 13:15:04.076467 32271 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 12.
I20260709 13:15:04.076458 32272 rpcz_store.cc:276] 0709 13:15:03.012244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.012598 (+   354us) service_pool.cc:224] Handling call
0709 13:15:03.013039 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:03.146077 (+133038us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:03.146107 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:03.146144 (+    37us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:03.146182 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:04.062347 (+916165us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b5400427cd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:15:04.062394 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:04.062518 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":305435904}
I20260709 13:15:04.077978 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.065140  5071 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:04.066533 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:04.081337 32196 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:04.070624 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.072424 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.083065 32268 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:15:04.078022 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.083851 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.064826  5007 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:04.033751 32273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 2986) took 1444 ms. Trace:
I20260709 13:15:04.083966 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.087188 32268 raft_consensus.cc:2410] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
W20260709 13:15:04.089576   365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.876s	user 0.004s	sys 0.029s
W20260709 13:15:04.191614   365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.157s	user 0.004s	sys 0.030s
I20260709 13:15:04.073828  5089 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.087514 32273 rpcz_store.cc:276] 0709 13:15:02.589605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.589836 (+   231us) service_pool.cc:224] Handling call
0709 13:15:02.590206 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:02.590467 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:03.749787 (+1159320us) log.cc:844] Serialized 14 byte log entry
0709 13:15:04.031234 (+281447us) log.cc:844] Serialized 14 byte log entry
0709 13:15:04.031468 (+   234us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:04.031531 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:04.031620 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:04.031709 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:04.033667 (+  1958us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":558770,"prepare.queue_time_us":1285484,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":86,"raft.queue_time_us":2211,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":49652,"spinlock_wait_cycles":38610944,"thread_start_us":827433,"threads_started":2,"wal-append.queue_time_us":285315}
I20260709 13:15:04.197527 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.207510 32196 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 12.
I20260709 13:15:04.211897 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:04.212157 32089 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:15:04.212622 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.213469 32089 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:04.088093  5071 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:04.088342  5007 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:04.209249  4653 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:04.209551  4946 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:04.211663  5089 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:04.027072  5050 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:04.211843  5016 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:04.194623  5077 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:04.242267 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.243242 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.243866 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.244199 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.228753 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.078799  4999 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:04.195695  5076 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:04.288291 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.317611 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.292078 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.214962 32089 leader_election.cc:304] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:04.287912 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.305130 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.287402 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.188138  5084 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:15:04.323424 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 108528us
I20260709 13:15:04.326694 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.214105  5061 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:15:04.223927  5066 log.cc:927] Time spent T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 1.255s	user 0.009s	sys 0.016s
W20260709 13:15:04.307188   369 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.30.63.3:36651 timed out after 1.870s (SENT) [suppressed 9 similar messages]
I20260709 13:15:04.238157  4684 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:04.226862  4513 consensus_meta.cc:287] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.564s	user 0.011s	sys 0.000s
I20260709 13:15:04.229543  4893 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:04.328940 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.210146  4772 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:04.240477  4987 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.218677  5071 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.237404  4913 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.229281  4894 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:04.236001  5016 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:04.330005 32272 raft_consensus.cc:1240] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:04.327580 32089 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:04.236984  5086 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:04.232102  5050 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:04.211848  5083 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:04.229858  5089 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:04.239964  4970 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:04.225998  4923 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.356712  4513 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:04.357081  4684 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:04.358628  4999 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.236707  5028 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:04.226934  5007 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:04.237288  5077 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:04.367244 32089 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:04.380183  4913 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:04.227805  4946 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:04.384203 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.399976 32271 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:15:04.227313  4653 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:04.385643   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 188439us
I20260709 13:15:04.386075 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.325196  5076 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:04.330052  5084 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:04.392987   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 85838us
I20260709 13:15:04.326581  5095 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:04.398237 32089 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:04.362753  4893 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:04.362372  4772 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:04.365965  4894 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:04.409070   368 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:04.395990  4999 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:04.418896  4999 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:04.419903  5016 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.420933  5102 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.421245  4999 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.421455  5102 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:04.422506  4999 consensus_queue.cc:1048] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:04.423658  5102 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.383343  5083 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:04.425935  5083 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.393976  4684 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:04.427444  4513 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.428783  4684 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.429868  4946 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.430462  4987 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:04.381804  5086 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:04.433852 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.414877 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.415069 32089 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:04.402704  4923 raft_consensus.cc:2749] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:04.437454  5076 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.439467 32089 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:04.443243 32089 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:04.448450 32089 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:15:04.453410 32162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 73340.8us
I20260709 13:15:04.455235 32089 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:04.441370  5095 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:04.451639  5007 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:04.454111  4923 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:04.455008  4513 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:15:04.469843 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 58981.3us
I20260709 13:15:04.473737 32165 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:04.475229  4674 consensus_queue.cc:1059] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:04.476815  5050 raft_consensus.cc:3055] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:04.477226  5050 raft_consensus.cc:740] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:04.478142  5050 consensus_queue.cc:260] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:04.479405  5050 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:04.462589  4982 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:15:04.557471 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 83781.5us
I20260709 13:15:04.559859 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.560472 32196 raft_consensus.cc:1275] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:15:04.560649 32191 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:15:04.562150 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.562980 32193 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 16.
I20260709 13:15:04.574206 32195 raft_consensus.cc:1217] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 6.5->[8.6-11.8]   Dedup: 8.6->[9.7-11.8]
I20260709 13:15:04.574791 32195 pending_rounds.cc:85] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 6
I20260709 13:15:04.575047 32195 pending_rounds.cc:107] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:15:04.575284 32195 raft_consensus.cc:2889] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:04.580940 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.584695 32267 raft_consensus.cc:2393] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 11: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:04.585942  4894 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.587873  4772 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.588482  4772 raft_consensus.cc:2804] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:04.588941  4772 raft_consensus.cc:697] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 12 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:04.589766  4772 consensus_queue.cc:237] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:04.598671  4653 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.487866  5086 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.602267  5077 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.568043  5109 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:04.604003  5109 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:04.606348  5109 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.606606  4997 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.586095  4946 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:04.573041  5076 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:04.631366  5076 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.631781  5076 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:04.623967  5095 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.633455  5095 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:04.635844  5095 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.626185   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:04.626880   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:04.624130  4914 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:04.628939  4946 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:04.630654  4982 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:04.628360  4893 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.637820 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:04.642738 32267 raft_consensus.cc:2376] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 10. Re-sending same reply.
I20260709 13:15:04.667937 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.669232 32197 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:15:04.670426 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.671231 32197 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 16.
I20260709 13:15:04.672283 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.673004 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.668000 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:04.675091 32192 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:15:04.676339 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.677158 32192 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
I20260709 13:15:04.678225 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.678925 32192 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:15:04.679193 32190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 3834) took 2070 ms. Trace:
I20260709 13:15:04.679725 32190 rpcz_store.cc:276] 0709 13:15:02.609287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.638415 (+ 29128us) service_pool.cc:224] Handling call
0709 13:15:02.638647 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:03.063961 (+425314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:04.678961 (+1615000us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b54002125d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:15:04.679136 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":955327232}
I20260709 13:15:04.681054 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.641337   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:04.690189 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.690860 32198 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:15:04.650169  4914 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:04.692808  4914 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.650481   396 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:15:04.700477 32199 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 16.
I20260709 13:15:04.653133  4982 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:04.703991  4982 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.709331 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.710984 32270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 2992) took 1431 ms. Trace:
I20260709 13:15:04.714360 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.715226 32199 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:15:04.714659 32270 rpcz_store.cc:276] 0709 13:15:03.279590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.279717 (+   127us) service_pool.cc:224] Handling call
0709 13:15:03.280023 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:03.968774 (+688751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:04.710569 (+741795us) spinlock_profiling.cc:243] Waited 688 ms on lock 0x7b5400415d54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:15:04.710878 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1582226816}
W20260709 13:15:04.713285 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 251381us
W20260709 13:15:04.691037  5104 log.cc:927] Time spent T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 13:15:04.712455 32194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2685) took 2136 ms. Trace:
I20260709 13:15:04.717330 32194 rpcz_store.cc:276] 0709 13:15:02.575580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.575697 (+   117us) service_pool.cc:224] Handling call
0709 13:15:02.575986 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:03.483634 (+907648us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:03.483682 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:03.492680 (+  8998us) log.cc:844] Serialized 26 byte log entry
0709 13:15:03.910281 (+417601us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:03.910311 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:04.711954 (+801643us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b54000f9454. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:15:04.712008 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:04.712060 (+    52us) raft_consensus.cc:1685] finished
0709 13:15:04.712075 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:04.712368 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38522,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":72,"spinlock_wait_cycles":1054206208,"thread_start_us":720457,"threads_started":2,"wal-append.queue_time_us":360745}
I20260709 13:15:04.720692 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.696297  4946 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.766418 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.768203 32199 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:15:04.769544 32272 raft_consensus.cc:1275] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:15:04.676016  4657 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.771195 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.773418 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.774124 32194 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
I20260709 13:15:04.778304 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.779212 32194 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:15:04.776858 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.780269 32199 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:15:04.764389  4893 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.783330 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.783948 32199 raft_consensus.cc:2468] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 8.
I20260709 13:15:04.784829 32122 raft_consensus.cc:1275] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:15:04.786496 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.787171 32199 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:15:04.791394 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:04.792133 32199 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:04.793181 32120 raft_consensus.cc:1275] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:15:04.798483 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:04.774475  4109 consensus_queue.cc:1048] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
W20260709 13:15:04.808705   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 399693us
W20260709 13:15:04.809576 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.828797 32199 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
I20260709 13:15:04.829881 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.830420 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.831487 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.833420 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.786707  4893 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:04.837909 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.838546 32199 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:15:04.840248 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.841288 32199 raft_consensus.cc:2410] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 18 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:15:04.842026 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.843024 32199 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:15:04.843819 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.844386 32199 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:15:04.845939 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.846796 32198 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 16.
I20260709 13:15:04.846271 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.851789 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:04.852494 32119 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:15:04.855100 32118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 3834) took 2423 ms. Trace:
I20260709 13:15:04.855508 32118 rpcz_store.cc:276] 0709 13:15:02.431835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.431999 (+   164us) service_pool.cc:224] Handling call
0709 13:15:03.218811 (+786812us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:03.221079 (+  2268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:04.854897 (+1633818us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b54003f57d0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff08ad 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:15:04.855043 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1808763264}
I20260709 13:15:04.861294 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:04.826777  4657 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.879496 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:04.881462 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:04.883396 32199 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:04.890256 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.898671 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.902015  4893 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:04.907480 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:04.913877 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.908253 32118 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 8.
W20260709 13:15:04.916548  4991 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.765s	user 0.013s	sys 0.018s
I20260709 13:15:04.912343   369 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:04.882577  4657 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:04.924532   369 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:04.925143 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:04.927915  5112 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:04.930636 32118 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:15:04.931245 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:15:04.933602   367 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.007s	sys 0.019s
I20260709 13:15:04.933559 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:15:04.935139   367 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.007s	sys 0.019s
W20260709 13:15:04.919646  4991 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.775s	user 0.013s	sys 0.018s
I20260709 13:15:04.935333 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:04.942484 32199 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:15:04.948238 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:04.959842 32199 raft_consensus.cc:2393] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 16: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:04.964033   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:04.966020   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:04.949272   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:04.971546  4671 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:04.950379  5109 consensus_queue.cc:1048] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:15:04.976234  4569 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:04.977952  4569 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:04.980144  4569 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:04.984508 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.985661 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.985988 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.986720 32264 raft_consensus.cc:2410] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:15:04.984707 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.989001 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:04.989506 32190 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:15:04.992334 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.996204 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:04.997088 32269 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:15:05.000000 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:05.004187 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:05.006018 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:05.006723 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:04.989838 32119 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:15:05.008810 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:05.035718 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:05.578398  5116 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:05.700131  4605 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:05.700793 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:05.700768  4605 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:05.010859 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:15:05.069653   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 134656us
I20260709 13:15:05.036795 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:15:05.583784  4671 consensus_meta.cc:287] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.611s	user 0.006s	sys 0.004s
I20260709 13:15:05.486573  4912 raft_consensus.cc:3055] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:15:05.511153  5076 consensus_meta.cc:287] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.879s	user 0.007s	sys 0.005s
I20260709 13:15:05.704070 32268 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 17.
I20260709 13:15:05.061050 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:05.704598  5056 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.704974 32120 raft_consensus.cc:2393] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 16: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:05.703871  4912 raft_consensus.cc:740] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:15:05.551717   368 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.010s	sys 0.014s
I20260709 13:15:05.704488  5076 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:05.722373   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 692388us
I20260709 13:15:05.723258 32197 raft_consensus.cc:2368] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 13. Current term is 14.
I20260709 13:15:05.723033  4912 consensus_queue.cc:260] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:04.949646  4772 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:05.724100  4912 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:05.704784  4605 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:05.735821 32124 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 17.
I20260709 13:15:05.719060  5056 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:05.485231  4991 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.738834  4991 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:05.739969  4605 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:05.740852  4605 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:05.741731  4991 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:05.743537  4605 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:05.700332  5116 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:05.771682 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:05.770872 32266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 2482) took 3603 ms. Trace:
I20260709 13:15:05.781086 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:05.781976 32196 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
W20260709 13:15:05.785410 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:05.776376 32266 rpcz_store.cc:276] 0709 13:15:02.167212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.167842 (+   630us) service_pool.cc:224] Handling call
0709 13:15:02.168328 (+   486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:02.207355 (+ 39027us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:15:02.245056 (+ 37701us) log.cc:844] Serialized 14 byte log entry
0709 13:15:03.094126 (+849070us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b180039a180. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59be7ec0a 00007fb5a55be219 00007fb59bf06a40 00007fb59bf014e4 00007fb59bf01455 00007fb5a29e93c7 00007fb59effb9a7 00007fb59f00b0bf 00007fb59f00b038
0709 13:15:03.094315 (+   189us) log.cc:844] Serialized 14 byte log entry
0709 13:15:03.094483 (+   168us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:03.094530 (+    47us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:03.094581 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:04.218938 (+1124357us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b180039a180. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bed22a6 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bf043f3 00007fb59bf067c1
0709 13:15:04.219683 (+   745us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b180039a180. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bf043f3 00007fb59bf067c1 00007fb59bf06779 00007fb59bf06709 00007fb59bf066d1 00007fb59bf059cd 000000000038f354 000000000038f199 00007fb59bee783a
0709 13:15:05.770513 (+1550830us) spinlock_profiling.cc:243] Waited 38.6 ms on lock 0x7b5400416754. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:15:05.770593 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:05.770787 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28811,"prepare.queue_time_us":2036413,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":89303,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":4668,"spinlock_wait_cycles":105976704}
I20260709 13:15:05.787320 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:05.787969 32266 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 17.
I20260709 13:15:05.788257 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:05.787446 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:05.788360 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:05.790656 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:05.791533 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:05.791621 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:05.793537 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:05.793587 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:05.797397 32191 raft_consensus.cc:1275] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:15:05.798622 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:05.800022 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:05.802577 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:05.803604 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:05.804059 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:05.792613  4991 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:05.804881  4991 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:05.806926  4991 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:05.320324  4657 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:05.816255 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:05.816615 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:05.816949 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:05.823652 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:05.821107 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:05.786713  4605 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:05.851006 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:05.851975 32124 raft_consensus.cc:2393] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 17: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:05.859467 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:05.863757 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:15:05.863953 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 165901us
W20260709 13:15:05.864861 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:05.870222 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:05.870354 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:15:05.872388   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 65727.9us
I20260709 13:15:05.853523  4657 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:05.866750 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:05.884403 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:05.854532  4605 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:05.886530 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:15:05.880692  5112 consensus_meta.cc:287] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6: Time spent flushing consensus metadata: real 0.935s	user 0.001s	sys 0.011s
W20260709 13:15:05.883111  5078 log.cc:927] Time spent T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 2.745s	user 0.020s	sys 0.036s
I20260709 13:15:05.872982  5141 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:05.893831 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:05.894199 32190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54182 (request call id 3843) took 1098 ms. Trace:
I20260709 13:15:05.894585 32190 rpcz_store.cc:276] 0709 13:15:04.795302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.798220 (+  2918us) service_pool.cc:224] Handling call
0709 13:15:05.894034 (+1095814us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b54002116d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:15:05.894145 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":407143808}
I20260709 13:15:05.903662 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:05.905367 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:05.905941 32120 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:15:05.904409 32122 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:15:05.907956 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:05.909704 32124 raft_consensus.cc:2393] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 14: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:05.909785 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:15:05.910240 32268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36080 (request call id 2500) took 1623 ms (client timeout 1591 ms). Trace:
W20260709 13:15:05.911737 32268 rpcz_store.cc:269] 0709 13:15:04.286960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.287120 (+   160us) service_pool.cc:224] Handling call
0709 13:15:05.910062 (+1622942us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54002b66d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:15:05.910170 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3176261888}
I20260709 13:15:05.890224  5112 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:05.914619 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:05.917673 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:05.918458 32121 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:15:05.921547  5031 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:05.922312  5031 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.922820  5031 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:05.932325 32197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2712) took 1262 ms (client timeout 1630 ms). Trace:
I20260709 13:15:05.933808 32118 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:15:05.939791 32270 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
W20260709 13:15:05.932920 32197 rpcz_store.cc:269] 0709 13:15:04.669695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.671986 (+  2291us) service_pool.cc:224] Handling call
0709 13:15:05.932088 (+1260102us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54003a4b54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:15:05.932255 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2412309888}
I20260709 13:15:05.883668  4657 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:05.896363  5145 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:05.949306 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:05.946942 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:15:05.962553 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 170711us
I20260709 13:15:05.914825  5143 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:05.970297 32124 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:15:05.972352 32165 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:05.972539 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:05.916422  5076 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:05.892436  5141 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:05.978897 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 111088us
I20260709 13:15:05.985409 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:05.988523   399 raft_consensus.cc:1275] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:15:05.989758  4605 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:05.990545  4657 leader_election.cc:290] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:15:05.991528  5132 log.cc:927] Time spent T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:15:05.991798 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:15:05.992337  5128 log.cc:927] Time spent T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:15:05.987323  5116 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:05.992921   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:05.992921 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:05.985006 32238 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:05.996660 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:05.987176 32090 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:06.005947   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
W20260709 13:15:06.008330   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 127777us
I20260709 13:15:06.009405   369 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:06.010813 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:15:05.996675  5129 log.cc:927] Time spent T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:15:05.994952   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:06.015596 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:05.986049  5076 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
W20260709 13:15:06.017297   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 134632us
I20260709 13:15:06.017989   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:06.009146  5116 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:15:06.020491 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 234049us
I20260709 13:15:05.981997  5143 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:06.013235  5150 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:06.023097 32197 raft_consensus.cc:1275] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:15:06.024821 32089 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:06.019320  5153 raft_consensus.cc:2804] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:06.028961 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:06.020226  5116 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:06.031113 32122 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
W20260709 13:15:06.028448 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 45451us
I20260709 13:15:05.975636  5145 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:06.022089  5031 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:06.037520  5149 consensus_queue.cc:1048] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:06.039037  5149 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:06.039408  5149 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:06.039778  5149 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:06.040473  5145 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:06.040947 32089 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:06.044494 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:06.024574  5150 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:06.046010 32165 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:06.058538 32165 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:06.030490  5153 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:06.034428  5116 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:06.032383  5159 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.020454  5076 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:06.055665  5145 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:06.062466 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:06.052963  4605 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:06.062497  5140 consensus_queue.cc:1048] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:15:06.064612  5153 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:06.056493  5150 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:06.060065  5151 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:15:06.068758 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 52410.3us
I20260709 13:15:06.072048 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:06.080017  5160 raft_consensus.cc:2764] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:15:06.074115 32089 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:06.080807  5160 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:06.081173  5165 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:06.081303  5160 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:06.082280 32089 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:06.083093  5165 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:06.083441  5160 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:06.083609  5165 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:06.084154  5165 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:06.069450  5145 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:06.084851  5145 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:15:06.088699  5154 log.cc:927] Time spent T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:15:06.090317 32089 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:06.092011 32089 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:15:06.092442 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 91894.9us
I20260709 13:15:06.092737 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:06.069041  4605 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:06.071422  5152 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:06.069074  5159 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:06.071707  5151 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:06.094965 32089 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:06.098358 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:06.098667 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:15:06.108225 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:06.111718 32123 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:15:06.100997 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:06.119788 32121 raft_consensus.cc:2368] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 14. Current term is 15.
W20260709 13:15:06.199380 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 88779us
I20260709 13:15:06.132103 32118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56890 (request call id 3860) took 1197 ms. Trace:
W20260709 13:15:06.185034  5105 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.545s	user 0.033s	sys 0.064s
W20260709 13:15:06.206758  5105 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.568s	user 0.038s	sys 0.073s
I20260709 13:15:06.206943   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
W20260709 13:15:06.105671  5148 log.cc:927] Time spent T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:15:06.107928  4605 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:06.098546  5007 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:06.216995  5007 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:06.217410  5007 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:06.095551   398 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:15:06.098012  5151 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:06.096941  5141 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:06.223603  5165 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:06.206103  5084 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:06.208911 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 85411.7us
I20260709 13:15:06.204180 32118 rpcz_store.cc:276] 0709 13:15:04.934660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.935099 (+   439us) service_pool.cc:224] Handling call
0709 13:15:06.131877 (+1196778us) spinlock_profiling.cc:243] Waited 989 ms on lock 0x7b5400032fd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:15:06.131990 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2275119360}
I20260709 13:15:06.209059 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:06.130224 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:06.136034 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:06.094959  5137 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:06.124305   402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38176 (request call id 223) took 1174 ms. Trace:
I20260709 13:15:06.233026   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:06.234908  5056 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:06.235519  5031 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:06.235942  5031 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:06.236305  5031 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:06.097718  5159 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:06.101588  5143 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:06.095901  5152 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:06.241214  5152 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:06.241206   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:06.228335  5088 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:15:06.229909  5137 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:06.246146  5137 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:06.249444   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:06.258322  5165 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:06.125473  5116 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:06.277236  5116 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:06.276901  5149 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:06.279708  5149 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:06.281046  5007 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:06.230782   402 rpcz_store.cc:276] 0709 13:15:04.949565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.949679 (+   114us) service_pool.cc:224] Handling call
0709 13:15:04.949948 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:05.724371 (+774423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:05.724401 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:05.724440 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:05.724483 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.124074 (+399591us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b540067dc54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:15:06.124122 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.124246 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1780535680}
I20260709 13:15:06.205938  5076 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:06.127111  5168 consensus_queue.cc:1059] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.147s
W20260709 13:15:06.286641 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 84661.6us
W20260709 13:15:06.287708 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 192798us
I20260709 13:15:06.295148 32089 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:15:06.296469 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 70042.8us
I20260709 13:15:06.227774 32194 raft_consensus.cc:2376] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 16. Re-sending same reply.
I20260709 13:15:06.131008 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:06.298760 32238 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:06.298929 32198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2739) took 1319 ms. Trace:
I20260709 13:15:06.291714 32162 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:06.300335 32089 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:06.301342 32162 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:06.302009 32089 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:06.291253  5160 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.305284  5160 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:06.307068  4605 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:06.307819  5076 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:06.299273 32198 rpcz_store.cc:276] 0709 13:15:04.979177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.130710 (+1151533us) service_pool.cc:224] Handling call
0709 13:15:06.298870 (+168160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:06.293411  5159 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:06.309041  5159 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:06.311383  5159 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:06.312654  5076 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:06.314847  5035 raft_consensus.cc:2804] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:06.314531  5031 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:06.315300  5035 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:06.315757  5035 raft_consensus.cc:3060] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:06.316612   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:06.318064   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:06.318006  5150 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:06.285252  5151 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:06.319342 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:06.319897 32199 raft_consensus.cc:2376] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15. Re-sending same reply.
I20260709 13:15:06.320345 32199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2740) took 1341 ms. Trace:
I20260709 13:15:06.302477 32194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2738) took 1323 ms. Trace:
I20260709 13:15:06.307483  5160 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:06.304073 32089 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:06.329286 32199 rpcz_store.cc:276] 0709 13:15:04.979419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.319087 (+1339668us) service_pool.cc:224] Handling call
0709 13:15:06.320293 (+  1206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:06.329373 32194 rpcz_store.cc:276] 0709 13:15:04.978910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.128419 (+1149509us) service_pool.cc:224] Handling call
0709 13:15:06.302402 (+173983us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:06.324635 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 121300us
I20260709 13:15:06.334143 32087 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:06.324965 32196 raft_consensus.cc:2955] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Committing config change with OpId 18.11: config changed from index 7 to 11, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:06.339157 32087 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
W20260709 13:15:06.339797 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 46008.2us
I20260709 13:15:06.332073 32089 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:15:06.345347 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 216753us
I20260709 13:15:06.320830  5151 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:06.320523  5150 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:06.321209  5168 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:06.322413   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
W20260709 13:15:06.365010 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 306525us
I20260709 13:15:06.295828  5145 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:06.378911 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:06.380950 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:06.388538 32271 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:15:06.389329 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 57345us
I20260709 13:15:06.387974 32264 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 19.
I20260709 13:15:06.382798 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:06.383595 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:06.351670  4908 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:06.384402 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:06.386053 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:06.396992 32268 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:15:06.383867 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:06.397795 32269 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
I20260709 13:15:06.398234 32266 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
I20260709 13:15:06.391871 32267 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:15:06.343657  5064 consensus_queue.cc:1048] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:15:06.392800 32270 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:15:06.386818 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:15:06.389461 32165 connection.cc:256] RPC call timeout handler was delayed by -1.391476116999911s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1656s for a response
W20260709 13:15:06.457266 32165 connection.cc:256] RPC call timeout handler was delayed by -1.3527761169998485s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
I20260709 13:15:06.456459 32271 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:15:06.364500  5170 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:06.375388  5031 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:06.375102  5168 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:15:06.474367 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 135281us
I20260709 13:15:06.391340   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:06.480825 32118 raft_consensus.cc:1240] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:15:06.485061 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:06.485759 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:06.481447 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:06.395972  5151 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:06.395728  5172 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:06.487066 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:06.475857 32022 catalog_manager.cc:5697] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:06.481784 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:06.490026 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:06.490705 32118 raft_consensus.cc:2393] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 16: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:06.493503 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:15:06.497397 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 152086us
I20260709 13:15:06.502045 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:06.502856 32116 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:15:06.497464 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:06.495012 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:06.504052 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:06.495795 32122 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:15:06.483134  5168 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:06.504468 32121 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:15:06.405889  5082 consensus_queue.cc:1048] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 13:15:06.480108  5165 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:06.396214  5152 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:06.405544  5156 consensus_queue.cc:1048] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 13:15:06.513881  4969 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:06.514637  4912 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:06.497246  4605 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:06.488741  5151 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:06.481999  5162 consensus_queue.cc:1048] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:15:06.519387  5137 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:06.514061  5064 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:06.493250  5171 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:06.522243  5149 raft_consensus.cc:3055] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:06.523916  5098 raft_consensus.cc:2955] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 19 LEADER]: Committing config change with OpId 18.11: config changed from index 7 to 11, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:06.526160 32238 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:06.484215  5170 raft_consensus.cc:697] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:06.496483  4999 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.547217  5007 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:06.493772  5150 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:06.555491 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 97656.1us
W20260709 13:15:06.628000 32165 connection.cc:256] RPC call timeout handler was delayed by -1.0665761169998405s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2017s for a response
W20260709 13:15:06.628382 32165 connection.cc:256] RPC call timeout handler was delayed by -1.0413761169997997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20450000000000002s for a response
I20260709 13:15:06.554138 32022 catalog_manager.cc:5697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 16 to 18, now has a pending config: VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1), VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2), VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3), VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 18 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } } pending_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:06.498320  5172 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:15:06.628682 32165 connection.cc:256] RPC call timeout handler was delayed by -1.038432592999925s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
I20260709 13:15:06.599752 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:06.613456 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:06.630246 32121 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:06.613170 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:06.631278 32117 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:15:06.564061  5151 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:15:06.635567 32236 connection.cc:256] RPC call timeout handler was delayed by -1.5953944170000796s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2137s for a response
I20260709 13:15:06.597023  5171 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:06.597262  5149 raft_consensus.cc:740] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:06.613101  5155 raft_consensus.cc:2804] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:06.586632  4912 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:06.617246 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:15:06.606767 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 83038.6us
I20260709 13:15:06.642845 32120 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 19.
I20260709 13:15:06.625876 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:06.645607 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:15:06.625078 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 276515us
I20260709 13:15:06.602663 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:06.644891 32116 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 20.
I20260709 13:15:06.627882  5116 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.634994 32165 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:06.614459 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:15:06.625784  5153 consensus_meta.cc:287] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6: Time spent flushing consensus metadata: real 0.534s	user 0.009s	sys 0.001s
I20260709 13:15:06.638501 32271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05806ba48f814549969547f21c7101c3"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:15:06.655690 32271 raft_consensus.cc:606] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:15:06.656034 32271 raft_consensus.cc:614] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:06.656105 32090 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:06.604671  5064 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:06.639110 32236 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:06.561628  4969 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:06.647776 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 257513us
I20260709 13:15:06.631409  5172 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:06.646229 32192 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:15:06.630795  4908 raft_consensus.cc:697] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:06.652812 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:06.652963 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:06.668713 32236 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:06.685688 32191 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:15:06.687374 32089 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:15:06.631822 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 283530us
I20260709 13:15:06.660905 32165 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:06.699515 32165 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:06.665076 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:06.700691 32165 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:06.701125 32194 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:06.637997  5075 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:06.671712 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:06.674052  4969 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:06.709812  5182 consensus_queue.cc:1048] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:15:06.674118  5170 consensus_queue.cc:237] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:06.639464  5171 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:06.686098  5174 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:06.677930  4912 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:06.627722  4999 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:06.650595  5155 raft_consensus.cc:697] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:15:06.750213 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 62901.9us
I20260709 13:15:06.635463  5150 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:06.681855  5152 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:06.681946  5064 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:06.682762  5145 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:06.683221  5177 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:06.683569  4671 raft_consensus.cc:2764] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:15:06.639123 32022 catalog_manager.cc:5697] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:06.669054  5153 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:06.728154  5156 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:15:06.719477 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 50870us
I20260709 13:15:06.711051 32165 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:06.725780 32239 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:06.659997  5116 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:06.687119  5176 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:06.735009 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 48489.4us
I20260709 13:15:06.742022 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:06.714113  5160 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:06.791965  5160 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:06.747980 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:06.792387  5160 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:06.792930 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:06.794119 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:15:06.750020 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 52861.1us
I20260709 13:15:06.799484 32118 raft_consensus.cc:1240] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:06.799875  5153 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:06.800285   402 raft_consensus.cc:1240] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:15:06.800864 32118 raft_consensus.cc:2955] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Committing config change with OpId 18.11: config changed from index 7 to 11, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:06.801424  5155 consensus_queue.cc:237] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:06.799373   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:06.803814  5007 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:06.804879 32271 raft_consensus.cc:1275] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:15:06.804363 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:06.805685 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:06.806525 32191 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:15:06.806798 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:06.807528 32264 raft_consensus.cc:2368] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 13. Current term is 14.
I20260709 13:15:06.808017 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:06.808897 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:06.810155 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:06.810252 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:06.751885 32089 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:06.722048  5159 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:06.811184 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:15:06.811676 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 59884.7us
I20260709 13:15:06.709237  5166 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:06.812306 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:06.713968  5137 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:06.812546 32089 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:06.812911 32269 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:15:06.714244  5075 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:06.774897 32022 catalog_manager.cc:5697] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:06.813854 32090 leader_election.cc:400] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 13. Current term is 14.
I20260709 13:15:06.814476 32090 leader_election.cc:403] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:15:06.813887 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:06.811786  4657 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:06.813591  5177 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:06.704849 32121 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:15:06.714757  4908 consensus_queue.cc:237] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:06.780483 32267 raft_consensus.cc:2955] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Committing config change with OpId 18.11: config changed from index 7 to 11, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:06.719455  5149 consensus_queue.cc:260] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:06.817920 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 107013us
W20260709 13:15:06.833007 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 107379us
I20260709 13:15:06.833563 32165 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:06.835549 32165 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:06.818747 32194 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:15:06.727852  5184 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:06.823844   369 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:06.808403 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:06.773267  5187 raft_consensus.cc:2749] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:06.791026  5174 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:06.826001  5178 raft_consensus.cc:2749] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 13. Current term is 14.
I20260709 13:15:06.804322  5007 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:06.838974  5035 consensus_meta.cc:287] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.520s	user 0.012s	sys 0.000s
I20260709 13:15:06.830107  5151 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:06.839594  4912 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:06.853499  5139 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:06.853629  4912 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:06.854267  4912 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:06.857151  5075 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:06.857986  5116 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:06.777510  5168 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:06.860056  5168 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:06.860828  4999 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:06.861366  5150 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:06.838455  5076 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:06.819259  5161 consensus_queue.cc:1059] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:15:06.843237  5184 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:06.843609  5149 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:06.820253  5176 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:06.865142  5184 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:06.906733  5161 raft_consensus.cc:3055] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:06.907194  5161 raft_consensus.cc:740] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:06.868263  5035 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:06.874375  5088 consensus_queue.cc:1059] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 13:15:06.873965  4912 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:06.913173  5161 consensus_queue.cc:260] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:06.926258  5161 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:06.922356  5151 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:06.949780  5172 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:06.952044  5172 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:06.953327  5176 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:06.955197  5171 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:06.957942  5160 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:06.959440  5035 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:06.960287  5160 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:06.968551  5171 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:06.774264 32019 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49534 (request call id 260) took 25841 ms (client timeout 15000 ms). Trace:
I20260709 13:15:06.815208 32090 leader_election.cc:304] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:06.816867 32089 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:15:07.006486 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 191201us
W20260709 13:15:07.009330 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 192354us
I20260709 13:15:07.011267 32090 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:15:07.014212 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.012012 32089 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
W20260709 13:15:06.997869 32019 rpcz_store.cc:269] 0709 13:14:40.925952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.935170 (+  9218us) service_pool.cc:224] Handling call
0709 13:15:06.767531 (+25832361us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:58.860937 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:58.943958 (+ 83021us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:58.944019 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:14:58.944056 (+    37us) tablet.cc:662] Decoding operations
0709 13:14:58.945666 (+  1610us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:58.945757 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:58.945789 (+    32us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:14:58.947097 (+  1308us) tablet.cc:701] Row locks acquired
0709 13:14:58.947145 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:14:58.947319 (+   174us) write_op.cc:270] Start()
0709 13:14:58.947479 (+   160us) write_op.cc:276] Timestamp: P: 1783602898947252 usec, L: 0
0709 13:14:58.947518 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:14:58.956040 (+  8522us) log.cc:844] Serialized 5880 byte log entry
0709 13:15:00.118610 (+1162570us) op_driver.cc:464] REPLICATION: finished
0709 13:15:00.361735 (+243125us) write_op.cc:301] APPLY: starting
0709 13:15:00.361830 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:00.416119 (+ 54289us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:00.443570 (+ 27451us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:00.786388 (+342818us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:00.786749 (+   361us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:15:00.786793 (+    44us) write_op.cc:312] APPLY: finished
0709 13:15:00.787276 (+   483us) log.cc:844] Serialized 139 byte log entry
0709 13:15:00.787482 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:00.787657 (+   175us) write_op.cc:454] Released schema lock
0709 13:15:00.787737 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:00.818922 (+ 31185us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:00.824174 (+  5252us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":20396,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":238680,"apply.run_cpu_time_us":24998,"apply.run_wall_time_us":437377,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66977,"num_ops":15,"prepare.queue_time_us":166352,"prepare.run_cpu_time_us":90186,"prepare.run_wall_time_us":342822,"raft.queue_time_us":279053,"raft.run_cpu_time_us":23747,"raft.run_wall_time_us":179529,"replication_time_us":1129928,"thread_start_us":621190,"threads_started":4,"wal-append.queue_time_us":334574,"wal-append.run_cpu_time_us":40391,"wal-append.run_wall_time_us":2502972}]]}
I20260709 13:15:07.017724 32115 raft_consensus.cc:1240] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:07.021724 32119 raft_consensus.cc:2393] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 14: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:07.023885 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:15:07.035244 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 165295us
I20260709 13:15:07.040607   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:07.041678   398 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
I20260709 13:15:07.043145 32264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:15:07.044548 32264 raft_consensus.cc:606] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:07.045220 32264 raft_consensus.cc:614] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:15:07.046609 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 210954us
I20260709 13:15:07.027441 32120 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:07.052175  4912 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:07.052306 32162 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:07.056857   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:07.058377  4772 raft_consensus.cc:3055] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:07.062512  4772 raft_consensus.cc:740] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:07.064260  4772 consensus_queue.cc:260] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:07.060068   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:07.060286   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:07.060559   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:07.072711  4772 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:07.079914 32264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:15:06.960848  5007 leader_election.cc:290] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:07.091351 32264 raft_consensus.cc:606] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:07.091982  5007 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:06.814980 32022 catalog_manager.cc:5697] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 5 to 8, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1), VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2), VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3), VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 10 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:07.048326 32165 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:07.122313 32264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:15:07.125304 32264 raft_consensus.cc:606] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:15:07.125984 32264 raft_consensus.cc:614] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:07.130031  5160 raft_consensus.cc:2804] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:07.130761  5160 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:07.131310  5160 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:07.095482  5007 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:07.142637 32022 catalog_manager.cc:5697] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 8 to 11, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 11 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:15:07.149637 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 101668us
I20260709 13:15:07.149438  4999 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:07.150902 32165 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:07.155683  4999 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:07.096118  5076 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:15:07.165257 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 153572us
I20260709 13:15:07.179306  5149 raft_consensus.cc:2804] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:07.179982  5149 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:07.180363  5149 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:07.185582  5165 raft_consensus.cc:2804] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:07.186141  5165 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:07.186203 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:07.186678  5165 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:07.187407 32271 raft_consensus.cc:2410] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:15:07.188294 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:07.189662 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:07.190302 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:07.192373 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:07.193638 32270 raft_consensus.cc:2410] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
W20260709 13:15:07.203292 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 58735.2us
I20260709 13:15:07.221488 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:07.225558 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:07.230221 32272 raft_consensus.cc:1240] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:07.231953 32089 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:07.236465 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:07.214962  5141 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:07.222304 32165 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:07.259809 32120 raft_consensus.cc:2468] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 11.
I20260709 13:15:07.237725 32022 catalog_manager.cc:5697] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:07.261075  5150 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:07.265352  4772 consensus_queue.cc:1059] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:15:07.269236 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 61481.9us
W20260709 13:15:07.275969  5193 log.cc:927] Time spent T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.510s	user 0.000s	sys 0.014s
I20260709 13:15:07.281283 32165 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:07.284886  5076 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:07.285362  5076 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:07.285768  5076 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:07.289208 32239 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:07.293283   369 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:07.293057  5082 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:07.309819  5082 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:07.308768 32165 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:07.302589 32022 catalog_manager.cc:5697] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:15:07.314409 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 82616.8us
I20260709 13:15:07.310259  5082 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:07.218359  5160 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:07.304037  5178 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:07.292549 32090 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:07.302749  5188 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:15:07.323307 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 343676us
I20260709 13:15:07.300199  5141 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:07.331993  5165 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:07.335989  5153 raft_consensus.cc:3055] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:07.336490  5153 raft_consensus.cc:740] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:07.337798  5153 consensus_queue.cc:260] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:07.339485  5153 raft_consensus.cc:3060] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:07.324438  5150 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:07.344725  5098 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:07.346678   394 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17.
I20260709 13:15:07.347492  5076 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:07.348536  5178 raft_consensus.cc:697] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 16 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:07.348822  5188 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:07.349016  4657 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:15:07.351339 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 58910.7us
I20260709 13:15:07.361537 32265 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afc0578da01e4736bf535c5df1439723"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:15:07.362237 32265 raft_consensus.cc:606] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:07.334184  5165 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:15:07.366950   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 74088.2us
I20260709 13:15:07.364852 32022 catalog_manager.cc:5697] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:07.372931 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:15:07.379062   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:07.379477 32239 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:07.381626 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 97173.9us
I20260709 13:15:07.390947 32239 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:07.397682  5056 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:07.403817 32165 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:07.391897 32238 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:07.411538 32087 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:07.412886  4657 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:07.413182 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:07.413547  4657 raft_consensus.cc:697] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:07.414860  4657 consensus_queue.cc:237] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:07.398648  5056 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:07.428912 32239 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:07.403491  5178 consensus_queue.cc:237] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:07.420215  4999 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:15:07.433965 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 49562.9us
I20260709 13:15:07.442230   402 raft_consensus.cc:1275] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:15:07.443684  5056 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:07.445627  5051 consensus_queue.cc:1048] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:15:07.436219  4908 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:07.449963  4908 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:07.450724  4908 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:07.451722  5076 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:07.453539 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 56389.3us
I20260709 13:15:07.454457 32165 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:07.455302  5076 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:07.457854 32238 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:07.458905  4969 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:07.459580 32238 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:07.460405  4969 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:07.440100  5141 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:07.460915  4969 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:07.460764  5149 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:07.461544  4969 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:07.462942  5149 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:07.463411 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.463786  5188 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:07.464637 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 47149.9us
I20260709 13:15:07.465477 32239 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:07.466634   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:07.467202   402 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:07.475317  5141 raft_consensus.cc:2804] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:07.475857  5141 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:07.476301  5141 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:07.476114 32165 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:07.478035 32165 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:07.478958  4999 raft_consensus.cc:2749] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:07.479751 32165 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:07.479753  4999 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:07.481487  4999 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:07.481971  4999 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:07.482059  5076 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:07.438426  5160 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:15:07.480989  5207 log.cc:927] Time spent T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 13:15:07.486896  5208 log.cc:927] Time spent T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:15:07.494254  5150 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:07.495980 32165 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:07.497560 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.507802  5116 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:07.508419  5116 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:07.510505  5116 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:07.511591  5165 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:07.512452   402 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:15:07.513019  5116 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:07.513726  5116 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:07.514313 32162 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:07.513370 32238 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:07.502894  5082 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:07.515381  4969 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:07.515857 32238 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:07.517519  4991 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:07.517789  5082 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:07.518018  4991 raft_consensus.cc:697] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:07.503798  5098 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:07.499789 32239 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:07.502686 32118 raft_consensus.cc:1240] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:07.516530  5051 raft_consensus.cc:2804] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:07.519006  4991 consensus_queue.cc:237] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:07.519503  5051 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:07.520226 32239 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:07.512236  5165 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:07.520880  5161 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:07.520639  5051 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:07.522091  4969 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:07.525693  5155 raft_consensus.cc:2764] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:15:07.527400 32239 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:07.528275  5161 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:07.530054 32239 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:07.531251  5165 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:07.515898  5116 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:07.513384   394 raft_consensus.cc:1240] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:15:07.535249  5161 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:07.537424  5082 consensus_queue.cc:1059] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:07.538383  5160 raft_consensus.cc:2804] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:07.538911  5160 raft_consensus.cc:697] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 12 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:07.539832  5160 consensus_queue.cc:237] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:07.541100  5082 raft_consensus.cc:3055] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:07.541951  5082 raft_consensus.cc:740] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:07.546679  5076 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:07.549423  5082 consensus_queue.cc:260] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:07.543638 32239 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:07.548403  5051 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:07.609432  5165 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:07.513402  4908 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:07.614374  5082 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:07.625288 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:07.627008 32272 raft_consensus.cc:1240] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:07.627424 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:07.628242 32264 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:15:07.632944 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 89412.6us
I20260709 13:15:07.637702 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:07.638682 32120 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:15:07.639207 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:07.640036 32115 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:07.637746   369 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:07.646489  4634 raft_consensus.cc:2804] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:07.647097  4634 raft_consensus.cc:697] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 11 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:07.624188  5056 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:07.648187 32115 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:15:07.653308 32197 raft_consensus.cc:1240] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:07.616617  5161 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:07.654456  5161 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:07.654831  5161 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:07.656795  5165 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:07.656808 32194 raft_consensus.cc:1240] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:07.639020 32122 raft_consensus.cc:1275] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:15:07.639294 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:07.657588  5130 consensus_queue.cc:1059] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:07.638861 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:07.646441  5125 consensus_queue.cc:1048] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:15:07.668440 32264 raft_consensus.cc:1275] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:15:07.670120 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 174252us
I20260709 13:15:07.671830  5130 raft_consensus.cc:3055] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:07.672260  5130 raft_consensus.cc:740] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:07.673198  5130 consensus_queue.cc:260] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:07.677668  5130 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:07.648123  4634 consensus_queue.cc:237] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:07.684278 32267 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:07.685788 32115 raft_consensus.cc:1240] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:15:07.687119 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:07.689273 32118 raft_consensus.cc:1240] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:07.690402 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:07.691250 32120 raft_consensus.cc:2393] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 13: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:07.694926 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:07.671504 32165 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:07.699723 32267 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:15:07.712561   394 raft_consensus.cc:1240] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: []
W20260709 13:15:07.713567  5139 consensus_queue.cc:1175] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "113b5461952d47e0944d463ea4e32801" responder_term: 13 status { last_received { term: 13 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 13 index: 11 } }
I20260709 13:15:07.716253  4908 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:07.717015  4908 consensus_queue.cc:1059] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:07.718426  5056 raft_consensus.cc:3055] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:07.718835  5056 raft_consensus.cc:740] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:07.721779  5051 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:07.723069  4999 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:07.725582  4999 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:07.763284 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:07.766052 32199 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:07.767218  5161 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:07.772755 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:07.773620 32190 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:15:07.774159   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:07.775004   394 raft_consensus.cc:2393] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 17: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:07.775539 32199 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 18.
I20260709 13:15:07.777596  5213 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:07.778335  5213 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:07.780444 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:07.781543 32264 raft_consensus.cc:2393] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 17: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:07.763993  5188 consensus_queue.cc:1059] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:15:07.782842  5056 consensus_queue.cc:260] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:07.785921  5056 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:07.756750  4999 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:07.784446 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:07.789690 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:07.813283 32264 raft_consensus.cc:2410] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:15:07.790341  5141 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:07.793437 32266 raft_consensus.cc:1240] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:07.794320  5178 consensus_queue.cc:1048] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:07.783841  5188 raft_consensus.cc:3055] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:07.800930 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:07.811281 32271 raft_consensus.cc:1240] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:07.811370 32272 raft_consensus.cc:1240] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 8. Current term is 9. Ops: []
W20260709 13:15:07.825570 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 154192us
I20260709 13:15:07.818981 32195 raft_consensus.cc:1275] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:15:07.818737 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:07.820879  5213 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:07.821303 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.822963  5161 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:07.827708 32090 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:07.816691  5165 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:07.845851 32196 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:07.847265  5141 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:07.825343  5188 raft_consensus.cc:740] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:07.848954 32270 raft_consensus.cc:1240] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:07.849545  5188 consensus_queue.cc:260] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:07.850797  5188 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:07.853158 32165 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:07.853979   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:07.860271   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:07.866755 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:07.861876  4657 raft_consensus.cc:2804] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:07.891556 32191 raft_consensus.cc:1240] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 12 LEADER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:07.870339  4999 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:07.892992 32197 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:07.906541  5151 consensus_queue.cc:1059] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
W20260709 13:15:07.909808 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 56839.2us
I20260709 13:15:07.895776  4657 raft_consensus.cc:697] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 13 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:07.921970 32115 raft_consensus.cc:1240] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:07.926376 32116 raft_consensus.cc:1240] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:07.922892 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:15:07.934512 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.938836 32116 raft_consensus.cc:1240] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:07.933519  5051 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:07.955948 32196 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:15:07.958395  5051 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:07.961136  5155 consensus_queue.cc:1059] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:07.962182  5155 raft_consensus.cc:3055] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:07.962682  5155 raft_consensus.cc:740] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:07.961463 32165 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:07.965758 32165 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:07.967653  4999 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:07.969280 32119 raft_consensus.cc:1240] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:07.969712  4657 consensus_queue.cc:237] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:07.955230  5082 consensus_queue.cc:1059] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:15:07.973963  5082 raft_consensus.cc:3055] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:07.974356  5082 raft_consensus.cc:740] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:07.968466  4999 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:07.967000 32165 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:07.975361  5082 consensus_queue.cc:260] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:07.976786  5213 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:07.977213  5213 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:07.978291  5213 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:07.986841  5149 raft_consensus.cc:3055] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:07.987394  5149 raft_consensus.cc:740] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:07.988690  5082 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:07.993691  5051 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:07.996781 32165 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:07.998142  5160 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:07.999692   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:08.006858  4969 consensus_queue.cc:1048] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:08.008942 32239 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:08.012109 32239 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:07.988466  5149 consensus_queue.cc:260] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:08.014298  5051 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:07.964066  5155 consensus_queue.cc:260] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:08.015801 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 59715.9us
I20260709 13:15:08.017530 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:08.013356  4969 consensus_queue.cc:1059] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:08.015113  5149 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:08.019145 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:08.019798 32119 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:08.015894  5155 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:08.012894  4991 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:08.025462 32116 raft_consensus.cc:1240] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:08.025887  4969 raft_consensus.cc:3055] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:08.026099 32165 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:08.026418  4969 raft_consensus.cc:740] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:08.026875 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:08.027547 32122 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:08.027632  4969 consensus_queue.cc:260] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:08.028916  4969 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:15:08.032797  5156 consensus_queue.cc:1175] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "113b5461952d47e0944d463ea4e32801" responder_term: 16 status { last_received { term: 16 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 16 index: 11 } }
I20260709 13:15:08.037699 32165 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:08.039480 32197 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:15:08.043011   394 raft_consensus.cc:1275] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:15:08.018429 32118 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:15:08.044694 32238 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:08.046072  4908 raft_consensus.cc:2804] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:08.045972  5213 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:08.046577  4908 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.047010  4908 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:08.048282  5213 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:08.053421  5150 consensus_queue.cc:1048] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:08.057286 32238 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:08.068897  5155 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:08.069872  4991 consensus_queue.cc:1048] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:08.070197  5155 raft_consensus.cc:697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:08.073372  5155 consensus_queue.cc:237] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:08.082886 32238 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:08.084021 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:08.087451 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:08.089053 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:08.090898 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:08.092087 32124 raft_consensus.cc:1240] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:08.094619 32115 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:15:08.067308  4908 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:08.102583 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:15:08.110594 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:08.112167 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:08.097025  4908 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:08.113422 32119 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:15:08.113580 32238 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:15:08.141434 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:08.143749 32122 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 18.
I20260709 13:15:08.149051 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:08.153977 32265 raft_consensus.cc:1275] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:15:08.154058 32195 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:08.108901  4969 raft_consensus.cc:2804] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:08.135120  5150 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:08.155129  4634 consensus_queue.cc:1059] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:08.155412  5224 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:08.173746  5224 raft_consensus.cc:697] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:08.174216  5125 raft_consensus.cc:3055] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:08.174882  5125 raft_consensus.cc:740] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:08.175455  5224 consensus_queue.cc:237] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:08.159305 32238 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:08.152717  5160 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:08.154511 32265 pending_rounds.cc:85] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06: Aborting all ops after (but not including) 8
I20260709 13:15:08.183519 32265 pending_rounds.cc:107] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:15:08.183952 32265 raft_consensus.cc:2889] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:08.174283  4772 consensus_queue.cc:1059] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:15:08.185227  5160 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:08.185348  4772 raft_consensus.cc:3055] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:08.185747  5160 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:08.185858  4772 raft_consensus.cc:740] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:08.186357  5051 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:08.187175  4772 consensus_queue.cc:260] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:08.179031  4908 consensus_queue.cc:1059] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:08.191179  4772 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:08.191711  4908 raft_consensus.cc:3055] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:08.192142  4908 raft_consensus.cc:740] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:08.151575  5130 consensus_queue.cc:1059] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:15:08.193238  4908 consensus_queue.cc:260] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:08.193820  5130 raft_consensus.cc:3055] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:08.178977 32239 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:08.179713  4991 consensus_queue.cc:1059] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:08.176185  5125 consensus_queue.cc:260] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:08.180759  4969 raft_consensus.cc:697] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:08.198835 32122 raft_consensus.cc:1240] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:08.182915 32238 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:08.161154 32197 raft_consensus.cc:1275] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:15:08.177953 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:08.206784 32124 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:08.198853 32195 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
W20260709 13:15:08.211777 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 174153us
I20260709 13:15:08.194342  5130 raft_consensus.cc:740] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:08.225055 32115 raft_consensus.cc:1275] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:15:08.227749 32238 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:08.212446  5082 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:08.237757 32267 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:08.225566  5056 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:08.240631  5056 raft_consensus.cc:2804] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:08.241240  5056 raft_consensus.cc:697] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:08.230074  5156 consensus_queue.cc:1059] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:15:08.242146  5056 consensus_queue.cc:237] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:08.218873  4908 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:08.256430  5156 raft_consensus.cc:3055] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:08.257867  5156 raft_consensus.cc:740] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:08.260825  5156 consensus_queue.cc:260] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:08.268975 32165 leader_election.cc:400] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 14. Current term is 15.
I20260709 13:15:08.230957  5161 consensus_queue.cc:1048] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:15:08.271072  5125 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:08.248829  5099 consensus_queue.cc:1048] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
W20260709 13:15:08.329500 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 102296us
I20260709 13:15:08.330960 32165 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:08.332722  5213 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:08.281483  5141 raft_consensus.cc:3055] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:08.347957 32124 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
W20260709 13:15:08.364687 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 135876us
W20260709 13:15:08.356791 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 49023.8us
I20260709 13:15:08.375672 32165 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:08.350247  5141 raft_consensus.cc:740] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:08.376703 32118 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:15:08.280925  5233 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.117s
I20260709 13:15:08.352063  5156 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:08.316366  5160 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:08.363701  4991 consensus_queue.cc:1059] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:15:08.393493   402 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:15:08.289042  4969 consensus_queue.cc:237] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:08.345979  5130 consensus_queue.cc:260] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:08.415442  5228 log.cc:927] Time spent T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.131s	user 0.000s	sys 0.013s
I20260709 13:15:08.402981  5150 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:08.456136 32267 raft_consensus.cc:1275] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:15:08.472411 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 66822.3us
I20260709 13:15:08.457247  5150 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.472034  5141 consensus_queue.cc:260] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:08.487941 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 101397us
I20260709 13:15:08.464912  5213 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:15:08.489661 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 99006.6us
I20260709 13:15:08.494411 32165 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:08.494681 32124 raft_consensus.cc:1275] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:15:08.494508 32197 raft_consensus.cc:1240] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:08.475138  4657 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.472147  5161 consensus_queue.cc:1059] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:15:08.477332  5155 raft_consensus.cc:3055] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:08.487787  5150 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:08.492244  5178 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 13:15:08.494526  5213 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:08.514869  5155 raft_consensus.cc:740] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:15:08.531386 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:08.508419  5098 consensus_queue.cc:1048] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:15:08.516674  5151 consensus_queue.cc:1048] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:15:08.528007  4999 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:15:08.552981 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:08.521508  4657 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:08.549105  5160 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:08.562515  5155 consensus_queue.cc:260] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:08.572561 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 94461.9us
I20260709 13:15:08.577839  5213 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:08.555734  5161 consensus_queue.cc:1059] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:15:08.553828  4999 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
W20260709 13:15:08.603217 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 107576us
I20260709 13:15:08.604004 32239 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:08.596478  4999 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:15:08.615356  5255 log.cc:927] Time spent T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.063s	user 0.000s	sys 0.002s
W20260709 13:15:08.629036 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 137692us
W20260709 13:15:08.629884 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:08.644390  5257 raft_consensus.cc:3055] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:08.644932  5257 raft_consensus.cc:740] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:08.645990  5244 raft_consensus.cc:3055] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:08.645857  5257 consensus_queue.cc:260] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:08.647367  5257 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:15:08.648516  5226 log.cc:927] Time spent T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.319s	user 0.000s	sys 0.003s
I20260709 13:15:08.646391  5244 raft_consensus.cc:740] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:08.628873  5155 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:08.661340  4657 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:08.664848 32165 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:15:08.667959  5227 log.cc:927] Time spent T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.365s	user 0.002s	sys 0.000s
I20260709 13:15:08.668314 32193 raft_consensus.cc:1217] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 13.8->[14.9-14.9]   Dedup: 14.9->[]
I20260709 13:15:08.668843 32193 raft_consensus.cc:1240] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:15:08.670867 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:08.678455 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:08.679055 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:08.680495 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:08.683902 32197 raft_consensus.cc:2393] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 17: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
W20260709 13:15:08.686036 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 60976.6us
I20260709 13:15:08.687247 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:08.687376  5244 consensus_queue.cc:260] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:08.689077  5244 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:08.692575 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:08.712270 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:08.715480 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:08.716831 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:08.717909 32195 raft_consensus.cc:2393] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 17: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:08.709141 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:08.677189  5056 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:08.713884 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:08.721938 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:08.692615  5259 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:08.728276  5150 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:08.730058  5259 raft_consensus.cc:697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:08.730551  5150 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:08.731187  5150 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:08.731033  5259 consensus_queue.cc:237] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:08.731773  5150 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:08.737614 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:15:08.742218 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 85329.6us
I20260709 13:15:08.772946 32196 raft_consensus.cc:1240] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:08.776387 32239 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:08.777510 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:08.780666 32190 raft_consensus.cc:1240] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:08.781011 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:08.782150 32190 raft_consensus.cc:1240] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:08.782541 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:08.783504 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:08.784359 32192 raft_consensus.cc:3060] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:08.787482 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:08.790278 32199 raft_consensus.cc:2393] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 18: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:08.794379  5258 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:08.794613  5244 consensus_queue.cc:1059] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:08.795094  5258 raft_consensus.cc:697] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:08.798835 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:08.799757 32193 raft_consensus.cc:2393] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 15: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:08.801998 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:08.803009 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:08.801783 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:08.799877  4999 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:08.796044  5258 consensus_queue.cc:237] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:08.784113  5239 consensus_queue.cc:1059] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.097s
I20260709 13:15:08.862824 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:08.860517 32118 raft_consensus.cc:1275] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:15:08.866845 32122 raft_consensus.cc:1275] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:15:08.869623 32116 raft_consensus.cc:1240] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:08.855043  5156 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.871980 32120 raft_consensus.cc:1275] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:15:08.848112  5178 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.889181  5259 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:15:08.889467  5264 log.cc:927] Time spent T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:15:08.855199  5161 consensus_queue.cc:1048] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:15:08.905126 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:15:08.908293 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 52815.7us
I20260709 13:15:08.908360 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:08.909294 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:08.910434 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:08.911818 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:08.915104 32199 raft_consensus.cc:1240] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:08.948021 32199 raft_consensus.cc:1275] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:15:08.949180 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:08.952311  5248 log.cc:927] Time spent T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:15:08.954221  5267 log.cc:927] Time spent T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:15:08.955302  5178 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:08.958748  5254 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.968210 32199 raft_consensus.cc:1275] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:15:08.970958 32194 raft_consensus.cc:1240] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:08.948235  5150 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:08.899580  5156 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:08.981387  5268 log.cc:927] Time spent T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:15:08.981024  5056 consensus_queue.cc:1059] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:08.967654  5161 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.925514  5259 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:08.989462 32193 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:15:08.989462 32191 raft_consensus.cc:1275] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:15:08.997370  5263 log.cc:927] Time spent T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:15:08.998157  5082 raft_consensus.cc:993] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:15:08.998718  5082 raft_consensus.cc:1081] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Signalling peer fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:15:08.983863  4991 consensus_queue.cc:1048] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:15:09.002345  4991 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:09.004163  4999 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:08.988235  5239 raft_consensus.cc:3055] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:09.004804  5239 raft_consensus.cc:740] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:08.988062  5161 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:09.005694  5239 consensus_queue.cc:260] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:09.007090  5239 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:09.007277  5161 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:08.973456  5254 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:09.009171  5259 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:09.011163  5254 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:09.012684   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:09.014763 32192 raft_consensus.cc:2468] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:15:09.032389 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:09.022141 32195 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:09.035701 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:09.037113 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:09.022014 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:09.022742  4657 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.025626 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:09.034040 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:09.038446  4657 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:09.039438 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:09.040537 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:09.040629  4657 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:15:09.029738 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:09.031148 32165 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:09.015938  5156 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:09.044879  4999 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:09.045688   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:09.046269   402 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:15:09.047374 32165 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:09.048872 32165 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:09.049588  4999 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:09.049969  4999 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:09.050211  5250 raft_consensus.cc:2804] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:09.050392  4999 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:09.050830  5250 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:09.051433  5250 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:09.055307 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:09.056550 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:09.057632 32268 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:15:09.075419   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:09.078032 32267 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
W20260709 13:15:09.033869   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 105928us
W20260709 13:15:09.043282 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:09.044034 32199 raft_consensus.cc:2393] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 14: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:09.102619 32022 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59534 (request call id 124) took 9820 ms. Trace:
W20260709 13:15:09.104533 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 55682.5us
I20260709 13:15:09.125216 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:09.103312 32022 rpcz_store.cc:276] 0709 13:14:59.282235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:59.282654 (+   419us) service_pool.cc:224] Handling call
0709 13:14:59.565532 (+282878us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b5400010810. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59beccb71 00007fb59becd0b2 00007fb5a4e46a89 00007fb5a4ddeda6 00007fb5a4db0088 00007fb5a4eae37e 00007fb5a336f2a4 00007fb5a336f232 00007fb5a336f161 00007fb5a336f0dc
0709 13:14:59.706104 (+140572us) spinlock_profiling.cc:243] Waited 7.15 ms on lock 0x7b5400047c54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5b090 00007fb59eff9f3a 00007fb5a4db01cc 00007fb5a4eae37e 00007fb5a336f2a4 00007fb5a336f232 00007fb5a336f161 00007fb5a336f0dc 00007fb5a336e392 00007fb59d32c48c 00007fb59d32b8c6
0709 13:15:09.102472 (+9396368us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:07.741522 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:07.742310 (+   788us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:07.742372 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:15:07.742393 (+    21us) tablet.cc:662] Decoding operations
0709 13:15:07.743713 (+  1320us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:07.743821 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:07.743852 (+    31us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:15:07.744948 (+  1096us) tablet.cc:701] Row locks acquired
0709 13:15:07.744991 (+    43us) write_op.cc:260] PREPARE: finished
0709 13:15:07.745126 (+   135us) write_op.cc:270] Start()
0709 13:15:07.745248 (+   122us) write_op.cc:276] Timestamp: P: 1783602907745069 usec, L: 0
0709 13:15:07.745263 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 13:15:07.745866 (+   603us) log.cc:844] Serialized 4666 byte log entry
0709 13:15:08.275259 (+529393us) op_driver.cc:464] REPLICATION: finished
0709 13:15:08.386589 (+111330us) write_op.cc:301] APPLY: starting
0709 13:15:08.386691 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:08.395172 (+  8481us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:08.395295 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:08.575454 (+180159us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:08.579184 (+  3730us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:15:08.579228 (+    44us) write_op.cc:312] APPLY: finished
0709 13:15:08.652933 (+ 73705us) log.cc:844] Serialized 105 byte log entry
0709 13:15:08.653151 (+   218us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:08.653291 (+   140us) write_op.cc:454] Released schema lock
0709 13:15:08.653357 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:08.653859 (+   502us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:08.653893 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4083035,"reported_tablets":16,"spinlock_wait_cycles":55769728,"child_traces":[["op",{"apply.queue_time_us":106007,"apply.run_cpu_time_us":20204,"apply.run_wall_time_us":267273,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50217,"num_ops":11,"prepare.queue_time_us":228680,"prepare.run_cpu_time_us":18788,"prepare.run_wall_time_us":135958,"raft.queue_time_us":284708,"raft.run_cpu_time_us":5717,"raft.run_wall_time_us":159193,"replication_time_us":502427,"thread_start_us":566329,"threads_started":4,"wal-append.queue_time_us":184357}]]}
I20260709 13:15:09.126212 32199 raft_consensus.cc:2468] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 9.
I20260709 13:15:09.130690 32119 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afc0578da01e4736bf535c5df1439723"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:56890
I20260709 13:15:09.131536 32119 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:09.132002 32119 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:09.139093  4657 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:09.139986  4657 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:09.146883 32165 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:09.147037 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:09.148193 32267 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:15:09.163055 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:09.145756  4657 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:09.164470  5160 raft_consensus.cc:2804] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:09.171820  5160 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:09.172220  5160 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:09.176764 32115 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:15:09.179106  5178 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:09.181650  4999 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:09.182353  5130 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:09.186664  5213 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:09.187299  5213 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:09.189479  5213 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:09.192734 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 63208.1us
W20260709 13:15:09.210852 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:09.206781 32119 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:09.220414  5161 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.005s
W20260709 13:15:09.227828  5270 log.cc:927] Time spent T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.396s	user 0.003s	sys 0.000s
I20260709 13:15:09.228760  5056 consensus_queue.cc:1059] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:09.229321  5155 consensus_queue.cc:1048] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:09.229839  5056 consensus_queue.cc:1048] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:15:09.241005 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 94239.7us
I20260709 13:15:09.243024 32239 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:09.249156  5250 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:09.251319  5250 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:09.253813  4999 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:09.256335 32165 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:09.257557 32119 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:09.263509  5236 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:09.264030  5236 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:09.264408  5236 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:09.267668  5237 raft_consensus.cc:3055] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:09.268167  5237 raft_consensus.cc:740] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:09.274988  5237 consensus_queue.cc:260] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:09.285102 32238 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:09.286824  5256 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:09.287569  5237 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:09.290802  5160 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:09.305938  5160 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:15:09.306022 32006 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ddd7dfc158794e3ab7427d0b86b46c8d with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 94085cf341634eb686a95983b6b7f7e6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:09.320837  5178 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:09.321529  5178 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:09.323257  5236 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:09.324903 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:09.334824 32272 raft_consensus.cc:3055] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:09.328464 32087 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:09.309513 32115 raft_consensus.cc:1275] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:15:09.335276 32272 raft_consensus.cc:740] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:09.340623 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:09.341264 32120 raft_consensus.cc:2468] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 9.
W20260709 13:15:09.332231 32089 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.987s (SENT) [suppressed 32 similar messages]
I20260709 13:15:09.350186  5149 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:09.350747  5149 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:09.351140  5149 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:09.301867  5257 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:09.337265  4657 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:09.358464 32272 consensus_queue.cc:260] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:09.362375   369 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:09.372553 32272 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:09.373724  5178 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:09.379662  5236 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:09.380380 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:09.381039 32124 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:09.383742 32272 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:15:09.357777  5056 consensus_queue.cc:1048] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:15:09.390708 32124 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:15:09.369239  5153 raft_consensus.cc:2804] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:09.365070  5257 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:09.405253 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:09.405362 32197 raft_consensus.cc:1275] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:15:09.401414 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 145123us
I20260709 13:15:09.401971  4999 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:09.392367 32239 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:09.380784   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:09.420390  4908 raft_consensus.cc:3055] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:09.421506  5257 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:09.364413  4657 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:09.394079  5153 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:09.407014  5250 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:09.442644 32090 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:09.450599 32198 raft_consensus.cc:1275] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:15:09.458437 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:09.459007 32272 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 18.
I20260709 13:15:09.460417  5035 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:09.460925  5035 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:09.461274  5035 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:09.471149   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:09.423010  4999 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:09.426759  5082 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:09.435587  5141 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:09.427078  4908 raft_consensus.cc:740] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:09.498638 32197 raft_consensus.cc:1240] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 20. Current term is 21. Ops: []
W20260709 13:15:09.502225 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 61420.3us
I20260709 13:15:09.443667  5153 raft_consensus.cc:3060] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:09.506598 32196 raft_consensus.cc:1240] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:09.515753  4908 consensus_queue.cc:260] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:09.517202   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:09.517859   394 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:15:09.455883  5257 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.523188 32196 raft_consensus.cc:1240] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:09.524300 32165 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6
W20260709 13:15:09.522550 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 79988.2us
I20260709 13:15:09.496735  4999 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:09.537134 32124 raft_consensus.cc:1240] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:09.542165   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:09.534909 32090 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:09.550285  5035 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:09.522537  5082 raft_consensus.cc:697] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:09.522840  5178 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:09.593317  5178 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:09.595847  5178 leader_election.cc:290] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:09.598471   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:09.602780  5082 consensus_queue.cc:237] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:09.605134  5281 log.cc:927] Time spent T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:15:09.606186  4657 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:09.531464  5257 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:09.608915  5257 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:09.478863  5250 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:09.534211  5125 consensus_queue.cc:1059] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 13:15:09.614025  5243 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.560199  5161 consensus_queue.cc:1048] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:09.615109  5250 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:15:09.570770 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 46645.7us
I20260709 13:15:09.615990 32165 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:09.534125  5274 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.616663  5274 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:09.618999  5274 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:09.619601  4908 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:09.573490  5237 consensus_queue.cc:1048] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:09.570890  5035 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:09.621613  5213 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:09.622536   394 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
I20260709 13:15:09.573699  5171 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:09.624836  5171 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:09.625294  5171 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:09.626228 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:09.533980  5246 consensus_queue.cc:1059] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:15:09.540753  5259 raft_consensus.cc:2804] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:09.628018  5246 raft_consensus.cc:3055] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:09.628135  5259 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:09.628695  5259 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:09.629300 32196 raft_consensus.cc:1240] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 20. Current term is 21. Ops: []
I20260709 13:15:09.628469  5246 raft_consensus.cc:740] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:09.546342  5277 consensus_queue.cc:1059] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:15:09.631883  5246 consensus_queue.cc:260] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:09.633011  5277 consensus_queue.cc:1059] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:15:09.633709  5246 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:09.626072 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:09.614132  5125 raft_consensus.cc:3055] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:15:09.634887  5125 raft_consensus.cc:740] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:09.614645  5243 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:09.635800  5125 consensus_queue.cc:260] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:09.637071  5243 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:09.585105  5149 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:09.638955  5149 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:09.633993  5277 raft_consensus.cc:3055] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:15:09.658475 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:09.659751 32269 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 15.
I20260709 13:15:09.661150   369 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:09.674954 32269 raft_consensus.cc:1240] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 12. Current term is 13. Ops: []
W20260709 13:15:09.648926 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:09.688020 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:09.655510  5125 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:09.655702  5277 raft_consensus.cc:740] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:09.694639 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:09.695784 32269 raft_consensus.cc:2410] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:15:09.698414 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:09.672793  5139 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:09.698453 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:09.703647 32020 catalog_manager.cc:5697] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:09.740733 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 186647us
I20260709 13:15:09.742234 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:09.746447 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:09.748818 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:09.748448 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:09.725620  5139 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:09.750351 32122 raft_consensus.cc:1275] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:15:09.736150  5098 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.727870  5149 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:09.752300 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:09.758455 32119 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:15:09.759727 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:09.760012 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:09.760787 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:09.762661 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:15:09.765333 32162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 218006us
I20260709 13:15:09.766907 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:09.766912 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:09.767647 32116 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:09.768893 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:09.769001 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:09.769594 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:09.769941 32118 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:09.772068 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:09.772490 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:09.741982  5250 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:09.775341 32270 raft_consensus.cc:1275] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:15:09.776460 32270 pending_rounds.cc:85] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06: Aborting all ops after (but not including) 10
I20260709 13:15:09.777110 32270 pending_rounds.cc:107] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:15:09.777354 32270 raft_consensus.cc:2889] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:09.780769 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:09.782018 32124 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:15:09.797622 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:09.757972  5139 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:09.798760 32119 raft_consensus.cc:1240] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 13 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:09.799747 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:09.800899 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:09.804024 32195 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:15:09.807502   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:09.810124 32196 raft_consensus.cc:2393] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 14: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:09.811823 32119 raft_consensus.cc:1240] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:09.808373   402 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:15:09.773132   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:09.814559 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:09.811179 32020 catalog_manager.cc:5697] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 10 to 12, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 12 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:09.810770 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:09.771119  5098 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:09.816563 32119 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:09.819146 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:09.819446 32271 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:15:09.819476 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:09.829133 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:09.838023 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:09.841224 32270 raft_consensus.cc:1240] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:09.868691 32264 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 17.
I20260709 13:15:09.860116 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:09.859575 32116 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
I20260709 13:15:09.842288 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:09.858958 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:09.848937 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:09.870167 32190 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:09.872148 32199 raft_consensus.cc:2393] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 13: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:09.828907 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:09.827111 32020 catalog_manager.cc:5697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 12 to 13, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 13 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:09.876473 32087 leader_election.cc:304] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:09.877720 32268 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 17.
I20260709 13:15:09.823315 32239 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:09.878880 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:15:09.878952 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 55711.8us
I20260709 13:15:09.880091 32118 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 17.
I20260709 13:15:09.877506 32269 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
I20260709 13:15:09.861070 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:15:09.874989 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 103631us
I20260709 13:15:09.765444  5149 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:09.888375 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:09.888356 32197 raft_consensus.cc:3055] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:09.891108 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:15:09.856940 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 44048.4us
I20260709 13:15:09.892923 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:09.829085 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:09.887099 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:09.895761 32194 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:09.874269 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:09.889561 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:09.896802 32116 raft_consensus.cc:2393] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 14: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:09.829161 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:09.838457 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:09.891501 32197 raft_consensus.cc:740] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:09.880308 32239 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:09.894945 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:09.859385 32267 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 15.
I20260709 13:15:09.853811  5259 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:09.900004  5291 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:09.900525  5291 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:09.901039  5291 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:09.888778  4908 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:09.877758  5160 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:09.901933  4908 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:09.902314  5160 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:09.840737   396 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:09.844172  5098 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:09.815851  5171 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:09.901183 32199 raft_consensus.cc:2393] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 18: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:09.811461  5213 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:09.904840 32191 raft_consensus.cc:1240] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:09.910324 32190 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17.
I20260709 13:15:09.916430 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:09.884999 32090 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:09.912099 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:09.912375 32117 raft_consensus.cc:2393] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 14: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
W20260709 13:15:09.911060 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 95406.8us
I20260709 13:15:09.819265  5156 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.923691 32122 raft_consensus.cc:1240] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 14. Current term is 15. Ops: []
W20260709 13:15:09.923813 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 43626.4us
I20260709 13:15:09.920264 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:09.924660 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:09.922820 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:09.924046 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:09.798097  5250 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:09.877913  5150 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:09.940275 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:09.929206 32090 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:09.936877 32123 raft_consensus.cc:2393] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 17: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:09.936977 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:09.922828 32089 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:09.935900 32119 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 15.
I20260709 13:15:09.938047 32238 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:09.901027  5259 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:09.939102 32124 raft_consensus.cc:2393] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 13: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:09.939894 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:09.947407 32195 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
W20260709 13:15:09.914793  5296 log.cc:927] Time spent T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.004s
I20260709 13:15:09.945636 32190 raft_consensus.cc:2393] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 17: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:09.822613  5257 consensus_queue.cc:1048] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 13:15:09.949389 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:09.929503 32197 consensus_queue.cc:260] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:09.902377  4908 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:09.950556 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:09.854988  5277 consensus_queue.cc:260] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:09.953383 32020 catalog_manager.cc:5697] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 12 to 14, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 14 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:09.954805  5149 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:09.955281 32020 catalog_manager.cc:5697] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 9 to 10, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 10 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:09.901155  5139 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:09.958006  5250 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:09.958428  5139 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:09.959486 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:09.960251 32197 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:09.960520 32273 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 9.
I20260709 13:15:09.964370 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:09.946153  5035 raft_consensus.cc:2764] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:15:09.966656 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:09.967427 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:09.939186  5151 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:09.939713  5272 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:09.930564  5294 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:09.950467  5237 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:09.971732 32020 catalog_manager.cc:5697] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 7 to 9, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 9 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:09.984098 32020 catalog_manager.cc:5697] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 12 to 13, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 13 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:09.985282 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:09.973810 32165 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:09.966604 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 43879.8us
I20260709 13:15:09.975001 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:09.976697 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:09.972306 32190 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:09.939895  5213 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:09.966897  4657 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:09.941149  5156 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:10.013103 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:09.949434  5150 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:10.016016 32194 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:15:10.014174 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:09.977242  5272 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.016625 32197 raft_consensus.cc:1275] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:15:10.015074 32190 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:15:10.016386 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:10.018833 32198 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:09.977553  5178 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:09.986186  5151 raft_consensus.cc:697] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:10.019878 32191 raft_consensus.cc:2376] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9. Re-sending same reply.
I20260709 13:15:09.989871  5243 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.990064  5082 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.021050 32162 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:09.990669  4969 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.023777 32020 catalog_manager.cc:5697] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 11 to 13, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 13 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:10.028775  5250 raft_consensus.cc:2804] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:10.029125  5250 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:10.029371  5250 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:10.029361 32020 catalog_manager.cc:5697] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 10 to 11, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 11 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:10.025364 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:10.031865 32020 catalog_manager.cc:5697] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 12 to 13, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 13 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:10.034865 32020 catalog_manager.cc:5697] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 7 to 8, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 8 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:10.037448 32199 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:10.037499  5243 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:10.038546 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 71938.2us
I20260709 13:15:10.038379  5151 consensus_queue.cc:237] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:10.013904  5259 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:10.037017 32089 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:10.014349  5160 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:15:10.042949   365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.021462  5272 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:10.044167  5250 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:10.047684 32265 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:15:10.052976  5178 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:10.083876  5178 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:10.021520   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:09.993153  5153 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:10.088335 32199 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
I20260709 13:15:10.063871 32165 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:10.092958 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:15:10.095220 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 58280.7us
I20260709 13:15:10.096037 32089 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:10.097343 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:10.098110 32266 raft_consensus.cc:2393] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 9: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:10.061026 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:10.042408 32020 catalog_manager.cc:5697] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 11 to 13, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 13 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:10.067489 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:09.988762  5294 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:10.036008  4657 consensus_queue.cc:1059] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:15:10.070642 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:10.075103  5256 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.040512  5082 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:10.041217  4969 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:10.079574  5161 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.080166 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:10.083487  5291 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:10.061534   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:10.147075   369 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:10.147259   402 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
I20260709 13:15:10.018370  5130 consensus_queue.cc:1059] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:15:10.070089 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:10.106665 32268 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:10.151856 32269 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:10.104128 32020 catalog_manager.cc:5697] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 10 to 12, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 12 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:10.088235  5149 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:10.078649 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:15:10.102303  4999 consensus_meta.cc:287] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.561s	user 0.003s	sys 0.007s
I20260709 13:15:10.139941 32196 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:10.140817 32267 raft_consensus.cc:2393] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 15: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:10.143573 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:10.166329 32266 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:10.166815  5304 consensus_queue.cc:1059] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:10.167912 32269 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
I20260709 13:15:10.107093  5295 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:10.170655 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:15:10.173674  5302 log.cc:927] Time spent T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:15:10.175978  5213 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:10.176575  5213 raft_consensus.cc:3055] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:10.176939  5213 raft_consensus.cc:740] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:10.177724  5213 consensus_queue.cc:260] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:10.178715  5213 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:10.186043  5291 leader_election.cc:290] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:10.186894 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:10.187587 32121 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 8.
I20260709 13:15:10.189883  5250 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:10.123193  5171 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:10.195360 32266 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 16.
W20260709 13:15:10.153352  5281 log.cc:927] Time spent T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:15:10.195845 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 102958us
I20260709 13:15:10.194137 32117 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 15.
W20260709 13:15:10.206130 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 61880.7us
I20260709 13:15:10.206990 32268 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
I20260709 13:15:10.157291  5246 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:15:10.172703 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 66093.3us
I20260709 13:15:10.223580 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:10.224221 32118 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:15:10.172037  5160 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:10.234911 32196 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
I20260709 13:15:10.119732  5256 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:10.281038 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 56916.4us
I20260709 13:15:10.276335  5294 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:10.201659  5310 consensus_queue.cc:1059] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.120s
W20260709 13:15:10.287784  5290 log.cc:927] Time spent T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:15:10.288985   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:10.289561  5243 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:10.291574   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:10.292909   398 raft_consensus.cc:2368] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 15. Current term is 16.
I20260709 13:15:10.294660  5272 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:10.295780  5156 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:10.296936  5153 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:10.201834  5035 consensus_queue.cc:1048] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 13:15:10.298884  5256 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:10.299880  5150 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:10.300109  5235 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:15:10.299907 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 77584.2us
I20260709 13:15:10.309631 32165 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:10.309811 32089 leader_election.cc:304] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:10.310637 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:10.230369  5246 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.154946  5161 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:10.312511 32193 raft_consensus.cc:3060] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:10.193025  4999 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:10.312605 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 148789us
I20260709 13:15:10.207553  5313 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.102s
I20260709 13:15:10.315991   369 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:10.317009 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:10.317423 32087 leader_election.cc:400] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Vote denied by peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025) with higher term. Message: Invalid argument: T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 15. Current term is 16.
I20260709 13:15:10.318584 32087 leader_election.cc:403] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:15:10.320739  5272 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:10.314522 32165 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:10.321352 32124 raft_consensus.cc:1275] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:15:10.320861 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.323623 32165 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:10.324431 32118 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:15:10.326874 32273 raft_consensus.cc:2393] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 11: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:10.329015 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:10.329649 32118 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:15:10.313807  5246 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:10.316972  5150 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:10.326071  5274 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:10.339411  5294 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:15:10.358357 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:10.359030 32121 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:10.373801 32194 raft_consensus.cc:1275] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:15:10.343982 32165 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:10.374727  5213 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:15:10.334810  5313 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:10.376819 32165 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:10.288306  4908 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:10.340070  5291 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:10.379199  4908 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:10.347484 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:10.349119  5082 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:10.380836 32117 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
W20260709 13:15:10.380967 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 45446.3us
I20260709 13:15:10.381927 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:10.382185 32239 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:10.382544 32117 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:15:10.384006 32239 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:15:10.384738   365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.384904  5224 consensus_queue.cc:1048] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:10.386745  5257 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:10.387113  5257 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.387445  5257 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:10.384742  5051 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:10.389176  5051 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.389523  5051 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:10.393934 32090 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:10.395010 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:10.349856   396 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
I20260709 13:15:10.397022  5161 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:10.397318 32269 raft_consensus.cc:2368] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 15. Current term is 16.
I20260709 13:15:10.399403  5301 raft_consensus.cc:3055] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:10.399988  5301 raft_consensus.cc:740] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:10.350801  5139 raft_consensus.cc:3055] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:10.400738  5139 raft_consensus.cc:740] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:10.400967  5301 consensus_queue.cc:260] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:10.401865  5139 consensus_queue.cc:260] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:10.402568  5301 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:10.403065  5139 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:15:10.351263 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.332899  5160 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:10.407270 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:10.351455  4999 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:10.407998 32199 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:15:10.409132 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:10.411424 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:10.351859 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:10.412366 32190 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:15:10.412885 32124 raft_consensus.cc:3060] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:10.412930 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:10.413514 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:10.413793 32191 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:15:10.414392 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:10.414935 32195 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:15:10.415854 32191 raft_consensus.cc:1275] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:15:10.352999  5150 raft_consensus.cc:697] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:10.416733 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:10.417518 32197 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:10.417552  5150 consensus_queue.cc:237] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:10.353188  4969 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:10.421257 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:10.423278 32239 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:10.430002 32193 raft_consensus.cc:2468] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 10.
I20260709 13:15:10.428735 32090 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:15:10.474538 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 46160.1us
W20260709 13:15:10.431401 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 53735us
I20260709 13:15:10.433034 32198 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:15:10.433104 32124 raft_consensus.cc:2468] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 10.
I20260709 13:15:10.443497 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:10.485641 32116 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 10.
I20260709 13:15:10.445163 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:10.446018 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:10.487061 32122 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:10.446811  5259 consensus_queue.cc:1059] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:10.448036  5160 raft_consensus.cc:697] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 17 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:10.449249  5277 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:10.486552 32117 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
W20260709 13:15:10.450214  5298 log.cc:927] Time spent T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.468s	user 0.003s	sys 0.000s
I20260709 13:15:10.450821  5213 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:10.441542  5233 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:10.452683  5171 raft_consensus.cc:3055] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:10.452847 32089 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:15:10.453994  5303 log.cc:927] Time spent T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.411s	user 0.003s	sys 0.000s
I20260709 13:15:10.465816 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:10.459321 32239 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:10.477295   368 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:10.506003 32268 raft_consensus.cc:2393] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 13: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:10.506258 32090 leader_election.cc:400] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 15. Current term is 16.
I20260709 13:15:10.492563 32197 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 18.
I20260709 13:15:10.499357  5291 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025) with higher term. Message: Invalid argument: T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 15. Current term is 16.
I20260709 13:15:10.502679 32165 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:10.535091 32165 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:10.451186  4908 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:10.503571 32117 raft_consensus.cc:1275] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:15:10.519523 32122 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 18.
I20260709 13:15:10.520712  4999 raft_consensus.cc:3055] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:10.520954   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:10.520519  5160 consensus_queue.cc:237] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:10.486310  4657 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:10.524780  5233 raft_consensus.cc:697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
W20260709 13:15:10.526597 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 65843.8us
I20260709 13:15:10.505312  5171 raft_consensus.cc:740] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
W20260709 13:15:10.533201 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 74075.6us
W20260709 13:15:10.533707   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 56521.7us
I20260709 13:15:10.538321 32121 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 18.
W20260709 13:15:10.545077 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 56230.5us
I20260709 13:15:10.490772  5304 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:10.540705  4999 raft_consensus.cc:740] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:10.553767   398 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:15:10.554044  5307 raft_consensus.cc:2804] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:10.541960  4908 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:10.560213 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 107424us
I20260709 13:15:10.599594 32089 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:10.545300  5240 raft_consensus.cc:2804] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:10.564731  5257 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:10.565826  5300 raft_consensus.cc:2749] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:10.542160  5213 raft_consensus.cc:697] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 15 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:10.541054  5312 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:10.550734  5178 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:10.568670   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:10.540007  5051 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:10.572873  4657 raft_consensus.cc:697] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:10.574273  5246 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:10.586362 32238 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:15:10.618075 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 83100.7us
I20260709 13:15:10.639760 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:10.622255 32089 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:15:10.640187 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 53930.5us
W20260709 13:15:10.629180 32006 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ddd7dfc158794e3ab7427d0b86b46c8d with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 94085cf341634eb686a95983b6b7f7e6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:10.591624  5082 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:10.593453  5307 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:10.611909  4908 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:10.634658 32236 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:10.609095  5274 raft_consensus.cc:697] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 16 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:10.627223  5312 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.624612  5165 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:10.624028  5240 raft_consensus.cc:697] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 10 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:10.593111  5304 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:15:10.573165  5233 consensus_queue.cc:237] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:10.654659   402 raft_consensus.cc:2368] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10.
I20260709 13:15:10.644385  5237 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:10.662379 32089 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:10.643922  5307 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:10.644086  4999 consensus_queue.cc:260] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:10.668694  5237 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.681178  5237 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:10.664001  5274 consensus_queue.cc:237] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:10.681461  5171 consensus_queue.cc:260] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:10.682842  5171 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:10.668694  5313 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:10.659534  5082 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:10.685338  5246 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:10.685640  4999 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:10.686684  5082 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:10.653285  5312 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:10.687070 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:10.687682 32121 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:15:10.678578  5051 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:10.689579  5291 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:10.690007 32089 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:10.690781  5165 raft_consensus.cc:2764] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260709 13:15:10.659513  5272 raft_consensus.cc:2804] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:10.692689  5272 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.693046  5272 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:15:10.696110 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 104643us
I20260709 13:15:10.697525 32087 leader_election.cc:400] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Vote denied by peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025) with higher term. Message: Invalid argument: T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10.
I20260709 13:15:10.697930 32087 leader_election.cc:403] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:10.700781 32121 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 10.
I20260709 13:15:10.705721   369 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:10.697620 32239 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:10.707755   394 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:15:10.709012 32162 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
W20260709 13:15:10.711535 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 54923.2us
I20260709 13:15:10.712524 32165 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:10.713639  5294 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:10.713991 32165 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:10.708748  5246 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:10.659736  5300 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:15:10.717692 32165 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:10.723680 32165 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:10.711545 32238 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:10.652971  5256 consensus_queue.cc:1048] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:15:10.664876  5257 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:10.729501  5244 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:10.675601  5304 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:10.715924  5150 raft_consensus.cc:2804] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:10.715229  5246 raft_consensus.cc:697] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 10 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:10.746078  5178 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025) with higher term. Message: Invalid argument: T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10.
I20260709 13:15:10.731765  5294 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:10.743435  5259 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:10.765868 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:10.765602 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:10.781554 32118 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:10.765554 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:10.782434 32117 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:10.776996 32165 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:10.753201  5250 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:10.663911  5213 consensus_queue.cc:237] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:10.806675  5250 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:15:10.808874  5325 log.cc:927] Time spent T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:15:10.664305  4657 consensus_queue.cc:237] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:10.730552  5276 consensus_queue.cc:1048] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 13:15:10.754658  5308 consensus_queue.cc:1048] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:15:10.794450  5150 raft_consensus.cc:697] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:10.674105  5240 consensus_queue.cc:237] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:10.766953  4908 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:10.827107 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 50241.7us
I20260709 13:15:10.828173 32165 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:10.829387 32165 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:10.836524 32118 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:15:10.835197  5250 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:10.793207  5304 consensus_queue.cc:1048] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:15:10.834745  5294 raft_consensus.cc:2764] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:15:10.833204  5161 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.850484  5150 consensus_queue.cc:237] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:10.837862  5246 consensus_queue.cc:237] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:10.868741 32165 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:10.875481 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 163994us
I20260709 13:15:10.903192 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:10.903853 32192 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:10.881980  5307 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:10.884848  5327 log.cc:927] Time spent T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.056s	user 0.002s	sys 0.000s
W20260709 13:15:10.885526 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 48255.5us
I20260709 13:15:10.885591  5244 raft_consensus.cc:697] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:10.885931  4908 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:10.923882  5324 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:10.924677  5324 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:10.886639  5224 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:10.890266  5308 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:10.890323  5082 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:10.927069  5082 raft_consensus.cc:697] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:10.927289  5324 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:10.926892  5308 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:10.928210  5082 consensus_queue.cc:237] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:10.929796  5308 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:10.910034 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:10.931070 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:10.931774 32267 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:10.931900   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:10.932142 32239 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:15:10.921829 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 53182us
I20260709 13:15:10.939105  5308 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:10.939636  5308 raft_consensus.cc:697] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:10.942020  5257 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.942570  5257 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:10.940495  5308 consensus_queue.cc:237] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:10.946141 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:10.946861 32115 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:10.950941  5257 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:10.952823 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:10.953471 32120 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 19.
I20260709 13:15:10.955982 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:10.956940 32194 raft_consensus.cc:2393] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 11: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:10.926813  5224 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:10.932567   394 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:15:10.933182   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:10.967243   402 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 20.
I20260709 13:15:10.915599 32117 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:15:10.931085 32190 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:10.968822 32236 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:10.969697  5324 raft_consensus.cc:2804] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:10.970058  5324 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:10.970400  5324 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:10.971624  5224 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:10.920933 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:10.973080 32191 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:10.959645 32165 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:10.980055 32165 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:10.981252 32165 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:10.983345 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 88242.8us
W20260709 13:15:10.984738 32089 leader_election.cc:336] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.745s (SENT)
I20260709 13:15:10.985037 32190 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:15:10.985272 32089 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:10.988516 32192 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:15:10.999415 32115 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:15:10.965646  5294 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:11.009840 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:11.019004 32117 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:15:11.011718 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:11.020236 32267 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 10.
I20260709 13:15:10.895393  5161 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:10.888420  5272 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:11.006682 32165 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:11.025177 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:11.000344  5233 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:10.991564  5250 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:11.028262 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:11.051040 32194 raft_consensus.cc:2393] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 20: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:11.000201  5213 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:11.033363  5244 consensus_queue.cc:237] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:11.035516  5312 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:11.022740  5150 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:11.022660  4999 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:15:11.053205 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 46645.4us
W20260709 13:15:11.054306 32089 leader_election.cc:336] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.778s (SENT)
W20260709 13:15:11.054953 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 121473us
I20260709 13:15:11.061388 32089 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:11.064917 32238 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:11.065610 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:11.066275 32268 raft_consensus.cc:2368] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12.
I20260709 13:15:11.064680 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:11.068315 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:11.054570  5300 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:11.069011 32268 raft_consensus.cc:2368] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 14. Current term is 15.
I20260709 13:15:11.069530 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:11.070465 32238 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:11.070958 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:11.072320 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:11.072917 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:11.073120  5141 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:11.073561  5291 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:11.085434 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:11.077088  5312 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:11.077185 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:11.079573 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:11.082273 32264 raft_consensus.cc:2368] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 15. Current term is 16.
I20260709 13:15:11.086393 32117 raft_consensus.cc:2368] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 14. Current term is 15.
I20260709 13:15:11.079732 32267 raft_consensus.cc:2368] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 15. Current term is 16.
I20260709 13:15:11.084441 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:11.080974 32238 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:11.083809 32089 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:11.084776 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:11.074023  4999 raft_consensus.cc:697] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 13 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:11.086552 32124 raft_consensus.cc:2393] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 14: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
W20260709 13:15:11.089048 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 60448us
I20260709 13:15:11.090054 32239 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:11.090080 32089 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:11.090714 32165 leader_election.cc:400] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12.
I20260709 13:15:11.078764 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:11.091311 32089 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:11.091615 32115 raft_consensus.cc:2393] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 15: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:11.091713 32165 leader_election.cc:400] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 14. Current term is 15.
I20260709 13:15:11.092060 32165 leader_election.cc:403] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:11.092561 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:11.095248 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:11.095661 32194 raft_consensus.cc:1240] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:11.128911 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:15:11.149668  5334 log.cc:927] Time spent T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:15:11.063438  5150 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:11.096943  5151 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:11.156926 32122 raft_consensus.cc:2393] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 15: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:11.156751 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:11.085884  5213 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:11.157764  5161 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:11.157853 32239 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:11.158475  5272 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:11.158432  5156 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:11.158684  5235 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:11.128345 32191 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:15:11.193006 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:11.197023 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:11.197670 32119 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:15:11.161363   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:11.096534 32192 raft_consensus.cc:1240] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:11.092876  5082 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:11.198709   402 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:11.131152 32165 leader_election.cc:400] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 15. Current term is 16.
I20260709 13:15:11.199581 32165 leader_election.cc:403] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:11.094476  5301 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:11.093847  4999 consensus_queue.cc:237] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:11.183010 32120 raft_consensus.cc:2368] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 15. Current term is 16.
I20260709 13:15:11.178514 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:11.179328 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:11.204519 32194 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
W20260709 13:15:11.212728 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 82667us
I20260709 13:15:11.214123 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:11.214221 32165 leader_election.cc:400] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 15. Current term is 16.
I20260709 13:15:11.214381 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:11.215451 32165 leader_election.cc:403] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:11.215652 32191 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:11.172773  5259 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 14. Current term is 15.
I20260709 13:15:11.173305  5335 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:11.220494 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:11.225783 32121 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:15:11.219848 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:11.224332 32119 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:15:11.229715 32191 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:15:11.198227  5312 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:11.236833 32239 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:11.191969  5156 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:11.182265  5237 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:11.243664 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:11.251688 32195 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:15:11.254290 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 163023us
I20260709 13:15:11.174153  5324 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:11.255285 32089 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:15:11.326629 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 89883.3us
I20260709 13:15:11.219763  5082 raft_consensus.cc:697] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:11.219293  5329 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 15. Current term is 16.
I20260709 13:15:11.188983  5213 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:11.242089  5304 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 15. Current term is 16.
I20260709 13:15:11.253755  5312 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.359762 32195 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:15:11.317545   402 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:15:11.256788  5156 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:11.336280  4969 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:15:11.343293 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 129258us
I20260709 13:15:11.363780  4969 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.364226  4969 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:11.366611  5160 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.366919 32165 leader_election.cc:400] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 14. Current term is 15.
I20260709 13:15:11.367130  5160 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:11.369278  5160 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:11.370051  5082 consensus_queue.cc:237] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:11.356637 32273 raft_consensus.cc:2368] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 15. Current term is 16.
I20260709 13:15:11.361377 32236 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:11.368503 32165 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:11.376711 32165 leader_election.cc:400] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 15. Current term is 16.
I20260709 13:15:11.377838 32165 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:11.386926 32194 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:15:11.363368  5312 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:11.407603  5272 raft_consensus.cc:2804] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:11.408751 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:11.411631  5272 raft_consensus.cc:697] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:11.380280  5160 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:11.386945  5329 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:15:11.423364 32272 raft_consensus.cc:1275] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:15:11.415503  5272 consensus_queue.cc:237] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:11.431176  5345 log.cc:927] Time spent T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:15:11.445415  5324 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:11.447615  5141 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:15:11.424409  5321 log.cc:927] Time spent T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:15:11.453405  5213 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:11.421998  5340 log.cc:927] Time spent T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:15:11.455823  5237 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:11.465631 32197 raft_consensus.cc:1275] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:15:11.468374  5156 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:11.476195  5125 consensus_queue.cc:1048] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:11.477736 32165 leader_election.cc:400] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 15. Current term is 16.
I20260709 13:15:11.478062 32165 leader_election.cc:403] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:11.478965  5300 consensus_queue.cc:1048] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:11.480429  5300 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:15:11.492496   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:11.498930 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:11.503357 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:11.504405 32124 raft_consensus.cc:2393] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 16: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:11.483522 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:11.505445 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:11.505861 32121 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:11.506107 32124 raft_consensus.cc:2393] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 14: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:11.507150 32124 raft_consensus.cc:1275] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:15:11.508225 32124 raft_consensus.cc:1275] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:15:11.486580 32115 raft_consensus.cc:1240] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:11.509747 32115 raft_consensus.cc:1275] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:15:11.486936 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:11.511008 32120 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 15.
I20260709 13:15:11.487476 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:11.512375 32119 raft_consensus.cc:2368] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12.
I20260709 13:15:11.488498 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:11.488878 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:11.489428   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:11.470186  4969 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:11.472103   402 raft_consensus.cc:1275] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:15:11.473171  5350 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:11.515883  5350 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:11.489632 32266 raft_consensus.cc:1275] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:15:11.517118  5328 consensus_queue.cc:1048] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:15:11.517953  5347 log.cc:927] Time spent T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.110s	user 0.002s	sys 0.000s
I20260709 13:15:11.518052  5350 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:11.475536 32190 raft_consensus.cc:2393] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 9: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:11.522125  5328 consensus_queue.cc:1048] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:11.519407 32264 raft_consensus.cc:2368] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 16. Current term is 17.
I20260709 13:15:11.485725 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:11.524819 32116 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:11.525542   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:11.526369  4969 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:11.529269 32273 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:15:11.536451   394 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:15:11.538832 32236 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:11.539815 32121 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:15:11.541126 32116 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 20.
I20260709 13:15:11.547355 32165 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:15:11.555799   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 378317us
I20260709 13:15:11.560009 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:11.574049 32124 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:11.596060 32165 leader_election.cc:400] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12.
I20260709 13:15:11.596475 32165 leader_election.cc:403] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:15:11.482069  5156 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:11.564121  5277 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.580199  5160 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:11.610828 32271 raft_consensus.cc:1240] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:11.578557  5300 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 15. Current term is 16.
I20260709 13:15:11.580964  5350 raft_consensus.cc:2804] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:11.563678  5250 consensus_queue.cc:1059] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:15:11.563388  5329 consensus_queue.cc:1048] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:15:11.563572  5213 consensus_queue.cc:1048] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:15:11.608196  5304 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12.
I20260709 13:15:11.640375 32124 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:15:11.613829  5160 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.647724 32196 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:15:11.651749 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:11.654904 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:11.611497  5294 consensus_queue.cc:1048] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:15:11.616303  5335 raft_consensus.cc:697] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:11.667479 32239 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:11.668409  5244 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:11.668937  5244 raft_consensus.cc:697] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:11.644268  5350 raft_consensus.cc:697] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:11.669780  5244 consensus_queue.cc:237] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:11.670908  5350 consensus_queue.cc:237] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:11.672240 32199 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:15:11.674813 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:11.673547 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:11.678723  4999 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:11.679379 32194 raft_consensus.cc:2393] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 20: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:11.679263  4999 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:11.615383  5277 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:11.651980  5160 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:11.687523 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:11.688144 32195 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:15:11.685829   398 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 20.
I20260709 13:15:11.696187 32271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0265ef82085f409c9de498f37135c550"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:15:11.696874 32271 raft_consensus.cc:606] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:11.697242 32271 raft_consensus.cc:614] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:11.699102 32236 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:15:11.699502 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 444292us
I20260709 13:15:11.704820  5313 raft_consensus.cc:2764] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:15:11.707687  5150 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:11.707924  5235 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:11.709976  5294 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.710534  5294 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:11.713158  5356 log.cc:927] Time spent T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:15:11.717244 32122 raft_consensus.cc:1275] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:15:11.717713  5277 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:11.719667 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:11.721896 32119 raft_consensus.cc:1275] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:15:11.723691 32124 raft_consensus.cc:1275] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:11.708418  5235 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:11.726164 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:11.726768 32194 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 21.
I20260709 13:15:11.727609  5235 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:11.727911   368 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:11.729785  5277 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:15:11.730178  5277 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.730494  5277 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:11.733248  5156 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:15:11.733824  5156 raft_consensus.cc:697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:11.733924 32271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10940646da924abea9f371781da8acee"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:15:11.734762 32271 raft_consensus.cc:606] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 19 LEADER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:11.735131   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:11.735798   396 raft_consensus.cc:1275] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:15:11.736019  5233 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:11.743495 32195 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:15:11.748639  5150 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.734789  5156 consensus_queue.cc:237] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:11.747287 32124 raft_consensus.cc:1275] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:15:11.755370 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:11.760339 32238 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:11.757565 32239 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:11.772769 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:11.764559 32124 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 20.
I20260709 13:15:11.778287 32238 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:11.780104 32264 raft_consensus.cc:1275] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:11.775866  5362 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:11.781953  5312 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:11.786867 32267 raft_consensus.cc:2368] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 14. Current term is 15.
I20260709 13:15:11.787871  5312 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:11.788045  5307 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:11.749439  5150 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:11.765781  5294 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:11.791730 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 91406.4us
I20260709 13:15:11.795243 32165 leader_election.cc:400] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 16. Current term is 17.
I20260709 13:15:11.795620 32165 leader_election.cc:403] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:11.795383  5294 consensus_queue.cc:1059] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:11.801116  5294 consensus_queue.cc:1243] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer 6b3ed521ce8947db80c4b4828b355c06 log is divergent from this leader: its last log entry 18.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:15:11.794812 32089 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:11.801848  5272 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:11.802424  5272 raft_consensus.cc:697] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:11.802942  5171 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:11.790364  5150 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:11.803342  5272 consensus_queue.cc:237] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:11.804550 32089 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:11.796672  5304 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 16. Current term is 17.
I20260709 13:15:11.807781  5328 raft_consensus.cc:3055] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:11.808230  5328 raft_consensus.cc:740] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:11.809106  5328 consensus_queue.cc:260] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:11.811290 32267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:15:11.811730   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:11.813270   402 raft_consensus.cc:2368] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12.
I20260709 13:15:11.812414  5348 consensus_queue.cc:1048] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:11.814414  5160 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:11.815511 32162 leader_election.cc:400] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 election: Vote denied by peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025) with higher term. Message: Invalid argument: T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12.
W20260709 13:15:11.815734  5357 log.cc:927] Time spent T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:15:11.816041 32267 raft_consensus.cc:606] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:11.819425 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:11.826208 32124 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:11.828403 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:11.829046 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:11.829958 32266 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
I20260709 13:15:11.842959 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:15:11.843775 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 63414.1us
I20260709 13:15:11.845714 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:11.846796 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:11.846930 32265 raft_consensus.cc:1275] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:15:11.838003  5125 consensus_queue.cc:1048] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
W20260709 13:15:11.851830 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 47351.6us
I20260709 13:15:11.816823  5171 raft_consensus.cc:2749] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:11.854802 32089 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:11.858062 32124 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:15:11.816900  4999 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:11.845947  5160 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:11.768848  5295 consensus_queue.cc:1048] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 13:15:11.766762  5274 consensus_queue.cc:1048] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
I20260709 13:15:11.840855  5362 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:11.849619  5308 consensus_queue.cc:1048] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
W20260709 13:15:11.874944 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 96771.9us
W20260709 13:15:11.876382  5365 log.cc:927] Time spent T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:15:11.875334 32089 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:11.882447  5233 consensus_queue.cc:1048] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:11.883885 32271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:15:11.874066  5171 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:11.871147  5235 consensus_queue.cc:1048] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:15:11.883437  5313 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:11.885053 32271 raft_consensus.cc:606] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:15:11.885831 32089 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:15:11.899668   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 138238us
I20260709 13:15:11.900897 32089 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:11.903650  5358 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.906104 32089 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:11.839744  5335 consensus_queue.cc:237] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:11.909993 32089 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:11.901228  5313 raft_consensus.cc:2764] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:15:11.911448  5235 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:11.906955  5171 raft_consensus.cc:2764] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:15:11.913849 32271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:15:11.914579 32271 raft_consensus.cc:606] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:11.904237  5358 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:11.919662  5358 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:11.902045  5233 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.921607 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:15:11.922402 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:11.930187 32192 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 13.
I20260709 13:15:11.930315 32089 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:11.897789  5277 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:11.931280  5171 raft_consensus.cc:2764] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 13:15:11.941340 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:11.932284   368 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:11.932140  5233 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:11.956137 32165 leader_election.cc:400] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 14. Current term is 15.
I20260709 13:15:11.957525 32165 leader_election.cc:403] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:11.959383 32089 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:11.960049 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:11.960944 32119 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:15:11.962401 32165 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:11.963547 32165 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:11.965176 32121 raft_consensus.cc:1240] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
W20260709 13:15:11.966284 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 120550us
I20260709 13:15:11.965284 32116 raft_consensus.cc:1275] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:15:11.975044 32165 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:11.978361 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 101165us
I20260709 13:15:11.989626 32119 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 22.
I20260709 13:15:11.953936  5328 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:11.968844  5307 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:15:11.948829  5277 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 22 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:11.969048  5235 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:15:12.008904   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 76706.9us
I20260709 13:15:12.011174 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:12.011855 32192 raft_consensus.cc:3060] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:11.981817  5329 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:12.013382  5329 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.013815  5329 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:11.997488   369 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:11.976774  5362 raft_consensus.cc:697] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:11.981994  5160 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:11.984186  5348 raft_consensus.cc:2804] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:11.964284  5233 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:11.997610  5171 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:15:12.025192 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 43827.6us
I20260709 13:15:12.010577 32022 catalog_manager.cc:5697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 7 to 11, term changed from 18 to 20, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to <none>, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1), VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2), VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3), VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 20 committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:12.002938  4999 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:12.040520 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:12.043609 32269 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:15:12.053417 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:12.024928  5348 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.054184 32264 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17.
I20260709 13:15:12.024547  5246 raft_consensus.cc:2804] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:15:12.062978 32192 raft_consensus.cc:2468] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 22.
I20260709 13:15:12.045964  5312 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.085129  5312 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:12.087569  5312 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:15:12.067979 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 44510.1us
I20260709 13:15:12.069180 32090 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:12.003106  5151 consensus_queue.cc:1059] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:15:12.047461 32022 catalog_manager.cc:5697] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:15:12.099582 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 103152us
I20260709 13:15:12.108991   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:12.110327  5362 consensus_queue.cc:237] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:12.073675  5348 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:12.113117  5151 raft_consensus.cc:3055] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:12.113526  5151 raft_consensus.cc:740] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:12.114342  5151 consensus_queue.cc:260] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:12.041958  5243 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:12.132174 32089 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:12.135315 32124 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:15:12.136785 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:12.137624 32119 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:12.103662  5171 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:15:12.142092 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:12.146446 32238 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:12.104102  5246 raft_consensus.cc:697] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 22 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:12.148056 32122 raft_consensus.cc:1275] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:15:12.148414 32269 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:15:12.169365 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:12.174865 32192 raft_consensus.cc:1275] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:15:12.177441 32119 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:15:12.144402  4999 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.147805  5171 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.178965  4999 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:12.179621  5171 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:12.131793  4657 consensus_queue.cc:1059] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:15:12.181900  4999 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:12.142880  5151 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:12.130559  5243 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:12.196437 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:12.186018  5380 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:12.185767  5358 consensus_queue.cc:1048] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:15:12.226219  5246 consensus_queue.cc:237] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:12.259796 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 256492us
I20260709 13:15:12.260878 32165 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:12.213238  5352 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:15:12.263450  5376 log.cc:927] Time spent T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 13:15:12.281281 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:12.286209 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:12.286888 32190 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 18.
I20260709 13:15:12.287755 32192 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:15:12.288498 32192 pending_rounds.cc:85] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 9
I20260709 13:15:12.288424 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:12.288939 32192 pending_rounds.cc:107] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:15:12.289227 32192 raft_consensus.cc:2889] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:12.287882 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:12.289889 32267 raft_consensus.cc:1275] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:15:12.275240  5300 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:12.208943  5171 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:12.356779  5235 raft_consensus.cc:3055] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:12.357390  5235 raft_consensus.cc:740] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:12.358373  5235 consensus_queue.cc:260] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:12.354425  5300 raft_consensus.cc:697] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:12.360615  5300 consensus_queue.cc:237] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:12.364651  5235 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:12.365936  5171 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:12.374189  5335 raft_consensus.cc:993] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:15:12.374989  5341 raft_consensus.cc:1081] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:15:12.379861 32264 raft_consensus.cc:1275] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:15:12.379735 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:12.380748 32266 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 12.
I20260709 13:15:12.388046 32192 raft_consensus.cc:1275] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:15:12.389418  5378 log.cc:927] Time spent T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:15:12.281479  5150 consensus_queue.cc:1048] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
W20260709 13:15:12.428468 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 80002.2us
I20260709 13:15:12.293344  5355 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.224s
W20260709 13:15:12.405150  5377 log.cc:927] Time spent T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.375s	user 0.005s	sys 0.000s
I20260709 13:15:12.383939  5082 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:12.511590  5307 consensus_meta.cc:287] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.002s
W20260709 13:15:12.606436  5383 log.cc:927] Time spent T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 13:15:12.607277 32190 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
W20260709 13:15:12.641449 32006 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ddd7dfc158794e3ab7427d0b86b46c8d with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 94085cf341634eb686a95983b6b7f7e6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:15:12.501596 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 66059.2us
W20260709 13:15:12.648312  5328 consensus_meta.cc:287] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.646s	user 0.012s	sys 0.005s
W20260709 13:15:12.687918 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 391722us
I20260709 13:15:12.648722  5304 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.651441  5307 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 14. Current term is 15.
W20260709 13:15:12.670150  5329 consensus_meta.cc:287] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.654s	user 0.005s	sys 0.010s
I20260709 13:15:12.694355 32199 raft_consensus.cc:1275] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 13:15:12.698119 32199 pending_rounds.cc:85] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 8
I20260709 13:15:12.698458 32199 pending_rounds.cc:107] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:15:12.698791 32199 raft_consensus.cc:2889] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:12.695740 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:12.700567 32271 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:15:12.648057  5082 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:12.749603  5387 log.cc:927] Time spent T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:15:12.770546 32022 catalog_manager.cc:5697] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:12.783984 32022 catalog_manager.cc:5697] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 12 to 17, leader changed from 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 17 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:12.787001 32022 catalog_manager.cc:5697] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:12.779506 32198 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:15:12.707793  5237 raft_consensus.cc:993] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:15:12.706597   398 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:15:12.791780 32022 catalog_manager.cc:5697] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 6 to 12, leader changed from 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 12 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:12.700757  5328 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:12.773110  4657 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.747677  5307 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:12.745721  5213 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:12.812292   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:12.706748  5329 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:12.799465  5156 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.023s	sys 0.030s
W20260709 13:15:12.802044  5357 log.cc:927] Time spent T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:15:12.814182  5237 raft_consensus.cc:1081] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Signalling peer fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:15:12.794412  5243 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:12.709115  5304 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:12.794239  5259 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:12.789729  5150 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:12.888504 32271 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 19.
I20260709 13:15:12.900535 32195 raft_consensus.cc:1240] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 11. Current term is 12. Ops: []
W20260709 13:15:12.890551  5156 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.023s	sys 0.034s
I20260709 13:15:12.845244  4657 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:12.913089 32118 raft_consensus.cc:1275] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:15:12.912994  5389 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.089s
W20260709 13:15:12.920231  5348 consensus_meta.cc:287] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6: Time spent flushing consensus metadata: real 0.807s	user 0.010s	sys 0.000s
I20260709 13:15:12.921005  5237 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:12.932046  5395 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:12.932951  5395 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:12.935582  5395 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:12.936220  5395 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:12.914397  5301 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.941814  5082 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:12.942066  5329 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:12.909106  5150 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:12.906844  5259 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:12.847851  5213 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:12.906677  5243 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:15:12.946820  5358 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:15:12.846231  5307 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:12.950133  5235 consensus_meta.cc:287] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.585s	user 0.009s	sys 0.002s
I20260709 13:15:12.950649  5396 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.954767  4657 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:12.959173  5403 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:12.992530  5403 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:12.993752 32197 raft_consensus.cc:1275] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:15:12.994854  5403 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:12.961222  5304 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:12.962234  5348 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:12.997620  5348 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:12.830260  5328 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:12.908087 32020 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49556 (request call id 254) took 27645 ms (client timeout 15000 ms). Trace:
W20260709 13:15:12.998502 32020 rpcz_store.cc:269] 0709 13:14:45.257433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.314491 (+ 57058us) service_pool.cc:224] Handling call
0709 13:15:12.894180 (+27579689us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:10.521676 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:10.522194 (+   518us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:10.522228 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:15:10.522245 (+    17us) tablet.cc:662] Decoding operations
0709 13:15:10.523364 (+  1119us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:10.523457 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:10.523485 (+    28us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:15:10.536195 (+ 12710us) tablet.cc:701] Row locks acquired
0709 13:15:10.539831 (+  3636us) write_op.cc:260] PREPARE: finished
0709 13:15:10.585732 (+ 45901us) write_op.cc:270] Start()
0709 13:15:10.592377 (+  6645us) write_op.cc:276] Timestamp: P: 1783602910551048 usec, L: 0
0709 13:15:10.593749 (+  1372us) op_driver.cc:348] REPLICATION: starting
0709 13:15:10.671301 (+ 77552us) log.cc:844] Serialized 5120 byte log entry
0709 13:15:10.800827 (+129526us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b1800336640. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bf04522 00007fb59bf067c1 00007fb59bf06779 00007fb59bf06709 00007fb59bf066d1 00007fb59bf059cd 000000000038f354 000000000038f199 00007fb59bee783a
0709 13:15:10.977891 (+177064us) op_driver.cc:464] REPLICATION: finished
0709 13:15:11.211873 (+233982us) write_op.cc:301] APPLY: starting
0709 13:15:11.220673 (+  8800us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:11.508904 (+288231us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:11.508935 (+    31us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:11.799788 (+290853us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:11.800064 (+   276us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:15:11.800136 (+    72us) write_op.cc:312] APPLY: finished
0709 13:15:11.800473 (+   337us) log.cc:844] Serialized 121 byte log entry
0709 13:15:11.826671 (+ 26198us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:11.845385 (+ 18714us) write_op.cc:454] Released schema lock
0709 13:15:11.853647 (+  8262us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:11.876034 (+ 22387us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:11.877900 (+  1866us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":69984,"reported_tablets":40,"spinlock_wait_cycles":1920,"child_traces":[["op",{"apply.queue_time_us":204100,"apply.run_cpu_time_us":21359,"apply.run_wall_time_us":677181,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58597,"num_ops":13,"prepare.queue_time_us":243229,"prepare.run_cpu_time_us":11021,"prepare.run_wall_time_us":207578,"raft.queue_time_us":167291,"raft.run_cpu_time_us":16955,"raft.run_wall_time_us":192949,"replication_time_us":367349,"spinlock_wait_cycles":5694848,"thread_start_us":452174,"threads_started":4,"wal-append.queue_time_us":41922,"wal-append.run_cpu_time_us":9674,"wal-append.run_wall_time_us":2072019}]]}
I20260709 13:15:12.972774  5395 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:12.972841  5301 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:13.010736  5301 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:13.011775   394 raft_consensus.cc:2368] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14.
W20260709 13:15:12.982072 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 301959us
W20260709 13:15:12.976076  5151 consensus_meta.cc:287] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.783s	user 0.006s	sys 0.006s
I20260709 13:15:12.905428  5256 consensus_queue.cc:1048] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:15:13.022293 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:13.045974 32193 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:15:13.022850 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 479424us
I20260709 13:15:13.058925 32193 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 14.
I20260709 13:15:13.060421   368 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:13.000152  5328 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:13.069397  5125 raft_consensus.cc:2804] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:13.069953  5125 raft_consensus.cc:697] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 14 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:13.070895  5125 consensus_queue.cc:237] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:12.988649  5329 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.071889  5329 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:13.012512  5396 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:13.010840  5395 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:13.075141  5396 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:13.076399 32272 raft_consensus.cc:1275] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:15:13.067515  5213 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:13.058825  5151 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:13.047313  5301 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:13.084906 32090 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:13.091868 32121 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:15:13.094512 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:13.094388 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:13.099390 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:13.106308 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:13.115677 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:13.116652 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:13.122380 32193 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:13.088064  5394 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:13.124778 32165 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:13.069962  5259 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:13.096102  5352 consensus_queue.cc:1048] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:15:13.143828  5394 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:13.153306  5160 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:13.063475  5051 consensus_queue.cc:1048] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:15:13.164793  5413 consensus_queue.cc:1048] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:15:13.165695  5405 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:13.154925  5328 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:13.153455  5395 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.178259  5307 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:13.118839  5277 consensus_queue.cc:1048] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:15:13.092496  5151 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:13.108995  5233 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:13.091298  5348 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.058812  5375 consensus_queue.cc:1048] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.073s
I20260709 13:15:13.166109  5329 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:13.091058  4908 consensus_queue.cc:1048] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
W20260709 13:15:13.198328 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 311629us
W20260709 13:15:13.201383 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 305066us
I20260709 13:15:13.279148 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:13.279502 32236 leader_election.cc:400] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025) with higher term. Message: Invalid argument: T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14.
I20260709 13:15:13.280174 32236 leader_election.cc:403] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:13.140043 32121 raft_consensus.cc:1275] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:15:13.109390  5301 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:13.148263  5150 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:13.154965 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:13.287143 32271 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:15:13.206652 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 82034.6us
I20260709 13:15:13.288092 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:13.216568 32193 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 19.
I20260709 13:15:13.292912 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:15:13.217814 32089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.011s	sys 0.017s
I20260709 13:15:13.219451 32122 raft_consensus.cc:1275] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:15:13.231884 32238 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:13.243331   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:13.296339   394 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 20.
I20260709 13:15:13.246629   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:13.247488  5259 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.248101  5250 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.253450 32195 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:15:13.257943 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:13.301924 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:13.259289 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:13.219285  5213 raft_consensus.cc:2749] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:13.243074  5402 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.268576 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:13.263305  5171 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:13.302935 32192 raft_consensus.cc:2368] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14.
I20260709 13:15:13.302856 32239 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:13.303483 32089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.012s	sys 0.017s
I20260709 13:15:13.264240  5395 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:13.285862  5233 raft_consensus.cc:697] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:13.286229  5235 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:13.311035 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:13.311298 32191 raft_consensus.cc:1275] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:15:13.274660  5348 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:13.324700  5341 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:13.263542  5160 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:13.257364  5405 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:13.305553 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 73792.2us
I20260709 13:15:13.259605  5328 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:13.273664  5300 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.910s	user 0.000s	sys 0.019s
I20260709 13:15:13.316605 32271 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 14.
I20260709 13:15:13.327976 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:15:13.318097 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 625022us
I20260709 13:15:13.325939  5348 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:13.317983  5310 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:13.338928 32089 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:13.299376  5307 consensus_queue.cc:1048] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:15:13.338303 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:13.342546 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:15:13.342267  5300 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.979s	user 0.000s	sys 0.020s
I20260709 13:15:13.348627 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:13.348932 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:13.352451 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:13.352242 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:13.354581 32265 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
I20260709 13:15:13.360961 32198 raft_consensus.cc:1275] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:15:13.312923  5259 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:13.312219  5250 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:13.364365 32194 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.009s	sys 0.018s
I20260709 13:15:13.364542 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:15:13.371481 32194 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.009s	sys 0.018s
I20260709 13:15:13.379190 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:13.341212  5355 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025) with higher term. Message: Invalid argument: T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14.
I20260709 13:15:13.323684  5171 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:13.388093 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:13.319993  5402 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:13.398121 32194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 4042) took 1017 ms. Trace:
I20260709 13:15:13.399319 32190 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:13.399726 32190 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:13.405280 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:13.406519 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:13.407436 32199 raft_consensus.cc:2393] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 16: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:13.408458 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:15:13.426611   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 306245us
I20260709 13:15:13.357367   396 raft_consensus.cc:1275] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:13.330279  5312 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:15:13.428023 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:13.428987 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:13.429683  5313 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:13.430365 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:13.432330 32199 raft_consensus.cc:1275] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:15:13.442651 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:13.328161  5235 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:13.437577 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:13.358814  4999 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:13.358480  5237 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:13.465022 32195 raft_consensus.cc:1275] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:15:13.464184 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:13.443425 32123 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
I20260709 13:15:13.397157  5381 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.473132 32117 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
I20260709 13:15:13.479558 32191 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 9.
W20260709 13:15:13.433395  5349 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.960s	user 0.005s	sys 0.028s
I20260709 13:15:13.428519  5329 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.397032  5390 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:13.473507 32165 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:13.440872 32190 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:13.507220 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:13.353868  5310 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:13.483984  5349 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.096s	user 0.005s	sys 0.028s
I20260709 13:15:13.478535  4657 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:13.522264 32116 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:56890
I20260709 13:15:13.531984 32116 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:13.483409  5394 leader_election.cc:290] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:13.523787 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:13.526793 32118 raft_consensus.cc:1275] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:15:13.470852  5418 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:13.429996  5404 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:13.532390 32116 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:13.369505  5233 consensus_queue.cc:237] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:13.506450  5413 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.541920 32118 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:13.549165 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:13.505846  5151 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:13.527333  5150 raft_consensus.cc:2804] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:13.482987  4999 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:15:13.486896  5237 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:13.525681  5390 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:13.585242 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:13.477133  5313 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:13.551004  5300 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.517715  5329 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:13.556996  5418 raft_consensus.cc:697] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:13.576851  5150 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.606233 32116 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:13.546423  4657 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:13.617515 32238 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:13.619019  5082 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:15:13.587870   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 157270us
I20260709 13:15:13.481773  5381 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:13.573544  5399 consensus_queue.cc:1048] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:15:13.643242 32118 raft_consensus.cc:1275] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:15:13.644109 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:13.554927  5404 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:13.614090  5421 log.cc:927] Time spent T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:15:13.583011  5224 consensus_queue.cc:1048] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:15:13.655301 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:13.646560 32116 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:13.699870 32271 raft_consensus.cc:3055] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:13.700403 32271 raft_consensus.cc:740] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:13.614904  5150 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:13.703097 32124 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 20.
I20260709 13:15:13.705156 32271 consensus_queue.cc:260] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:13.572350  5413 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:13.629366  5395 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:13.710887 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 93441.3us
I20260709 13:15:13.721565 32238 leader_election.cc:400] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14.
I20260709 13:15:13.641083  5311 consensus_queue.cc:1059] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.335s
I20260709 13:15:13.723062  5399 consensus_queue.cc:1048] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:13.711467  5396 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.724074  4969 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:13.724434  5396 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:13.607159  5300 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:13.728842  5402 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:13.729000  5300 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:13.729296  5310 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:13.711640  5304 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:13.730814  4999 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:13.731232  5304 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:13.732158  5420 log.cc:927] Time spent T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.291s	user 0.001s	sys 0.000s
I20260709 13:15:13.734114  5304 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:13.734577  5404 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:13.735944  5436 log.cc:927] Time spent T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:15:13.738370  5416 consensus_queue.cc:1048] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:13.744144  5237 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:13.744902  5418 consensus_queue.cc:237] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:13.750799 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:13.751094 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:13.641398  5411 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:15:13.703943  5422 log.cc:927] Time spent T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:15:13.760227 32271 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:13.763531   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
W20260709 13:15:13.707149 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 87922.2us
I20260709 13:15:13.765174 32119 raft_consensus.cc:1240] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:13.772439 32089 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:13.614972  5301 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:13.712318  5405 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:13.789355   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:13.790439  5390 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:13.783381  5250 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:13.791395  5235 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:13.816599 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:13.794543  5313 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:13.795678  5329 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:13.758024  5396 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:13.798169  5413 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:15:13.798847  5423 log.cc:927] Time spent T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:15:13.805819 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:13.816543 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:15:13.817219  5431 log.cc:927] Time spent T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
I20260709 13:15:13.632908  5244 consensus_queue.cc:1048] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.174s
W20260709 13:15:13.818068  5432 log.cc:927] Time spent T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
I20260709 13:15:13.818145 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:13.812844  5294 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:13.645743  5406 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.762658  5259 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:13.798107  5381 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:13.643054  5328 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:13.831872 32192 raft_consensus.cc:1275] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:13.783732  5171 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:13.839026 32271 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:15:13.847208 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:13.837637   368 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:15:13.889846   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 52334.9us
I20260709 13:15:13.849720  5394 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:13.896979  5348 raft_consensus.cc:2804] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:13.903549  5348 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.904095  5348 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:13.928872  5435 log.cc:927] Time spent T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:15:13.878535  5294 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:13.933144  5380 raft_consensus.cc:3055] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:13.933672  5380 raft_consensus.cc:740] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:13.934525  5380 consensus_queue.cc:260] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:13.937619  4657 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:13.850734 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 78411.9us
I20260709 13:15:13.940279 32199 raft_consensus.cc:1275] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:15:13.398563 32194 rpcz_store.cc:276] 0709 13:15:12.384922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.385140 (+   218us) service_pool.cc:224] Handling call
0709 13:15:12.385522 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:12.385755 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:15:12.782417 (+396662us) log.cc:844] Serialized 14 byte log entry
0709 13:15:13.396837 (+614420us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:13.397819 (+   982us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:15:13.397865 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:13.397943 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:13.398066 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64633,"prepare.queue_time_us":492564,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":4581,"raft.queue_time_us":25122,"thread_start_us":985460,"threads_started":2}
I20260709 13:15:13.626497  5160 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:13.868029  5425 log.cc:927] Time spent T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.295s	user 0.000s	sys 0.000s
I20260709 13:15:13.871359  5278 consensus_queue.cc:1048] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:15:13.886231  5424 log.cc:927] Time spent T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.320s	user 0.002s	sys 0.000s
I20260709 13:15:13.939993 32089 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:13.945638 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:13.932559  5294 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:13.962349 32089 leader_election.cc:304] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:13.949177  5380 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:13.959251  5274 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:13.946977  5240 consensus_queue.cc:1048] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:15:13.892846  5406 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:13.989933  5381 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:13.991022  5171 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.991377  5453 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:13.998117  5388 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:13.965970  5308 consensus_queue.cc:1048] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
W20260709 13:15:14.004472 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.987561   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:14.010303 32122 raft_consensus.cc:1275] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:15:14.007249  5328 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:13.984017  5274 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:14.013055  5449 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:14.013664  5449 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:14.015688  5243 raft_consensus.cc:993] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:15:14.011256 32196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 2826) took 1724 ms. Trace:
I20260709 13:15:14.016237  5243 raft_consensus.cc:1081] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 19 LEADER]: Signalling peer fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:15:14.016182 32196 rpcz_store.cc:276] 0709 13:15:12.285592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.285725 (+   133us) service_pool.cc:224] Handling call
0709 13:15:12.286108 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:12.286519 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:12.286557 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:12.892101 (+605544us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b2c0005bf68. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59d8eaa11 00007fb59d8fa372 00007fb59f02ca01 00007fb59eff143a 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2
0709 13:15:12.892632 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 13:15:13.333157 (+440525us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:13.358120 (+ 24963us) log.cc:844] Serialized 14 byte log entry
0709 13:15:13.359844 (+  1724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:13.359940 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:13.869189 (+509249us) spinlock_profiling.cc:243] Waited 5.37 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:15:14.010174 (+140985us) raft_consensus.cc:1685] finished
0709 13:15:14.010194 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:14.010322 (+   128us) inbound_call.cc:177] Queueing success response
0709 13:15:14.016131 (+  5809us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b1800378e80. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bf043f3 00007fb59bf067c1 00007fb59bf06779 00007fb59bf06709 00007fb59bf066d1 00007fb59bf059cd 000000000038f354 000000000038f199 00007fb59bee783a
Metrics: {"mutex_wait_us":4831,"prepare.queue_time_us":29884,"prepare.run_cpu_time_us":1307,"prepare.run_wall_time_us":10551,"raft.queue_time_us":13372,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":8640,"spinlock_wait_cycles":55459712,"thread_start_us":357871,"threads_started":1,"wal-append.queue_time_us":530687}
I20260709 13:15:14.005757  5413 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:14.018985  5413 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:13.991146   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:14.026351 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:14.007558  5171 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:14.013088  5328 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:14.035236  5328 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:14.021241  4657 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.039815  4657 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:14.006067  5381 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:14.045631 32087 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:14.050930  5355 consensus_queue.cc:1048] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:14.052474  5235 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:14.054287  5348 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:14.055014   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:14.030630  5312 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:14.058840  5312 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:14.061079  5312 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:14.062304  5413 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:14.065636 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:14.066293 32198 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:14.056509  5348 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 10 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:14.060300 32190 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:14.074133 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:14.090400 32190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:54182 (request call id 4046) took 1568 ms. Trace:
I20260709 13:15:14.066226  5150 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:14.089522 32090 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:14.094929 32198 raft_consensus.cc:2468] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 10.
I20260709 13:15:14.091820 32190 rpcz_store.cc:276] 0709 13:15:12.500924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.501072 (+   148us) service_pool.cc:224] Handling call
0709 13:15:14.059129 (+1558057us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b54002107d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59efe8a3d 00007fb5a3fb8cd0 00007fb59d53d254 00007fb59d53d1e2 00007fb59d53d111 00007fb59d53d08c 00007fb59d53c342 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:15:14.069340 (+ 10211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1734272896}
I20260709 13:15:14.096864   368 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:14.065649  4657 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:14.100755   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:14.102033  5388 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:14.103910  5348 raft_consensus.cc:2804] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:14.159309 32116 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10940646da924abea9f371781da8acee"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:56890
I20260709 13:15:14.160332 32116 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:14.160892 32116 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:15:14.176362 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 52375.5us
W20260709 13:15:14.182934 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:14.178839  5348 raft_consensus.cc:697] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 10 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:14.185298  5348 consensus_queue.cc:237] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:14.189405  5449 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:14.194694  5456 log.cc:927] Time spent T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7: Append to log took a long time: real 0.162s	user 0.002s	sys 0.000s
I20260709 13:15:14.206133  5278 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:14.206774  5278 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:14.178293  5388 raft_consensus.cc:697] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:14.243999 32116 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:14.226459  5051 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.178083  5272 consensus_queue.cc:1048] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:15:14.281126 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:14.299034 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:14.259473  5312 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:14.316641 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:14.318583 32115 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:15:14.317767 32264 raft_consensus.cc:1275] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:15:14.319207 32116 leader_election.cc:290] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:14.358073 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:14.358145 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:14.363277 32239 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:14.364733 32193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 4055) took 1070 ms. Trace:
I20260709 13:15:14.364955 32116 raft_consensus.cc:1240] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:14.346005 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:14.365159 32193 rpcz_store.cc:276] 0709 13:15:13.294415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.294555 (+   140us) service_pool.cc:224] Handling call
0709 13:15:13.294822 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:13.364549 (+ 69727us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:13.364611 (+    62us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:13.364669 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:13.364713 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:14.364484 (+999771us) spinlock_profiling.cc:243] Waited 69.5 ms on lock 0x7b54003377d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:15:14.364529 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:14.364681 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159846272}
I20260709 13:15:14.379189 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:14.382019 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:14.382259 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:14.382655 32270 raft_consensus.cc:3055] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:15:14.383013 32270 raft_consensus.cc:740] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:14.382814 32272 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:15:14.389609 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:14.311493  5278 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:14.305282  5051 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:14.337990  5406 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:14.336750  5362 consensus_queue.cc:1048] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:15:14.393486  5355 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:14.341461  5312 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:14.400406  5150 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:14.311528  5388 consensus_queue.cc:237] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:14.424412  5355 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:14.405174  5399 consensus_queue.cc:1059] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:15:14.438962  5237 consensus_queue.cc:1048] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:15:14.475327  5355 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:14.511442  5051 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:14.517632 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:14.519176 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:14.522220 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:14.523491 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:14.524362 32119 raft_consensus.cc:2410] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:15:14.525549   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:14.529301 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:14.534955  5312 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:14.544305 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:14.545046 32117 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:15:14.551790 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:14.557493 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:14.572791 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:14.585187 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:14.586181 32121 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 15.
I20260709 13:15:14.580170  5439 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:15:14.597968 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 168764us
I20260709 13:15:14.591499  5355 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:14.674625 32123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 2630) took 1171 ms. Trace:
W20260709 13:15:14.675388  5474 log.cc:927] Time spent T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:15:14.675819  5472 log.cc:927] Time spent T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:15:14.617913  5439 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:14.675225 32123 rpcz_store.cc:276] 0709 13:15:13.479033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.480115 (+  1082us) service_pool.cc:224] Handling call
0709 13:15:13.480428 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:13.512747 (+ 32319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:13.512787 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:13.512847 (+    60us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:15:13.512893 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:14.650631 (+1137738us) spinlock_profiling.cc:243] Waited 32.1 ms on lock 0x7b5400098dd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:15:14.650691 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:14.650847 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73817344}
I20260709 13:15:14.680575 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:14.681419 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:14.682024 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:14.682711 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:14.684031 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:14.692102 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:14.684993 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:14.685613 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:14.650756   396 raft_consensus.cc:1240] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 10 LEADER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:15:14.702745 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:14.700784 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:14.700030 32192 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:14.704983 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:14.706689 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:14.712144 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:14.712987 32190 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
I20260709 13:15:14.715607 32268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 3170) took 1174 ms. Trace:
I20260709 13:15:14.682493  5396 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.716527 32268 rpcz_store.cc:276] 0709 13:15:13.529850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.530339 (+   489us) service_pool.cc:224] Handling call
0709 13:15:13.530625 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:13.552282 (+ 21657us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:13.552310 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:14.057883 (+505573us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b1800439600. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bed22a6 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59d8eaa11 00007fb59d8fa372 00007fb59f02ca01 00007fb59eff143a
0709 13:15:14.339976 (+282093us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b2c00139618. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59d8eaa11 00007fb59d8fa372 00007fb59f02ca01 00007fb59eff143a 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2
0709 13:15:14.340507 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 13:15:14.481541 (+141034us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:14.679807 (+198266us) log.cc:844] Serialized 14 byte log entry
0709 13:15:14.704056 (+ 24249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:14.704151 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:14.704204 (+    53us) raft_consensus.cc:1685] finished
0709 13:15:14.704222 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:14.704370 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88994,"prepare.queue_time_us":21447,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":51851,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":13782,"spinlock_wait_cycles":7921664,"thread_start_us":317144,"threads_started":2,"wal-append.queue_time_us":223287}
I20260709 13:15:14.728641 32238 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:14.739632 32238 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:14.745433 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:14.746554 32192 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:15:14.702966  5272 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:14.768570  5272 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:14.769887  5475 log.cc:927] Time spent T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:15:14.774557  5355 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:14.776279 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:14.776970 32195 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:15:14.755128  5439 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:14.761322  5480 log.cc:927] Time spent T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:15:14.764813  5235 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:14.742887  5396 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:14.781424 32006 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ddd7dfc158794e3ab7427d0b86b46c8d with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 94085cf341634eb686a95983b6b7f7e6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:14.785593 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:14.785996 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:14.787875 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:14.752431  5224 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:14.791491 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:14.751057  4969 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:14.792526 32192 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:14.780642  5272 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:14.780478  5476 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:14.802716 32165 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:14.802953 32191 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
I20260709 13:15:14.802033   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:14.804840  5150 raft_consensus.cc:2749] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:14.806905 32165 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:14.808060 32165 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:14.809345 32165 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:14.810704 32165 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:14.790021  5235 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:14.816941 32192 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 20.
I20260709 13:15:14.818487 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:14.819336 32192 raft_consensus.cc:2393] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 12: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:14.809092  5150 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:15:14.810915  5213 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:14.811785  5415 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:14.831830 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:14.836841 32192 raft_consensus.cc:2393] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 12: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:14.840950 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:14.814003  5295 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:14.805864  5476 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:14.826854  5439 consensus_queue.cc:1048] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
W20260709 13:15:14.879644  5488 log.cc:927] Time spent T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:15:14.877182  5150 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:15:14.915515 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 104892us
I20260709 13:15:14.916752 32165 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:14.890722  5388 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:14.849910  5295 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:14.970163  5489 log.cc:927] Time spent T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:15:14.972381  5487 log.cc:927] Time spent T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:15:14.948413  5328 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:14.975920  5396 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:14.952100  5388 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:15.012132 32162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 95688.8us
W20260709 13:15:15.017989 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 101387us
I20260709 13:15:15.023628 32194 raft_consensus.cc:1240] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:15.024029 32165 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:15.024856 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:14.995886  5381 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:15.025666 32268 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 12.
I20260709 13:15:15.033082 32268 raft_consensus.cc:3055] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:15.033582 32268 raft_consensus.cc:740] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:15.003643  5418 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:15.038648   369 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:15.039177 32165 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:15.035171 32268 consensus_queue.cc:260] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:15.043787 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:15.043875 32268 raft_consensus.cc:3060] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:15.044906 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:14.996304  5328 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:15.021883  5492 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:15.023000  5274 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:15.075501 32165 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:15.088080 32268 raft_consensus.cc:1275] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:15:15.088999 32268 pending_rounds.cc:85] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06: Aborting all ops after (but not including) 8
I20260709 13:15:15.089349 32268 pending_rounds.cc:107] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:15:15.089708 32268 raft_consensus.cc:2889] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:15.088039 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:15.041184  5399 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:15.043645  5235 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:15.095970 32089 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.30.63.2:44517 timed out after 1.512s (SENT) [suppressed 7 similar messages]
I20260709 13:15:15.096832 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:15.097534 32119 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 14.
I20260709 13:15:15.083222  5240 raft_consensus.cc:2804] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:15.081609  5479 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:15.081314  5335 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:15:15.094781  5499 log.cc:927] Time spent T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:15:15.105050 32090 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:15.051608  5418 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:15.100041  5492 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:15.100816  5476 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:15.110445  5240 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:15.100414  5438 consensus_queue.cc:1048] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
W20260709 13:15:15.118054  5375 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.016s	sys 0.009s
I20260709 13:15:15.102444  5399 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:15.114249  5501 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:15.149835 32196 raft_consensus.cc:1240] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:15.119040  5235 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:15:15.148463  5375 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.017s	sys 0.009s
I20260709 13:15:15.113739  5335 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:15.177642  5388 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:15.179211  5328 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:15.179405  5335 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:15.140906  5240 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:15.182896  5399 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:15.113826  5479 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:15.162431  5235 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:15.204675 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 129237us
I20260709 13:15:15.197872 32270 consensus_queue.cc:260] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:15.205778 32165 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:15.196862  5494 log.cc:927] Time spent T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:15:15.208895 32270 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:15.212148  5500 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:15.213579  5479 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:15.222395 32165 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:15.230520  5150 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:15.230985  5150 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:15.231401  5150 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:15.233453  5418 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:15.200480  5235 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:15.196486  5399 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:15.238709 32270 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 20.
W20260709 13:15:15.246078 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 74491.8us
I20260709 13:15:15.247466 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:15.249397 32192 raft_consensus.cc:1275] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:15:15.249119  5243 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
W20260709 13:15:15.263477 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 148948us
I20260709 13:15:15.263017 32165 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:15.277391 32165 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:15.264431 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:15:15.279513 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:15.256628  5492 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:15.254967   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:15.283146  5495 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:15.281189  5396 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:15.307204  5396 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.307592  5396 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:15:15.309598 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 213649us
I20260709 13:15:15.243444  5399 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:15.295673   369 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:15.312502 32089 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:15.256794  5277 consensus_queue.cc:1048] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:15:15.244138  5240 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:15.319154   369 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:15.309079  5308 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.316166 32193 raft_consensus.cc:1275] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:15:15.316406 32089 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:15.317785 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:15.319845 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:15.324095 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:15.242650  5150 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:15.417486 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 101199us
I20260709 13:15:15.418242 32089 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:15.418231 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:15.320618  5171 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:15.437489 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:15.437934 32089 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:15.438118 32269 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:15:15.436174 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:15.312228  5495 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:15.441262   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 122202us
I20260709 13:15:15.442080 32089 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:15.422791 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:15.313403  5233 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:15.453336 32089 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:15.410254  5507 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:15.419574  5476 raft_consensus.cc:2804] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:15.439174  5388 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:15:15.480098 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 161801us
I20260709 13:15:15.450083  5502 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:15.453354  5171 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:15.451025  5274 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:15.483412 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:15.419072  5308 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:15.474526   395 raft_consensus.cc:1240] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:15.500902 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:15.502456 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:15.502828  5150 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:15.503950 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:15.504288 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:15.504652 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:15.510210   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:15.473891  5476 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:15.507345 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:15.512022 32273 raft_consensus.cc:3055] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:15.512493 32273 raft_consensus.cc:740] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:15.476476  5514 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:15.511898  5476 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:15.524886 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:15.525738 32269 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:15:15.527822   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 84666.7us
I20260709 13:15:15.513582 32273 consensus_queue.cc:260] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:15.485929  5507 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:15.533598 32273 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:15.462318  5233 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:15.555114 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:15.458590  5495 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:15.510877  5396 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:15.656503  5514 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:15.662928  5514 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:15.667621  5507 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:15.668251  5507 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:15.671563  5396 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:15.623859  5388 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:15.673549  5388 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:15.674876  5502 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:15.675392  5502 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:15.676221  5519 log.cc:927] Time spent T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:15:15.662158  5240 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 13 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:15.680218  5515 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.680842  5515 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:15.661592  5362 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.681886  5362 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:15.720177 32266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50584 (request call id 556) took 1456 ms. Trace:
I20260709 13:15:15.720783 32266 rpcz_store.cc:276] 0709 13:15:14.264264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.269846 (+  5582us) service_pool.cc:224] Handling call
0709 13:15:14.270308 (+   462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:14.425755 (+155447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:14.425787 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:14.434811 (+  9024us) log.cc:844] Serialized 26 byte log entry
0709 13:15:14.601063 (+166252us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:14.631738 (+ 30675us) log.cc:844] Serialized 14 byte log entry
0709 13:15:14.631949 (+   211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:14.695981 (+ 64032us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54000e29d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:15:14.696030 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:15.717845 (+1021815us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b180009ec80. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bf043f3 00007fb59bf067c1 00007fb59bf06779 00007fb59bf06709 00007fb59bf066d1 00007fb59bf059cd 000000000038f354 000000000038f199 00007fb59bee783a
0709 13:15:15.719902 (+  2057us) raft_consensus.cc:1685] finished
0709 13:15:15.719929 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.720101 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":402,"prepare.queue_time_us":30554,"prepare.run_cpu_time_us":14090,"prepare.run_wall_time_us":24531,"raft.queue_time_us":1827,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":14690,"spinlock_wait_cycles":368412928,"thread_start_us":156563,"threads_started":1,"wal-append.queue_time_us":241741}
I20260709 13:15:15.565616  5171 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:15.751528 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:15.795279 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:15.797168 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:15.809000 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:15.809723 32266 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:15:15.812898 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 395367us
I20260709 13:15:15.788743  5399 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:15:15.817975 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:15.761098  5171 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:15.818485 32273 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
I20260709 13:15:15.791661  5495 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:15.824291 32115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 4079) took 1597 ms. Trace:
I20260709 13:15:15.825974 32115 rpcz_store.cc:276] 0709 13:15:14.227253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.330403 (+103150us) service_pool.cc:224] Handling call
0709 13:15:14.330686 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:14.341916 (+ 11230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:14.341956 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:14.342457 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:15:14.502404 (+159947us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:15:14.502466 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.820186 (+1317720us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b54000988d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:15:15.820234 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:15.820286 (+    52us) raft_consensus.cc:1685] finished
0709 13:15:15.820300 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.824200 (+  3900us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25209216,"thread_start_us":159542,"threads_started":1,"wal-append.queue_time_us":288152,"wal-append.run_cpu_time_us":3441,"wal-append.run_wall_time_us":1151505}
I20260709 13:15:15.832120 32165 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:15.836915 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:15.837637 32273 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
I20260709 13:15:15.839054 32165 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:15.848541 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 363649us
I20260709 13:15:15.849664 32165 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:15.853391 32165 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:15.836107  5495 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:15.853353 32266 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:15:15.816361 32269 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:15:15.841542  5507 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:15.889689  5507 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:15.890188  5507 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:15.892148  5507 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:15.892719  5381 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:15.893132  5233 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:15.848256   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:15.864841 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:15:15.867022  5518 log.cc:927] Time spent T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 13:15:15.867920  5522 log.cc:927] Time spent T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:15:15.868521  5407 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.873013  5295 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:15.884802  5515 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:15.885537  5308 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:15.887281  5171 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:15.846997  5396 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:15.854624  5501 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:15.862798  5150 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:15.861882  5502 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:15.896396  5507 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:15:15.912828 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 460509us
I20260709 13:15:15.915522 32089 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:15.917145 32089 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:15.893236  5381 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:15.921674 32165 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:15.934006 32165 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:15.943883 32165 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:15.950608  5235 consensus_meta.cc:287] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.715s	user 0.016s	sys 0.002s
I20260709 13:15:15.951265  5235 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:15.952224  5381 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:15.922878  5362 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:15.916517  5502 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:15.954679  5233 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:15.955446  5233 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:15.960801 32089 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:15.961886 32165 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:15.967965  5509 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:15.968242  5533 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:15.957226  5396 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:15.945513  5501 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:15.901842  5407 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:15.969763 32090 leader_election.cc:304] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:15:15.969777 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:15.947049  5415 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:15.920845  5507 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:15.973730 32165 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:15.974298 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 124001us
I20260709 13:15:15.960413  5381 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.979522 32089 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:15.972949  5533 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:15.980775  5533 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.981171  5533 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:15.982425  5407 leader_election.cc:290] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:15.983160  5407 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:15:15.983692  5407 raft_consensus.cc:697] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 20 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:15.984709  5381 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:15.987030  5381 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:15.989014  5470 log.cc:927] Time spent T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 1.499s	user 0.021s	sys 0.021s
I20260709 13:15:15.990798 32118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 4061) took 1943 ms. Trace:
I20260709 13:15:15.991262 32118 rpcz_store.cc:276] 0709 13:15:14.047227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.047387 (+   160us) service_pool.cc:224] Handling call
0709 13:15:14.051548 (+  4161us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:14.071578 (+ 20030us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:14.071619 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:14.092178 (+ 20559us) log.cc:844] Serialized 26 byte log entry
0709 13:15:14.185376 (+ 93198us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b480027e4d8. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a3f1aaa1 00007fb5a3f11b37 00007fb5a3f119ca 00007fb5a400926f 00007fb5a4008f37 00007fb5a401d55c 00007fb5a401d508 00007fb5a401d488 00007fb5a401d443 00007fb5a401c6ec 00007fb5a2f46a96
0709 13:15:14.408663 (+223287us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:14.408721 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:14.408842 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:15.919450 (+1510608us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:15:15.990550 (+ 71100us) raft_consensus.cc:1685] finished
0709 13:15:15.990576 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.990732 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19615,"raft.queue_time_us":20344,"raft.run_cpu_time_us":1994,"raft.run_wall_time_us":97834,"spinlock_wait_cycles":50022400,"thread_start_us":294572,"threads_started":1,"wal-append.queue_time_us":377270}
I20260709 13:15:15.997246   394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38184 (request call id 445) took 1413 ms. Trace:
I20260709 13:15:15.997643   394 rpcz_store.cc:276] 0709 13:15:14.583968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.584210 (+   242us) service_pool.cc:224] Handling call
0709 13:15:14.584558 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:14.700766 (+116208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:14.700801 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:14.700845 (+    44us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:14.700875 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.997002 (+1296127us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b540051b8d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:15:15.997042 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.997161 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266712448}
I20260709 13:15:15.972062  5501 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.005681  5501 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:16.006477  5507 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:16.007900  5235 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:16.010207  5233 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:15.995990  5476 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:16.013579 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:16.003334 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:16.003621 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:16.004629  5171 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:16.004777  5528 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:16.021768  5528 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:16.015036 32089 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:16.015493 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:16.016721 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:16.017547  5491 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:16.017951  5407 consensus_queue.cc:237] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:16.020469 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:16.021104 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:16.037597 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:16.041638 32269 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 19.
I20260709 13:15:16.023989  5528 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:16.049232 32089 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:16.050623  5171 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:16.051522 32165 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:16.058645 32165 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:16.063953 32165 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:16.066479  5171 raft_consensus.cc:2749] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:16.068262 32089 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:16.069126  5171 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:16.069303  5235 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:16.069712  5235 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.070050  5235 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:16.075274 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:16.076295 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:16.076776 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:16.075913 32119 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 18.
I20260709 13:15:16.075873 32165 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:16.080008 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:16.081825 32124 raft_consensus.cc:2368] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 12. Current term is 13.
I20260709 13:15:16.083302 32165 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:16.077164  5491 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:16.069723  5171 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:16.065136  5495 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:15:16.084390  5396 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:16.089323 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:16.090963  5506 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:16.091712  5530 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:16.093739  5492 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:16.095252 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:16.099628  5235 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:16.023437  5533 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:16.102850  5501 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:16.104001  5476 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:16.190042 32195 raft_consensus.cc:1240] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:15:16.192914 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:16.193589 32115 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:15:16.194644 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:16.112723  5362 consensus_queue.cc:1048] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:16.115329 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:16.199187 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:16.199975 32194 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 19.
I20260709 13:15:16.112711   394 raft_consensus.cc:1240] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:16.117497 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:16.118131   396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38164 (request call id 389) took 1904 ms. Trace:
I20260709 13:15:16.119005 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:16.204692 32197 raft_consensus.cc:2393] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 12: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:16.119707 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:16.137455  5388 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:16.084087 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 107665us
W20260709 13:15:16.147526 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 64334.8us
I20260709 13:15:16.208235 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:16.208851 32118 raft_consensus.cc:1240] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:16.210739 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:16.169097   369 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:16.174285 32190 raft_consensus.cc:1240] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 20. Current term is 21. Ops: []
I20260709 13:15:16.179805  5171 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:16.182040 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:16.183158 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:16.186597  5501 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:16.173604  5492 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:16.114217 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:16.150537  5259 raft_consensus.cc:2804] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:16.202878 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:16.192328 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:16.222579 32195 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:15:16.215024 32122 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:15:16.223464 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:16.192624 32087 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:16.226493 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:16.197366  5396 raft_consensus.cc:697] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 13 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:16.215775 32120 raft_consensus.cc:1240] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:15:16.217033 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:16.171851  5491 raft_consensus.cc:697] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
W20260709 13:15:16.218299   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 49345.9us
I20260709 13:15:16.253309  5491 consensus_queue.cc:237] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:16.189963 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:16.228374 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:16.258652 32191 raft_consensus.cc:1275] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:15:16.206295 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:16.220901  5509 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:16.264087  5509 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.197791  5495 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:16.232069 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:16.224714  5476 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:16.264371 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:15:16.239840 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 51224.1us
I20260709 13:15:16.265839  5235 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:16.176846  5530 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:16.269887  5533 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:16.174770  5506 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:16.241375 32090 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:16.242386  5514 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:16.272892 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:16.273119  5506 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:16.273463  5514 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:16.274312 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:16.275461 32118 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:16.275662  5259 raft_consensus.cc:697] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 12 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:16.270681  5530 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:16.240871  5381 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:16.276948  5259 consensus_queue.cc:237] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:16.282176 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:16.283555 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:16.283610 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:16.288134 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:16.288416 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:16.291075 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:16.291916 32264 raft_consensus.cc:2393] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 12: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:16.292480  5495 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:16.296048 32196 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:15:16.296826 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:16.297776 32198 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 17.
I20260709 13:15:16.299124 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:16.299933 32266 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 20.
I20260709 13:15:16.301581 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:16.302462 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:16.302981 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:16.303659 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:16.305469 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:16.306666   368 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:16.307081 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:16.264513  5509 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:16.314402 32266 raft_consensus.cc:2393] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 13: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:16.316160 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:16.316345 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:16.311932 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:16.313342 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:16.319169 32264 raft_consensus.cc:2393] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 18: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:16.319342 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:16.320087 32120 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:16.327605 32118 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
I20260709 13:15:16.331457 32271 raft_consensus.cc:1275] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:15:16.332190 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:16.332683 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:16.340258 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:16.346864 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:16.348618 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:16.349879 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:16.350732 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:16.351173 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:16.351593 32196 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 20.
I20260709 13:15:16.350045 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:16.342056 32090 leader_election.cc:304] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:16.366887 32198 raft_consensus.cc:2393] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 21: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:16.367789 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:16.368531 32124 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:16.370988 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:16.372010 32118 raft_consensus.cc:2393] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 16: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:16.378131   369 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:16.204188   396 rpcz_store.cc:276] 0709 13:15:14.213869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.221582 (+  7713us) service_pool.cc:224] Handling call
0709 13:15:14.283843 (+ 62261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:14.709872 (+426029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.117889 (+1408017us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b5400315954. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:15:16.118074 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":729314048}
I20260709 13:15:16.340660  5506 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:16.379909 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:16.381775 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:16.427601 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:16.430505 32120 raft_consensus.cc:2468] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 15.
I20260709 13:15:16.434897 32089 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:16.442498 32089 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:16.461226 32022 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59534 (request call id 125) took 5589 ms. Trace:
I20260709 13:15:16.471664 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:16.472810 32118 raft_consensus.cc:2393] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 13: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:16.473472 32089 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:16.478113 32124 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:15:16.481333 32089 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:16.482568 32089 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:16.483181   369 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:16.461690 32022 rpcz_store.cc:276] 0709 13:15:10.837707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.838631 (+   924us) service_pool.cc:224] Handling call
0709 13:15:16.427085 (+5588454us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:13.343867 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:13.576655 (+232788us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:13.582834 (+  6179us) write_op.cc:435] Acquired schema lock
0709 13:15:13.587119 (+  4285us) tablet.cc:662] Decoding operations
0709 13:15:13.871959 (+284840us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:13.872021 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:13.872049 (+    28us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:15:13.872599 (+   550us) tablet.cc:701] Row locks acquired
0709 13:15:13.872620 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:15:13.872777 (+   157us) write_op.cc:270] Start()
0709 13:15:13.872894 (+   117us) write_op.cc:276] Timestamp: P: 1783602913872732 usec, L: 0
0709 13:15:13.872917 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:15:13.873578 (+   661us) log.cc:844] Serialized 2443 byte log entry
0709 13:15:14.193621 (+320043us) spinlock_profiling.cc:243] Waited 7.56 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:15:14.449349 (+255728us) op_driver.cc:464] REPLICATION: finished
0709 13:15:14.676898 (+227549us) write_op.cc:301] APPLY: starting
0709 13:15:14.676989 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:14.764509 (+ 87520us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:14.764555 (+    46us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:14.968065 (+203510us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:14.968363 (+   298us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:15:14.968431 (+    68us) write_op.cc:312] APPLY: finished
0709 13:15:14.996919 (+ 28488us) log.cc:844] Serialized 65 byte log entry
0709 13:15:15.005347 (+  8428us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:15.018427 (+ 13080us) write_op.cc:454] Released schema lock
0709 13:15:15.022171 (+  3744us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:15.057038 (+ 34867us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:15.072892 (+ 15854us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":694003,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":202067,"apply.run_cpu_time_us":13663,"apply.run_wall_time_us":361493,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29267,"num_ops":6,"prepare.queue_time_us":475650,"prepare.run_cpu_time_us":25695,"prepare.run_wall_time_us":678133,"raft.queue_time_us":236756,"raft.run_cpu_time_us":22757,"raft.run_wall_time_us":161611,"replication_time_us":576205,"spinlock_wait_cycles":17389312,"thread_start_us":784330,"threads_started":4,"wal-append.queue_time_us":152676,"wal-append.run_cpu_time_us":24218,"wal-append.run_wall_time_us":2049658}]]}
I20260709 13:15:16.497910 32089 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:16.416448  5506 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:16.511837 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:16.512598 32197 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:15:16.427627  5348 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:16.542963 32239 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:16.546010 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:16.469954  5536 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:16.543433 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:16.555759 32118 raft_consensus.cc:2393] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 16: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:16.417379  5407 consensus_queue.cc:1048] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
W20260709 13:15:16.471925  5532 log.cc:927] Time spent T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:15:16.551779 32239 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:16.567880 32239 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:16.511201  5438 raft_consensus.cc:2804] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:16.515175  5506 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:16.500912  5233 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:16.572412 32239 leader_election.cc:400] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 12. Current term is 13.
I20260709 13:15:16.592212 32239 leader_election.cc:403] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:15:16.501142  5295 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:15:16.559320  5521 log.cc:927] Time spent T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:15:16.501833  5502 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:15:16.593760 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 95924.3us
I20260709 13:15:16.594194 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:16.559266  5512 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:16.603915  5438 raft_consensus.cc:697] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 15 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:16.427868  5396 consensus_queue.cc:237] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:16.566663  5495 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:16.605973 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 65998.4us
I20260709 13:15:16.605655 32089 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:16.570006  5399 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:16.616662 32089 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:16.633409  5502 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:16.634027  5502 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:16.591691  5529 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:16.637158  5529 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:16.637567  5529 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:16.638589   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:16.620766 32239 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:16.643756  5272 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:16.644160  5272 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:16.644510  5272 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:16.575796   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:16.649034 32239 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:16.649905  5233 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:16.636265  5502 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:16.650429  5233 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:16.650867  5502 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:16.650146 32087 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:16.654708   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:16.656421  5517 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:16.605806  5535 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 12. Current term is 13.
I20260709 13:15:16.573369  5507 consensus_queue.cc:1048] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:15:16.661075 32239 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:16.665515  5341 consensus_queue.cc:1059] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:16.595412  5171 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:16.666792  5525 raft_consensus.cc:3055] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:16.670717  5525 raft_consensus.cc:740] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:15:16.671798  5539 log.cc:927] Time spent T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:15:16.671563  5525 consensus_queue.cc:260] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:16.685559 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 310006us
I20260709 13:15:16.689260 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:16.652468  5233 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:16.701833 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:16.700803  5235 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:16.691457  5525 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:16.705296 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:16.706838  5509 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:16.707248  5272 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:16.707973 32194 raft_consensus.cc:1240] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:16.668157  5399 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:16.710011  5509 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:16.710428  5399 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:16.710917  5399 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:15:16.748803 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:16.717892  5295 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:16.767115 32165 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:16.777671  5546 log.cc:927] Time spent T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:15:16.778936  5569 log.cc:927] Time spent T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:15:16.779121  5492 consensus_meta.cc:287] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.547s	user 0.007s	sys 0.001s
I20260709 13:15:16.783043 32265 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:15:16.783221 32165 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:16.786018 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 74582.3us
I20260709 13:15:16.789129 32165 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:16.668444  5517 consensus_queue.cc:1059] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.112s
I20260709 13:15:16.791026 32165 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:16.797791 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 181227us
I20260709 13:15:16.798852 32089 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:16.800467 32089 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:16.811462 32089 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:16.785120  5259 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:16.722268  5438 consensus_queue.cc:237] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:16.819495 32089 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:15:16.824414 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 122788us
I20260709 13:15:16.794118  5491 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:16.795439  5537 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:16.781198  5328 consensus_queue.cc:1059] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
W20260709 13:15:16.831317 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 117843us
I20260709 13:15:16.795004  5312 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:16.850050  5312 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:16.852368  5312 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:16.852569 32238 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:16.854550 32238 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:16.780972  5495 consensus_queue.cc:1059] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:15:16.854840  5572 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:16.855585  5495 raft_consensus.cc:3055] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:16.855975  5495 raft_consensus.cc:740] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:16.856158  5572 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.856685  5572 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:16.856799  5495 consensus_queue.cc:260] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:16.858093  5495 raft_consensus.cc:3060] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:16.860783  5517 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:16.794806  5341 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:16.863060  5341 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:15:16.856375 32238 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:16.865198  5341 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:16.865738  5341 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:16.866082  5341 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.866392  5341 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:16.832857 32089 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:16.786366  5492 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:16.868389  5572 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:16.870337  5492 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:16.819967  5396 raft_consensus.cc:2749] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:16.813257  5272 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:16.826011  5515 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:16.871347 32192 raft_consensus.cc:1240] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:16.886269 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:16.834916  5563 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:16.911248 32122 raft_consensus.cc:1240] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:16.902532 32116 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:15:16.837160  5514 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:15:16.877283  5570 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:16.889748  5388 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:16.890115  5558 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:15:16.924084 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 133506us
I20260709 13:15:16.881675  5517 consensus_queue.cc:1059] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:15:16.932281 32165 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:16.918212  5171 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:16.907083  5572 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:16.944837 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:16.946791 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:16.948436 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:16.950580 32191 raft_consensus.cc:2393] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 16: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:16.955822 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:16.960326 32273 raft_consensus.cc:1275] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:15:16.966042 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:16.969388 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:16.970520  5578 consensus_queue.cc:1048] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:16.971616 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:16.973731 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:16.976063 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:16.977136 32265 raft_consensus.cc:1275] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:15:16.979210 32272 raft_consensus.cc:2393] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 20: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
W20260709 13:15:16.982456 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 149686us
I20260709 13:15:16.982816 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:16.997273 32120 raft_consensus.cc:2376] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18. Re-sending same reply.
I20260709 13:15:17.006110  5529 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:17.017918  5416 raft_consensus.cc:3055] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:17.018386  5416 raft_consensus.cc:740] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:17.019155  5416 consensus_queue.cc:260] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:17.020174  5416 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:17.021934 32264 raft_consensus.cc:1240] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:17.004138  5515 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:15:17.028928 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 133116us
I20260709 13:15:17.070384 32238 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:17.033703 32089 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:16.926237  5506 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:17.008342  5529 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:16.957787  5509 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:17.075248 32238 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:17.072221  5415 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:15:17.083889 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 50268.1us
I20260709 13:15:17.077993  5566 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:17.072468  5328 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:17.093745 32089 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:17.093811 32117 raft_consensus.cc:1275] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:15:17.094838 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 160096us
I20260709 13:15:17.098594 32089 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:17.099525 32089 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:17.089700  5506 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:17.094652 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:17.102891 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:17.104054 32194 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:17.106025 32117 raft_consensus.cc:1240] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:15:17.088318  5535 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:17.108295 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:17.109006 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:17.110078 32193 raft_consensus.cc:1275] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:15:17.080096  5362 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:17.086781  5491 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:17.086872  5586 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:17.110392  5572 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:17.142583  5572 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:17.097131  5415 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:17.079636  5150 consensus_queue.cc:1048] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:15:17.111260  5535 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:17.145109  5535 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:17.102464  5536 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:17.145825  5415 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:17.103518  5171 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:17.026036  5399 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:17.102576  5578 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.166409 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:17.137693  5588 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:17.100989  5566 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:17.167600 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:15:17.135582 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 221528us
I20260709 13:15:17.177464 32267 raft_consensus.cc:1240] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:15:17.113041  5581 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:17.178699 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:17.179804 32265 raft_consensus.cc:1275] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:15:17.181133 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:17.182224 32194 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 18.
I20260709 13:15:17.182787 32198 raft_consensus.cc:1240] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:17.184257 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:17.186666 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:17.185508   368 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:17.189427 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:17.195832 32273 raft_consensus.cc:1240] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:17.101240  5341 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:17.198555 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:17.150068  5362 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:17.197710 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:17.199679 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:17.134155  5514 consensus_queue.cc:1059] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:15:17.178968  5572 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:17.204110 32197 raft_consensus.cc:2393] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 20: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:17.103230  5328 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:17.110644  5529 consensus_queue.cc:1059] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.138s
I20260709 13:15:17.203490  5362 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:17.260610  5328 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:17.197576  5528 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:17.166761  5491 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:17.180651  5587 raft_consensus.cc:476] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Not starting pre-election -- already a leader
W20260709 13:15:17.257855 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 55950.7us
W20260709 13:15:17.335104 32165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.335947 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:17.172785  5578 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:17.343832 32269 raft_consensus.cc:1240] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:15:17.353660 32194 raft_consensus.cc:2393] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 12: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
W20260709 13:15:17.353996  5594 log.cc:927] Time spent T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:15:17.354588  5578 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:17.179626  5588 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:17.359721 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 84405us
W20260709 13:15:17.365535  5539 log.cc:927] Time spent T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 13:15:17.395871  5495 consensus_meta.cc:287] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.537s	user 0.012s	sys 0.000s
I20260709 13:15:17.441407  5528 raft_consensus.cc:697] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:17.433835  5566 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:17.442458  5528 consensus_queue.cc:237] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:17.438691  5590 log.cc:927] Time spent T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.072s	user 0.003s	sys 0.000s
I20260709 13:15:17.371222  5587 consensus_queue.cc:1048] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:15:17.341450   396 raft_consensus.cc:1240] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:17.445966  5502 consensus_queue.cc:1059] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
W20260709 13:15:17.466343  5579 log.cc:927] Time spent T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.514s	user 0.000s	sys 0.003s
I20260709 13:15:17.469973 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:15:17.475093 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.481174  5591 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.489128  5591 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:17.490252  5259 raft_consensus.cc:3055] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:17.490911  5259 raft_consensus.cc:740] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:17.492139  5259 consensus_queue.cc:260] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:17.496124  5362 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:17.506371   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 135290us
I20260709 13:15:17.499073  5341 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:17.511786  5399 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:17.514971  5362 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:17.516047  5591 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:17.517319  5535 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:17.517920  5491 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:17.519616  5535 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:15:17.565788 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.577828 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:17.585671 32118 raft_consensus.cc:1275] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:15:17.588512 32272 raft_consensus.cc:1240] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:17.592196 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:17.592923 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:17.598922  5341 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:17.600209  5573 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:17.601398  5573 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:17.604449 32265 raft_consensus.cc:1275] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:15:17.585762 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:17.611014  5581 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:17.612166  5581 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:17.600256  5341 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:17.618157 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:17.627933  5581 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:17.641016 32115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 2655) took 1200 ms. Trace:
I20260709 13:15:17.641857 32115 rpcz_store.cc:276] 0709 13:15:16.420353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.811539 (+391186us) service_pool.cc:224] Handling call
0709 13:15:16.817299 (+  5760us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:16.999288 (+181989us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:16.999335 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:16.999395 (+    60us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:15:16.999453 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.604278 (+604825us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54000348d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:15:17.604396 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:17.620772 (+ 16376us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":417897216}
I20260709 13:15:17.628657 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:17.676177 32193 raft_consensus.cc:1275] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:15:17.678200  5491 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:17.679258  5491 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:17.682758 32119 raft_consensus.cc:1275] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:15:17.686753  5341 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:17.690066   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:17.690769  5492 consensus_queue.cc:1048] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:17.691545   396 raft_consensus.cc:2393] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 13: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:15:17.693225 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:17.697492 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:17.698397  5533 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:17.700073  5533 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:17.703003  5476 consensus_queue.cc:1048] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:17.709052 32198 raft_consensus.cc:1240] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 20. Current term is 21. Ops: []
I20260709 13:15:17.709995  5533 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:17.710997  5492 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:17.714679  5492 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:17.711504  5515 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:17.717514  5515 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:17.719381  5491 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:17.711243 32194 raft_consensus.cc:1240] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:17.720504  5515 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:17.731961  5576 log.cc:927] Time spent T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.791s	user 0.004s	sys 0.000s
I20260709 13:15:17.724440  5588 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:17.737924 32123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 2652) took 1378 ms. Trace:
I20260709 13:15:17.739835  5573 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:17.749085   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:17.750327  5570 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:17.751562  5570 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:17.752394 32116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 4118) took 1082 ms. Trace:
I20260709 13:15:17.753604 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:17.754422 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:17.752826 32116 rpcz_store.cc:276] 0709 13:15:16.669864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.913888 (+244024us) service_pool.cc:224] Handling call
0709 13:15:16.914749 (+   861us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:16.933486 (+ 18737us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:16.936858 (+  3372us) log.cc:844] Serialized 14 byte log entry
0709 13:15:17.091113 (+154255us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:17.091160 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:17.091214 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.751237 (+660023us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b1800263020. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bed22a6 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419
0709 13:15:17.751971 (+   734us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b54000979d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:15:17.752017 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:17.752234 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13321,"prepare.queue_time_us":3574,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":1713,"raft.queue_time_us":80,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":8571,"spinlock_wait_cycles":49485440,"thread_start_us":153845,"threads_started":1,"wal-append.queue_time_us":200235}
I20260709 13:15:17.755942 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:17.756407 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:17.757213 32124 raft_consensus.cc:2410] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:15:17.758397 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:17.758759 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:17.758980 32124 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 15.
I20260709 13:15:17.759366 32116 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:15:17.760774  5573 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:17.761407  5595 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.761684  5573 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:17.762226  5595 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:17.729930 32118 raft_consensus.cc:1275] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:15:17.770081 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:17.771551 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:17.774454 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:17.775962 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:17.696148 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:17.777536 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:17.782519 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:17.783600 32264 raft_consensus.cc:2410] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:15:17.723672  5492 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:17.738432 32123 rpcz_store.cc:276] 0709 13:15:16.359771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.754966 (+395195us) service_pool.cc:224] Handling call
0709 13:15:16.755315 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:16.755513 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:16.765687 (+ 10174us) log.cc:844] Serialized 14 byte log entry
0709 13:15:17.021405 (+255718us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b180019f0c0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bf04522 00007fb59bf067c1 00007fb59bf06779 00007fb59bf06709 00007fb59bf066d1 00007fb59bf059cd 000000000038f354 000000000038f199 00007fb59bee783a
0709 13:15:17.730831 (+709426us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:15:17.736811 (+  5980us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b180019f0c0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59eb994bc 00007fb59bee748b 00007fb5a4d41ab9 00007fb59bf0369b 00007fb59bf0193f 00007fb59bf01455 00007fb59efe9060 00007fb59effb716 00007fb59f00c287
0709 13:15:17.736990 (+   179us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:17.737096 (+   106us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:17.737210 (+   114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.737312 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:17.737725 (+   413us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":12630,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":325,"raft.queue_time_us":40768,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":9353,"spinlock_wait_cycles":95826560,"thread_start_us":127217,"threads_started":2,"wal-append.queue_time_us":151718}
I20260709 13:15:17.812745 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:17.813772 32197 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:17.821347  5527 consensus_queue.cc:1048] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:17.823345  5527 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.823897  5527 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:17.827124  5527 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:17.829584 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:17.833434 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:17.833994 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:17.834757 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:17.835629 32117 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 20.
I20260709 13:15:17.841741  5563 raft_consensus.cc:3055] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:15:17.842437  5563 raft_consensus.cc:740] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:17.861541 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:17.865408  5312 raft_consensus.cc:3055] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:17.866217  5312 raft_consensus.cc:740] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:17.850296  5515 consensus_queue.cc:1059] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:15:17.871407  5492 raft_consensus.cc:3055] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:17.871965  5492 raft_consensus.cc:740] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:17.873967  5492 consensus_queue.cc:260] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:17.844192  5563 consensus_queue.cc:260] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:17.879508  5224 raft_consensus.cc:3055] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:15:17.879699  5570 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:17.879721 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:17.881968  5224 raft_consensus.cc:740] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:17.882932  5595 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:17.887176  5224 consensus_queue.cc:260] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:17.892737  5224 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:17.893410 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:17.868291  5312 consensus_queue.cc:260] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:17.894869  5312 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:17.898905  5563 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:17.901446  5492 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:17.905121 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:17.905685   369 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:17.906912 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:17.907152  5240 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:17.907696 32272 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 12.
I20260709 13:15:17.929224 32266 raft_consensus.cc:1240] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:17.923708 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:17.968336 32197 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
W20260709 13:15:17.982826 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.985495  5573 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:18.003252 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:17.986228   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:18.009790 32197 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
W20260709 13:15:17.994159   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 88801.7us
I20260709 13:15:18.021111  5259 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:18.036963 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:18.037060 32021 catalog_manager.cc:5697] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:18.019446 32089 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:18.045153 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:18.045449 32021 catalog_manager.cc:5697] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 12 to 13, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 13 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
W20260709 13:15:18.075780 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 75016.2us
I20260709 13:15:18.078290   369 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:18.080120 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:18.088210  5388 raft_consensus.cc:2749] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:18.089939  5566 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.050s
I20260709 13:15:18.094061  5506 raft_consensus.cc:2804] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:18.094527  5506 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.094841  5506 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:18.070886  5537 consensus_queue.cc:1059] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:15:18.105070  5537 raft_consensus.cc:3055] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:18.105554  5537 raft_consensus.cc:740] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:18.105674 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:18.097522 32191 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 13.
I20260709 13:15:18.108994 32239 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:15:18.111498 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.111588  5573 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:18.112334  5573 raft_consensus.cc:697] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:18.115425  5573 consensus_queue.cc:237] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:18.123569 32197 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:15:18.128242 32089 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:18.129379  5233 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:15:18.130239  5233 consensus_queue.cc:1059] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:18.130641  5295 consensus_queue.cc:1048] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:18.133450  5388 consensus_queue.cc:1059] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:18.134479  5388 raft_consensus.cc:3055] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:18.134888  5388 raft_consensus.cc:740] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:18.106711  5537 consensus_queue.cc:260] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:18.142223  5259 consensus_queue.cc:1059] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:15:18.086578 32021 catalog_manager.cc:5697] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 9 to 12, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 12 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:18.147168  5150 raft_consensus.cc:3055] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:15:18.163692 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 58876.8us
I20260709 13:15:18.136082  5388 consensus_queue.cc:260] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:18.188704 32165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.189282  5388 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:15:18.189302 32165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.190938  5585 consensus_queue.cc:1059] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:15:18.192420  5585 raft_consensus.cc:3055] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:18.192888  5585 raft_consensus.cc:740] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:18.194900  5537 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:18.198222 32273 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 21.
I20260709 13:15:18.201282  5438 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:18.202029  5438 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:18.203436  5585 consensus_queue.cc:260] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:18.206681  5585 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:18.207962 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:18.209714 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:18.210619  5295 raft_consensus.cc:3055] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:18.211117  5295 raft_consensus.cc:740] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
W20260709 13:15:18.222507 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 45476.1us
I20260709 13:15:18.225540 32021 catalog_manager.cc:5697] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 11 to 12, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 12 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:18.226567 32194 raft_consensus.cc:1240] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:15:18.227890 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:18.227451 32021 catalog_manager.cc:5697] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:18.169729  5150 raft_consensus.cc:740] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:18.224473 32239 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:18.249385 32089 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:18.259186 32089 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:18.260927  5233 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:18.291625 32119 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:15:18.212281  5295 consensus_queue.cc:260] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:18.295547 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:18.278156  5585 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:18.289222   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
W20260709 13:15:18.308866 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 84488.8us
I20260709 13:15:18.310910 32165 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:18.311252  5259 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:15:18.312028  5259 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:18.312999 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:18.300621  5341 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:18.314044  5573 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.314658  5573 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:18.317020   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:18.251987  5150 consensus_queue.cc:260] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:18.319307 32239 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:18.276546  5506 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:18.321183 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.312472 32165 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:18.324959  5515 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:18.325562 32165 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:18.319881 32021 catalog_manager.cc:5697] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 7 to 9, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 9 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:18.328780  5515 consensus_queue.cc:1048] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:18.328300 32021 catalog_manager.cc:5697] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:18.336733  5428 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:15:18.348469  5295 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:18.328791  5492 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:15:18.350711 32165 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:18.359843  5515 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:15:18.402941 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 143873us
W20260709 13:15:18.405299 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 86157.7us
I20260709 13:15:18.397105  5573 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:18.399384  5240 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:18.410096 32021 catalog_manager.cc:5697] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:18.413830 32239 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:18.420953   394 raft_consensus.cc:1240] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:18.426851  5517 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:15:18.410485  5595 consensus_queue.cc:1048] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:15:18.429035 32089 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:18.423480 32021 catalog_manager.cc:5697] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:18.438814 32238 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:18.440162 32165 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:18.441576 32165 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:18.423275  5570 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:15:18.454632 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 52204.8us
I20260709 13:15:18.458784  5341 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:18.459362  5341 raft_consensus.cc:697] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:18.460307  5341 consensus_queue.cc:237] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:18.458803  5388 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:18.463444  5558 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:18.433108  5517 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:15:18.464241 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 52009.2us
I20260709 13:15:18.455776 32238 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:18.434491  5533 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:18.468619  5558 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:18.471510  5573 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:18.476389  5618 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:18.477398  5558 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:18.478039  5558 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.456645  5570 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:18.478683  5558 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:18.480227  5570 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:18.417579  5240 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:18.472107 32238 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:18.462200  5388 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:18.482082  5563 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:18.483268  5558 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:18.484258  5502 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:18.457160 32021 catalog_manager.cc:5697] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:18.480425  5534 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:18.472225  5438 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:18.500365  5506 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:18.500701   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 133505us
I20260709 13:15:18.503412 32239 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:18.505291  5570 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:15:18.512995 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 71515us
I20260709 13:15:18.513788 32165 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:18.512388 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:18.516122 32194 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:18.518769  5388 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:18.521086  5240 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:18.522121 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:18.523422 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:15:18.524327 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.525383 32021 catalog_manager.cc:5697] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 10 to 12, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 12 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.527433 32021 catalog_manager.cc:5697] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 15 to 16, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 16 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:18.538112 32238 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:18.539891  5524 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:15:18.538792  5534 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:18.541972  5530 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:18.542707  5534 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:18.543486  5150 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:18.544111  5530 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:18.552042 32165 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:18.553963 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:18.559201  5415 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:18.567858  5596 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.556352 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:18.572985 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:18.573225 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:18.579545 32194 raft_consensus.cc:2468] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 14.
W20260709 13:15:18.579748   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 75421.2us
I20260709 13:15:18.503437  5563 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:18.552443 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:18.552657  5530 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:15:18.597244  5617 log.cc:927] Time spent T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:15:18.597409  5530 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:18.598062 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:18.598739 32123 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 20.
W20260709 13:15:18.601655  5616 log.cc:927] Time spent T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:15:18.568575  5596 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:18.605624  5596 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:18.553318 32021 catalog_manager.cc:5697] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 13 to 15, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 15 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.553561  5259 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:18.611832 32239 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:18.616387 32119 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:15:18.618324 32191 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:15:18.620344 32021 catalog_manager.cc:5697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 13 to 15, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 15 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.625244  5492 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:18.625967  5492 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:18.626824  5501 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:18.613144  5570 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:18.551788  5502 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:18.634544  5570 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:18.634644  5563 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:18.636184  5502 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:18.637409  5573 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:15:18.632267 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 80304.6us
I20260709 13:15:18.638651 32165 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:18.639863 32165 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:18.640789  5501 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:18.640844  5259 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:18.641294  5501 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:18.641450  5259 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:18.641805  5501 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:18.641960  5259 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:15:18.647867  5620 log.cc:927] Time spent T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:15:18.628237  5492 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:18.650506 32165 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:18.661391 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:18.663628 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:18.666042 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:18.669678 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:18.670403 32265 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 21.
W20260709 13:15:18.675643 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.667054  5595 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:15:18.677459  5595 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.677865  5595 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:18.678247  5596 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:15:18.680866 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 85691.7us
I20260709 13:15:18.680279  5492 consensus_queue.cc:1048] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:15:18.683843 32239 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:18.686000 32239 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:18.686496  5573 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:18.686514  5502 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:18.687651  5573 raft_consensus.cc:2749] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:18.687405  5502 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:18.689107 32239 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:18.691146 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:18.692142 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:18.692327  5502 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:18.693256 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:18.697141 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:18.695571 32021 catalog_manager.cc:5697] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 10 to 13, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 13 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:18.700562 32265 raft_consensus.cc:2393] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 19: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:18.702160  5622 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:18.697175 32264 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 19.
I20260709 13:15:18.702874 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:18.702814  5622 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:18.704782 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:18.705535 32271 raft_consensus.cc:2393] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 16: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:18.708108  5534 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:18.708717  5534 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:18.709703  5259 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:18.710280  5613 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:18.710819  5613 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:18.711745  5259 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:18.713912  5613 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:18.714718  5622 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:18.710834  5534 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:18.721328 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:18.722040 32196 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:15:18.722321 32123 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:15:18.725612   369 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:18.726807  5438 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:18.727880   369 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:18.728757  5438 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:18.729192  5438 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:18.729601  5438 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:18.735453  5595 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:18.740943 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:18.759760 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:18.766139 32021 catalog_manager.cc:5697] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } }
I20260709 13:15:18.761264   368 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:18.773239 32191 raft_consensus.cc:2368] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 for earlier term 21. Current term is 22.
W20260709 13:15:18.773456 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 84412.8us
I20260709 13:15:18.774137 32239 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:18.768365 32021 catalog_manager.cc:5697] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:18.780954  5570 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:18.781708  5570 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:18.784756 32090 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:18.785979  5502 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:18.786451  5502 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:18.786803  5502 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:18.790119  5595 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:18.791182   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:18.792068 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:18.797027  5570 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:18.798974 32238 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:18.800783  5517 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:18.801222  5517 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.801585  5517 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:18.805531 32021 catalog_manager.cc:5697] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 3 to 7, leader changed from 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 7 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:18.807354 32021 catalog_manager.cc:5697] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 6 to 10, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 10 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.810549  5596 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:18.832322 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:18.831007  5570 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:18.836635  5506 raft_consensus.cc:2804] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:18.837297  5506 raft_consensus.cc:697] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 14 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:18.838881 32239 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:18.838773  5506 consensus_queue.cc:237] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:18.840421  5626 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:18.843251  5534 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.843791  5534 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:18.845373   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 56831.1us
I20260709 13:15:18.846001  5534 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:18.768008  5312 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:18.746920  5530 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:18.792012  5628 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:18.810782 32238 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:15:18.831529   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 56468.8us
I20260709 13:15:18.815925  5438 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:18.817672  5501 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:18.836360  5570 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:18.825591 32199 raft_consensus.cc:1275] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:15:18.850066   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
W20260709 13:15:18.858035 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 47326.7us
I20260709 13:15:18.861737 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:18.865104 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:18.871251  5570 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:18.875635 32197 raft_consensus.cc:1240] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:18.875762  5501 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:18.876624 32117 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:15:18.877013   395 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:18.878131   368 leader_election.cc:400] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 for earlier term 21. Current term is 22.
I20260709 13:15:18.878741  5628 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:18.881933  5628 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:18.882761  5628 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:18.883458  5628 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:18.886263 32272 raft_consensus.cc:1240] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:18.887603  5530 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:18.895941 32087 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:18.910075 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:18.899598 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:18.912180 32192 raft_consensus.cc:1240] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:18.863020  5596 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:18.915421 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:18.916218 32124 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:18.917461 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:18.918219 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:18.883096  5438 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 21 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:18.923717 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:18.915256 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:18.927137 32199 raft_consensus.cc:2368] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 for earlier term 21. Current term is 22.
I20260709 13:15:18.915385  5233 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:18.920746  5596 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.937799 32264 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 21.
I20260709 13:15:18.937389  5570 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:18.939826  5570 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:18.950340  5621 log.cc:927] Time spent T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.349s	user 0.003s	sys 0.000s
I20260709 13:15:18.952994  5502 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:18.949819  5517 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:18.956097  5517 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:18.957638  5295 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.958174  5295 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:18.959395  5502 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:18.960302  5295 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:18.960508  5596 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:18.966153 32124 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 21.
I20260709 13:15:18.967383 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:18.969297 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:18.975271 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:18.968688 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:18.989893 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:18.974515 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:18.974958   368 leader_election.cc:400] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 21 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 for earlier term 21. Current term is 22.
I20260709 13:15:18.981076 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:18.991983   368 leader_election.cc:403] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:15:18.977699 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:15:18.985672 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 68715.6us
I20260709 13:15:18.975728 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:18.994496 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:18.976032 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:18.981822  5570 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:18.968645  5295 consensus_queue.cc:1059] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:15:18.997076 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:18.997507 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:18.998201 32191 raft_consensus.cc:2393] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 19: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:18.973410 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:15:18.981659 32006 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ddd7dfc158794e3ab7427d0b86b46c8d with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 94085cf341634eb686a95983b6b7f7e6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:18.967708 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:18.999025  5295 raft_consensus.cc:3055] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:18.999562  5295 raft_consensus.cc:740] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:19.000500  5295 consensus_queue.cc:260] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:19.001827  5295 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:19.003741 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:18.974905 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:19.004911 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:19.005242 32196 raft_consensus.cc:2393] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 19: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:18.972296 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:18.991199 32198 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 19.
I20260709 13:15:18.973007   395 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 22.
I20260709 13:15:18.998986 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:19.009902 32191 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:15:19.012053  5430 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 for earlier term 21. Current term is 22.
I20260709 13:15:18.996277 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:19.021646 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:19.022796 32266 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 19.
I20260709 13:15:19.026571 32273 raft_consensus.cc:2393] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 14: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:19.028056 32264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:15:18.983754  5628 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:19.034196 32264 raft_consensus.cc:606] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:15:19.034646 32264 raft_consensus.cc:614] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:19.025664  5341 consensus_queue.cc:1048] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:15:19.036973 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:19.038084 32090 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:19.040027 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:19.040730 32273 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:19.041348 32089 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:19.042035 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:19.042675 32115 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:19.049551 32089 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:19.044384  5570 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:19.053267  5570 raft_consensus.cc:697] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:19.054448  5570 consensus_queue.cc:237] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:19.057682  5613 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:19.058192  5613 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:19.051344 32121 raft_consensus.cc:1275] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:15:19.046669  5628 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:19.060206  5613 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:19.060683  5233 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:19.064007  5596 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:19.065121 32271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10940646da924abea9f371781da8acee"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:15:19.065708 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:19.066126  5596 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:19.066395 32116 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:15:19.067348 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:19.067909 32117 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:19.065760 32271 raft_consensus.cc:606] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:19.069149 32271 raft_consensus.cc:614] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:19.074587 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:19.074604 32271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:15:19.075541 32271 raft_consensus.cc:606] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:15:19.078812 32271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:15:19.079478 32271 raft_consensus.cc:606] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:15:19.080978  5517 consensus_queue.cc:1059] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:19.082672  5525 raft_consensus.cc:3055] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:19.083056  5525 raft_consensus.cc:740] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:19.082289  5517 consensus_queue.cc:1059] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:15:19.085573 32271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:15:19.086113  5312 raft_consensus.cc:3055] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:19.086306 32271 raft_consensus.cc:606] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:15:19.086575  5312 raft_consensus.cc:740] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:19.086756 32271 raft_consensus.cc:614] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:19.087561  5312 consensus_queue.cc:260] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:19.083938  5525 consensus_queue.cc:260] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:19.090005  5525 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:19.092880 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:15:19.093624  5312 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:15:19.095599 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.109128 32165 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:19.097083 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:19.098881 32273 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 22.
I20260709 13:15:19.100481 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:19.110316 32123 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:19.105329 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:19.103345 32089 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:19.111321 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:19.111785 32089 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:19.112787  5295 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:19.113914  5295 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:19.114526 32089 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:19.115270  5388 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:19.111902 32197 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:19.102839  5596 consensus_queue.cc:1048] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:15:19.101333 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:19.120939  5501 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:19.121376  5501 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:19.121703  5501 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:19.123087 32197 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:15:19.133075 32191 raft_consensus.cc:1275] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:15:19.127457 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:19.134732 32193 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:19.137173 32115 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:15:19.140482 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:19.139178 32165 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:19.152559  5259 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:19.153004  5259 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:19.153383  5259 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:19.161706  5259 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:19.162904 32117 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 22.
W20260709 13:15:19.165077 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 65149.2us
I20260709 13:15:19.165395 32238 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:19.167152  5626 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:15:19.177639 32165 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:19.173601  5259 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:19.176277 32238 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:19.181412 32089 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:19.184049 32123 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:15:19.185644 32165 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:19.188174  5537 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:19.188382 32089 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:19.186825  5524 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:19.186237  5233 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:19.197629  5570 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:19.198210  5524 raft_consensus.cc:697] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:19.196333 32239 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:19.200721  5524 consensus_queue.cc:237] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:19.203258  5501 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:19.196817 32089 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:19.208568 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:19.208998 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:19.208429 32089 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:19.198925  5233 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:19.204190  5517 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:19.213384 32089 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:19.186628  5259 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:19.218042 32117 raft_consensus.cc:1275] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:15:19.218991 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:19.197206  5595 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:15:19.225148  5595 raft_consensus.cc:697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 22 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:19.186491  5573 consensus_queue.cc:1048] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:15:19.226140  5595 consensus_queue.cc:237] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:19.220470 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:19.229375 32270 raft_consensus.cc:2393] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 14: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:19.230156  5517 raft_consensus.cc:697] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:19.231204  5517 consensus_queue.cc:237] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:19.222508  5501 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:19.216017  5534 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:19.243423 32122 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:15:19.228883 32117 pending_rounds.cc:85] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d: Aborting all ops after (but not including) 8
I20260709 13:15:19.246685 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:19.247409 32270 raft_consensus.cc:2393] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 16: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:19.247502 32165 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:19.247735 32089 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:19.251509 32193 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:15:19.253525 32089 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:19.245695 32117 pending_rounds.cc:107] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:15:19.268810 32117 raft_consensus.cc:2889] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:19.269696 32089 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:19.214653  5295 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:19.270627 32089 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:19.271103 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:19.273562 32089 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:19.276172 32089 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:19.257233  5558 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:19.263772  5534 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:19.270121  5515 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:19.282963  5534 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:19.271574  5537 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:19.274941  5628 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:19.276715  5388 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:19.294941 32122 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:15:19.283318  5558 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:19.288760  5534 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:19.301564  5233 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:19.292671  5341 consensus_queue.cc:1048] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:15:19.292096  5515 raft_consensus.cc:697] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:19.308709 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:19.291349  5570 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:19.314445  5570 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:19.314914  5570 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:19.318890  5502 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.319571  5502 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:19.330837 32271 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
W20260709 13:15:19.337570 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 61462.6us
I20260709 13:15:19.340093 32089 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:19.343938 32165 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:19.349946 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:19.359036 32089 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:19.349203  5501 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:19.385425  5501 raft_consensus.cc:697] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:19.386406  5501 consensus_queue.cc:237] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:19.308476  5515 consensus_queue.cc:237] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:19.388860  5388 raft_consensus.cc:2749] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:19.391103  5502 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:19.353942  5558 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:19.398049 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:15:19.407531 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 44283.7us
I20260709 13:15:19.421298 32197 raft_consensus.cc:1275] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:15:19.416360 32165 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:19.423826  5259 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:15:19.431604 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 72644us
I20260709 13:15:19.426757  5259 raft_consensus.cc:697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:19.424291  5438 consensus_queue.cc:1048] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:15:19.435505  5259 consensus_queue.cc:237] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:19.437924  5558 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.438508  5558 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:19.441443 32271 raft_consensus.cc:3060] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:19.445748 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:19.450287 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:19.455024 32197 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 20.
I20260709 13:15:19.462472 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:19.464147 32089 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:19.465704 32270 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 20.
I20260709 13:15:19.468124 32090 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:19.460394  5558 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:19.488435  5645 log.cc:927] Time spent T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:15:19.518913 32271 raft_consensus.cc:1275] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:15:19.499336  5295 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:19.542840  5438 consensus_queue.cc:1048] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:19.544335  5626 raft_consensus.cc:993] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:15:19.544977  5626 raft_consensus.cc:1081] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:15:19.550655 32193 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:15:19.551352 32193 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:19.551733 32193 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:15:19.553151  5644 log.cc:927] Time spent T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:15:19.497445  5502 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:19.462865  5534 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:19.567813 32270 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:15:19.575572  5570 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:19.577111  5613 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:19.577973  5534 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:19.579850 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:19.557948  5502 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.580626 32265 raft_consensus.cc:2393] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 19: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:19.580689  5502 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:19.585517 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:19.587356 32118 raft_consensus.cc:1240] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:19.594374 32193 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:19.642369 32193 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:19.644692 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:19.645958 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:19.646170 32271 raft_consensus.cc:3055] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:19.646611 32117 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:19.646850 32271 raft_consensus.cc:740] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:19.668021 32117 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:15:19.670065 32121 raft_consensus.cc:1275] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:15:19.670787  5653 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.671311  5653 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:19.673698  5653 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:19.674943 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:19.675714 32273 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 17.
I20260709 13:15:19.673781 32195 raft_consensus.cc:1275] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:15:19.680087 32165 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:15:19.680437  5647 log.cc:927] Time spent T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:15:19.680472 32190 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 19.
I20260709 13:15:19.688328  5626 consensus_queue.cc:1048] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:19.693013  5596 consensus_queue.cc:1048] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:19.694741  5570 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:19.695590 32089 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:19.697537 32165 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:19.698576  5613 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:19.699246  5613 raft_consensus.cc:697] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:19.700186 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:19.701102 32195 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:15:19.688748  5530 consensus_queue.cc:1059] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:19.701817 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:19.702685 32118 raft_consensus.cc:1275] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:15:19.707511 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:19.716532 32090 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:19.724069 32271 consensus_queue.cc:260] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:19.726388  5558 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:19.764945 32271 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:19.761981  5501 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:19.722875  5570 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:15:19.744901  5525 consensus_queue.cc:1048] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:15:19.775337  5501 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.760787  5515 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:19.797487 32271 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:15:19.801218  5501 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:19.757292  5613 consensus_queue.cc:237] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:19.841663  5588 raft_consensus.cc:3055] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:19.842597  5588 raft_consensus.cc:740] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:19.844306  5588 consensus_queue.cc:260] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:19.860128 32271 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:15:19.836596  5515 raft_consensus.cc:697] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 12 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:19.909114  5515 consensus_queue.cc:237] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:19.924530  5650 log.cc:927] Time spent T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:15:19.928665  5658 log.cc:927] Time spent T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.093s	user 0.002s	sys 0.000s
W20260709 13:15:19.932111  5655 log.cc:927] Time spent T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:15:19.942999  5654 log.cc:927] Time spent T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:15:19.945230  5502 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:19.947402  5502 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:19.949718 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:19.950379 32271 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:15:19.954187 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 54130.4us
I20260709 13:15:19.954384  5595 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:15:19.958019 32120 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:15:19.971026 32271 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 21.
I20260709 13:15:19.898241  5588 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:19.975106 32271 raft_consensus.cc:1275] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:19.975047 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:19.993271 32193 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:19.978817 32090 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:15:20.034783 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 56051.4us
I20260709 13:15:20.030395  5502 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:20.041255  5388 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:15:20.033620  5653 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:15:20.045894  5295 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:20.108170 32197 raft_consensus.cc:1275] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:15:20.109223 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 54371.8us
I20260709 13:15:20.142469 32193 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 21.
I20260709 13:15:20.076086  5502 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:20.160166   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 284978us
W20260709 13:15:20.160873 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 173502us
I20260709 13:15:20.169749 32117 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:15:20.186426  5668 log.cc:927] Time spent T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:15:20.179927  5674 consensus_queue.cc:1048] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:20.141227  5295 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:20.192978 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:20.214100  5666 log.cc:927] Time spent T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.321s	user 0.001s	sys 0.001s
I20260709 13:15:20.198585  5388 raft_consensus.cc:697] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 21 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:20.235194 32270 raft_consensus.cc:1275] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:15:20.237075 32265 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:20.237932  5656 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:15:20.246028 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:20.248360 32197 raft_consensus.cc:2393] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 13: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
W20260709 13:15:20.256644  5672 log.cc:927] Time spent T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:15:20.270597  5677 log.cc:927] Time spent T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:15:20.279392  5501 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:20.288839  5686 consensus_queue.cc:1048] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:20.297842 32116 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:20.299973 32117 raft_consensus.cc:1275] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:15:20.321538  5388 consensus_queue.cc:237] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:20.335096 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 190959us
I20260709 13:15:20.340971  5150 consensus_queue.cc:1048] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
W20260709 13:15:20.372134   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 111810us
W20260709 13:15:20.375159  5682 log.cc:927] Time spent T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:15:20.375526  5678 consensus_queue.cc:1048] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:15:20.387943 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:20.396940 32198 raft_consensus.cc:2368] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 17. Current term is 18.
I20260709 13:15:20.400421  5502 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:20.351140  5674 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:15:20.411010 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:20.411826 32273 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:15:20.413439  5295 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:20.420116 32116 raft_consensus.cc:1275] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:20.420094 32090 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:20.430439  5628 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:20.430938  5628 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:20.431354  5628 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:20.436983   395 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 22 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:15:20.445240 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:20.446048 32273 raft_consensus.cc:2393] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 17: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
W20260709 13:15:20.444907   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 46982.9us
W20260709 13:15:20.460083 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 102494us
I20260709 13:15:20.466429 32089 leader_election.cc:400] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 17. Current term is 18.
I20260709 13:15:20.466778 32089 leader_election.cc:403] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:20.469964 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:20.470566 32273 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:20.471905 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:20.449661  5501 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:20.478816 32194 raft_consensus.cc:1275] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:15:20.462106  5259 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:20.470459  5502 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:15:20.465575  5678 consensus_queue.cc:1048] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:15:20.500226  5680 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:15:20.508865  5628 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:20.516610 32273 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
I20260709 13:15:20.492134  5259 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:20.560958 32165 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:15:20.572458 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 69668.4us
I20260709 13:15:20.503947  5570 consensus_queue.cc:1048] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
W20260709 13:15:20.574795  5694 log.cc:927] Time spent T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:15:20.581475 32121 raft_consensus.cc:1275] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:15:20.598476  5588 consensus_meta.cc:287] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.561s	user 0.009s	sys 0.003s
I20260709 13:15:20.638273 32264 raft_consensus.cc:1275] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:15:20.580794  5501 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:20.647871  5643 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.635807  5656 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:15:20.660517  5295 consensus_queue.cc:1048] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:20.661535  5628 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:20.661965  5295 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.662453  5295 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:20.663115  5259 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:20.667068 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:20.680847  5502 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 17. Current term is 18.
I20260709 13:15:20.681715  5501 raft_consensus.cc:697] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:20.682649  5501 consensus_queue.cc:237] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:20.704962 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:20.705864 32273 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 18.
I20260709 13:15:20.675268  5295 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:20.726979 32090 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:20.648463  5643 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:20.759886 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:20.761149 32273 raft_consensus.cc:2393] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 18: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:20.741866  5295 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:15:20.784789 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 180583us
I20260709 13:15:20.786605 32120 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
I20260709 13:15:20.795123 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:20.796277 32195 raft_consensus.cc:2393] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 13: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:20.855140 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:20.783377  5295 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.887071 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:20.887696 32195 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17.
I20260709 13:15:20.868376  5295 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:20.943259 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:15:20.956458  5690 log.cc:927] Time spent T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:15:20.957283  5715 log.cc:927] Time spent T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:15:20.958881  5705 log.cc:927] Time spent T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 13:15:20.965416  5703 log.cc:927] Time spent T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:15:20.972376 32270 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
W20260709 13:15:21.021358  5717 log.cc:927] Time spent T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:15:21.021847 32271 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:15:21.042414 32266 raft_consensus.cc:1275] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:15:21.062893 32090 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:21.069391 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:21.060241  5643 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:21.090960  5295 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:21.092195 32123 raft_consensus.cc:2368] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 18. Current term is 19.
I20260709 13:15:21.071796  5628 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:21.061765  5678 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:15:21.065869  5388 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:15:21.129068  5628 raft_consensus.cc:697] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 13 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
W20260709 13:15:21.195003  5685 log.cc:927] Time spent T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:15:21.242583 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:21.243402 32197 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:15:21.261399 32199 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:15:21.270812  5703 log.cc:927] Time spent T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:15:21.287107  5684 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:15:21.289927  5718 log.cc:927] Time spent T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:15:21.293867  5295 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:21.386246 32197 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 19.
W20260709 13:15:21.387892 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 245927us
I20260709 13:15:21.388602 32089 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:15:21.418885  5687 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.013s	sys 0.026s
W20260709 13:15:21.419373  5687 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.013s	sys 0.026s
I20260709 13:15:21.420286 32165 leader_election.cc:400] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 18. Current term is 19.
I20260709 13:15:21.420696 32165 leader_election.cc:403] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:21.421298 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:21.422021 32264 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:21.406886  5710 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:21.427933 32090 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:21.376699  5628 consensus_queue.cc:237] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:21.467859 32264 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 19.
I20260709 13:15:21.472994 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:21.438413  5678 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 18. Current term is 19.
W20260709 13:15:21.492646 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 46807us
I20260709 13:15:21.442804  5710 raft_consensus.cc:697] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
W20260709 13:15:21.501344 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 64354.9us
I20260709 13:15:21.458587  5736 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:21.511174 32264 raft_consensus.cc:1275] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:15:21.511952   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 67837.2us
W20260709 13:15:21.556310 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 45221us
W20260709 13:15:21.565096  5656 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.011s	sys 0.004s
I20260709 13:15:21.565542  5626 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:21.584745   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 66111.5us
W20260709 13:15:21.581625  5656 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.011s	sys 0.004s
I20260709 13:15:21.597019  5651 consensus_queue.cc:1048] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:15:21.573158  5710 consensus_queue.cc:237] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:21.588521  5626 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:21.658805  5626 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:21.665372  5651 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:21.666008  5651 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:21.668045  5651 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:21.648902  5738 log.cc:927] Time spent T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:15:21.670220 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:21.672260 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:21.674103 32265 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:15:21.675778 32165 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:21.677367 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:21.679929 32118 raft_consensus.cc:2393] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 13: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:21.678526 32198 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:15:21.717936 32238 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:15:21.764550 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 46693.7us
I20260709 13:15:21.719434  5711 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:21.806725  5754 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:21.807360  5754 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:21.764670  5687 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:21.809270  5687 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.763752  5388 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.845072  5687 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:21.845206  5388 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:21.847441  5388 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:21.825897 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 49102.7us
I20260709 13:15:21.770115  5534 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:21.848886  5534 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:21.851095  5534 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:21.855790 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:21.856618  5678 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:21.857226  5678 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:21.860308  5678 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:21.863225 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:15:21.852412  5723 log.cc:927] Time spent T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:15:21.879487  5678 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:21.880283  5678 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:21.882637  5678 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:21.773561  5711 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:21.883889  5711 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:21.884655 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:15:21.899003  5755 log.cc:927] Time spent T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 13:15:21.905575  5754 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:22.069149  5626 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:22.074626  5626 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:22.077158  5626 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:22.089820  5684 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:22.090063  5534 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:22.090521  5534 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:22.090468  5684 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:22.137006 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:22.110461  5737 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:15:22.146796 32164 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.007s	sys 0.007s
W20260709 13:15:22.147324 32164 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.007s	sys 0.008s
I20260709 13:15:22.120899  5761 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:22.176975 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:22.134083  5573 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:22.180776 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:22.187554 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:22.187987 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:22.192358  5573 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:22.196915 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:22.173928  5492 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.181638  5534 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:22.254086 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 62876us
I20260709 13:15:22.199373  5573 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:22.235077 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:22.234549  5771 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:22.180742  5761 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:22.258654  5628 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:22.195498  5737 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:22.233353  5492 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:22.208004  5687 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:22.315598 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 53297.7us
I20260709 13:15:22.335016 32270 raft_consensus.cc:2393] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 14: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:22.345788   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:22.346203   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:22.353111   394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38164 (request call id 410) took 1081 ms. Trace:
I20260709 13:15:22.355664   394 rpcz_store.cc:276] 0709 13:15:21.270048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.270249 (+   201us) service_pool.cc:224] Handling call
0709 13:15:22.350225 (+1079976us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b58001e2498. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59beccb71 00007fb59becca22 00007fb5a4de5c09 00007fb5a3f3fee0 00007fb5a40090ab 00007fb5a4009131 00007fb5a3fcafc0 00007fb5a3fb5929 00007fb5a3fb53d2 00007fb59d52cbd4
0709 13:15:22.350416 (+   191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:22.350591 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:22.350615 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:22.350655 (+    40us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:22.350685 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:22.350738 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:22.350850 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4700544}
I20260709 13:15:22.326249  5628 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:22.372750 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:22.374752 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:22.358132  5684 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:22.383621 32117 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:15:22.365883  5729 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:22.278556  5771 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:22.399852 32162 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:22.379761  5776 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:22.389242  5665 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:22.410019  5665 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:22.411667  5762 log.cc:927] Time spent T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:15:22.412274  5665 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:22.400815  5233 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:22.412936  5233 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:22.415354  5233 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:22.400543  5681 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:22.417915  5681 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:22.413168 32272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 3336) took 1020 ms. Trace:
I20260709 13:15:22.399283  5781 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:22.399648  5684 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:22.420946 32272 rpcz_store.cc:276] 0709 13:15:21.393122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.393253 (+   131us) service_pool.cc:224] Handling call
0709 13:15:21.400995 (+  7742us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:21.456126 (+ 55131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:21.456196 (+    70us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:21.474024 (+ 17828us) log.cc:844] Serialized 52 byte log entry
0709 13:15:21.925789 (+451765us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:21.925847 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:21.925953 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:22.412933 (+486980us) raft_consensus.cc:1685] finished
0709 13:15:22.412958 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:22.413103 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1716,"raft.queue_time_us":2107,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"thread_start_us":445634,"threads_started":2,"wal-append.queue_time_us":725448}
I20260709 13:15:22.399780  5729 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:22.441658 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 173741us
I20260709 13:15:22.464978  5687 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:15:22.461900 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 80809.5us
I20260709 13:15:22.496815 32162 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:22.504055 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:22.504787 32120 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:15:22.505749  5681 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:22.508251  5573 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:22.509007  5573 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:22.448303  5684 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:22.512168  5573 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:22.459141  5779 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:22.408914  5776 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:22.484141  5656 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.001s	sys 0.015s
I20260709 13:15:22.525986 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:22.526711 32123 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 18.
I20260709 13:15:22.479424  5792 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:22.465760  5785 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:22.465139  5788 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:22.445431  5233 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:22.494249  5737 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:22.448184  5781 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:22.526891  5656 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.001s	sys 0.019s
I20260709 13:15:22.498401  5783 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:22.535270  5775 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:22.541312  5794 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:22.542378  5788 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:22.543582  5721 log.cc:927] Time spent T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 1.527s	user 0.013s	sys 0.007s
I20260709 13:15:22.547319 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:22.528617  5761 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:22.528296  5796 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:22.536012  5792 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:22.555258  5673 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:22.550145  5388 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:22.557026  5150 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:22.557456 32165 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:22.557644  5653 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:22.558075  5775 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:22.567694 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:22.581797 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:22.588347  5778 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:22.536667  5785 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:22.633066  5785 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:15:22.636998  5764 log.cc:927] Time spent T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.437s	user 0.002s	sys 0.000s
I20260709 13:15:22.587232  5295 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:22.638896  5295 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:22.640029  5757 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:22.640694  5757 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:22.640879  5150 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:22.642928  5757 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:22.643416  5757 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:22.643852  5757 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:22.645095  5628 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:22.646469  5757 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:22.649189 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:22.649554  5588 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:22.650275  5683 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:22.650159  5588 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:22.650779  5683 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:22.652235  5588 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:22.652833  5683 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:22.652945   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:22.654183   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:22.654923 32121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 2716) took 1854 ms. Trace:
I20260709 13:15:22.656489  5150 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:22.660238  5492 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:22.655318 32121 rpcz_store.cc:276] 0709 13:15:20.800950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.857074 (+ 56124us) service_pool.cc:224] Handling call
0709 13:15:20.857370 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:20.857583 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:15:21.074441 (+216858us) log.cc:844] Serialized 14 byte log entry
0709 13:15:22.654469 (+1580028us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b1800437aa0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59eb994bc 00007fb59bee748b 00007fb5a4d41ab9 00007fb59bf0369b 00007fb59bf0193f 00007fb59bf01455 00007fb59efe9060 00007fb59effb716 00007fb59f00c287
0709 13:15:22.654561 (+    92us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:22.654608 (+    47us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:15:22.654650 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:22.654715 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:22.654848 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1089,"prepare.queue_time_us":212391,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":2560,"raft.queue_time_us":30566,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":2104,"spinlock_wait_cycles":5634304,"thread_start_us":238417,"threads_started":2}
I20260709 13:15:22.664378 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:22.665593 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:22.666132 32122 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:15:22.668781 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:22.668915 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:22.674077 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:22.590742  5771 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:22.611171  5788 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:22.561110  5783 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:22.620378 32124 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:15:22.621310 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 63931us
I20260709 13:15:22.693514   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:22.618382  5388 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:22.619975  5673 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:22.702405  5673 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:22.622540  5653 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:22.584623  5794 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:22.704432  5653 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:15:22.624053  5716 log.cc:927] Time spent T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 1.626s	user 0.006s	sys 0.030s
I20260709 13:15:22.710116  5388 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:22.628372  5711 consensus_meta.cc:287] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.744s	user 0.005s	sys 0.006s
I20260709 13:15:22.622969  5798 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:22.740765 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:22.629613  5776 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:22.565027  5643 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:22.559648  5233 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:22.679158 32090 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:22.682088 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:22.682911  5778 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:22.672829  5613 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:22.686882  5775 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:22.688457  5792 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:22.691001  5684 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:22.699712  5781 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:22.714604 32124 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:15:22.718962 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:22.719790 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:22.722601 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:22.725459  5783 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:22.728492   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:22.731253   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:22.730675   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:22.729837   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:22.739712 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:15:22.743132 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 59223us
I20260709 13:15:22.757246 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:15:22.759055 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 80014.7us
I20260709 13:15:22.763639 32271 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 18.
I20260709 13:15:22.775792 32090 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:22.780175 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:22.763876 32272 raft_consensus.cc:1275] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:15:22.764345 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 43508.5us
I20260709 13:15:22.729125   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:22.769271 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:22.760942  5613 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:22.782760 32196 raft_consensus.cc:1275] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:15:22.784013 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:22.784164 32124 raft_consensus.cc:1275] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:15:22.785040   369 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:22.787947  5233 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:22.781852 32198 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:15:22.760967  5665 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:22.757762  5643 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:22.740664  5711 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:22.927449 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:23.045715 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:22.933101 32239 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:23.044446 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:23.014480 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:23.045276 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:22.932814 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:23.096396   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:23.004505 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:22.927521 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:22.934955 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:22.798396 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:22.761494  5776 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:23.188211 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:23.042052 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:23.041306 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:23.069060 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:23.089126 32238 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:22.894917 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:23.183737 32090 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
W20260709 13:15:23.205519 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 116508us
I20260709 13:15:23.207034 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:23.208775 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:22.764133  5341 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:23.041865 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:23.214267 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:22.936110  5782 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:23.219519  5782 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:23.221850  5782 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:23.222841 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:23.224087 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:15:23.076901  5710 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.243s	user 0.014s	sys 0.011s
W20260709 13:15:23.226348  5710 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.393s	user 0.017s	sys 0.014s
I20260709 13:15:23.225432 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:23.228610 32116 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 22.
I20260709 13:15:22.789471  5783 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:23.096319  5534 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:23.233500  5534 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:23.158258   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:22.944696  5792 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:23.239890  5792 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:22.791985  5794 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:23.105091  5558 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:23.245114  5558 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:23.247355 32122 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
W20260709 13:15:23.013885  5721 log.cc:927] Time spent T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:15:23.039460  5778 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:23.210224  5665 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:23.251564  5665 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:23.068549  5793 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.159725  5742 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.253284  5793 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:23.253548  5742 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:23.255390  5793 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:23.256129  5742 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:15:23.268926 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 335877us
I20260709 13:15:23.215374 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:23.215941 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:23.217590 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:23.259424  5757 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:23.273007 32195 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:15:22.943799  5627 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:15:23.276301 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 59375.3us
I20260709 13:15:23.278638 32239 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:23.266865 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 83230.3us
I20260709 13:15:23.284255 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:23.272225 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:23.214263 32270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36084 (request call id 3347) took 1008 ms. Trace:
I20260709 13:15:23.164625  5415 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:23.291754 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:23.273007 32124 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 15.
I20260709 13:15:23.272225  5697 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:23.284430 32090 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:23.285516 32270 rpcz_store.cc:276] 0709 13:15:22.187142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.187298 (+   156us) service_pool.cc:224] Handling call
0709 13:15:23.195165 (+1007867us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b540021a554. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:15:23.195299 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":337046400}
I20260709 13:15:23.344547 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:23.306684 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:23.246387  5643 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:23.337241 32238 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:23.360684 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:23.376739  5686 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:23.377014  5792 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:23.379422 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:23.272557  5570 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:23.285894  5588 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:23.273280  5757 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:23.390892 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:23.359125  5697 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:23.392428 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:23.369441  5794 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:15:23.394929 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 110622us
I20260709 13:15:23.395689 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:23.256132  5341 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:23.403855 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:23.404570 32190 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:15:23.335755  5627 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:23.385824  5772 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:23.393298  5757 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:23.388788  5775 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:23.357426  5415 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:23.398334  5771 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:23.400377  5697 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:23.421159 32265 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:15:23.435410 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:23.437958 32089 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:23.445362 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:23.448431 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:23.454216 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:23.452562 32198 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
I20260709 13:15:23.457595 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:23.464814  5665 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:23.465701  5665 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:23.468829  5595 consensus_queue.cc:1048] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:23.414925  5570 consensus_queue.cc:1048] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:15:23.473560  5770 consensus_queue.cc:1048] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:23.474378  5415 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:23.468402  5665 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:23.475528  5711 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:23.453958  5628 raft_consensus.cc:2749] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:23.479413 32165 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:23.453730 32089 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:23.480997 32089 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:23.482167 32089 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:23.483647 32089 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:23.485823 32165 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:23.425240  5771 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:23.418426  5772 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:23.413494  5794 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:23.456714  5534 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:23.457201  5558 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:23.454553  5710 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:23.424593  5775 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:23.486032  5628 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:23.484573  5643 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:23.512516 32165 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:23.488087  5665 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:23.495926  5771 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:23.503765  5752 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:23.485536  5684 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:23.532902  5627 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:15:23.528865 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 45291.5us
I20260709 13:15:23.535952 32089 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:23.525579  5711 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:23.545922  5341 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:23.546705  5775 leader_election.cc:290] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:23.534220  5643 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:23.549850 32194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56926 (request call id 826) took 1010 ms. Trace:
I20260709 13:15:23.553555 32194 rpcz_store.cc:276] 0709 13:15:22.539141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.539293 (+   152us) service_pool.cc:224] Handling call
0709 13:15:22.545805 (+  6512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:22.591758 (+ 45953us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:22.591788 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:22.591829 (+    41us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:15:22.591861 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:23.549625 (+957764us) spinlock_profiling.cc:243] Waited 45.7 ms on lock 0x7b54002111d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:15:23.549668 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:23.549781 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105197312}
I20260709 13:15:23.518569  5710 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:23.555117 32089 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:23.554629  5775 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:23.591245  5697 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:23.593772  5710 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:23.601125  5772 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:23.621624  5794 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:23.630082 32239 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
W20260709 13:15:23.631119 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 350089us
I20260709 13:15:23.632567 32239 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:23.642522 32239 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:23.644902 32239 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:23.658345  5673 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:23.643685  5588 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:23.657578 32193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56926 (request call id 825) took 1119 ms. Trace:
I20260709 13:15:23.660265 32193 rpcz_store.cc:276] 0709 13:15:22.538085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.538256 (+   171us) service_pool.cc:224] Handling call
0709 13:15:22.538612 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:22.774373 (+235761us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:22.774402 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:22.774444 (+    42us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:15:22.774477 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:23.657322 (+882845us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b54000b2f54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:15:23.657375 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:23.657493 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":541726080}
I20260709 13:15:23.640946  5692 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:23.661752  5692 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:23.662106  5692 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:23.664083 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:23.664961 32267 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:15:23.668195  5524 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:23.668781  5524 raft_consensus.cc:697] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:23.669586  5524 consensus_queue.cc:237] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:23.675997  5729 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:23.678117  5295 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:23.679467 32120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 4260) took 1098 ms. Trace:
I20260709 13:15:23.679953 32120 rpcz_store.cc:276] 0709 13:15:22.581345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.581678 (+   333us) service_pool.cc:224] Handling call
0709 13:15:22.616353 (+ 34675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:22.762981 (+146628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:22.763029 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:22.763090 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:22.763137 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:23.679156 (+916019us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54003f57d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:15:23.679227 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:23.679394 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":336455040}
I20260709 13:15:23.684789  5771 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:23.690237  5790 log.cc:927] Time spent T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 1.232s	user 0.017s	sys 0.019s
I20260709 13:15:23.696997 32117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 4261) took 1112 ms. Trace:
I20260709 13:15:23.697427 32117 rpcz_store.cc:276] 0709 13:15:22.584400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.584550 (+   150us) service_pool.cc:224] Handling call
0709 13:15:22.584881 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:23.260034 (+675153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:23.260076 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:23.260151 (+    75us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:23.260203 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:23.696782 (+436579us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b54001653d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:15:23.696832 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:23.696942 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1552212224}
I20260709 13:15:23.717023 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:23.717875 32271 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:15:23.716125 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:23.738647 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:23.740228 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:15:23.750797 32116 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.014s	sys 0.119s
W20260709 13:15:23.751389 32116 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.014s	sys 0.119s
W20260709 13:15:23.759393   396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.081s	sys 0.081s
I20260709 13:15:23.759301  5692 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:23.760195   396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.082s	sys 0.082s
I20260709 13:15:23.761332  5670 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:15:23.764073   396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38176 (request call id 291) took 1036 ms. Trace:
I20260709 13:15:23.766084 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:15:23.769557 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 214511us
I20260709 13:15:23.770327 32089 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:23.784924 32089 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:15:23.795162 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 59063.7us
I20260709 13:15:23.764562   396 rpcz_store.cc:276] 0709 13:15:22.727904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.728033 (+   129us) service_pool.cc:224] Handling call
0709 13:15:22.728326 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:22.728533 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:15:23.096495 (+367962us) log.cc:844] Serialized 14 byte log entry
0709 13:15:23.760945 (+664450us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:23.761034 (+    89us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:15:23.761107 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:23.763886 (+  2779us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:23.764015 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":671579,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":2523,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"thread_start_us":642485,"threads_started":2,"wal-append.queue_time_us":579782}
W20260709 13:15:23.795934 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 270861us
I20260709 13:15:23.796104 32090 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:23.796345  5729 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:23.802070 32195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 2982) took 1941 ms. Trace:
I20260709 13:15:23.807252 32195 rpcz_store.cc:276] 0709 13:15:21.855213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.855397 (+   184us) service_pool.cc:224] Handling call
0709 13:15:23.796849 (+1941452us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54001bb054. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:15:23.796946 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3257232256}
I20260709 13:15:23.804319 32124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55358 (request call id 630) took 1021 ms. Trace:
I20260709 13:15:23.808315 32124 rpcz_store.cc:276] 0709 13:15:22.782495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.635893 (+853398us) service_pool.cc:224] Handling call
0709 13:15:23.666052 (+ 30159us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:23.666206 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:23.666229 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:23.666269 (+    40us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:15:23.666300 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:23.666364 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:23.804171 (+137807us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b54002e2f50. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff08ad 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:15:23.804267 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68609920}
I20260709 13:15:23.802414  5697 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:23.806471  5613 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:23.809528   369 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:23.810525  5692 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:23.811056  5681 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:23.813750   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:23.786679  5783 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:23.815699   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:23.817598   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:23.817800 32020 catalog_manager.cc:5697] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:23.818799   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:23.819366 32020 catalog_manager.cc:5697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: leader changed from <none> to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 20 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:23.827037  5794 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:23.830124  5744 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:23.830732  5744 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:23.831059   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:23.830225  5794 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:23.788988  5570 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:23.832923  5744 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:23.832960   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:23.834362  5794 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:23.827944 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:23.832330   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:23.844105 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:23.848680 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:23.849026 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:23.849368 32190 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 21.
I20260709 13:15:23.852051 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:23.856958 32238 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:15:23.858911 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 62901.3us
I20260709 13:15:23.859835 32090 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:23.860780  5570 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:23.861456  5570 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:23.860244 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:23.862103 32090 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:23.861913  5570 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:23.862979  5729 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:23.863476  5698 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:23.865172  5698 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:23.865597  5698 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:23.870209 32165 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:23.872455  5804 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:23.872514 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:23.873063  5804 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:23.873420  5804 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:23.874792  5698 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:23.795311  5757 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:23.878850 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:23.879076  5729 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:23.907037  5729 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:23.907711 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:23.909121  5729 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:23.915928  5757 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:23.917723 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:23.917878 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:23.918682 32121 raft_consensus.cc:2368] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 13. Current term is 14.
I20260709 13:15:23.898584  5783 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:23.920928 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:23.921438  5783 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:23.922576  5804 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:23.880837 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:23.883647 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:23.930702 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:23.919883  5570 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:23.933256 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:23.934813  5570 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:23.935684  5783 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:23.687227  5771 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:23.890614 32264 raft_consensus.cc:1240] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:23.893530 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:23.893245 32238 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:15:23.938611 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 45436.6us
I20260709 13:15:23.939386  5224 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:15:23.939301 32119 raft_consensus.cc:1240] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:23.898368 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:23.899887 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:23.901561 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:23.881642  5613 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:23.942569  5613 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:23.946817  5613 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:23.947510 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:23.939875  5224 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:23.948827  5224 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:23.954450 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:23.957263 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:23.959935 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:23.959884   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:23.963822  5804 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:23.967017 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:23.969448 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:23.972071 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:23.973538 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:23.974361 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:23.975067 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:23.975131 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:23.977352 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:23.897590 32089 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:23.980562 32197 raft_consensus.cc:1240] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:15:23.980860   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:23.982331 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:23.984633 32087 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:23.986433 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:23.982482 32020 catalog_manager.cc:5697] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 7 to 10, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 10 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:23.989768 32165 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:23.990305 32020 catalog_manager.cc:5697] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 9 to 15, leader changed from 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 15 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:23.993399 32087 leader_election.cc:304] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:23.995031 32165 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:23.996927  5794 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:23.988710  5224 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:23.999990  5224 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:15:24.000414 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 100945us
I20260709 13:15:24.001729  5794 raft_consensus.cc:2749] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:24.002753 32271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:15:23.992934 32020 catalog_manager.cc:5697] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 17 to 18, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 18 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:24.004550 32271 raft_consensus.cc:606] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:15:24.004736 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:24.005960 32165 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:24.007099 32165 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:24.011884 32123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 2746) took 1233 ms. Trace:
I20260709 13:15:24.003747  5771 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:24.013777 32239 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:24.016412  5570 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:24.011658  5770 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:24.009747  5793 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:24.017911  5698 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:15:24.015724 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 118245us
I20260709 13:15:24.013226  5501 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:24.011251  5746 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:24.029059 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:24.029894 32195 raft_consensus.cc:2393] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 14: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:24.031044  5501 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:24.031564  5501 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:24.025508  5627 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:24.032809 32271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:15:24.033273  5746 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:24.033439 32271 raft_consensus.cc:606] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:24.033728  5746 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:24.038743  5770 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:24.039331  5770 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:24.026494 32165 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:24.052515 32165 leader_election.cc:400] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 13. Current term is 14.
I20260709 13:15:24.053020 32165 leader_election.cc:403] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:15:24.056022 32271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:15:24.055902 32020 catalog_manager.cc:5697] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:24.056747 32271 raft_consensus.cc:606] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:15:24.057502 32020 catalog_manager.cc:5697] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:24.059110 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:24.058907 32020 catalog_manager.cc:5697] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:24.064105 32165 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:24.068056 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:24.073156  5711 consensus_queue.cc:1059] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:15:24.072965 32020 catalog_manager.cc:5697] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 10 to 12, leader changed from 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 12 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:24.074293  5711 raft_consensus.cc:3055] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:24.074641 32020 catalog_manager.cc:5697] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:24.076167 32020 catalog_manager.cc:5697] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:15:24.079018 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 51243.4us
I20260709 13:15:24.012377 32123 rpcz_store.cc:276] 0709 13:15:22.778407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.497288 (+718881us) service_pool.cc:224] Handling call
0709 13:15:23.500954 (+  3666us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:23.501148 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:23.885182 (+384034us) log.cc:844] Serialized 14 byte log entry
0709 13:15:24.011037 (+125855us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:24.011090 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:24.011157 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.011322 (+   165us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:24.011831 (+   509us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7602,"prepare.queue_time_us":250017,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":8484,"thread_start_us":465210,"threads_started":2}
I20260709 13:15:24.084053 32090 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:24.080396 32239 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:24.052852  5744 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:24.088186 32271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:15:24.088816 32271 raft_consensus.cc:606] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:24.089466 32267 raft_consensus.cc:1240] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:24.091085  5698 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:24.097879 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:24.098102 32273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:15:24.098666 32273 raft_consensus.cc:606] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:15:24.098991 32273 raft_consensus.cc:614] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:24.087220 32090 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:24.076061  5794 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:24.102967 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:24.074694  5711 raft_consensus.cc:740] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:24.104571 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:15:24.112546 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:24.069779  5804 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:15:24.144467 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 61195.2us
I20260709 13:15:24.145149 32271 raft_consensus.cc:1240] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:24.094942  5643 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:15:24.148633 32165 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:24.102957  5570 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:24.153898  5698 raft_consensus.cc:993] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:15:24.159442 32239 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:24.169714 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:24.172621 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:24.172771 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:15:24.153210 32021 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49550 (request call id 260) took 24787 ms (client timeout 15000 ms). Trace:
I20260709 13:15:24.176059 32089 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:24.192112 32089 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:24.197356 32239 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:24.201943  5776 consensus_queue.cc:1059] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:24.180028  5698 raft_consensus.cc:1081] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Signalling peer fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:15:24.203413 32117 raft_consensus.cc:1240] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:24.177106  5729 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:24.206557  5341 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:24.219874  5710 raft_consensus.cc:2764] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:15:24.221022 32089 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:24.206686  5570 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:24.222087  5793 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:24.222175 32089 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:24.223215  5295 raft_consensus.cc:3055] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:24.223616  5295 raft_consensus.cc:740] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:24.224746  5773 consensus_queue.cc:1059] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:24.226583  5624 raft_consensus.cc:3055] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:24.226979  5624 raft_consensus.cc:740] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:24.227912  5624 consensus_queue.cc:260] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:24.229116  5624 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:24.231761  5588 raft_consensus.cc:993] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:15:24.232245 32271 raft_consensus.cc:1240] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:24.182953  5744 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:24.239667  5729 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:24.232273  5686 raft_consensus.cc:1081] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:15:24.243076  5771 consensus_queue.cc:1059] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:24.244029 32192 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:15:24.244606 32192 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:24.244992 32192 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:24.224375  5295 consensus_queue.cc:260] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:24.187415  5711 consensus_queue.cc:260] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:24.247200  5711 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:24.222034  5570 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:24.247131  5771 raft_consensus.cc:3055] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:24.248787  5570 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:24.248811  5771 raft_consensus.cc:740] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:24.249917  5771 consensus_queue.cc:260] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:24.251235  5771 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:24.254680 32192 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:24.268239 32192 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:24.246435  5295 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:15:24.273876 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 67813.1us
I20260709 13:15:24.181509  5627 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:15:24.276698  5769 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:15:24.277598 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 55500.6us
I20260709 13:15:24.278435 32089 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:24.279240  5769 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:24.294147 32239 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:24.295565  5729 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:24.296756 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:24.295583  5698 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:24.298282 32239 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:24.299045  5698 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:24.298563  5746 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:24.300053 32192 raft_consensus.cc:1240] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:24.303156  5794 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 13. Current term is 14.
I20260709 13:15:24.304203 32197 raft_consensus.cc:1275] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:15:24.173830 32021 rpcz_store.cc:269] 0709 13:14:59.353906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:59.413517 (+ 59611us) service_pool.cc:224] Handling call
0709 13:15:24.108772 (+24695255us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:19.047413 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:19.153064 (+105651us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:19.153118 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:15:19.153151 (+    33us) tablet.cc:662] Decoding operations
0709 13:15:19.154753 (+  1602us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:19.154846 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:19.154873 (+    27us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:15:19.156363 (+  1490us) tablet.cc:701] Row locks acquired
0709 13:15:19.156407 (+    44us) write_op.cc:260] PREPARE: finished
0709 13:15:19.156571 (+   164us) write_op.cc:270] Start()
0709 13:15:19.191680 (+ 35109us) write_op.cc:276] Timestamp: P: 1783602919156502 usec, L: 0
0709 13:15:19.194030 (+  2350us) op_driver.cc:348] REPLICATION: starting
0709 13:15:19.237872 (+ 43842us) log.cc:844] Serialized 7403 byte log entry
0709 13:15:19.572444 (+334572us) op_driver.cc:464] REPLICATION: finished
0709 13:15:19.893020 (+320576us) write_op.cc:301] APPLY: starting
0709 13:15:19.893129 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:20.292645 (+399516us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:20.292792 (+   147us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:21.439053 (+1146261us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:21.491180 (+ 52127us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:15:21.491243 (+    63us) write_op.cc:312] APPLY: finished
0709 13:15:21.491743 (+   500us) log.cc:844] Serialized 172 byte log entry
0709 13:15:21.642148 (+150405us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:21.677094 (+ 34946us) write_op.cc:454] Released schema lock
0709 13:15:21.718784 (+ 41690us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:21.850923 (+132139us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:21.850958 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10740,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":306199,"apply.run_cpu_time_us":51170,"apply.run_wall_time_us":1882069,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83737,"num_ops":19,"prepare.queue_time_us":94374,"prepare.run_cpu_time_us":26025,"prepare.run_wall_time_us":300897,"raft.queue_time_us":165205,"raft.run_cpu_time_us":26903,"raft.run_wall_time_us":231178,"replication_time_us":366675,"thread_start_us":597988,"threads_started":5,"wal-append.queue_time_us":320400,"wal-append.run_cpu_time_us":16676,"wal-append.run_wall_time_us":2179759}]]}
I20260709 13:15:24.305335  5670 consensus_queue.cc:1059] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:24.306736  5670 raft_consensus.cc:3055] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:24.307070  5670 raft_consensus.cc:740] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:24.307850  5670 consensus_queue.cc:260] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:24.310348  5670 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:24.313759  5686 consensus_queue.cc:1048] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:24.316781 32089 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:24.317840  5729 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:24.326619 32239 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:24.327265   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:24.327701 32089 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:24.331187  5769 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:15:24.330220 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 149953us
I20260709 13:15:24.332684  5746 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:24.334532 32165 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:24.336522  5804 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:24.337271  5770 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:24.343122 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:24.348040 32089 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:24.348716  5770 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:24.349035  5698 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:15:24.290517  5570 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:24.355682 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:24.328157  5501 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:24.370483  5501 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:24.337978 32165 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:24.371474   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:24.372366  5804 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:24.373476  5746 consensus_queue.cc:1059] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:24.373867 32165 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:24.374464  5746 raft_consensus.cc:3055] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:24.374814  5746 raft_consensus.cc:740] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:24.375618  5746 consensus_queue.cc:260] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:24.387358 32116 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:56890
I20260709 13:15:24.387789  5746 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:24.387959 32116 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:24.388463 32116 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:15:24.390908 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.392745  5770 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:24.395690  5744 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:24.396704  5570 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:24.397670 32116 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:24.400198 32116 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:24.401252 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:24.401906 32273 raft_consensus.cc:3055] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:24.402221 32273 raft_consensus.cc:740] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:24.402987 32273 consensus_queue.cc:260] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:24.404167 32273 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:24.404862 32117 raft_consensus.cc:1275] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:15:24.411058 32273 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 19.
I20260709 13:15:24.412309 32090 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:24.413378 32192 raft_consensus.cc:1240] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:24.414975  5624 consensus_queue.cc:1059] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:15:24.415948  5773 raft_consensus.cc:3055] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:24.416322  5773 raft_consensus.cc:740] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:24.417178  5773 consensus_queue.cc:260] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:24.418577  5773 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:24.421347   400 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:15:24.423740  5570 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:24.424064 32162 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:24.424371  5570 raft_consensus.cc:697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:24.424985  5711 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:24.426630 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:24.425488  5711 raft_consensus.cc:697] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:24.427395 32117 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:24.427872  5711 consensus_queue.cc:237] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:24.437557 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:24.438287 32273 raft_consensus.cc:3055] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:24.438959 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:24.438656 32273 raft_consensus.cc:740] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:24.441466 32273 consensus_queue.cc:260] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:24.442910 32273 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:24.445405 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:24.445922 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:24.449546  5698 raft_consensus.cc:993] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:15:24.450057  5698 raft_consensus.cc:1081] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:15:24.452284  5570 consensus_queue.cc:237] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:24.452979 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:24.454073 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:24.452359 32192 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:15:24.455287 32192 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:24.455722 32192 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:24.458321 32273 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 19.
I20260709 13:15:24.465924 32117 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 19.
I20260709 13:15:24.468493 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:24.472011 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:24.472311 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:24.472288 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:24.478469 32165 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:24.479394 32192 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:24.481710  5746 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:15:24.482849  5501 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:24.496935 32192 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:24.497884 32121 raft_consensus.cc:1240] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:24.493067  5524 consensus_queue.cc:1048] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.009s
W20260709 13:15:24.540373 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 47303.3us
I20260709 13:15:24.542850 32165 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:24.547825 32165 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:24.545944  5767 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:15:24.578823  5627 raft_consensus.cc:993] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:15:24.579734  5627 raft_consensus.cc:1081] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Signalling peer fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:15:24.578788  5828 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:24.581331  5828 raft_consensus.cc:697] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 19 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:24.581878 32089 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:24.582995  5570 raft_consensus.cc:2749] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:24.582638  5828 consensus_queue.cc:237] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:24.584295 32089 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:24.585443  5570 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:24.586675 32116 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:56890
I20260709 13:15:24.587262 32116 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:24.591293 32116 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:24.597383 32089 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:24.599537 32089 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:24.601907 32089 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:24.605448 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:24.606019 32117 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:24.608983 32089 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:24.610543 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:24.611136 32273 raft_consensus.cc:3055] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:24.611264 32117 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:15:24.611454 32273 raft_consensus.cc:740] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:24.612186 32273 consensus_queue.cc:260] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:24.598949  5295 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:24.613466 32273 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:24.604645  5770 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:24.616474  5729 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:24.620716  5295 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:24.627919 32273 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:15:24.649328 32116 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:24.663853 32165 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:24.666116 32116 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:24.669878 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:24.670586 32273 raft_consensus.cc:3055] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:24.670920 32273 raft_consensus.cc:740] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:24.672212 32273 consensus_queue.cc:260] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:24.673588 32273 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:24.680136  5828 raft_consensus.cc:2804] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:24.680766  5828 raft_consensus.cc:697] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:24.681697  5828 consensus_queue.cc:237] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:24.687002 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:24.687608 32191 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:24.687906 32271 raft_consensus.cc:1240] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 21. Current term is 22. Ops: []
I20260709 13:15:24.689452 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:24.690055 32192 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:24.694625 32273 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17.
I20260709 13:15:24.696861 32191 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17.
I20260709 13:15:24.698596 32090 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:24.699429  5570 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:24.699932  5570 raft_consensus.cc:697] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:24.700846  5570 consensus_queue.cc:237] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:24.708375 32192 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 19.
I20260709 13:15:24.698460  5295 consensus_queue.cc:1059] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:15:24.711640  5295 raft_consensus.cc:3055] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:15:24.712042  5295 raft_consensus.cc:740] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:24.712915  5295 consensus_queue.cc:260] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:24.714156  5295 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:24.715826 32116 raft_consensus.cc:1240] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:24.725332 32121 raft_consensus.cc:1240] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:24.739418 32020 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59534 (request call id 126) took 6636 ms. Trace:
I20260709 13:15:24.741299  5224 consensus_queue.cc:1059] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:24.742424  5224 raft_consensus.cc:3055] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:24.742789  5224 raft_consensus.cc:740] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:24.743667  5224 consensus_queue.cc:260] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:24.740437 32020 rpcz_store.cc:276] 0709 13:15:18.101127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.101593 (+   466us) service_pool.cc:224] Handling call
0709 13:15:24.736848 (+6635255us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:24.268916 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:24.269489 (+   573us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:24.269529 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:15:24.269550 (+    21us) tablet.cc:662] Decoding operations
0709 13:15:24.270657 (+  1107us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:24.270741 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:24.270773 (+    32us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:15:24.271822 (+  1049us) tablet.cc:701] Row locks acquired
0709 13:15:24.271845 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:15:24.272009 (+   164us) write_op.cc:270] Start()
0709 13:15:24.272132 (+   123us) write_op.cc:276] Timestamp: P: 1783602924271958 usec, L: 0
0709 13:15:24.272158 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:15:24.281115 (+  8957us) log.cc:844] Serialized 4423 byte log entry
0709 13:15:24.502464 (+221349us) op_driver.cc:464] REPLICATION: finished
0709 13:15:24.613234 (+110770us) write_op.cc:301] APPLY: starting
0709 13:15:24.613332 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:24.621068 (+  7736us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:24.621173 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:24.689318 (+ 68145us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:24.689567 (+   249us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:15:24.689619 (+    52us) write_op.cc:312] APPLY: finished
0709 13:15:24.689959 (+   340us) log.cc:844] Serialized 105 byte log entry
0709 13:15:24.716631 (+ 26672us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:24.716769 (+   138us) write_op.cc:454] Released schema lock
0709 13:15:24.716816 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:24.718682 (+  1866us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:24.718739 (+    57us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1359730,"reported_tablets":11,"spinlock_wait_cycles":9600,"child_traces":[["op",{"apply.queue_time_us":110512,"apply.run_cpu_time_us":14998,"apply.run_wall_time_us":105262,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50217,"num_ops":11,"prepare.queue_time_us":113602,"prepare.run_cpu_time_us":6966,"prepare.run_wall_time_us":99832,"raft.queue_time_us":96145,"raft.run_cpu_time_us":42074,"raft.run_wall_time_us":100942,"replication_time_us":230132,"thread_start_us":289554,"threads_started":4,"wal-append.queue_time_us":80421}]]}
I20260709 13:15:24.737128  5828 consensus_queue.cc:1059] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:15:24.753917  5746 raft_consensus.cc:3055] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:24.754335  5746 raft_consensus.cc:740] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:24.753947  5224 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:24.755151  5746 consensus_queue.cc:260] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:24.756381  5746 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:24.779318 32018 catalog_manager.cc:5697] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 14 to 17, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 17 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:24.781742 32018 catalog_manager.cc:5697] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:24.784682 32018 catalog_manager.cc:5697] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:24.786398 32018 catalog_manager.cc:5697] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 11 to 14, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 14 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:24.789295 32018 catalog_manager.cc:5697] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 13 to 17, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 17 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:24.795889 32018 catalog_manager.cc:5697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:24.798334 32018 catalog_manager.cc:5697] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 11 to 14, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 14 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:24.800384 32018 catalog_manager.cc:5697] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 11 to 13, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 13 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:24.809026 32018 catalog_manager.cc:5697] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 12 to 13, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 13 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:24.812975 32018 catalog_manager.cc:5697] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 11 to 13, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 13 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:24.815606 32018 catalog_manager.cc:5697] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:24.861519 32020 catalog_manager.cc:5697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 20 to 22, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 22 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:24.863933 32020 catalog_manager.cc:5697] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 12 to 14, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 14 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:24.890246 32197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46032
I20260709 13:15:24.890856 32197 raft_consensus.cc:606] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 22 LEADER]: Received request to transfer leadership
I20260709 13:15:24.895371 32192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46032
I20260709 13:15:24.895944 32192 raft_consensus.cc:606] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 22 LEADER]: Received request to transfer leadership
W20260709 13:15:24.897274 32008 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 0cf85dc23ac44824a3668eb1b1f3aa42 already in progress [suppressed 4 similar messages]
I20260709 13:15:24.929420 32267 raft_consensus.cc:1275] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:15:24.931255  5771 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:24.934551 32197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46032
I20260709 13:15:24.935151 32197 raft_consensus.cc:606] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 22 LEADER]: Received request to transfer leadership
W20260709 13:15:24.937402 32018 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49534 (request call id 261) took 24297 ms (client timeout 15000 ms). Trace:
I20260709 13:15:24.937036 32017 catalog_manager.cc:5697] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:24.939630 32017 catalog_manager.cc:5697] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:24.947973 32017 catalog_manager.cc:5697] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 13 to 16, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 16 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:24.955870 32017 catalog_manager.cc:5697] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:24.958127 32017 catalog_manager.cc:5697] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:24.963371 32017 catalog_manager.cc:5697] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:24.965811 32017 catalog_manager.cc:5697] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 11 to 15, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 15 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:24.968253 32017 catalog_manager.cc:5697] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 14 to 15, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 15 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:24.969889 32017 catalog_manager.cc:5697] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:24.972484 32017 catalog_manager.cc:5697] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 10 to 11, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 11 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:24.974242 32017 catalog_manager.cc:5697] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 15 to 16, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 16 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:24.979329 32197 raft_consensus.cc:1275] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:15:24.979192 32017 catalog_manager.cc:5697] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 9 to 11, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 11 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:24.984140  5710 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:15:24.937896 32018 rpcz_store.cc:269] 0709 13:15:00.639647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:00.640677 (+  1030us) service_pool.cc:224] Handling call
0709 13:15:24.937321 (+24296644us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:24.825211 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:24.825750 (+   539us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:24.825789 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:15:24.825805 (+    16us) tablet.cc:662] Decoding operations
0709 13:15:24.826872 (+  1067us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:24.826934 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:24.826966 (+    32us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:15:24.828052 (+  1086us) tablet.cc:701] Row locks acquired
0709 13:15:24.828069 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:15:24.828231 (+   162us) write_op.cc:270] Start()
0709 13:15:24.828346 (+   115us) write_op.cc:276] Timestamp: P: 1783602924828179 usec, L: 0
0709 13:15:24.828366 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:15:24.829036 (+   670us) log.cc:844] Serialized 4348 byte log entry
0709 13:15:24.834128 (+  5092us) op_driver.cc:464] REPLICATION: finished
0709 13:15:24.834581 (+   453us) write_op.cc:301] APPLY: starting
0709 13:15:24.834659 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:24.840180 (+  5521us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:24.840284 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:24.850291 (+ 10007us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:24.850528 (+   237us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:15:24.850580 (+    52us) write_op.cc:312] APPLY: finished
0709 13:15:24.850919 (+   339us) log.cc:844] Serialized 105 byte log entry
0709 13:15:24.851104 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:24.851243 (+   139us) write_op.cc:454] Released schema lock
0709 13:15:24.851298 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:24.867269 (+ 15971us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:24.867298 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1744856,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":242,"apply.run_cpu_time_us":13220,"apply.run_wall_time_us":17034,"cfile_cache_hit":44,"cfile_cache_hit_bytes":46090,"num_ops":11,"prepare.queue_time_us":131,"prepare.run_cpu_time_us":4111,"prepare.run_wall_time_us":9318,"replication_time_us":5614,"spinlock_wait_cycles":44800}]]}
I20260709 13:15:24.986253 32017 catalog_manager.cc:5697] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 13 to 14, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 14 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:25.007419 32121 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:25.019479 32121 raft_consensus.cc:1275] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:15:25.021083   400 raft_consensus.cc:1275] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:15:25.000355 32017 catalog_manager.cc:5697] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:25.025450  5828 consensus_queue.cc:1048] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:15:25.036254  5778 consensus_queue.cc:1048] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:25.043041  5746 raft_consensus.cc:993] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801: : Instructing follower 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:15:25.044474  5767 raft_consensus.cc:1081] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 22 LEADER]: Signalling peer 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:15:25.048358 32273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:36080
I20260709 13:15:25.049155 32273 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:25.049678 32273 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:15:25.052737  5828 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:25.053398  5828 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:25.065567 32273 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:25.067430 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:25.067843 32273 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 23 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:25.068087 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:25.068722 32116 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:15:25.068122 32121 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 17.
I20260709 13:15:25.069037   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:25.069424 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:25.069650   400 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:15:25.078365 32192 raft_consensus.cc:3055] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:15:25.078872 32192 raft_consensus.cc:740] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:25.079532 32116 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 23.
I20260709 13:15:25.079682 32192 consensus_queue.cc:260] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:25.081598 32192 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:15:25.081676 32165 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:25.082832  5828 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:25.087050   400 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 23.
I20260709 13:15:25.088851  5746 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:25.092844 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:25.096994 32267 raft_consensus.cc:1275] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:25.097826 32264 raft_consensus.cc:1275] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:15:25.098917 32271 raft_consensus.cc:2393] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 17: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:25.099862 32236 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:25.097008  5746 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:25.100845  5588 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:15:25.101151  5746 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:25.101393  5588 raft_consensus.cc:697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:25.103073  5588 consensus_queue.cc:237] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:25.113541 32192 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 23.
I20260709 13:15:25.126245  5767 consensus_queue.cc:1048] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:25.131040 32018 catalog_manager.cc:5697] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 15 to 16, leader changed from 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 16 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:25.132447  5778 consensus_queue.cc:1048] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:25.133900 32273 raft_consensus.cc:1275] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:15:25.135171 32070 auto_rebalancer.cc:893] Removing replace marker failed: Replica 113b5461952d47e0944d463ea4e32801 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 23 committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:15:25.135614 32070 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 0cf85dc23ac44824a3668eb1b1f3aa42 already in progress
W20260709 13:15:25.135942 32070 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 0cf85dc23ac44824a3668eb1b1f3aa42 already in progress
I20260709 13:15:25.138459  5770 consensus_queue.cc:1048] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:25.141611 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:25.147437 32117 raft_consensus.cc:1275] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:25.149878 32117 raft_consensus.cc:1275] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:15:25.152247  5828 consensus_queue.cc:1048] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:25.159250  5820 consensus_queue.cc:1048] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:15:25.167711  5746 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:25.191529  5746 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:25.192889 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:25.193028 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:25.197038 32267 raft_consensus.cc:2393] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 17: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:25.220813 32121 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 17.
I20260709 13:15:25.222714 32165 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:25.224633  5778 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:25.225860  5778 raft_consensus.cc:697] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 17 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:25.227113  5778 consensus_queue.cc:237] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:25.289775  5821 log.cc:927] Time spent T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7: Append to log took a long time: real 0.081s	user 0.002s	sys 0.000s
I20260709 13:15:25.329210 32195 raft_consensus.cc:1275] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:15:25.332026  5570 consensus_queue.cc:1048] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:15:25.429319 32016 catalog_manager.cc:5697] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 14 to 15, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 15 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:25.431782 32016 catalog_manager.cc:5697] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 8 to 15. New cstate: current_term: 15 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:25.434201 32016 catalog_manager.cc:5697] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 17 to 19, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 19 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:25.446249 32016 catalog_manager.cc:5697] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 19 to 20, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 20 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:25.448755 32016 catalog_manager.cc:5697] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:25.451380 32016 catalog_manager.cc:5697] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 12 to 15, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 15 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:25.476812 32016 catalog_manager.cc:5697] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:25.489558 32016 catalog_manager.cc:5697] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:25.491678 32016 catalog_manager.cc:5697] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 14 to 18, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 18 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
W20260709 13:15:25.478433 32017 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49556 (request call id 255) took 18795 ms (client timeout 15000 ms). Trace:
W20260709 13:15:25.493259 32017 rpcz_store.cc:269] 0709 13:15:06.682904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.684011 (+  1107us) service_pool.cc:224] Handling call
0709 13:15:25.478306 (+18794295us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:25.201060 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:25.201899 (+   839us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:25.201957 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:15:25.201981 (+    24us) tablet.cc:662] Decoding operations
0709 13:15:25.203679 (+  1698us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:25.203738 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:25.203773 (+    35us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:15:25.206146 (+  2373us) tablet.cc:701] Row locks acquired
0709 13:15:25.206174 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:15:25.206389 (+   215us) write_op.cc:270] Start()
0709 13:15:25.206550 (+   161us) write_op.cc:276] Timestamp: P: 1783602925206327 usec, L: 0
0709 13:15:25.206584 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:15:25.208712 (+  2128us) log.cc:844] Serialized 5502 byte log entry
0709 13:15:25.291328 (+ 82616us) op_driver.cc:464] REPLICATION: finished
0709 13:15:25.291933 (+   605us) write_op.cc:301] APPLY: starting
0709 13:15:25.292024 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:25.302370 (+ 10346us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:25.302469 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:25.309399 (+  6930us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:25.309712 (+   313us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:15:25.309783 (+    71us) write_op.cc:312] APPLY: finished
0709 13:15:25.310236 (+   453us) log.cc:844] Serialized 129 byte log entry
0709 13:15:25.310458 (+   222us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:25.310655 (+   197us) write_op.cc:454] Released schema lock
0709 13:15:25.310727 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:25.384902 (+ 74175us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:25.384940 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8599,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":348,"apply.run_cpu_time_us":18467,"apply.run_wall_time_us":40245,"cfile_cache_hit":56,"cfile_cache_hit_bytes":58660,"num_ops":14,"prepare.queue_time_us":3803,"prepare.run_cpu_time_us":6141,"prepare.run_wall_time_us":13425,"replication_time_us":84555}]]}
I20260709 13:15:25.499112 32016 catalog_manager.cc:5697] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:25.502723 32016 catalog_manager.cc:5697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 12 to 16, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 16 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:25.510100 32016 catalog_manager.cc:5697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 15 to 18, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 18 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:25.512354 32016 catalog_manager.cc:5697] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 10 to 15, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 15 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:25.514405 32016 catalog_manager.cc:5697] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 11 to 12, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 12 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:25.516139 32016 catalog_manager.cc:5697] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:25.517963 32016 catalog_manager.cc:5697] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:25.531284 32016 catalog_manager.cc:5697] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 13 to 16, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 16 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:25.533782 32016 catalog_manager.cc:5697] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 12 to 13, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 13 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:25.528633  5767 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.535173  5767 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:25.535866 32197 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 23 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:15:25.537353  5767 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:25.537956 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:25.537815  5827 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:15:25.538615 32118 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 19.
I20260709 13:15:25.538424 32016 catalog_manager.cc:5697] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 10 to 12, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 12 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:25.542299 32016 catalog_manager.cc:5697] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 11 to 13, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 13 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:25.545648 32165 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:25.553238  5767 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:25.553721  5767 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.554118  5767 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:25.547176 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:25.554788 32264 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 19.
I20260709 13:15:25.561275 32016 catalog_manager.cc:5697] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 11 to 12, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 12 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:25.566181 32016 catalog_manager.cc:5697] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 15 to 16, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 16 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:25.570866 32016 catalog_manager.cc:5697] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:25.572494 32016 catalog_manager.cc:5697] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:25.585608 32016 catalog_manager.cc:5697] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 16 to 19, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 19 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:25.569553  5767 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:25.588702  5767 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:25.589305 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:25.589982 32116 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:25.590546 32016 catalog_manager.cc:5697] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:25.593174 32016 catalog_manager.cc:5697] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:25.593986 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:25.594588 32264 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:25.595291 32016 catalog_manager.cc:5697] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:25.597265 32016 catalog_manager.cc:5697] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 12 to 13, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 13 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:25.612018 32264 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 20.
I20260709 13:15:25.612269   396 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 23 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:15:25.615509  5827 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:15:25.627002 32165 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:25.627166 32116 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 20.
I20260709 13:15:25.632112  5767 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:15:25.632840  5767 raft_consensus.cc:697] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 20 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:25.633710  5767 consensus_queue.cc:237] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:25.647653  5710 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:25.648267  5710 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:25.651844 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:25.652868 32195 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
I20260709 13:15:25.658318  5710 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:25.659576 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:25.660420 32264 raft_consensus.cc:2393] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 15: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:25.660007 32089 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:25.672809  5710 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:25.673362  5710 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:25.673856  5710 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:25.680284 32264 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:15:25.680974  5827 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:25.686098 32118 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 23 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:15:25.687778  5827 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:25.690436  5827 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:25.691422 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:25.692279 32118 raft_consensus.cc:2393] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 11: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:25.693414   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:25.694276   400 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:15:25.696921  5827 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:15:25.698210 32236 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:25.699322  5627 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:25.699702  5627 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:25.701381  5849 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:15:25.700069  5627 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:25.718925  5773 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.719723  5773 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:25.723776   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 48144.7us
I20260709 13:15:25.726760 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:25.737422  5773 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:25.739416 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:25.740477 32197 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 19.
I20260709 13:15:25.742609   368 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:25.743790  5670 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:25.744228  5670 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.745406  5670 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:25.745671  5627 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:25.752170  5627 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:25.758414 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:25.758679  5710 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:25.759469 32121 raft_consensus.cc:2393] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 11: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:25.761693  5710 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:25.766263   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:25.766672 32117 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:15:25.766927 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:25.767726 32273 raft_consensus.cc:2393] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 15: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:25.771370  5820 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:25.772202 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:25.784828  5670 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:25.788113 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:25.793635 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:25.794194  5670 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:25.794313 32195 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:25.780299 32197 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
I20260709 13:15:25.798045   396 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:15:25.799269 32236 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:25.801249 32089 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:25.804176  5295 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:25.804767  5295 raft_consensus.cc:697] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:25.805745  5295 consensus_queue.cc:237] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:25.806702  5757 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:25.807296  5757 raft_consensus.cc:697] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:25.808164  5757 consensus_queue.cc:237] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:25.840869 32195 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 20.
I20260709 13:15:25.842193   368 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:25.846711  5588 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.847371  5670 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:15:25.847545  5588 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:25.848317  5670 raft_consensus.cc:697] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 20 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:25.852419 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:25.849309  5670 consensus_queue.cc:237] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:25.857848  5588 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:25.857446 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:25.863111 32195 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:15:25.864179  5295 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.864445 32238 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:25.864770  5295 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:25.866927  5295 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:25.867506  5757 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:25.867905  5757 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.868252  5757 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:25.868516 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:25.869171 32273 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:15:25.869591 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:25.870473 32090 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:25.875221  5570 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:25.875669  5570 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.876006  5570 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:25.876742  5770 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:25.877319  5770 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:25.879482  5770 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:25.881996   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:25.889729 32195 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:15:25.890969 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:25.891992 32192 raft_consensus.cc:2368] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 19. Current term is 20.
I20260709 13:15:25.897953 32089 leader_election.cc:400] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 19. Current term is 20.
I20260709 13:15:25.898305 32089 leader_election.cc:403] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:25.919286  5570 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:25.923657  5295 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:15:25.930295  5757 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:25.944623  5757 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:25.944816 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:25.945596 32192 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:25.945847 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:25.946532 32195 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:25.950429 32017 catalog_manager.cc:5697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 22 to 23, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 23 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:25.952975 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:25.955085  5295 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 19. Current term is 20.
I20260709 13:15:25.955981 32195 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:15:25.957258 32238 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:25.946022  5570 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:25.959628  5757 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:25.960820  5757 raft_consensus.cc:697] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:25.967773 32192 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
I20260709 13:15:25.971879 32089 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:25.972818  5866 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:25.973413  5866 raft_consensus.cc:697] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:25.974375  5866 consensus_queue.cc:237] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:25.974530  5757 consensus_queue.cc:237] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:25.978775 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 91267.2us
I20260709 13:15:25.985841 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:25.986553 32264 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:26.001331 32264 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
I20260709 13:15:26.013109  5686 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.013782  5686 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:26.016130  5686 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:26.017460 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:26.018456 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:26.019121 32116 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 22.
I20260709 13:15:26.020165 32239 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:26.021173  5686 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:15:26.021721  5686 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.022183  5686 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:15:26.058651  5820 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:26.060420  5820 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:26.064508 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:26.065241 32273 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:15:26.066293  5820 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:26.064258 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:26.067291 32116 raft_consensus.cc:2393] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 16: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:26.069950 32165 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:26.072476  5820 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:26.073060  5820 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:26.073582  5820 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:26.074966  5686 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:26.082223 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:26.083716 32116 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:15:26.087807  5820 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:26.090754 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:26.091581 32118 raft_consensus.cc:2393] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 16: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:26.092949 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:26.095367 32116 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 23.
I20260709 13:15:26.096751 32239 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:26.098076  5588 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:15:26.098670  5588 raft_consensus.cc:697] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:26.099673  5588 consensus_queue.cc:237] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:26.107905 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:26.107617  5686 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 23 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:26.110342 32264 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:15:26.097357  5820 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:26.112790 32165 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:26.114174  5820 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:26.115020  5820 raft_consensus.cc:697] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:26.116173  5820 consensus_queue.cc:237] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:26.142200 32017 catalog_manager.cc:5697] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:26.145450  5866 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.136879 32016 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49556 (request call id 256) took 1932 ms. Trace:
I20260709 13:15:26.146060  5866 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:26.148541  5866 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:26.150184 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:26.152735  5849 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.153270  5849 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:26.154664   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:26.155251   396 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:15:26.157998  5849 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:26.159750 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:26.160370 32116 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:15:26.161504 32087 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:26.163143  5863 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:26.163530  5863 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.163852  5863 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:26.163779 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:26.169807 32165 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:26.172886  5828 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:26.173331  5828 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.173671  5828 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:26.181787  5863 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:26.184988  5863 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:26.184907 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:26.192080   396 raft_consensus.cc:1275] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:26.195201  5686 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:26.195793  5686 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:26.197773  5757 consensus_queue.cc:1048] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:15:26.199621  5820 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:26.199234 32273 raft_consensus.cc:1275] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:15:26.200318  5820 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:26.146759 32016 rpcz_store.cc:276] 0709 13:15:24.199069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.199408 (+   339us) service_pool.cc:224] Handling call
0709 13:15:26.131277 (+1931869us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:25.648823 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:25.649522 (+   699us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:25.649569 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:15:25.649590 (+    21us) tablet.cc:662] Decoding operations
0709 13:15:25.652765 (+  3175us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:25.652836 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:25.652868 (+    32us) tablet.cc:685] Acquiring locks for 29 operations
0709 13:15:25.656734 (+  3866us) tablet.cc:701] Row locks acquired
0709 13:15:25.656774 (+    40us) write_op.cc:260] PREPARE: finished
0709 13:15:25.656979 (+   205us) write_op.cc:270] Start()
0709 13:15:25.657133 (+   154us) write_op.cc:276] Timestamp: P: 1783602925656911 usec, L: 0
0709 13:15:25.657162 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:15:25.659274 (+  2112us) log.cc:844] Serialized 11228 byte log entry
0709 13:15:25.663506 (+  4232us) op_driver.cc:464] REPLICATION: finished
0709 13:15:25.664071 (+   565us) write_op.cc:301] APPLY: starting
0709 13:15:25.664179 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:25.736330 (+ 72151us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:25.736449 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:25.881283 (+144834us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:25.908568 (+ 27285us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=58,key_file_lookups=58,delta_file_lookups=58,mrs_lookups=0
0709 13:15:25.908638 (+    70us) write_op.cc:312] APPLY: finished
0709 13:15:25.909126 (+   488us) log.cc:844] Serialized 252 byte log entry
0709 13:15:25.910059 (+   933us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:25.910284 (+   225us) write_op.cc:454] Released schema lock
0709 13:15:25.910345 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:25.948993 (+ 38648us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:25.949028 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":49600,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":331,"apply.run_cpu_time_us":38282,"apply.run_wall_time_us":284827,"cfile_cache_hit":116,"cfile_cache_hit_bytes":121510,"num_ops":29,"prepare.queue_time_us":11810,"prepare.run_cpu_time_us":8450,"prepare.run_wall_time_us":11705,"replication_time_us":6187}]]}
I20260709 13:15:26.198083  5686 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:26.199568 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:26.203673  5849 consensus_queue.cc:1048] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:15:26.204504  5820 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:26.206462 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:26.207163 32118 raft_consensus.cc:2393] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 13: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:26.208662   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:26.210214 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:26.210601 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:26.212695 32118 raft_consensus.cc:2368] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 22. Current term is 23.
I20260709 13:15:26.213840 32087 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:26.214537  5865 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:15:26.216111 32165 leader_election.cc:400] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 22. Current term is 23.
I20260709 13:15:26.216471 32165 leader_election.cc:403] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:26.217129  5767 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:15:26.223186  5828 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:26.229128 32192 raft_consensus.cc:2368] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14.
I20260709 13:15:26.239114  5828 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:26.240315 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:26.247690 32271 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:15:26.248781 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:26.249369 32116 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:26.241343 32118 raft_consensus.cc:1240] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:26.255263 32238 leader_election.cc:400] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14.
I20260709 13:15:26.255667 32238 leader_election.cc:403] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:26.258257  5757 consensus_queue.cc:1059] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:26.259168  5757 raft_consensus.cc:3055] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:26.259570  5757 raft_consensus.cc:740] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:26.258984 32271 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:15:26.242302  5767 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 22. Current term is 23.
I20260709 13:15:26.260342  5827 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14.
I20260709 13:15:26.261983  5757 consensus_queue.cc:260] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:26.263224 32273 raft_consensus.cc:1240] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:26.263916  5757 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:26.255410 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:26.265413  5863 consensus_queue.cc:1059] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:26.266150  5863 consensus_queue.cc:1243] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer 6b3ed521ce8947db80c4b4828b355c06 log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:15:26.266652  5863 raft_consensus.cc:3055] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:26.267007  5863 raft_consensus.cc:740] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:26.256089 32116 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:15:26.273383 32017 catalog_manager.cc:5697] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 10 to 11, leader changed from 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 11 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:26.276172  5863 consensus_queue.cc:260] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:26.277686  5863 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:26.278172 32165 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:26.279036  5849 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:26.279538  5849 raft_consensus.cc:697] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:26.280356  5849 consensus_queue.cc:237] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:26.290405 32116 raft_consensus.cc:1275] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:15:26.292022  5828 consensus_queue.cc:1048] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:15:26.316431  5865 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.317023  5865 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:26.319334  5865 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:26.321972 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:26.322913 32273 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 16.
I20260709 13:15:26.324221 32090 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:26.325212  5865 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:26.325657  5865 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.326136  5865 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:26.343355 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:26.343072  5865 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:26.347522 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:26.357962 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:26.358666 32264 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:26.364023  5865 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:26.369220 32264 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17.
I20260709 13:15:26.374231 32090 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:26.375337  5866 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:26.375903  5866 raft_consensus.cc:697] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:26.376734  5866 consensus_queue.cc:237] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:26.393082 32192 raft_consensus.cc:1275] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:15:26.394351  5588 consensus_queue.cc:1048] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:26.407264 32016 catalog_manager.cc:5697] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 17 to 23, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 23 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:26.408923 32016 catalog_manager.cc:5697] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 15 to 16, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 16 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:26.410137 32016 catalog_manager.cc:5697] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 13 to 16, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 16 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:26.430742 32116 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:15:26.432687  5855 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:15:26.412433 32016 catalog_manager.cc:5697] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 16 to 17, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 17 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:26.446947 32116 raft_consensus.cc:1275] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:15:26.447397 32116 pending_rounds.cc:85] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d: Aborting all ops after (but not including) 9
I20260709 13:15:26.447625 32116 pending_rounds.cc:107] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:15:26.447854 32116 raft_consensus.cc:2889] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:26.453421  5757 consensus_queue.cc:1048] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:26.463781 32195 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:15:26.465566  5670 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:15:27.069484 32273 raft_consensus.cc:1240] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:27.078581 32271 raft_consensus.cc:1275] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:15:27.110271 32118 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.020s	sys 0.007s
W20260709 13:15:27.110797 32118 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.020s	sys 0.007s
I20260709 13:15:27.127964 32118 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 23 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:15:27.142906 32123 raft_consensus.cc:1275] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:15:27.207442  5893 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:15:27.308502  5828 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:27.334308 32118 raft_consensus.cc:1240] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:27.336812 32199 raft_consensus.cc:1275] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:15:27.346063  5904 consensus_queue.cc:1048] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:15:27.348348  5887 consensus_queue.cc:1059] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:15:27.395402 32264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:15:27.396018 32264 raft_consensus.cc:606] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:15:27.401010  5887 consensus_queue.cc:1243] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer fcfc3281929645969ecedbb0c0af759d log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:15:27.402309  5767 consensus_queue.cc:1059] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:27.403357  5849 raft_consensus.cc:3055] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:27.396435 32264 raft_consensus.cc:614] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:27.403764  5849 raft_consensus.cc:740] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:27.411360  5849 consensus_queue.cc:260] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:27.412626 32009 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ddd7dfc158794e3ab7427d0b86b46c8d with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 6b3ed521ce8947db80c4b4828b355c06 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 12 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:27.413019  5849 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:27.415889 32196 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 23 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:15:27.419507 32264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
W20260709 13:15:27.420101 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 51927.9us
I20260709 13:15:27.420456 32264 raft_consensus.cc:606] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:15:27.423210  5828 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:27.424765 32264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:15:27.425674 32264 raft_consensus.cc:606] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:15:27.430711  5885 raft_consensus.cc:993] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:15:27.431223  5885 raft_consensus.cc:1081] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:15:27.439239 32273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d002861120de41408d48712b6bd491e1"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:15:27.439939 32273 raft_consensus.cc:606] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:27.455175 32273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:15:27.455859 32273 raft_consensus.cc:606] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:15:27.457283 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:15:27.456801 32016 catalog_manager.cc:5697] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 16 to 17, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 17 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:27.458284 32016 catalog_manager.cc:5697] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 18 to 19, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 19 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:27.459615 32016 catalog_manager.cc:5697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 18 to 19, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 19 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:27.482244 32197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:15:27.483139 32197 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:27.483594 32197 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:27.490556  5627 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:27.491770  5627 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:27.494081  5627 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:27.497763 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:27.519665 32192 raft_consensus.cc:1275] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:15:27.520117 32192 pending_rounds.cc:85] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 9
I20260709 13:15:27.520334 32192 pending_rounds.cc:107] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:15:27.520533 32192 raft_consensus.cc:2889] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:27.527347 32197 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:27.547039   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 197600us
I20260709 13:15:27.551175 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:27.552098 32117 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:27.553719 32197 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:27.557149 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 56941.3us
W20260709 13:15:27.556740 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 70541.6us
I20260709 13:15:27.560217 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:27.560818 32273 raft_consensus.cc:3055] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:27.561138 32273 raft_consensus.cc:740] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:27.561638 32270 raft_consensus.cc:1275] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:15:27.561842 32273 consensus_queue.cc:260] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:27.563119 32273 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:27.565743 32271 raft_consensus.cc:1275] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:15:27.578370 32117 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
I20260709 13:15:27.587505 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:27.565840  5891 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:27.583473 32016 catalog_manager.cc:5697] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:27.592973 32165 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:27.584602 32273 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
I20260709 13:15:27.565044  5746 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:27.627202 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:15:27.632130 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 68370.6us
I20260709 13:15:27.588783  5891 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:27.636878  5922 consensus_queue.cc:1048] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:27.637565 32019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49534 (request call id 262) took 8418 ms. Trace:
I20260709 13:15:27.574939  5588 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 13:15:27.637938 32019 rpcz_store.cc:276] 0709 13:15:19.164717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.165652 (+   935us) service_pool.cc:224] Handling call
0709 13:15:19.301556 (+135904us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b5400047c54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5b090 00007fb59eff9f3a 00007fb5a4db01cc 00007fb5a4eae37e 00007fb5a336f2a4 00007fb5a336f232 00007fb5a336f161 00007fb5a336f0dc 00007fb5a336e392 00007fb59d32c48c 00007fb59d32b8c6
0709 13:15:27.582981 (+8281425us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":399846,"reported_tablets":54,"spinlock_wait_cycles":52111616}
I20260709 13:15:27.614918  5892 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:15:27.688791 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 49097.4us
I20260709 13:15:27.629428  5746 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:15:27.695971  5904 consensus_queue.cc:1048] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
W20260709 13:15:27.701656   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 153818us
I20260709 13:15:27.717633 32022 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49550 (request call id 261) took 10704 ms. Trace:
I20260709 13:15:27.718356 32022 rpcz_store.cc:276] 0709 13:15:17.013147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.013342 (+   195us) service_pool.cc:224] Handling call
0709 13:15:27.717386 (+10704044us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1153224,"reported_tablets":55,"spinlock_wait_cycles":164096}
W20260709 13:15:27.728569 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 86352.7us
I20260709 13:15:27.674675  5892 raft_consensus.cc:697] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
W20260709 13:15:27.761435   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 327679us
W20260709 13:15:27.764804   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 59276.7us
I20260709 13:15:27.642380  5920 consensus_queue.cc:1048] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.078s
W20260709 13:15:27.779906  5914 log.cc:927] Time spent T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:15:27.786223  5902 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:27.787035  5913 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:27.786800  5902 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:27.787683  5913 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:27.789834  5902 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:27.798424 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:27.802668  5892 consensus_queue.cc:237] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:27.752498  5820 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:27.821884  5886 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.822495  5886 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:27.824712  5886 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:27.812356  5820 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:27.827440  5891 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:27.837419  5746 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:27.839447  5820 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:27.836222  5913 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:27.847074  5856 raft_consensus.cc:993] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:15:27.847841  5856 raft_consensus.cc:1081] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:15:27.860162  5897 raft_consensus.cc:993] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:15:27.860769  5897 raft_consensus.cc:1081] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:15:27.954456  5903 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:27.984103  5903 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:27.984179   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:27.987977  5903 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:27.915438 32193 consensus_queue.cc:237] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:15:27.948789  5767 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:27.995796  5767 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:28.000996 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:27.923187 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:28.015744 32117 raft_consensus.cc:2393] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 12: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:28.025599 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:28.027693 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:15:28.053779 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 133605us
I20260709 13:15:28.057158  5767 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:28.071903  5941 log.cc:927] Time spent T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:15:28.074033 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:28.074867 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:28.094410  5856 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.114916  5856 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:28.112321 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:15:28.117262 32145 debug-util.cc:398] Leaking SignalData structure 0x7b08003b3f80 after lost signal to thread 30975
I20260709 13:15:28.098224 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:28.101198 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:15:28.119215 32145 debug-util.cc:398] Leaking SignalData structure 0x7b08003cd0a0 after lost signal to thread 32056
I20260709 13:15:28.117233 32264 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 12.
I20260709 13:15:28.120927 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:28.095306 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:15:28.122933 32145 debug-util.cc:398] Leaking SignalData structure 0x7b08002eeca0 after lost signal to thread 32148
W20260709 13:15:28.124821 32145 debug-util.cc:398] Leaking SignalData structure 0x7b0800050440 after lost signal to thread 32223
W20260709 13:15:28.127140 32145 debug-util.cc:398] Leaking SignalData structure 0x7b08000c57e0 after lost signal to thread 32297
W20260709 13:15:28.127506 32145 debug-util.cc:398] Leaking SignalData structure 0x7b08000ee920 after lost signal to thread 32298
I20260709 13:15:28.121423  5856 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:15:28.129442 32145 debug-util.cc:398] Leaking SignalData structure 0x7b080021c380 after lost signal to thread 427
W20260709 13:15:28.131884 32162 consensus_peers.cc:597] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 314924e72a7f4efa9cbae136ba7cd259. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:28.133641   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:28.134423   396 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:15:28.135748 32236 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:28.136695  5856 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:28.137156  5856 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.137568  5856 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:28.144245 32238 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:28.145517  5897 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:28.169672 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:28.187201 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:28.194893 32267 raft_consensus.cc:1275] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:15:28.193375 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:28.192293 32090 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:28.207115  5856 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:28.208092  5903 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:28.208894 32118 raft_consensus.cc:1275] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:15:28.215128  5886 raft_consensus.cc:993] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:15:28.215654  5886 raft_consensus.cc:1081] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Signalling peer fcfc3281929645969ecedbb0c0af759d to start an election
W20260709 13:15:28.270747 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.286584   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:28.287281   396 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:15:28.300884   396 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:15:28.304379 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:28.310844 32016 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49556 (request call id 257) took 1990 ms. Trace:
I20260709 13:15:28.312776 32123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d002861120de41408d48712b6bd491e1"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:56890
I20260709 13:15:28.320253 32123 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:28.316175 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:28.319054 32236 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:28.319006 32115 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
W20260709 13:15:28.313894 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 48261us
I20260709 13:15:28.320823 32123 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:28.317516  5856 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:28.324564  5897 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:28.328810 32238 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:28.337572  5885 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:28.335289  5897 raft_consensus.cc:697] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:28.348243 32238 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:28.351343  5897 consensus_queue.cc:237] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:28.352931  5891 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:15:28.366839 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 134498us
I20260709 13:15:28.374145 32197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:15:28.374797 32197 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:28.375193 32197 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:28.375506 32195 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:15:28.376050 32195 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:28.376413 32195 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:28.321559 32016 rpcz_store.cc:276] 0709 13:15:26.320484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.322830 (+  2346us) service_pool.cc:224] Handling call
0709 13:15:28.310582 (+1987752us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:27.821294 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:27.822040 (+   746us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:27.822075 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:15:27.822094 (+    19us) tablet.cc:662] Decoding operations
0709 13:15:27.822986 (+   892us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:27.823059 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:27.823093 (+    34us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:15:27.823736 (+   643us) tablet.cc:701] Row locks acquired
0709 13:15:27.823757 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:15:27.823910 (+   153us) write_op.cc:270] Start()
0709 13:15:27.824018 (+   108us) write_op.cc:276] Timestamp: P: 1783602927823848 usec, L: 0
0709 13:15:27.824039 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:15:27.834367 (+ 10328us) log.cc:844] Serialized 3210 byte log entry
0709 13:15:28.017699 (+183332us) op_driver.cc:464] REPLICATION: finished
0709 13:15:28.162706 (+145007us) write_op.cc:301] APPLY: starting
0709 13:15:28.162823 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:28.228994 (+ 66171us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:28.229136 (+   142us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:28.234339 (+  5203us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:28.234699 (+   360us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:15:28.234769 (+    70us) write_op.cc:312] APPLY: finished
0709 13:15:28.235239 (+   470us) log.cc:844] Serialized 81 byte log entry
0709 13:15:28.240261 (+  5022us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:28.240610 (+   349us) write_op.cc:454] Released schema lock
0709 13:15:28.240692 (+    82us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:28.300909 (+ 60217us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:28.301145 (+   236us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1204333,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":144646,"apply.run_cpu_time_us":14419,"apply.run_wall_time_us":138138,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37647,"num_ops":8,"prepare.queue_time_us":179344,"prepare.run_cpu_time_us":17394,"prepare.run_wall_time_us":43742,"raft.queue_time_us":122881,"raft.run_cpu_time_us":20107,"raft.run_wall_time_us":166014,"replication_time_us":168235,"thread_start_us":528330,"threads_started":4,"wal-append.queue_time_us":31590}]]}
I20260709 13:15:28.391196 32123 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:28.394528 32124 raft_consensus.cc:1240] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:28.398782  5885 consensus_queue.cc:1059] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:15:28.399849 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:28.400393  5856 raft_consensus.cc:3055] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:28.400821  5856 raft_consensus.cc:740] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:28.401731  5856 consensus_queue.cc:260] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:28.402940  5856 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:28.404412 32123 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:28.405470 32195 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:28.410351   369 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:28.422123  5947 log.cc:927] Time spent T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:15:28.421844 32022 catalog_manager.cc:5697] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 17 to 18, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 18 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:28.418653 32197 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:28.424999 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 57515.5us
I20260709 13:15:28.423820 32022 catalog_manager.cc:5697] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 15 to 17, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 17 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:28.427709 32193 raft_consensus.cc:1240] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:28.428184 32022 catalog_manager.cc:5697] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:28.430619   369 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:28.431670  5670 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:28.431419 32022 catalog_manager.cc:5697] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 12 to 14, now has a pending config: VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1), VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2), VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3), NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 14 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:15:28.433270 32191 raft_consensus.cc:1240] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:28.433960 32022 catalog_manager.cc:5697] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 12 to 15, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 15 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:28.434828  5913 raft_consensus.cc:2764] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:15:28.434996  5948 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:28.437979 32195 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:28.438660 32268 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 19.
I20260709 13:15:28.450541   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:28.450801 32090 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:28.451264   396 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:28.451920  5904 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:28.452679  5904 raft_consensus.cc:697] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:28.453653  5904 consensus_queue.cc:237] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:28.459472   396 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:15:28.466115 32197 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:28.472090 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:28.472779 32121 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:28.473083 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:28.476122 32271 raft_consensus.cc:3055] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:28.476421 32271 raft_consensus.cc:740] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:28.477867 32123 raft_consensus.cc:1275] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:15:28.478123 32271 consensus_queue.cc:260] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:28.479629 32271 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:28.481119  5884 consensus_queue.cc:1059] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:28.482165  5884 raft_consensus.cc:3055] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:28.482548  5884 raft_consensus.cc:740] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:28.483426  5884 consensus_queue.cc:260] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:28.486409  5884 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:28.505856 32121 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
I20260709 13:15:28.512169  5952 ts_tablet_manager.cc:933] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:28.512306 32271 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
I20260709 13:15:28.523940  5952 tablet_copy_client.cc:323] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Beginning tablet copy session from remote peer at address 127.30.63.2:44517
I20260709 13:15:28.526337 32209 tablet_copy_service.cc:140] P 113b5461952d47e0944d463ea4e32801: Received BeginTabletCopySession request for tablet 314924e72a7f4efa9cbae136ba7cd259 from peer 94085cf341634eb686a95983b6b7f7e6 ({username='slave'} at 127.0.0.1:56926)
I20260709 13:15:28.526929 32209 tablet_copy_service.cc:161] P 113b5461952d47e0944d463ea4e32801: Beginning new tablet copy session on tablet 314924e72a7f4efa9cbae136ba7cd259 from peer 94085cf341634eb686a95983b6b7f7e6 at {username='slave'} at 127.0.0.1:56926: session id = 94085cf341634eb686a95983b6b7f7e6-314924e72a7f4efa9cbae136ba7cd259
I20260709 13:15:28.547027 32209 tablet_copy_source_session.cc:215] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:28.554778 32165 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:28.562439  5952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 314924e72a7f4efa9cbae136ba7cd259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:28.574435  5888 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:28.579850 32165 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:28.583241  5820 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:28.594482 32165 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:28.596470  5948 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:28.601413 32019 catalog_manager.cc:5697] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:28.617390  5820 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:15:28.625969 32165 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:28.626609  5820 consensus_queue.cc:1048] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:28.627463  5746 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:28.628856  5746 raft_consensus.cc:697] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:28.629563 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:28.630167 32191 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:28.629802  5746 consensus_queue.cc:237] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:28.630663 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:28.645157 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:28.645821 32269 raft_consensus.cc:1275] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:15:28.653095 32191 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 19.
I20260709 13:15:28.656309 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:28.656919 32115 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:28.658878 32271 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:15:28.664463 32115 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:15:28.671680  5888 raft_consensus.cc:2955] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:15:28.700263 32271 consensus_queue.cc:237] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:28.725549 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 54933.6us
I20260709 13:15:28.730495 32264 consensus_queue.cc:237] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:15:28.734216  5948 consensus_queue.cc:1048] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:28.755786 32165 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
W20260709 13:15:28.766588 32236 consensus_peers.cc:597] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2ec7a9cf151948fdaa078aba5fb1df43. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:28.725970  5952 tablet_copy_client.cc:806] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:28.777277 32121 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 23 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:15:28.771541 32267 raft_consensus.cc:2955] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:15:28.802325  5890 raft_consensus.cc:2804] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:28.803020  5890 raft_consensus.cc:697] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 13 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:28.790526  5952 tablet_copy_client.cc:670] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:28.822976  5952 tablet_copy_client.cc:538] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:28.841750 32191 raft_consensus.cc:1275] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:15:28.804066  5890 consensus_queue.cc:237] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:28.847769  5959 consensus_queue.cc:1048] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:28.855443  5885 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:15:28.861094 32123 raft_consensus.cc:1275] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:15:28.862383 32016 catalog_manager.cc:5697] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 18 to 19, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 19 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:28.905342   396 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 23 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:15:28.908361 32118 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:28.912894  5886 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:15:28.872807  5885 consensus_queue.cc:1048] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:15:28.921895 32118 raft_consensus.cc:1275] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:15:28.923877  5886 consensus_queue.cc:1048] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:28.941206  5952 tablet_bootstrap.cc:492] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap starting.
I20260709 13:15:28.983264 32115 raft_consensus.cc:2955] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:15:28.988436 32019 catalog_manager.cc:5697] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 17 to 18, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 18 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:29.000685  5891 raft_consensus.cc:2955] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 LEADER]: Committing config change with OpId 23.16: config changed from index 11 to 16, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:15:29.032738  5963 log.cc:927] Time spent T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:15:29.057139 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 73752.8us
I20260709 13:15:29.059414   396 raft_consensus.cc:1275] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:15:29.060853   400 raft_consensus.cc:2955] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 11 to 16, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:29.061147 32116 raft_consensus.cc:2955] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 11 to 16, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:15:29.078732 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 61809.8us
I20260709 13:15:29.082808  5885 consensus_queue.cc:1048] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:29.109108 32016 catalog_manager.cc:5697] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: config changed from index -1 to 11, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added, no longer has a pending config: VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1), VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2), VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3), NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 14 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:15:29.130299 32265 raft_consensus.cc:1275] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:15:29.145735 32022 catalog_manager.cc:5697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 11 to 16, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New cstate: current_term: 23 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:29.149636 32195 raft_consensus.cc:1275] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:15:29.169096 32115 raft_consensus.cc:1275] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:15:29.192723  5966 consensus_queue.cc:1048] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:15:29.192116  5627 raft_consensus.cc:2955] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
W20260709 13:15:29.193823  5970 log.cc:927] Time spent T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.052s	user 0.004s	sys 0.000s
I20260709 13:15:29.210306  5973 consensus_queue.cc:1048] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:15:29.213274 32181 tablet_service.cc:1558] Processing DeleteTablet for tablet 0cf85dc23ac44824a3668eb1b1f3aa42 with delete_type TABLET_DATA_TOMBSTONED (TS 113b5461952d47e0944d463ea4e32801 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:46032
W20260709 13:15:29.237210 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 78706.3us
W20260709 13:15:29.246521 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 75972.1us
W20260709 13:15:29.248363  5977 log.cc:927] Time spent T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:15:29.265978  5984 tablet_replica.cc:333] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:15:29.270692 32117 raft_consensus.cc:2955] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:15:29.312469 32265 raft_consensus.cc:1275] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:15:29.324905   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 46969.5us
I20260709 13:15:29.309341  5919 consensus_queue.cc:1048] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:15:29.372797  5980 ts_tablet_manager.cc:933] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:29.370584 32195 raft_consensus.cc:2955] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:15:29.384997 32009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0cf85dc23ac44824a3668eb1b1f3aa42 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:29.420642  5984 raft_consensus.cc:2243] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:29.526906 32265 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:15:29.529134 32116 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:15:29.539552  5984 raft_consensus.cc:2272] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:29.547374 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 172187us
I20260709 13:15:29.554157  5980 tablet_copy_client.cc:323] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Beginning tablet copy session from remote peer at address 127.30.63.3:36651
I20260709 13:15:29.598946  5984 ts_tablet_manager.cc:1916] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:29.598361  5960 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:15:29.563778  5966 consensus_queue.cc:1048] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
W20260709 13:15:29.664060 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 118103us
W20260709 13:15:29.673689 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 97803.5us
I20260709 13:15:29.768725 32282 tablet_copy_service.cc:140] P 6b3ed521ce8947db80c4b4828b355c06: Received BeginTabletCopySession request for tablet 2ec7a9cf151948fdaa078aba5fb1df43 from peer 94085cf341634eb686a95983b6b7f7e6 ({username='slave'} at 127.0.0.1:50584)
I20260709 13:15:29.769380 32282 tablet_copy_service.cc:161] P 6b3ed521ce8947db80c4b4828b355c06: Beginning new tablet copy session on tablet 2ec7a9cf151948fdaa078aba5fb1df43 from peer 94085cf341634eb686a95983b6b7f7e6 at {username='slave'} at 127.0.0.1:50584: session id = 94085cf341634eb686a95983b6b7f7e6-2ec7a9cf151948fdaa078aba5fb1df43
W20260709 13:15:29.806931 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 107779us
I20260709 13:15:29.824994 32282 tablet_copy_source_session.cc:215] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:29.844833   400 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:15:29.860829 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:29.903596 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 62364.9us
I20260709 13:15:29.983632  5980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec7a9cf151948fdaa078aba5fb1df43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:30.042089  6022 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:15:30.049423  5820 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:15:30.067198 32019 catalog_manager.cc:5697] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 12 to 13, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 13 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:30.173844  5984 ts_tablet_manager.cc:1929] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 23.15
I20260709 13:15:30.212361  5984 log.cc:1199] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 113b5461952d47e0944d463ea4e32801: Deleting WAL directory at /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-1-root/wals/0cf85dc23ac44824a3668eb1b1f3aa42
I20260709 13:15:30.215823 32022 catalog_manager.cc:5697] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d reported cstate change: config changed from index -1 to 10, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New cstate: current_term: 16 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:15:30.242306  5984 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46032 (request call id 8) took 1029 ms. Trace:
I20260709 13:15:30.242780  5984 rpcz_store.cc:276] 0709 13:15:29.212707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.212986 (+   279us) service_pool.cc:224] Handling call
0709 13:15:29.265523 (+ 52537us) ts_tablet_manager.cc:1151] Deleting tablet 0cf85dc23ac44824a3668eb1b1f3aa42
0709 13:15:29.265617 (+    94us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:15:29.789453 (+523836us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:30.157028 (+367575us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:30.242191 (+ 85163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9050,"tablet-delete.queue_time_us":51492,"thread_start_us":26218,"threads_started":1}
I20260709 13:15:30.245376 32008 catalog_manager.cc:5028] TS 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): tablet 0cf85dc23ac44824a3668eb1b1f3aa42 (table test-workload [id=9b9dc20f98e547b59efac9c530f28125]) successfully deleted
I20260709 13:15:30.267995  5952 tablet_bootstrap.cc:492] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:15:30.332495  5952 tablet_bootstrap.cc:492] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap complete.
I20260709 13:15:30.407543  5980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:38164 (request call id 443) took 1259 ms. Trace:
I20260709 13:15:30.408120  5980 rpcz_store.cc:276] 0709 13:15:29.148478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.148632 (+   154us) service_pool.cc:224] Handling call
0709 13:15:29.373201 (+224569us) ts_tablet_manager.cc:934] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
0709 13:15:29.928818 (+555617us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:15:30.342446 (+413628us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:30.361224 (+ 18778us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:15:30.406798 (+ 45574us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:15:30.407085 (+   287us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:30.407384 (+   299us) ts_tablet_manager.cc:989] Replica registered.
0709 13:15:30.407452 (+    68us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":328,"tablet-copy.queue_time_us":159174,"thread_start_us":270741,"threads_started":2}
I20260709 13:15:30.410552  5952 ts_tablet_manager.cc:1403] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6: Time spent bootstrapping tablet: real 1.470s	user 0.072s	sys 0.062s
I20260709 13:15:30.427462  5980 tablet_copy_client.cc:806] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:30.438791  5980 tablet_copy_client.cc:670] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:30.441897 32267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:15:30.442658 32267 raft_consensus.cc:606] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:30.468268 32269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:15:30.469026 32269 raft_consensus.cc:606] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:15:30.475502 32195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:15:30.476125 32195 raft_consensus.cc:606] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:30.460922  5980 tablet_copy_client.cc:538] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:30.490151  5952 raft_consensus.cc:359] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 14 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:30.491518  5952 raft_consensus.cc:740] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Initialized, Role: LEARNER
I20260709 13:15:30.492424  5952 consensus_queue.cc:260] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:15:30.494724 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:15:30.495144  5952 ts_tablet_manager.cc:1434] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6: Time spent starting tablet: real 0.074s	user 0.006s	sys 0.001s
I20260709 13:15:30.496894 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:30.500155 32209 tablet_copy_service.cc:342] P 113b5461952d47e0944d463ea4e32801: Request end of tablet copy session 94085cf341634eb686a95983b6b7f7e6-314924e72a7f4efa9cbae136ba7cd259 received from {username='slave'} at 127.0.0.1:56926
I20260709 13:15:30.500725 32209 tablet_copy_service.cc:434] P 113b5461952d47e0944d463ea4e32801: ending tablet copy session 94085cf341634eb686a95983b6b7f7e6-314924e72a7f4efa9cbae136ba7cd259 on tablet 314924e72a7f4efa9cbae136ba7cd259 with peer 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:30.527050 32117 consensus_queue.cc:237] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:15:30.541589  5948 raft_consensus.cc:993] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801: : Instructing follower fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:15:30.542121  5948 raft_consensus.cc:1081] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Signalling peer fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:15:30.545058  5856 raft_consensus.cc:993] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:15:30.545611  5856 raft_consensus.cc:1081] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Signalling peer fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:15:30.549628 32119 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:56890
I20260709 13:15:30.550309 32119 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:30.550686 32119 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:30.551570 32118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:56884
I20260709 13:15:30.552161 32118 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:30.552517 32118 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:30.563994  5856 raft_consensus.cc:993] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:15:30.568899 32119 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:30.569226 32118 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:30.567021  5856 raft_consensus.cc:1081] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:15:30.572667 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:30.573143 32195 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:15:30.573320 32264 raft_consensus.cc:3055] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:30.573614 32264 raft_consensus.cc:740] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:30.573671 32195 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:30.574433 32264 consensus_queue.cc:260] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:30.574110 32195 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:30.575616 32264 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:30.571442 32119 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:30.584189 32267 raft_consensus.cc:1275] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:15:30.585068 32195 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:30.586992 32019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49550 (request call id 265) took 1459 ms. Trace:
I20260709 13:15:30.587203 32118 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:30.588655 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:30.589254 32269 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:30.592168 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:30.592913 32198 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:15:30.594902 32087 consensus_peers.cc:597] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a75997deb5a741f998b671928aad3637. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:30.597237 32195 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:30.598958 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:30.599581 32193 raft_consensus.cc:3055] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:30.599865 32193 raft_consensus.cc:740] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:30.600715 32193 consensus_queue.cc:260] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:30.602023 32193 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:30.605031  5975 consensus_queue.cc:1048] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:30.628505 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:30.629223 32267 raft_consensus.cc:3055] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:30.629555 32267 raft_consensus.cc:740] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:30.630005 32269 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17.
I20260709 13:15:30.631902 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:30.632457 32119 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:30.632386 32090 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:30.587404 32019 rpcz_store.cc:276] 0709 13:15:29.128075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.128224 (+   149us) service_pool.cc:224] Handling call
0709 13:15:30.586932 (+1458708us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:30.173654 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:30.209481 (+ 35827us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:30.209544 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:15:30.209566 (+    22us) tablet.cc:662] Decoding operations
0709 13:15:30.212309 (+  2743us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:30.212410 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:30.212446 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:15:30.212663 (+   217us) tablet.cc:701] Row locks acquired
0709 13:15:30.212684 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:15:30.213028 (+   344us) write_op.cc:270] Start()
0709 13:15:30.220046 (+  7018us) write_op.cc:276] Timestamp: P: 1783602930212899 usec, L: 0
0709 13:15:30.225009 (+  4963us) op_driver.cc:348] REPLICATION: starting
0709 13:15:30.287100 (+ 62091us) log.cc:844] Serialized 591 byte log entry
0709 13:15:30.524764 (+237664us) op_driver.cc:464] REPLICATION: finished
0709 13:15:30.568452 (+ 43688us) write_op.cc:301] APPLY: starting
0709 13:15:30.568571 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:30.569779 (+  1208us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:30.569905 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:30.570603 (+   698us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:30.570779 (+   176us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:15:30.570822 (+    43us) write_op.cc:312] APPLY: finished
0709 13:15:30.571019 (+   197us) log.cc:844] Serialized 25 byte log entry
0709 13:15:30.571191 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:30.571260 (+    69us) write_op.cc:454] Released schema lock
0709 13:15:30.571297 (+    37us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":43384,"apply.run_cpu_time_us":3290,"apply.run_wall_time_us":22226,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8317,"num_ops":1,"prepare.queue_time_us":19572,"prepare.run_cpu_time_us":4084,"prepare.run_wall_time_us":151140,"replication_time_us":279303,"thread_start_us":33232,"threads_started":2}]]}
I20260709 13:15:30.641346 32267 consensus_queue.cc:260] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:30.631410 32195 raft_consensus.cc:1275] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:15:30.640655 32264 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 16.
I20260709 13:15:30.644975 32267 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:30.661562  5975 raft_consensus.cc:2804] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:30.662559  5975 raft_consensus.cc:697] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:30.668896 32193 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17.
I20260709 13:15:30.669847 32267 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:15:30.672139 32090 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:30.672792 32119 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:15:30.685060 32198 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 16.
I20260709 13:15:30.677367 32165 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:30.687157  5746 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:30.687759  5746 raft_consensus.cc:697] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:30.688700  5919 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:30.689626  5919 raft_consensus.cc:697] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 16 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:30.690766  5919 consensus_queue.cc:237] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:30.688787  5746 consensus_queue.cc:237] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:30.701812  5980 tablet_bootstrap.cc:492] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap starting.
I20260709 13:15:30.674221  5904 consensus_queue.cc:1048] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:15:30.711745  5975 consensus_queue.cc:237] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:30.765328 32019 catalog_manager.cc:5697] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 16 to 17, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 17 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:30.773444 32016 catalog_manager.cc:5697] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 15 to 16, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 16 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:30.789513  5990 raft_consensus.cc:2955] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:15:30.799947 32198 raft_consensus.cc:2955] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:15:30.805110 32269 raft_consensus.cc:2955] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:15:30.826467 32019 catalog_manager.cc:5697] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 15 to 16, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 16 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:30.852123 32016 catalog_manager.cc:5697] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 reported cstate change: config changed from index -1 to 10, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New cstate: current_term: 15 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
W20260709 13:15:30.864342 32070 auto_rebalancer.cc:629] Failed to schedule move for tablet a08fb71ae3e84c459773fd53510d6e04: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:15:30.953028  5980 tablet_bootstrap.cc:492] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:30.954025  5980 tablet_bootstrap.cc:492] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap complete.
I20260709 13:15:30.954797  5980 ts_tablet_manager.cc:1403] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6: Time spent bootstrapping tablet: real 0.253s	user 0.054s	sys 0.006s
I20260709 13:15:30.966693  5952 ts_tablet_manager.cc:933] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339)
I20260709 13:15:30.989923  5952 tablet_copy_client.cc:323] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Beginning tablet copy session from remote peer at address 127.30.63.1:42339
I20260709 13:15:30.991743 32134 tablet_copy_service.cc:140] P fcfc3281929645969ecedbb0c0af759d: Received BeginTabletCopySession request for tablet a75997deb5a741f998b671928aad3637 from peer 94085cf341634eb686a95983b6b7f7e6 ({username='slave'} at 127.0.0.1:55358)
I20260709 13:15:30.992343 32134 tablet_copy_service.cc:161] P fcfc3281929645969ecedbb0c0af759d: Beginning new tablet copy session on tablet a75997deb5a741f998b671928aad3637 from peer 94085cf341634eb686a95983b6b7f7e6 at {username='slave'} at 127.0.0.1:55358: session id = 94085cf341634eb686a95983b6b7f7e6-a75997deb5a741f998b671928aad3637
I20260709 13:15:31.009078  5980 raft_consensus.cc:359] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:15:31.014792   396 raft_consensus.cc:1217] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.10->[14.11-14.11]   Dedup: 14.11->[]
I20260709 13:15:31.016754   396 raft_consensus.cc:2955] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 14 LEARNER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:15:31.011952  5980 raft_consensus.cc:740] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Initialized, Role: LEARNER
I20260709 13:15:31.031229 32134 tablet_copy_source_session.cc:215] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:31.058975  5952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a75997deb5a741f998b671928aad3637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:31.065732  5980 consensus_queue.cc:260] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:15:31.073330  5980 ts_tablet_manager.cc:1434] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6: Time spent starting tablet: real 0.118s	user 0.009s	sys 0.001s
I20260709 13:15:31.077955 32282 tablet_copy_service.cc:342] P 6b3ed521ce8947db80c4b4828b355c06: Request end of tablet copy session 94085cf341634eb686a95983b6b7f7e6-2ec7a9cf151948fdaa078aba5fb1df43 received from {username='slave'} at 127.0.0.1:50584
I20260709 13:15:31.078476 32282 tablet_copy_service.cc:434] P 6b3ed521ce8947db80c4b4828b355c06: ending tablet copy session 94085cf341634eb686a95983b6b7f7e6-2ec7a9cf151948fdaa078aba5fb1df43 on tablet 2ec7a9cf151948fdaa078aba5fb1df43 with peer 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:31.137367  5952 tablet_copy_client.cc:806] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:31.137993  5952 tablet_copy_client.cc:670] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:31.169646  5952 tablet_copy_client.cc:538] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:31.178552 32192 raft_consensus.cc:1275] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:31.181372  5952 tablet_bootstrap.cc:492] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap starting.
I20260709 13:15:31.181150  5919 consensus_queue.cc:1048] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:31.198585 32119 raft_consensus.cc:1275] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:15:31.203598  5999 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:31.211555 32198 raft_consensus.cc:1275] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:15:31.212985  5919 consensus_queue.cc:1048] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:31.250442 32267 raft_consensus.cc:1275] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:31.252753  5975 consensus_queue.cc:1048] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:31.269186 32269 raft_consensus.cc:1275] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:15:31.276988  5919 consensus_queue.cc:1048] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:31.330183 32265 raft_consensus.cc:1275] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:15:31.332773  5746 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:31.497318   396 raft_consensus.cc:1217] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.9->[16.10-16.10]   Dedup: 16.10->[]
I20260709 13:15:31.510412 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:31.620617 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 201770us
W20260709 13:15:31.638124 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 59915us
I20260709 13:15:31.671561  5952 tablet_bootstrap.cc:492] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:31.674898  5952 tablet_bootstrap.cc:492] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap complete.
I20260709 13:15:31.681439  6060 raft_consensus.cc:1064] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:15:31.687141  5952 ts_tablet_manager.cc:1403] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6: Time spent bootstrapping tablet: real 0.506s	user 0.045s	sys 0.010s
I20260709 13:15:31.696882  6060 consensus_queue.cc:237] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:31.705729 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 56597us
W20260709 13:15:31.723055   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 47551.2us
I20260709 13:15:31.822047  5952 raft_consensus.cc:359] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:15:31.822924  5952 raft_consensus.cc:740] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Initialized, Role: LEARNER
I20260709 13:15:31.823554  5952 consensus_queue.cc:260] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
W20260709 13:15:31.852126   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 47835.4us
I20260709 13:15:31.888478  5952 ts_tablet_manager.cc:1434] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6: Time spent starting tablet: real 0.199s	user 0.005s	sys 0.002s
W20260709 13:15:31.971127 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 157484us
W20260709 13:15:31.977715 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 138945us
W20260709 13:15:31.979699 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 256908us
W20260709 13:15:31.982839 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 71423.5us
I20260709 13:15:31.995973   396 raft_consensus.cc:1275] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 14 LEARNER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:15:31.997838  6060 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:32.015280   400 raft_consensus.cc:1217] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.9->[15.10-15.10]   Dedup: 15.10->[]
I20260709 13:15:32.061311 32134 tablet_copy_service.cc:342] P fcfc3281929645969ecedbb0c0af759d: Request end of tablet copy session 94085cf341634eb686a95983b6b7f7e6-a75997deb5a741f998b671928aad3637 received from {username='slave'} at 127.0.0.1:55358
I20260709 13:15:32.061837 32134 tablet_copy_service.cc:434] P fcfc3281929645969ecedbb0c0af759d: ending tablet copy session 94085cf341634eb686a95983b6b7f7e6-a75997deb5a741f998b671928aad3637 on tablet a75997deb5a741f998b671928aad3637 with peer 94085cf341634eb686a95983b6b7f7e6
W20260709 13:15:32.088693 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 93938.8us
I20260709 13:15:32.093631 32267 raft_consensus.cc:1275] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:15:32.115031 32117 raft_consensus.cc:1275] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:15:32.128471  5627 raft_consensus.cc:1064] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:15:32.131253  5627 consensus_queue.cc:237] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 8, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:32.161360  6060 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:32.187719  6065 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:32.215363   400 raft_consensus.cc:1275] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 16 LEARNER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:32.217226  6074 consensus_queue.cc:1048] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:32.234105 32123 raft_consensus.cc:1275] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:32.241580 32197 raft_consensus.cc:1275] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:32.246363  6015 consensus_queue.cc:1048] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:32.277585  6015 consensus_queue.cc:1048] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:32.286505  6085 raft_consensus.cc:2955] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:32.297765   396 raft_consensus.cc:2955] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:32.301271  6060 raft_consensus.cc:2955] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:32.309021 32117 raft_consensus.cc:2955] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:32.312430 32272 raft_consensus.cc:2955] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:32.323988 32019 catalog_manager.cc:5697] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 10 to 11, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:32.336971 32197 raft_consensus.cc:2955] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:32.354950 32016 catalog_manager.cc:5697] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d reported cstate change: config changed from index 11 to 12, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:32.375717   396 raft_consensus.cc:2955] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:32.384259 32123 raft_consensus.cc:2955] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:15:32.476953 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 60219.8us
W20260709 13:15:32.507513   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 92091.3us
I20260709 13:15:32.591120 32272 consensus_queue.cc:237] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:32.601403   396 raft_consensus.cc:1275] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:32.602277 32197 raft_consensus.cc:1275] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:32.603428  6075 consensus_queue.cc:1048] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:32.608736  6075 consensus_queue.cc:1048] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:32.612087  6015 raft_consensus.cc:2955] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:32.618566   400 raft_consensus.cc:2955] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:32.626473 32197 raft_consensus.cc:2955] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:32.630558 32009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2ec7a9cf151948fdaa078aba5fb1df43 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:32.639735 32193 consensus_queue.cc:237] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:32.647195   396 raft_consensus.cc:1275] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:15:32.648393 32123 raft_consensus.cc:1275] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:15:32.648653  6060 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:32.650564  6060 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:32.659065  5988 raft_consensus.cc:1064] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:15:32.659798  5948 raft_consensus.cc:2955] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:32.662150  5988 consensus_queue.cc:237] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:32.662930 32116 raft_consensus.cc:2955] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:32.668831   398 raft_consensus.cc:2955] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:32.679069 32019 catalog_manager.cc:5697] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: config changed from index 11 to 12, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New cstate: current_term: 16 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:32.707315 32008 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 314924e72a7f4efa9cbae136ba7cd259 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:32.715981 32110 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ec7a9cf151948fdaa078aba5fb1df43 with delete_type TABLET_DATA_TOMBSTONED (TS fcfc3281929645969ecedbb0c0af759d not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:56870
I20260709 13:15:32.731408 32019 catalog_manager.cc:5697] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 12 to 13, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New cstate: current_term: 14 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:32.793313 32259 tablet_service.cc:1558] Processing DeleteTablet for tablet 314924e72a7f4efa9cbae136ba7cd259 with delete_type TABLET_DATA_TOMBSTONED (TS 6b3ed521ce8947db80c4b4828b355c06 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:45768
I20260709 13:15:32.814736  6103 tablet_replica.cc:333] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:15:32.814960  6102 tablet_replica.cc:333] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:15:32.816558  6102 raft_consensus.cc:2243] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.827054  6102 raft_consensus.cc:2272] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.827102  6103 raft_consensus.cc:2243] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.828213  6103 raft_consensus.cc:2272] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.842420 32267 raft_consensus.cc:1275] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:15:32.847460   398 raft_consensus.cc:1275] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 15 LEARNER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:15:32.847584  6102 ts_tablet_manager.cc:1916] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:32.849421  6072 consensus_queue.cc:1048] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:32.851505 32197 raft_consensus.cc:1275] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:15:32.851689  6072 consensus_queue.cc:1048] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:32.858639  6087 consensus_queue.cc:1048] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:32.863989  6103 ts_tablet_manager.cc:1916] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:32.882622 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:32.921205 32265 raft_consensus.cc:2955] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:32.912009  6072 raft_consensus.cc:2955] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:32.980945  6103 ts_tablet_manager.cc:1929] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.12
I20260709 13:15:33.008049  6102 ts_tablet_manager.cc:1929] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.11
I20260709 13:15:33.015182 32196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:15:33.015816 32196 raft_consensus.cc:606] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 15 LEADER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:33.020807 32019 catalog_manager.cc:5697] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: config changed from index 10 to 11, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:33.013907  6103 log.cc:1199] T 314924e72a7f4efa9cbae136ba7cd259 P 6b3ed521ce8947db80c4b4828b355c06: Deleting WAL directory at /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-2-root/wals/314924e72a7f4efa9cbae136ba7cd259
I20260709 13:15:33.052531 32197 raft_consensus.cc:2955] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:33.033743  6102 log.cc:1199] T 2ec7a9cf151948fdaa078aba5fb1df43 P fcfc3281929645969ecedbb0c0af759d: Deleting WAL directory at /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-0-root/wals/2ec7a9cf151948fdaa078aba5fb1df43
I20260709 13:15:33.076988   398 raft_consensus.cc:2955] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:33.086565 32009 catalog_manager.cc:5028] TS 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): tablet 314924e72a7f4efa9cbae136ba7cd259 (table test-workload [id=9b9dc20f98e547b59efac9c530f28125]) successfully deleted
I20260709 13:15:33.122648 32009 catalog_manager.cc:5028] TS fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): tablet 2ec7a9cf151948fdaa078aba5fb1df43 (table test-workload [id=9b9dc20f98e547b59efac9c530f28125]) successfully deleted
I20260709 13:15:33.170099 32123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:53200
I20260709 13:15:33.170811 32123 raft_consensus.cc:606] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:15:33.179767 32123 consensus_queue.cc:237] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:33.183344 32117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a75997deb5a741f998b671928aad3637"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:53200
I20260709 13:15:33.186800 32117 raft_consensus.cc:606] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:15:33.187336 32117 raft_consensus.cc:630] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Rejecting request to transfer leadership because tablet server 113b5461952d47e0944d463ea4e32801 is not a voter in the active config
I20260709 13:15:33.201030 32272 raft_consensus.cc:1275] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:15:33.201045   398 raft_consensus.cc:1275] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:15:33.201234 32196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:15:33.202059 32196 raft_consensus.cc:606] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:33.203893 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:15:33.205838 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:33.205961  6070 consensus_queue.cc:1048] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:33.213550  6072 consensus_queue.cc:1048] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:33.218559  5988 raft_consensus.cc:2955] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:33.226640 32272 raft_consensus.cc:2955] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:33.230970   398 raft_consensus.cc:2955] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:33.234232 32009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a75997deb5a741f998b671928aad3637 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:33.243121 32019 catalog_manager.cc:5697] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d reported cstate change: config changed from index 11 to 12, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New cstate: current_term: 15 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:33.277629 32181 tablet_service.cc:1558] Processing DeleteTablet for tablet a75997deb5a741f998b671928aad3637 with delete_type TABLET_DATA_TOMBSTONED (TS 113b5461952d47e0944d463ea4e32801 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:46032
I20260709 13:15:33.294545  6070 raft_consensus.cc:993] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:15:33.295296  5988 raft_consensus.cc:1081] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:15:33.297999 32196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54172
I20260709 13:15:33.298810 32196 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:33.299769 32196 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:33.317963 32196 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:33.320271 32196 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:33.322252 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:33.322906 32123 raft_consensus.cc:3055] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:15:33.324373 32123 raft_consensus.cc:740] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:33.325232 32123 consensus_queue.cc:260] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:33.326440 32123 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:33.323496 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:33.327129 32269 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:33.332939  6109 tablet_replica.cc:333] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:15:33.339126 32269 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 20.
I20260709 13:15:33.348374 32165 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:33.350589  6060 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:15:33.351130  6060 raft_consensus.cc:697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 20 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:33.351985  6060 consensus_queue.cc:237] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:33.356978  6109 raft_consensus.cc:2243] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:33.357977  6109 raft_consensus.cc:2272] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:33.362648  5948 raft_consensus.cc:993] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801: : Instructing follower 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:15:33.363126  5948 raft_consensus.cc:1081] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 15 LEADER]: Signalling peer 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:15:33.363317 32123 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 20.
I20260709 13:15:33.363637  6109 ts_tablet_manager.cc:1916] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:33.367833 32269 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:36080
I20260709 13:15:33.368376 32269 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:33.368734 32269 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:33.375394 32269 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:33.380021 32269 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:33.381980 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:33.382462 32123 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:33.385217 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:33.385910 32197 raft_consensus.cc:3055] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:33.386220 32197 raft_consensus.cc:740] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:33.386922 32197 consensus_queue.cc:260] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:33.388168 32197 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:33.388696 32022 catalog_manager.cc:5697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 19 to 20, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 20 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:33.439916 32123 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:15:33.444176 32239 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:33.440754 32197 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:15:33.445138  6075 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:33.445647  6075 raft_consensus.cc:697] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:33.446477  6075 consensus_queue.cc:237] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:33.484359  6109 ts_tablet_manager.cc:1929] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.11
I20260709 13:15:33.496496  6109 log.cc:1199] T a75997deb5a741f998b671928aad3637 P 113b5461952d47e0944d463ea4e32801: Deleting WAL directory at /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-1-root/wals/a75997deb5a741f998b671928aad3637
I20260709 13:15:33.505837 32022 catalog_manager.cc:5697] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 15 to 16, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 16 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:33.524092 32008 catalog_manager.cc:5028] TS 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): tablet a75997deb5a741f998b671928aad3637 (table test-workload [id=9b9dc20f98e547b59efac9c530f28125]) successfully deleted
I20260709 13:15:33.560477  5999 raft_consensus.cc:993] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801: : Instructing follower 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:15:33.561110  5948 raft_consensus.cc:1081] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Signalling peer 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:15:33.563987 32272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:36080
I20260709 13:15:33.564617 32272 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:33.564973 32272 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:33.595870 32272 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:33.602474 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:33.603137 32123 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:33.627950 32123 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:15:33.631820 32272 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:33.632792 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:33.633315 32197 raft_consensus.cc:3055] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:33.633610 32197 raft_consensus.cc:740] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:33.634305 32197 consensus_queue.cc:260] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:33.636906 32197 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:33.631502 32239 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:33.642998  6015 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:33.647600 32197 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:15:33.662148  6015 raft_consensus.cc:697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:33.663483  6015 consensus_queue.cc:237] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:33.705272 32022 catalog_manager.cc:5697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 16 to 17, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 17 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:33.814698 32116 raft_consensus.cc:1275] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:15:33.816250  5948 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:15:33.825326 32272 raft_consensus.cc:1275] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:15:33.827159  5999 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:15:33.861848 32197 raft_consensus.cc:1275] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:33.863639  6112 consensus_queue.cc:1048] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:33.967504 32118 raft_consensus.cc:1275] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:33.986356  6075 consensus_queue.cc:1048] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:15:34.207026 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:34.234107 32116 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:15:34.236886  6015 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:34.302820 32197 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:15:34.304551  6015 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:15:34.490725 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 81945.4us
I20260709 13:15:34.817849 32196 consensus_queue.cc:237] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:15:34.898524 32123 raft_consensus.cc:1275] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:34.902323 32269 raft_consensus.cc:1275] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:15:34.905066 32162 consensus_peers.cc:597] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 547f929c96244ef9a23b3eec5126aa3e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:34.907137  5948 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:34.909063  5948 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:34.988762  5999 raft_consensus.cc:2955] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:15:34.991983 32115 raft_consensus.cc:2955] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:15:34.997820 32269 raft_consensus.cc:2955] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:15:35.019493 32019 catalog_manager.cc:5697] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 reported cstate change: config changed from index -1 to 11, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New cstate: current_term: 16 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:35.028172 32115 consensus_queue.cc:237] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:15:35.070892 32193 raft_consensus.cc:1275] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:15:35.071381 32265 raft_consensus.cc:1275] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:15:35.072536  6127 consensus_queue.cc:1048] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:35.077395  6072 consensus_queue.cc:1048] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:15:35.079846 32087 consensus_peers.cc:597] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7db983b299754e0eba1ba5726c892858. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:35.100903  6127 raft_consensus.cc:2955] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Committing config change with OpId 19.11: config changed from index -1 to 11, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:15:35.104843 32196 raft_consensus.cc:2955] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Committing config change with OpId 19.11: config changed from index -1 to 11, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:15:35.204787 32265 consensus_queue.cc:237] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:15:35.207998 32022 catalog_manager.cc:5697] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d reported cstate change: config changed from index -1 to 11, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New cstate: current_term: 19 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:35.208547 32269 raft_consensus.cc:2955] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Committing config change with OpId 19.11: config changed from index -1 to 11, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
W20260709 13:15:35.223843 32236 consensus_peers.cc:597] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c0324508029249e0a1ff9d3eb1936981. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:35.228129 32115 raft_consensus.cc:1275] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:15:35.232450  6123 consensus_queue.cc:1048] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:15:35.265591 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 66561.8us
I20260709 13:15:35.263418  6123 raft_consensus.cc:2955] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:15:35.269460 32115 raft_consensus.cc:2955] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:15:35.326407 32193 raft_consensus.cc:1275] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:15:35.345805  6126 consensus_queue.cc:1048] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:35.463414 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:35.477313 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 50959.5us
I20260709 13:15:35.497336 32265 consensus_queue.cc:237] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:15:35.507808  6155 ts_tablet_manager.cc:933] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:35.513911 32197 raft_consensus.cc:2955] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
W20260709 13:15:35.537021 32236 consensus_peers.cc:597] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d3a2e596cd6e4340bfea0e5a0e0609d7. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:35.616956 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 128120us
W20260709 13:15:35.628983 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 107129us
I20260709 13:15:35.637526 32196 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:15:35.644325  6155 tablet_copy_client.cc:323] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Beginning tablet copy session from remote peer at address 127.30.63.2:44517
I20260709 13:15:35.566223 32017 catalog_manager.cc:5697] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d reported cstate change: config changed from index -1 to 12, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New cstate: current_term: 17 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:15:35.646318 32209 tablet_copy_service.cc:140] P 113b5461952d47e0944d463ea4e32801: Received BeginTabletCopySession request for tablet 547f929c96244ef9a23b3eec5126aa3e from peer 94085cf341634eb686a95983b6b7f7e6 ({username='slave'} at 127.0.0.1:56926)
I20260709 13:15:35.646878 32209 tablet_copy_service.cc:161] P 113b5461952d47e0944d463ea4e32801: Beginning new tablet copy session on tablet 547f929c96244ef9a23b3eec5126aa3e from peer 94085cf341634eb686a95983b6b7f7e6 at {username='slave'} at 127.0.0.1:56926: session id = 94085cf341634eb686a95983b6b7f7e6-547f929c96244ef9a23b3eec5126aa3e
I20260709 13:15:35.648552  6151 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:35.655934 32123 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:15:35.669023 32209 tablet_copy_source_session.cc:215] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:35.672921  6123 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:35.758643  6165 ts_tablet_manager.cc:933] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:35.766542  6151 raft_consensus.cc:2955] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index -1 to 13, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:15:35.770795  6155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 547f929c96244ef9a23b3eec5126aa3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:35.770254 32115 raft_consensus.cc:2955] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index -1 to 13, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:15:35.794209 32022 catalog_manager.cc:5697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: config changed from index -1 to 13, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New cstate: current_term: 17 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:35.811244  6163 ts_tablet_manager.cc:933] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339)
I20260709 13:15:35.832341  6165 tablet_copy_client.cc:323] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Beginning tablet copy session from remote peer at address 127.30.63.3:36651
I20260709 13:15:35.832943  6163 tablet_copy_client.cc:323] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Beginning tablet copy session from remote peer at address 127.30.63.1:42339
I20260709 13:15:35.836076 32282 tablet_copy_service.cc:140] P 6b3ed521ce8947db80c4b4828b355c06: Received BeginTabletCopySession request for tablet c0324508029249e0a1ff9d3eb1936981 from peer 94085cf341634eb686a95983b6b7f7e6 ({username='slave'} at 127.0.0.1:50584)
I20260709 13:15:35.836834 32282 tablet_copy_service.cc:161] P 6b3ed521ce8947db80c4b4828b355c06: Beginning new tablet copy session on tablet c0324508029249e0a1ff9d3eb1936981 from peer 94085cf341634eb686a95983b6b7f7e6 at {username='slave'} at 127.0.0.1:50584: session id = 94085cf341634eb686a95983b6b7f7e6-c0324508029249e0a1ff9d3eb1936981
I20260709 13:15:35.838363 32198 raft_consensus.cc:2955] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index -1 to 13, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:15:35.842796 32134 tablet_copy_service.cc:140] P fcfc3281929645969ecedbb0c0af759d: Received BeginTabletCopySession request for tablet 7db983b299754e0eba1ba5726c892858 from peer 94085cf341634eb686a95983b6b7f7e6 ({username='slave'} at 127.0.0.1:55358)
I20260709 13:15:35.843421 32134 tablet_copy_service.cc:161] P fcfc3281929645969ecedbb0c0af759d: Beginning new tablet copy session on tablet 7db983b299754e0eba1ba5726c892858 from peer 94085cf341634eb686a95983b6b7f7e6 at {username='slave'} at 127.0.0.1:55358: session id = 94085cf341634eb686a95983b6b7f7e6-7db983b299754e0eba1ba5726c892858
I20260709 13:15:35.861032 32282 tablet_copy_source_session.cc:215] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:35.863590 32134 tablet_copy_source_session.cc:215] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:35.868074  6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0324508029249e0a1ff9d3eb1936981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:35.873227  6163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db983b299754e0eba1ba5726c892858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:35.875824 32269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:15:35.876573 32269 raft_consensus.cc:606] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:15:35.877014  6155 tablet_copy_client.cc:806] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:35.877568  6155 tablet_copy_client.cc:670] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:35.902961 32115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:53200
I20260709 13:15:35.904290 32115 raft_consensus.cc:606] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:35.908224 32193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:15:35.908849 32193 raft_consensus.cc:606] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 13 LEADER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:35.912241  6155 tablet_copy_client.cc:538] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:35.927704  6143 raft_consensus.cc:993] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d: : Instructing follower 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:15:35.928439  6143 raft_consensus.cc:1081] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Signalling peer 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:15:35.930501 32269 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:36084
I20260709 13:15:35.931078 32269 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:35.931440 32269 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:35.938927 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:15:35.968262 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:35.969409 32269 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:35.981600 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:35.982234 32123 raft_consensus.cc:3055] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:35.982548 32123 raft_consensus.cc:740] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:35.992173  6155 tablet_bootstrap.cc:492] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6: Bootstrap starting.
I20260709 13:15:35.992635 32123 consensus_queue.cc:260] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:35.993762 32269 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:35.993940 32123 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:35.994992 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:35.998301 32193 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:35.992659  6165 tablet_copy_client.cc:806] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:36.001302  6165 tablet_copy_client.cc:670] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:36.138319  6165 tablet_copy_client.cc:538] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:36.147944 32193 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 18.
I20260709 13:15:36.150111  6163 tablet_copy_client.cc:806] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:36.150698  6163 tablet_copy_client.cc:670] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:36.153719  6169 ts_tablet_manager.cc:933] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:36.160095 32123 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 18.
I20260709 13:15:36.171896 32239 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:36.172844  6123 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:36.173463  6123 raft_consensus.cc:697] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:36.174240  6163 tablet_copy_client.cc:538] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:36.174369  6123 consensus_queue.cc:237] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:36.182817  6169 tablet_copy_client.cc:323] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Beginning tablet copy session from remote peer at address 127.30.63.3:36651
I20260709 13:15:36.193172 32282 tablet_copy_service.cc:140] P 6b3ed521ce8947db80c4b4828b355c06: Received BeginTabletCopySession request for tablet d3a2e596cd6e4340bfea0e5a0e0609d7 from peer 94085cf341634eb686a95983b6b7f7e6 ({username='slave'} at 127.0.0.1:50584)
I20260709 13:15:36.193949 32282 tablet_copy_service.cc:161] P 6b3ed521ce8947db80c4b4828b355c06: Beginning new tablet copy session on tablet d3a2e596cd6e4340bfea0e5a0e0609d7 from peer 94085cf341634eb686a95983b6b7f7e6 at {username='slave'} at 127.0.0.1:50584: session id = 94085cf341634eb686a95983b6b7f7e6-d3a2e596cd6e4340bfea0e5a0e0609d7
I20260709 13:15:36.206152 32282 tablet_copy_source_session.cc:215] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:15:36.232852 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 46826.5us
I20260709 13:15:36.235325  5999 raft_consensus.cc:993] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801: : Instructing follower fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:15:36.236352  6060 raft_consensus.cc:1081] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 13 LEADER]: Signalling peer fcfc3281929645969ecedbb0c0af759d to start an election
W20260709 13:15:36.261332 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 72684.9us
I20260709 13:15:36.284674  6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3a2e596cd6e4340bfea0e5a0e0609d7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:36.297770 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 79682us
W20260709 13:15:36.301674 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 67146.1us
I20260709 13:15:36.323309  6163 tablet_bootstrap.cc:492] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap starting.
I20260709 13:15:36.337190 32123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:56884
I20260709 13:15:36.337989 32123 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:36.338371 32123 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:36.358489 32123 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:36.370505 32123 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:36.371732   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:36.372345   398 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:15:36.390817 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 89841.8us
I20260709 13:15:36.392321   398 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
W20260709 13:15:36.445650 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 88933us
I20260709 13:15:36.445573 32022 catalog_manager.cc:5697] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 17 to 18, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 18 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:36.455075 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:36.455724 32193 raft_consensus.cc:3055] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:36.456036 32193 raft_consensus.cc:740] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:36.456779 32193 consensus_queue.cc:260] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:36.457954 32193 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:36.451645  6165 tablet_bootstrap.cc:492] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap starting.
W20260709 13:15:36.481509 32162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 127340us
W20260709 13:15:36.485636 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 127099us
I20260709 13:15:36.491020 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:36.491664 32269 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:36.512075   400 raft_consensus.cc:1240] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:36.513082 32269 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:15:36.484954 32193 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:15:36.570991 32089 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:36.572556  6149 raft_consensus.cc:2804] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:36.573299  6149 raft_consensus.cc:697] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:36.576117  6149 consensus_queue.cc:237] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:36.602254 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 47366.5us
W20260709 13:15:36.640287 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 90518us
I20260709 13:15:36.648335 32198 raft_consensus.cc:1275] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:15:36.672458 32121 raft_consensus.cc:1275] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:15:36.689217  6123 consensus_queue.cc:1048] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:15:36.711095  6156 raft_consensus.cc:993] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:15:36.711911  6169 tablet_copy_client.cc:806] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:36.712173  6156 raft_consensus.cc:1081] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:15:36.711162  6182 consensus_queue.cc:1048] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:15:36.734506  6169 tablet_copy_client.cc:670] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:36.754596 32198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:15:36.755209 32198 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:36.755569 32198 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:36.780139 32198 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:36.790341 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:36.790977 32121 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:36.795560  6155 tablet_bootstrap.cc:492] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:36.797252  6155 tablet_bootstrap.cc:492] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6: Bootstrap complete.
I20260709 13:15:36.799368  6155 ts_tablet_manager.cc:1403] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6: Time spent bootstrapping tablet: real 0.807s	user 0.038s	sys 0.029s
I20260709 13:15:36.801995 32198 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:36.803104 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:36.803676 32272 raft_consensus.cc:3055] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:36.803965 32272 raft_consensus.cc:740] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:36.824973 32272 consensus_queue.cc:260] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:36.838091 32121 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 17.
I20260709 13:15:36.841087 32272 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:36.846215 32198 raft_consensus.cc:1240] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:36.851385 32165 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:36.859275  6178 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:36.859850  6178 raft_consensus.cc:697] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 17 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:36.860796  6178 consensus_queue.cc:237] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:36.865134  6169 tablet_copy_client.cc:538] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:36.913409 32272 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 17.
I20260709 13:15:36.896906 32017 catalog_manager.cc:5697] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 13 to 14, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 14 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:37.000792 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 76925.8us
W20260709 13:15:37.002101 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 66697.2us
I20260709 13:15:36.995641 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:37.110003 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 45912.4us
W20260709 13:15:37.101658  6202 log.cc:927] Time spent T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:15:37.241148  6169 tablet_bootstrap.cc:492] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap starting.
W20260709 13:15:37.245066  6204 log.cc:927] Time spent T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
I20260709 13:15:37.168002  6155 raft_consensus.cc:359] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
W20260709 13:15:37.255949  6165 log.cc:927] Time spent T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.324s	user 0.001s	sys 0.000s
I20260709 13:15:37.293112  6155 raft_consensus.cc:740] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Initialized, Role: LEARNER
W20260709 13:15:37.323683 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 190574us
W20260709 13:15:37.386552 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 54145.9us
W20260709 13:15:37.393134 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 58020.3us
W20260709 13:15:37.429631   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 140924us
I20260709 13:15:37.444496 32019 catalog_manager.cc:5697] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 16 to 17, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 17 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:37.444540   398 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:15:37.456202  6207 log.cc:927] Time spent T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.535s	user 0.007s	sys 0.011s
I20260709 13:15:37.370129  6155 consensus_queue.cc:260] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:15:37.466571  6155 ts_tablet_manager.cc:1434] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6: Time spent starting tablet: real 0.666s	user 0.010s	sys 0.000s
W20260709 13:15:37.467031  6155 ts_tablet_manager.cc:1467] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6: Tablet startup took 666ms
W20260709 13:15:37.469223 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 44832.8us
I20260709 13:15:37.517789  6183 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:37.546015 32199 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:15:37.467376  6155 ts_tablet_manager.cc:1469] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6: Trace:
0709 13:15:35.404435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.404623 (+   188us) service_pool.cc:224] Handling call
0709 13:15:35.508191 (+103568us) ts_tablet_manager.cc:934] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
0709 13:15:35.704310 (+196119us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:15:35.824324 (+120014us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:35.824446 (+   122us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:15:35.876005 (+ 51559us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:15:35.876272 (+   267us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:35.876563 (+   291us) ts_tablet_manager.cc:989] Replica registered.
0709 13:15:35.876646 (+    83us) inbound_call.cc:177] Queueing success response
0709 13:15:35.991810 (+115164us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:15:36.800781 (+808971us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:15:37.006577 (+205796us) tablet_replica.cc:261] Starting instrumentation
0709 13:15:37.007251 (+   674us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":288,"mutex_wait_us":11097,"raft.queue_time_us":4274,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":7857,"tablet-copy.queue_time_us":102477,"tablet-download-pool.queue_time_us":139,"tablet-download-pool.run_cpu_time_us":1266,"tablet-download-pool.run_wall_time_us":10585,"thread_start_us":176007,"threads_started":2}
I20260709 13:15:37.588761 32209 tablet_copy_service.cc:342] P 113b5461952d47e0944d463ea4e32801: Request end of tablet copy session 94085cf341634eb686a95983b6b7f7e6-547f929c96244ef9a23b3eec5126aa3e received from {username='slave'} at 127.0.0.1:56926
I20260709 13:15:37.595155 32209 tablet_copy_service.cc:434] P 113b5461952d47e0944d463ea4e32801: ending tablet copy session 94085cf341634eb686a95983b6b7f7e6-547f929c96244ef9a23b3eec5126aa3e on tablet 547f929c96244ef9a23b3eec5126aa3e with peer 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:37.613127 32115 raft_consensus.cc:1275] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:15:37.655088 32270 raft_consensus.cc:1275] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:15:37.656253  6186 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:37.689198  6165 tablet_bootstrap.cc:492] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:37.689054  6212 consensus_queue.cc:1048] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:37.690327  6165 tablet_bootstrap.cc:492] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap complete.
I20260709 13:15:37.691399  6165 ts_tablet_manager.cc:1403] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6: Time spent bootstrapping tablet: real 1.291s	user 0.051s	sys 0.018s
I20260709 13:15:37.720885 32269 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:15:37.744030  6188 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:37.751893  6214 consensus_queue.cc:1048] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:37.746125  6165 raft_consensus.cc:359] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:15:37.793387  6165 raft_consensus.cc:740] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Initialized, Role: LEARNER
I20260709 13:15:37.794140  6165 consensus_queue.cc:260] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:15:37.812321   398 raft_consensus.cc:1217] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.10->[16.11-16.11]   Dedup: 16.11->[]
I20260709 13:15:37.833976  6165 ts_tablet_manager.cc:1434] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6: Time spent starting tablet: real 0.142s	user 0.006s	sys 0.003s
I20260709 13:15:37.837062 32282 tablet_copy_service.cc:342] P 6b3ed521ce8947db80c4b4828b355c06: Request end of tablet copy session 94085cf341634eb686a95983b6b7f7e6-c0324508029249e0a1ff9d3eb1936981 received from {username='slave'} at 127.0.0.1:50584
I20260709 13:15:37.837546 32282 tablet_copy_service.cc:434] P 6b3ed521ce8947db80c4b4828b355c06: ending tablet copy session 94085cf341634eb686a95983b6b7f7e6-c0324508029249e0a1ff9d3eb1936981 on tablet c0324508029249e0a1ff9d3eb1936981 with peer 94085cf341634eb686a95983b6b7f7e6
W20260709 13:15:37.933346  6163 log.cc:927] Time spent T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.054s	user 0.003s	sys 0.000s
I20260709 13:15:37.983196  6163 tablet_bootstrap.cc:492] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:37.984242  6163 tablet_bootstrap.cc:492] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap complete.
I20260709 13:15:37.985021  6163 ts_tablet_manager.cc:1403] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6: Time spent bootstrapping tablet: real 1.662s	user 0.068s	sys 0.016s
W20260709 13:15:37.989362 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 67234us
I20260709 13:15:38.033978  6163 raft_consensus.cc:359] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:15:38.034853  6163 raft_consensus.cc:740] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Initialized, Role: LEARNER
I20260709 13:15:38.061048  6163 consensus_queue.cc:260] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:15:38.122890  6163 ts_tablet_manager.cc:1434] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6: Time spent starting tablet: real 0.138s	user 0.008s	sys 0.002s
I20260709 13:15:38.138650   402 raft_consensus.cc:1217] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.11->[17.12-17.12]   Dedup: 17.12->[]
I20260709 13:15:38.186005  6169 tablet_bootstrap.cc:492] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:38.186851  6169 tablet_bootstrap.cc:492] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap complete.
I20260709 13:15:38.187968  6169 ts_tablet_manager.cc:1403] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6: Time spent bootstrapping tablet: real 0.947s	user 0.050s	sys 0.029s
W20260709 13:15:38.236299 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 121880us
I20260709 13:15:38.191907  6169 raft_consensus.cc:359] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:15:38.397094  6169 raft_consensus.cc:740] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Initialized, Role: LEARNER
I20260709 13:15:38.398643  6169 consensus_queue.cc:260] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
W20260709 13:15:38.410158 32162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 55180.5us
I20260709 13:15:38.411970  5948 raft_consensus.cc:1064] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:15:38.425802  6169 ts_tablet_manager.cc:1434] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6: Time spent starting tablet: real 0.237s	user 0.005s	sys 0.008s
I20260709 13:15:38.437532  5948 consensus_queue.cc:237] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:38.465792 32134 tablet_copy_service.cc:342] P fcfc3281929645969ecedbb0c0af759d: Request end of tablet copy session 94085cf341634eb686a95983b6b7f7e6-7db983b299754e0eba1ba5726c892858 received from {username='slave'} at 127.0.0.1:55358
I20260709 13:15:38.466524 32134 tablet_copy_service.cc:434] P fcfc3281929645969ecedbb0c0af759d: ending tablet copy session 94085cf341634eb686a95983b6b7f7e6-7db983b299754e0eba1ba5726c892858 on tablet 7db983b299754e0eba1ba5726c892858 with peer 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:38.508683 32282 tablet_copy_service.cc:342] P 6b3ed521ce8947db80c4b4828b355c06: Request end of tablet copy session 94085cf341634eb686a95983b6b7f7e6-d3a2e596cd6e4340bfea0e5a0e0609d7 received from {username='slave'} at 127.0.0.1:50584
I20260709 13:15:38.509326 32282 tablet_copy_service.cc:434] P 6b3ed521ce8947db80c4b4828b355c06: ending tablet copy session 94085cf341634eb686a95983b6b7f7e6-d3a2e596cd6e4340bfea0e5a0e0609d7 on tablet d3a2e596cd6e4340bfea0e5a0e0609d7 with peer 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:38.516732   402 raft_consensus.cc:1275] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 16 LEARNER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:38.523623  6224 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:38.564535 32271 raft_consensus.cc:1275] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:38.569121  6224 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:38.582058 32118 raft_consensus.cc:1275] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:38.639572  6178 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:15:38.647716 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:38.689118  6219 raft_consensus.cc:1064] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:15:38.692353  6219 consensus_queue.cc:237] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:38.721627   402 raft_consensus.cc:1217] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.10->[19.11-19.11]   Dedup: 19.11->[]
I20260709 13:15:38.733804   398 raft_consensus.cc:1217] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.12->[17.13-17.13]   Dedup: 17.13->[]
I20260709 13:15:38.740317  6178 raft_consensus.cc:2955] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:38.752182 32271 raft_consensus.cc:2955] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:38.819156   398 raft_consensus.cc:2955] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:38.829717   402 raft_consensus.cc:1275] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 17 LEARNER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:15:38.831653  6170 consensus_queue.cc:1048] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:38.851949 32019 catalog_manager.cc:5697] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 reported cstate change: config changed from index 11 to 12, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:38.876085 32118 raft_consensus.cc:1275] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:15:38.888586 32193 raft_consensus.cc:1275] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:15:38.890822  6170 consensus_queue.cc:1048] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:38.892154  6160 consensus_queue.cc:1048] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:38.923660 32121 raft_consensus.cc:2955] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:39.048271 32119 raft_consensus.cc:2955] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:39.045477  6227 raft_consensus.cc:2955] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:15:39.100816   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 70776.2us
I20260709 13:15:39.138020 32193 raft_consensus.cc:2955] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:39.191735  6156 raft_consensus.cc:1064] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:15:39.215063  6156 consensus_queue.cc:237] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:39.245421   398 raft_consensus.cc:2955] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:39.263887 32022 catalog_manager.cc:5697] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d reported cstate change: config changed from index 12 to 13, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:15:39.288775 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 118666us
I20260709 13:15:39.314030 32191 consensus_queue.cc:237] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:39.319540   402 raft_consensus.cc:1275] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:15:39.321403  6214 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:39.330228  6143 raft_consensus.cc:1064] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:15:39.332428  6190 raft_consensus.cc:2955] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:39.339407   398 raft_consensus.cc:2955] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:39.347489 32197 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:15:39.366247   402 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 17 LEARNER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:15:39.333256  6143 consensus_queue.cc:237] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 9, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:39.394560  6262 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 13:15:39.397804  6151 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:15:39.411967 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 127908us
I20260709 13:15:39.417511 32019 catalog_manager.cc:5697] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 12 to 13, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New cstate: current_term: 16 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:39.432996 32271 consensus_queue.cc:237] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:39.441056   396 raft_consensus.cc:1275] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:15:39.432977 32121 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:15:39.442739  6151 consensus_queue.cc:1048] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:15:39.450316 32271 raft_consensus.cc:1275] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:15:39.458027 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 172349us
I20260709 13:15:39.460906  6182 raft_consensus.cc:2955] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:39.469312  5948 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:39.475173   396 raft_consensus.cc:2955] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:39.479144 32009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c0324508029249e0a1ff9d3eb1936981 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:39.495348 32019 catalog_manager.cc:5697] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: config changed from index 13 to 14, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New cstate: current_term: 17 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:39.475550 32265 raft_consensus.cc:2955] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:39.500371 32193 raft_consensus.cc:1275] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:15:39.508911 32110 tablet_service.cc:1558] Processing DeleteTablet for tablet 547f929c96244ef9a23b3eec5126aa3e with delete_type TABLET_DATA_TOMBSTONED (TS fcfc3281929645969ecedbb0c0af759d not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:56870
I20260709 13:15:39.509256 32121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:53200
I20260709 13:15:39.511425 32269 raft_consensus.cc:1275] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:15:39.521755 32008 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 547f929c96244ef9a23b3eec5126aa3e with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:39.522697  6151 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:15:39.537583 32118 raft_consensus.cc:1275] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:15:39.538138  6182 raft_consensus.cc:2955] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 13 to 14, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:39.539885 32193 raft_consensus.cc:2955] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:39.542286   398 raft_consensus.cc:1275] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 19 LEARNER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:15:39.533536 32121 raft_consensus.cc:606] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:39.629848  6270 tablet_replica.cc:333] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:15:39.631587  6270 raft_consensus.cc:2243] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:39.632943  6270 raft_consensus.cc:2272] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:39.558279  6219 consensus_queue.cc:1048] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
W20260709 13:15:39.640997 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 65910.8us
W20260709 13:15:39.645087 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 82788us
I20260709 13:15:39.669368 32121 raft_consensus.cc:2955] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:39.678511 32197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:15:39.681084  6266 consensus_queue.cc:1048] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.116s
I20260709 13:15:39.687170 32197 raft_consensus.cc:606] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 17 LEADER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:39.745538 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 64374.4us
I20260709 13:15:39.782823  6270 ts_tablet_manager.cc:1916] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:39.784654 32272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:15:39.785339 32272 raft_consensus.cc:606] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:15:39.720013  6143 consensus_queue.cc:1048] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:15:39.797545  6264 consensus_queue.cc:1048] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:39.799577  6154 raft_consensus.cc:993] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d: : Instructing follower 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:15:39.800948 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:15:39.810838  6272 raft_consensus.cc:993] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801: : Instructing follower fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:15:39.811517  6272 raft_consensus.cc:1081] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 17 LEADER]: Signalling peer fcfc3281929645969ecedbb0c0af759d to start an election
I20260709 13:15:39.832980   398 raft_consensus.cc:2955] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:39.844019 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:39.848618  6170 raft_consensus.cc:993] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:15:39.849176  6170 raft_consensus.cc:1081] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:15:39.857937 32181 tablet_service.cc:1558] Processing DeleteTablet for tablet c0324508029249e0a1ff9d3eb1936981 with delete_type TABLET_DATA_TOMBSTONED (TS 113b5461952d47e0944d463ea4e32801 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:46032
I20260709 13:15:39.859869 32191 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:15:39.865847 32191 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:39.866245 32191 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:15:39.857092 32019 catalog_manager.cc:5697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 reported cstate change: config changed from index 13 to 14, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:39.871899  6265 raft_consensus.cc:1081] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Signalling peer 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:15:39.883143 32191 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:39.904176 32191 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 24 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:39.910027 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:39.910756 32117 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:15:39.939378 32265 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:36084
I20260709 13:15:39.940086 32265 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:39.940512 32265 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:39.951797  6291 tablet_replica.cc:333] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:15:39.953071  6291 raft_consensus.cc:2243] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:39.953912  6291 raft_consensus.cc:2272] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:39.946967 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:39.959053 32269 raft_consensus.cc:3055] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:15:39.965020 32124 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:56884
I20260709 13:15:39.965652 32124 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:39.959518 32269 raft_consensus.cc:740] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:39.999151 32117 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 24.
I20260709 13:15:39.998348 32119 raft_consensus.cc:2955] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:39.997988 32124 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:40.007620 32120 raft_consensus.cc:1240] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 23. Current term is 24. Ops: []
I20260709 13:15:40.048243 32265 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:40.025290 32269 consensus_queue.cc:260] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:40.081368 32269 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:15:40.088825 32124 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:40.090941 32124 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:40.095718 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 43699.5us
I20260709 13:15:40.100137  6291 ts_tablet_manager.cc:1916] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:40.110387  6270 ts_tablet_manager.cc:1929] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.12
I20260709 13:15:40.146916  6270 log.cc:1199] T 547f929c96244ef9a23b3eec5126aa3e P fcfc3281929645969ecedbb0c0af759d: Deleting WAL directory at /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-0-root/wals/547f929c96244ef9a23b3eec5126aa3e
I20260709 13:15:40.116925 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:40.120404 32269 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 24.
I20260709 13:15:40.149107 32272 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:40.120488 32265 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:40.122592 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:40.123471  6266 raft_consensus.cc:2955] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Committing config change with OpId 19.12: config changed from index 11 to 12, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:40.150913 32009 catalog_manager.cc:5028] TS fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): tablet 547f929c96244ef9a23b3eec5126aa3e (table test-workload [id=9b9dc20f98e547b59efac9c530f28125]) successfully deleted
I20260709 13:15:40.128121 32267 consensus_queue.cc:237] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:40.141654 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:40.157603 32118 raft_consensus.cc:3055] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:40.157958 32118 raft_consensus.cc:740] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:40.158789 32118 consensus_queue.cc:260] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:40.159899 32118 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:40.162858   402 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:15:40.165141  6227 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:15:40.173945 32191 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:15:40.176788 32197 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:40.146251 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:40.177655  6178 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:15:40.178721  6178 raft_consensus.cc:697] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 24 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:40.179710  6178 consensus_queue.cc:237] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:40.184357 32118 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:15:40.190371 32239 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:40.192211  6279 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:40.192819  6279 raft_consensus.cc:697] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:40.193835  6279 consensus_queue.cc:237] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:40.193662 32267 raft_consensus.cc:2955] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index 11 to 12, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:40.205826 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:40.206482 32191 raft_consensus.cc:3055] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:40.206908 32191 raft_consensus.cc:740] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:40.203410   402 raft_consensus.cc:2955] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index 11 to 12, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:40.206539 32022 catalog_manager.cc:5697] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d reported cstate change: config changed from index 11 to 12, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:40.216360 32198 raft_consensus.cc:2955] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index 11 to 12, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:40.218247 32191 consensus_queue.cc:260] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:40.218878  6219 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:15:40.219547 32191 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:40.222468 32197 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:15:40.223146 32193 raft_consensus.cc:1240] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:40.213107 32272 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 18.
I20260709 13:15:40.232987  6262 raft_consensus.cc:2955] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Committing config change with OpId 17.15: config changed from index 14 to 15, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:40.246326 32118 consensus_queue.cc:237] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:40.246680 32193 raft_consensus.cc:2955] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Committing config change with OpId 17.15: config changed from index 14 to 15, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:40.249506   398 raft_consensus.cc:2955] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Committing config change with OpId 17.15: config changed from index 14 to 15, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:15:40.279598 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 54185.4us
I20260709 13:15:40.280143 32090 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:40.298017  6286 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:40.298707  6286 raft_consensus.cc:697] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 18 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:40.299862  6286 consensus_queue.cc:237] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:40.354108 32022 catalog_manager.cc:5697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 14 to 15, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New cstate: current_term: 17 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:15:40.364876 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 80979us
I20260709 13:15:40.425625 32191 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 18.
I20260709 13:15:40.434563   398 raft_consensus.cc:1275] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:15:40.436462 32193 raft_consensus.cc:1275] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:15:40.464890 32110 tablet_service.cc:1558] Processing DeleteTablet for tablet d3a2e596cd6e4340bfea0e5a0e0609d7 with delete_type TABLET_DATA_TOMBSTONED (TS fcfc3281929645969ecedbb0c0af759d not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:56870
I20260709 13:15:40.473547  6270 tablet_replica.cc:333] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:15:40.512681 32118 raft_consensus.cc:1240] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 18 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:40.521770 32009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d3a2e596cd6e4340bfea0e5a0e0609d7 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:40.517376  6290 consensus_queue.cc:1048] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:15:40.546573  6291 ts_tablet_manager.cc:1929] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.13
I20260709 13:15:40.547183  6291 log.cc:1199] T c0324508029249e0a1ff9d3eb1936981 P 113b5461952d47e0944d463ea4e32801: Deleting WAL directory at /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-1-root/wals/c0324508029249e0a1ff9d3eb1936981
I20260709 13:15:40.549461 32008 catalog_manager.cc:5028] TS 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): tablet c0324508029249e0a1ff9d3eb1936981 (table test-workload [id=9b9dc20f98e547b59efac9c530f28125]) successfully deleted
I20260709 13:15:40.553849 32017 catalog_manager.cc:5697] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 23 to 24, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 24 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:40.576109 32022 catalog_manager.cc:5697] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 17 to 18, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 18 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:40.611479  6270 raft_consensus.cc:2243] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:40.612792  6231 consensus_queue.cc:1048] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:40.623118  6270 raft_consensus.cc:2272] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:40.642151 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 44768.4us
I20260709 13:15:40.647490  6270 ts_tablet_manager.cc:1916] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:40.661226  6143 raft_consensus.cc:2955] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index 12 to 13, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:40.665967 32124 raft_consensus.cc:1275] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:15:40.670347 32016 catalog_manager.cc:5697] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 12 to 13, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 13 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:40.679085  6219 consensus_queue.cc:1048] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:40.686491 32269 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:15:40.689623   402 raft_consensus.cc:2955] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:40.694837  6178 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:15:40.743676 32120 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:15:40.745163  6178 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:15:40.746641 32192 raft_consensus.cc:2955] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:40.757249 32009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7db983b299754e0eba1ba5726c892858 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:40.782166 32265 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:15:40.784107 32198 raft_consensus.cc:1275] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:15:40.784665  6275 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:15:40.786840  6279 consensus_queue.cc:1048] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:40.803210 32197 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:15:40.797171 32017 catalog_manager.cc:5697] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 12 to 13, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New cstate: current_term: 19 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:40.806928  6266 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:15:40.832422 32259 tablet_service.cc:1558] Processing DeleteTablet for tablet 7db983b299754e0eba1ba5726c892858 with delete_type TABLET_DATA_TOMBSTONED (TS 6b3ed521ce8947db80c4b4828b355c06 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:45768
I20260709 13:15:40.847378  6306 tablet_replica.cc:333] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:15:40.849916  6306 raft_consensus.cc:2243] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:40.861511  6306 raft_consensus.cc:2272] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:40.870944 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:40.883409  6306 ts_tablet_manager.cc:1916] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:40.925598  6270 ts_tablet_manager.cc:1929] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.14
I20260709 13:15:40.949730  6270 log.cc:1199] T d3a2e596cd6e4340bfea0e5a0e0609d7 P fcfc3281929645969ecedbb0c0af759d: Deleting WAL directory at /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-0-root/wals/d3a2e596cd6e4340bfea0e5a0e0609d7
I20260709 13:15:41.030576 32009 catalog_manager.cc:5028] TS fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): tablet d3a2e596cd6e4340bfea0e5a0e0609d7 (table test-workload [id=9b9dc20f98e547b59efac9c530f28125]) successfully deleted
I20260709 13:15:41.103745  6306 ts_tablet_manager.cc:1929] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.12
I20260709 13:15:41.104254  6306 log.cc:1199] T 7db983b299754e0eba1ba5726c892858 P 6b3ed521ce8947db80c4b4828b355c06: Deleting WAL directory at /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-2-root/wals/7db983b299754e0eba1ba5726c892858
I20260709 13:15:41.106081 32009 catalog_manager.cc:5028] TS 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): tablet 7db983b299754e0eba1ba5726c892858 (table test-workload [id=9b9dc20f98e547b59efac9c530f28125]) successfully deleted
I20260709 13:15:42.253597 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:42.270538   368 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.000s	sys 0.012s
W20260709 13:15:42.271132   368 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.000s	sys 0.013s
W20260709 13:15:42.922485   367 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.008s	sys 0.007s
W20260709 13:15:42.923251   367 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.009s	sys 0.007s
I20260709 13:15:42.924826  6215 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:42.926074  6318 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:42.926689  6318 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:42.930281  6257 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:42.931188  6257 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:42.933140   369 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.011s	sys 0.006s
W20260709 13:15:42.933548   369 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.011s	sys 0.007s
W20260709 13:15:42.940940   365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.864s	user 0.010s	sys 0.023s
W20260709 13:15:42.941618   365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.300s	user 0.011s	sys 0.023s
I20260709 13:15:42.942405  6318 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:42.943055  6318 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:42.935959  6316 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:42.944936  6316 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:42.947423  6316 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:42.925722  6215 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:42.943871  6318 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:43.006172   368 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.007s	sys 0.011s
W20260709 13:15:43.006580   368 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.008s	sys 0.011s
I20260709 13:15:43.024852  6319 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.027052  6318 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:43.025802  6319 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:43.027052  6215 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.035884  6319 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.037358  6316 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:43.037987  6316 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:43.040126  6316 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.043552  6319 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:43.045964  6215 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:43.046828  6215 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:43.044271  6319 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:43.050626  6215 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.051870  6319 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.056088  6324 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.056928  6324 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:43.059432  6324 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.060232  6323 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:43.066097  6323 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:43.069029  6323 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:43.070173  6319 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:43.113159  6319 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:43.118821  6319 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.076924  6321 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:43.077859  6326 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.124683  6321 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.127853  6321 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.124691  6326 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.132112  6326 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.072544  6215 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.133186  6215 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:43.137051  6215 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.069845  6325 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:43.140991  6325 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:43.144234  6325 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.150501  6326 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:43.151015  6321 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.153988  6326 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:43.154968  6321 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.143368  6257 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.157816  6326 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:43.157850  6321 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.164835  6328 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.225582  6328 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.248816  6328 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.255734  6329 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.256307  6329 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.258654  6329 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.283222  6329 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:43.284168  6321 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:43.284561  6326 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.284780  6321 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:43.285179  6326 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.287724  6321 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:43.287886  6326 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.283810  6329 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.288534  6321 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.289379  6321 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.283777  6336 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:43.290966  6336 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:43.291699  6321 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.293083  6336 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:43.293509  6329 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:43.295424 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 1.75367e+06us
I20260709 13:15:43.306761  6275 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:43.307520  6275 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.317222  6275 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.338891  6265 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.339836  6265 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:43.341321 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 1.80229e+06us
I20260709 13:15:43.358876  6340 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.360270  6340 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:43.360680  6346 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.363505  6346 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.364730  6340 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:43.367005  6339 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.357266  6342 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:43.342790  6328 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:43.378232  6330 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.349584  6329 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:43.402284  6329 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.349972  6336 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:43.404393  6336 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:43.407637  6336 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:43.348546  6321 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:43.407747  6342 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.408381  6321 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.410988  6321 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.344066  6332 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.411794  6332 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.414197  6332 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.342931  6331 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.414976  6331 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.341718  6326 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:43.416711  6326 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:43.417114  6342 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.418977  6326 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:43.380247  6327 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:43.419770  6327 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.422588  6327 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.395100  6334 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:43.423394  6334 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.365695  6346 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.425068  6328 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.424886  6339 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:43.434108  6329 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.435597  6339 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:43.429036  6330 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.441164  6337 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:43.440935  6343 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.443274  6345 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.443338  6337 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.443944  6345 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.443915  6343 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.446110  6337 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.446226  6343 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.447528  6343 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:43.447988  6343 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:43.448326  6341 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:43.448992  6340 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.448896  6341 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.449656  6340 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.452013  6334 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.451213  6341 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.452716  6340 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.452823  6342 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:43.453429  6342 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:43.454578  6333 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:43.455229  6332 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:43.455143  6333 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:43.455531  6342 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:43.455768  6332 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:15:43.456724  6342 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:43.456779  6346 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:43.457149  6321 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.457374  6335 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:43.457347  6342 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.452857  6331 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.458251  6326 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:43.458642  6331 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.458796  6326 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:43.459133  6331 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:43.459712  6342 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.458081  6335 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.461333  6333 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:43.461424  6345 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.462881  6335 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.463478  6326 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:43.457402  6346 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.441932  6336 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:43.468948  6346 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.469583  6328 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.470077  6332 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.460299  6342 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.473763  6265 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.474013  6343 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:43.475252  6342 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:43.480612 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 1.91081e+06us
I20260709 13:15:43.485945  6340 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:43.495187  6340 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:43.495914  6344 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.496938  6344 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.497954  6340 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:43.498729  6265 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:43.498847  6348 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:43.499377  6265 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.499557  6348 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:43.500250  6338 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.500919  6338 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.501948  6348 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:43.502529  6348 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.546744  6343 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.546924  6348 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.547340  6343 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.590317 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.591259 32193 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 19.
I20260709 13:15:43.477591  6336 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.636615  6336 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.637164  6338 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.638006  6347 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:43.638720  6347 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.640792  6331 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:43.642328  6343 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.642982  6343 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:43.633141  6342 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.643833  6342 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:43.643591  6343 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.577967  6346 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.644297  6342 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:43.644946  6346 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.646361  6342 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:43.646888  6346 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.478229  6321 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.499375  6344 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.737924  6343 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.740046  6348 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.745456  6347 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.748061  6321 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.648044  6265 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.749316 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.755841 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.756434 32197 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 17.
I20260709 13:15:43.763779 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.764928 32191 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17.
I20260709 13:15:43.768793 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.770488 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.771139 32191 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:15:43.775452 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.785194 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.786170 32191 raft_consensus.cc:2468] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 8.
I20260709 13:15:43.790437 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.790660  6348 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:43.791168  6348 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.791771 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:43.792330 32118 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 14.
I20260709 13:15:43.793330 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:43.793694 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:43.794258 32120 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 23.
I20260709 13:15:43.794493 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:43.795681 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:43.796108 32119 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 13.
I20260709 13:15:43.798255 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.766880  6265 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:43.788991  6347 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.800923 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.809194   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:43.809412   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:43.810000   394 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:15:43.810824   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:43.793303  6348 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.814580 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.814996 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.821689   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:43.822171 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.824433   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:43.825052   394 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:15:43.828438  6340 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.815972  6347 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.829241  6340 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.832008 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.832679  6353 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.832731  6342 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.835012  6353 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:43.835690  6342 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.828414  6350 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:43.833268  6341 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:43.838325  6350 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.839001  6353 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:43.833217  6346 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:43.839619   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:43.839906  6346 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:43.820930  6265 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.840997  6350 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.841256  6340 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.842460  6265 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.842986  6346 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:43.830720  6347 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.845571 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:43.847213 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:43.847764 32121 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 17.
I20260709 13:15:43.848928 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:43.849318 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.849952 32198 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:15:43.849998 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.850319 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.850670 32197 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 16.
I20260709 13:15:43.850880 32193 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:15:43.851891   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:43.852510 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.854936 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.855521 32198 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 16.
I20260709 13:15:43.855758 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.856559 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.857033 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.857548  6342 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.838369  6341 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:43.858201 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.857615 32190 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
I20260709 13:15:43.861003 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.852557   398 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 19.
I20260709 13:15:43.852005 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.860286  6341 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.861869 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.876554  6330 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:43.880929 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:43.881480 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:43.881624 32124 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 9.
I20260709 13:15:43.882593 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:43.883183 32118 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:15:43.884464 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:43.849465 32121 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 16.
I20260709 13:15:43.885703 32162 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:43.886498  6330 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:43.886802 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:43.886876  6330 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.887470  6330 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:43.889050   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:43.889810 32162 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:43.890259   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:43.890632  6349 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:43.890825   402 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 17.
I20260709 13:15:43.891078  6349 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:43.891527  6349 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:43.896957 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:43.861752 32195 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 18.
I20260709 13:15:43.904181 32162 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:43.909195 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.910169 32121 consensus_queue.cc:237] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:43.910815  6331 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:43.910583 32118 consensus_queue.cc:237] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:15:43.911232  6331 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:43.911635  6331 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:43.919792  6331 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:43.921334 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:43.921940 32119 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 17.
I20260709 13:15:43.922621  6331 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:43.923120 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:43.923703 32119 raft_consensus.cc:2468] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 8.
I20260709 13:15:43.923879   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:43.924415   402 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:43.926323  6349 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:43.940037  6349 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:43.942346  6330 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:43.944254   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 46077.4us
I20260709 13:15:43.945487 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:43.948174 32120 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:15:43.945497   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:43.949250   400 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:43.955844 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:43.956874 32119 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:15:43.950275   369 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:43.974131   402 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
I20260709 13:15:43.977717 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.978077 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.965755   369 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:43.990590 32162 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:43.990715 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:43.993588 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.994306 32199 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:15:43.998283 32192 raft_consensus.cc:2393] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 17: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:43.968734  6356 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:44.003077 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.006459 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:43.998579  6321 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:44.008021  6321 raft_consensus.cc:697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:44.007387 32199 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 16.
I20260709 13:15:43.999650  6354 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:44.014129 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.017761 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.016340  6276 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:44.018544 32120 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:15:44.016536   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:44.017119  6330 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:44.017766 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.001441  6356 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:44.015615  6352 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:44.028288   402 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:44.042863 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:44.046263 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.054388 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:44.054553 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:44.055003   400 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 20.
I20260709 13:15:44.055092 32191 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:15:44.056160 32193 raft_consensus.cc:1275] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:15:44.056427 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:44.056804 32162 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:44.067791  6330 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:15:44.068377  6330 raft_consensus.cc:697] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 20 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:44.070976  6330 consensus_queue.cc:237] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:44.057294 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:44.069587 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.086133  6362 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:44.086793  6362 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.088999  6362 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:44.090999  6279 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:44.091501  6279 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:44.093658  6279 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:44.093314  6321 consensus_queue.cc:237] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:44.034339  6354 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.100642  6362 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:44.101092  6354 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:44.101190  6362 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:44.037906  6276 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.102432  6360 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:44.103453  6362 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:44.103646  6276 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:44.103204  6360 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.104018  6362 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:44.104148  6276 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:44.104748  6219 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:44.105427  6279 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:44.105510  6219 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.106016  6279 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.106639 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.107856  6219 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:44.108040 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.113814  6219 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:44.113920 32119 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:15:44.108196  6279 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:44.108670 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.108824 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.109392 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.109573 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.110262 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.110628 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.110993 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.104892  6227 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:44.115811 32115 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
I20260709 13:15:44.101727  6354 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:15:44.125355   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 146539us
I20260709 13:15:44.111747 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.111449  6362 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.130112 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.130784 32121 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:15:44.112174  6276 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:44.112939 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.044545  6356 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:44.115262 32120 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:15:44.115100 32122 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:15:44.124825   402 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 17.
W20260709 13:15:44.119969   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 154316us
I20260709 13:15:44.114354  6219 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.134729 32162 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:44.133802   369 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:44.134488  6354 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:44.121970  6351 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:44.140363  6359 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:44.129217  6227 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.142204  6276 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:44.135584 32089 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:44.154739 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.149701 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:44.057548  6352 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.149161 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:44.160261 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.158155 32089 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:44.154678  6349 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:44.161252 32265 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 15.
I20260709 13:15:44.160378  6156 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:44.166225 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.166030  6355 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:44.167021 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.170908 32267 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 11.
I20260709 13:15:44.166980 32089 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:15:44.174758   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 48398.7us
I20260709 13:15:44.159415  6276 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:44.164942  6342 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:44.191632 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:15:44.192054   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 58316.9us
I20260709 13:15:44.153760  6367 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:44.194393 32269 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 16.
I20260709 13:15:44.160696  6364 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:15:44.190433 32089 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:44.156729  6359 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:44.183467  6156 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.196682 32199 raft_consensus.cc:1240] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:44.212478 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.152891  6351 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:44.200861 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.199038 32089 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:44.170724  6355 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:44.213734  6347 raft_consensus.cc:2804] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:44.185062  6341 raft_consensus.cc:2804] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:44.215122 32269 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 15.
I20260709 13:15:44.217770 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.221383 32267 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 14.
I20260709 13:15:44.217682 32089 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:44.219882  6355 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:44.193826  6342 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:44.231611  6346 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:44.220289  6347 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:44.233608 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.199407  6349 raft_consensus.cc:697] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 17 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
W20260709 13:15:44.239053   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 55438.5us
I20260709 13:15:44.197813  6276 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.198451  6364 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:15:44.246941 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 93764.7us
I20260709 13:15:44.247485 32089 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:44.220049  6275 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:44.258471 32165 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:44.220403  6361 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:44.262485 32165 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:44.255092 32022 catalog_manager.cc:5697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 17 to 18, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 18 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:44.224535  6341 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:15:44.264462 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.243480  6342 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:44.266327 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.269677  6375 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:44.242403  6346 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:15:44.275400   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 80787.3us
I20260709 13:15:44.208998  6367 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:44.295897  6352 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:44.296325  6219 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:44.296934  6367 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:44.252681  6360 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:44.296633  6375 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.233314  6279 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:44.298156  6346 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:44.298240  6279 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.300192  6375 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:44.240959  6363 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:44.305758  6363 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.307987  6363 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:44.272032 32089 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:44.309680  6265 raft_consensus.cc:2804] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:44.310120  6265 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:44.310156 32089 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:44.310681  6265 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:44.311426 32089 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:44.278857  6349 consensus_queue.cc:237] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:44.313303  6351 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:44.309674  6276 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:44.308001  6354 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:44.280177  6362 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:44.258857  6275 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:44.271356  6341 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:44.281677 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.315356 32089 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:44.266743  6321 raft_consensus.cc:2804] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:44.283699 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.263695  6143 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:44.284914 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:44.285085  6227 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:44.259291  6364 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:15:44.271735  6361 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.287813 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:15:44.288920  6368 log.cc:927] Time spent T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:15:44.320663  6275 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:44.288983 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:44.289873 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:44.290498  6359 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:44.333478   369 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:44.243078  6369 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:44.300391  6279 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:44.294082  6156 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:44.256842  6347 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:44.303738 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:15:44.369599 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 50955.9us
I20260709 13:15:44.282591  6371 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:44.334417  6353 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:44.329710 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.332675  6343 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:44.379087 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.353039   369 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:44.367303 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:15:44.357481   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 99394.8us
I20260709 13:15:44.354316 32089 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:44.319344 32272 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 15.
I20260709 13:15:44.334244  6350 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:44.320858  6321 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:44.322945  6143 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:44.290618 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:44.372529 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.377521  6376 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:15:44.377974 32294 debug-util.cc:398] Leaking SignalData structure 0x7b08002f66c0 after lost signal to thread 30975
W20260709 13:15:44.395313 32294 debug-util.cc:398] Leaking SignalData structure 0x7b080036a760 after lost signal to thread 32056
W20260709 13:15:44.396522 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.391386  6321 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:44.391497  6350 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:44.401007  6350 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:44.401616 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.402871 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.393548  6143 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:44.372304  6371 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:15:44.397536 32294 debug-util.cc:398] Leaking SignalData structure 0x7b080032f740 after lost signal to thread 32148
I20260709 13:15:44.379303  6343 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:44.391857  6344 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:44.413216  6344 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:44.403893  6265 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.413739  6344 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:44.415508 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.416931 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.418071 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.407660  6361 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:44.408113  6343 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:44.419325 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.408190  6348 consensus_queue.cc:1048] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:15:44.403990 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.352718  6369 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:44.422412  6369 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:44.393112 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.424005 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.408334  6360 consensus_queue.cc:1059] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.017s
I20260709 13:15:44.425614  6360 consensus_queue.cc:1243] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer 113b5461952d47e0944d463ea4e32801 log is divergent from this leader: its last log entry 18.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:15:44.426193  6360 raft_consensus.cc:3055] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:44.422173 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.410120  6370 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:44.427316  6370 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:44.427734  6370 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:44.405153  6371 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:44.408269  6376 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:44.432716  6376 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:44.435134  6265 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:44.426523  6360 raft_consensus.cc:740] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:44.379397  6353 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:44.420423 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:15:44.440951 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 58202us
W20260709 13:15:44.406338 32294 debug-util.cc:398] Leaking SignalData structure 0x7b080031a940 after lost signal to thread 32223
W20260709 13:15:44.448546 32294 debug-util.cc:398] Leaking SignalData structure 0x7b080022b320 after lost signal to thread 32297
W20260709 13:15:44.448988 32294 debug-util.cc:398] Leaking SignalData structure 0x7b080023d400 after lost signal to thread 32298
I20260709 13:15:44.390188   368 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:44.353608  6355 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.459333 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.456985  6353 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:44.498517  6355 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:44.499280 32121 raft_consensus.cc:1240] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:44.461215  6375 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:44.500839  6375 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.501423 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.501582  6346 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.502475 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.502838  6375 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:44.503508 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.472901  6360 consensus_queue.cc:260] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:44.505201 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:44.484069 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:44.505905 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:44.506984 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:44.483744 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:44.488160 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:44.507808 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:44.487123 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:44.491007  6356 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:44.507290  6371 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.509151 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:44.509539 32190 raft_consensus.cc:1240] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:44.510437  6366 raft_consensus.cc:2764] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:15:44.510625   400 raft_consensus.cc:1240] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 14. Current term is 15. Ops: []
W20260709 13:15:44.511543   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 121451us
I20260709 13:15:44.512249   368 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:44.512948  6366 raft_consensus.cc:2764] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:15:44.510466  6356 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:44.475092  6275 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.514977 32124 raft_consensus.cc:1240] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:44.515772  6343 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.490412  6321 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:44.458544 32294 debug-util.cc:398] Leaking SignalData structure 0x7b0800335a60 after lost signal to thread 427
I20260709 13:15:44.504648 32121 raft_consensus.cc:1240] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:44.505353  6360 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:44.521060  6342 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.494349  6376 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:44.522238  6321 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:44.498426 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:44.529039 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:44.529383 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:44.529661  6341 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.530207 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:44.531397  6350 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:44.541913 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:44.493363 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 106683us
W20260709 13:15:44.521198 32294 debug-util.cc:398] Leaking SignalData structure 0x7b080030c280 after lost signal to thread 6290
I20260709 13:15:44.532963   400 raft_consensus.cc:1275] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:15:44.549603   398 raft_consensus.cc:1240] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 17. Current term is 18. Ops: []
W20260709 13:15:44.549052   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 196089us
I20260709 13:15:44.535053  6364 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:44.536428 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 268425us
I20260709 13:15:44.555153   398 raft_consensus.cc:1240] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:44.555823   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:44.510506  6371 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:44.556856   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:44.544986 32118 raft_consensus.cc:1240] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:44.545461 32272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "375545897daf43fa925e7b181b2a634b"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:38858
I20260709 13:15:44.558226 32272 raft_consensus.cc:606] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:15:44.547392   402 raft_consensus.cc:1240] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:44.548080 32123 raft_consensus.cc:1240] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:44.459749  6143 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.548712 32115 raft_consensus.cc:1240] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:44.562824   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:44.563467   398 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:15:44.564188   369 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:44.567966   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:44.569633 32193 raft_consensus.cc:1240] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 17 LEADER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:44.571812 32117 raft_consensus.cc:1240] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:44.572870   394 raft_consensus.cc:1240] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 24 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 23. Current term is 24. Ops: []
I20260709 13:15:44.574496   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:44.574707 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:44.561307  6275 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:44.588721  6362 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:44.589494 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.589293  6362 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.590055 32269 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 18.
I20260709 13:15:44.590653  6227 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:44.591163  6227 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.591652  6362 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:44.592753  6360 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:44.593155  6227 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:44.593541  6354 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:44.593775  6227 consensus_queue.cc:1059] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:44.593443  6360 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.594250  6354 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.561352  6346 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:44.547549  6370 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:44.562357  6321 consensus_queue.cc:1048] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:15:44.579193  6377 consensus_queue.cc:1059] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:15:44.601059 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:44.580463  6143 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:44.606293   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
W20260709 13:15:44.612510 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 52729.8us
I20260709 13:15:44.581867 32239 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:44.585659  6341 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:44.598868  6369 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:44.595507  6279 raft_consensus.cc:3055] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:44.619628 32190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:15:44.619928  6279 raft_consensus.cc:740] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:44.620200   399 raft_consensus.cc:1240] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:44.620208 32190 raft_consensus.cc:606] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 20 LEADER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:44.621177  6369 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:44.620864  6279 consensus_queue.cc:260] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.585582  6347 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.622156  6279 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:44.600759 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:44.601418 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:44.601797 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:44.623389  6379 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:44.579896  6373 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:44.623880  6347 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:44.605419  6343 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:44.611900 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 52613.9us
I20260709 13:15:44.558074  6344 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.581595  6350 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:44.625207 32165 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:44.626050 32165 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:44.626312  6344 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:44.627455  6377 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:44.627655  6330 raft_consensus.cc:2804] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:44.627873  6377 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:44.628170  6330 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:44.628386  6377 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:44.628679  6330 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:44.606786   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:44.630084 32165 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:44.609627  6370 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:44.617414  6338 raft_consensus.cc:3055] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:44.599890  6342 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:44.604081  6376 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:44.607326  6364 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 24 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:44.596357  6354 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:44.618408  6353 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.577777  6219 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:44.640329 32117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7594a5601f24445092c404115861232c"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:53200
I20260709 13:15:44.640520  6219 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.624538 32120 raft_consensus.cc:1240] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:44.641788  6353 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:44.616209 32239 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:44.642705  6219 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:44.643247 32116 raft_consensus.cc:1240] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:44.643720 32239 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:44.621784  6384 consensus_queue.cc:1059] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:15:44.632872  6338 raft_consensus.cc:740] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:44.644441  6375 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:44.645113  6375 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:44.645615  6354 raft_consensus.cc:3055] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:44.645319  6338 consensus_queue.cc:260] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:44.646024  6354 raft_consensus.cc:740] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:44.646775  6338 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:44.647424 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.646849  6354 consensus_queue.cc:260] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:44.647804 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.648435 32264 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:15:44.648515  6354 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:44.648967 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.596410  6360 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:44.650046 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.650454 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.651118 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.651680 32267 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 24.
I20260709 13:15:44.627480 32236 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:44.635855   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:44.652287 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.592356  6362 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:44.652906 32271 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:15:44.653371 32236 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:44.653877  6219 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:44.641002 32117 raft_consensus.cc:606] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:44.654587 32236 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:44.653184  6362 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:15:44.655357  6375 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:44.655471 32236 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:44.656009  6375 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:44.656231  6379 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:44.656373  6375 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:44.656821  6375 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:44.657080  6362 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:44.658981  6361 consensus_queue.cc:1059] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:15:44.660166  6384 raft_consensus.cc:3055] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:15:44.660529  6384 raft_consensus.cc:740] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:44.661285 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:15:44.661343  6384 consensus_queue.cc:260] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:44.663468 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:44.595284  6227 consensus_queue.cc:1059] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 13:15:44.636947 32165 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:44.667152 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.667807 32272 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 19.
I20260709 13:15:44.667843 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.668005 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.667336  6321 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:44.668956 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.669344 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.669596 32267 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 18.
I20260709 13:15:44.668447 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.668995  6321 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:44.612272   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:44.671275 32165 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:44.671967 32236 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:44.671890 32239 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:44.670818  6321 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:44.675089  6384 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:15:44.675379  6227 consensus_queue.cc:1243] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer 113b5461952d47e0944d463ea4e32801 log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:15:44.677220 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:44.713441  6359 raft_consensus.cc:3055] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:44.713943  6359 raft_consensus.cc:740] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:44.714566  6219 consensus_queue.cc:1059] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:44.717226  6359 consensus_queue.cc:260] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:44.678467   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:44.679225   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:44.719009  6359 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:44.719292   395 raft_consensus.cc:2393] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 18: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:15:44.679428   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:44.679881   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:44.680728  6351 raft_consensus.cc:993] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:15:44.683941   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:44.685492  6331 raft_consensus.cc:2749] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:44.720474  6351 raft_consensus.cc:1081] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:15:44.685808 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:44.726012 32193 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "375545897daf43fa925e7b181b2a634b"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54182
I20260709 13:15:44.691565 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:44.691727 32269 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17.
I20260709 13:15:44.686091 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:44.692159 32087 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:44.686416  6362 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:44.673893 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.682296   401 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:15:44.686977 32236 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:44.673956  6360 consensus_queue.cc:1059] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
W20260709 13:15:44.677887 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:44.731122 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 44216.9us
I20260709 13:15:44.732945 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:44.733153  6219 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:44.679427 32239 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:44.733549 32115 raft_consensus.cc:3060] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:15:44.733633 32087 consensus_peers.cc:597] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0717a2686ee346b7a5a183e36fdfd173. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:44.734141 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:44.734880  6353 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:44.735736 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:44.682050  6374 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:44.744851 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.677511 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:44.673554  6349 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:44.746156  6349 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:44.746579  6349 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:44.664196  6330 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.750229  6330 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:44.699743  6321 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.752159  6321 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:44.677659   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:44.737669 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:15:44.754494 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 75143us
I20260709 13:15:44.754685  6219 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:44.755800 32239 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:44.756908 32239 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:44.754520  6360 raft_consensus.cc:3055] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:44.757851  6360 raft_consensus.cc:740] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:44.758639  6360 consensus_queue.cc:260] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:44.739053   369 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:44.740836 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:44.742856 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:44.760835   369 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:44.746587   399 raft_consensus.cc:1240] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:44.761590 32239 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:44.710548  6377 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.762915   369 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:44.767238 32268 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 18.
I20260709 13:15:44.768311 32115 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 24.
I20260709 13:15:44.770444 32239 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:44.769445  6376 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:44.771605  6376 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:44.771963  6376 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:44.769345  6356 raft_consensus.cc:2804] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:44.772670  6356 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:44.773104  6356 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:44.771858  6360 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:44.774876 32239 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:44.776448   369 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:44.779207  6370 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:44.779771  6370 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:44.780226  6370 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:44.795425  6370 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:44.797863  6354 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:44.798784  6364 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:44.799209  6364 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:44.799566  6364 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:44.753813  6349 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.774385  6219 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:44.805145 32193 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:44.805332  6349 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:44.805603 32193 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:44.810158 32239 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:44.811520 32239 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:44.812528 32239 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:44.814169 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.815088 32268 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 16.
W20260709 13:15:44.836323 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 148424us
I20260709 13:15:44.767828  6362 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:44.771018  6374 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:44.859948 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.861004 32239 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:44.813446  6227 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:44.860097 32193 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.816195  6219 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:44.855202 32165 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:44.862331 32016 catalog_manager.cc:5697] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 19 to 20, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 20 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:44.855720  6354 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:44.875332  6391 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:44.875530 32165 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:44.875887  6391 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:44.876299  6391 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:44.879666 32165 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:44.774716  6375 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:44.879485  6349 raft_consensus.cc:2804] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:44.885877 32271 raft_consensus.cc:2468] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 24.
I20260709 13:15:44.859058  6367 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:15:44.855489  6351 consensus_queue.cc:1059] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:15:44.895308 32239 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:44.895462 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:15:44.894634   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 117043us
I20260709 13:15:44.896812 32268 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17.
I20260709 13:15:44.897010  6354 consensus_queue.cc:1059] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:44.901185  6351 raft_consensus.cc:3055] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:44.901683  6351 raft_consensus.cc:740] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:44.902565  6351 consensus_queue.cc:260] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.903395 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.904104 32272 raft_consensus.cc:2393] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 18: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:15:44.904248 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.904304 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.904848 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.870819  6361 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:44.906210 32239 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:44.905009 32273 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:15:44.905470 32272 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 20.
I20260709 13:15:44.906802 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.907485  6354 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:44.907588 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.906240 32165 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:44.909513 32268 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 18.
I20260709 13:15:44.908095  6227 raft_consensus.cc:3055] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:44.911386 32267 raft_consensus.cc:1240] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:44.911559  6227 raft_consensus.cc:740] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:44.912393  6227 consensus_queue.cc:260] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.913344  6377 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:44.913712  6227 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:44.915251  6375 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:44.917160  6370 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:44.919131   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:44.902163  6356 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:44.913983  6219 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:44.925315 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:44.927095 32199 raft_consensus.cc:1240] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:44.927551 32191 raft_consensus.cc:1240] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:44.910010  6387 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:44.928644   396 raft_consensus.cc:1275] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:15:44.893728  6349 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:44.929531  6349 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:44.930142 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.930714 32266 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 20.
I20260709 13:15:44.930868  6360 consensus_queue.cc:1059] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:44.931176 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:44.931579 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:44.931833  6360 consensus_queue.cc:1059] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:44.932753 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:44.932866 32267 raft_consensus.cc:1275] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:15:44.933686  6356 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:44.934108  6351 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:44.934363  6362 raft_consensus.cc:3055] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:44.934790  6362 raft_consensus.cc:740] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:44.935621  6362 consensus_queue.cc:260] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.935882  6330 consensus_queue.cc:1048] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:44.936960  6362 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:44.937440 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:44.939610 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:44.940147 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:44.940558 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:44.941207 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:44.941788 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:44.942296 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:44.946928  6391 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.940636 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:44.948796 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:44.950670  6354 raft_consensus.cc:3055] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:44.951130  6354 raft_consensus.cc:740] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:44.953452  6354 consensus_queue.cc:260] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:44.954810  6354 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:44.957329 32272 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17.
I20260709 13:15:44.905916   369 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:44.932920 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:15:44.968009   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 62192.1us
I20260709 13:15:44.970006   369 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:44.970329 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.971239   369 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:44.971913 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.974030   369 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:44.960913 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.958813 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.974778 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.958536 32193 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:44.961331 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.961210 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.962416  6391 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:44.976094 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.977010  6373 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:44.977144 32087 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:44.977589  6373 raft_consensus.cc:697] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:44.978191 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.978722 32087 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:44.978490  6373 consensus_queue.cc:237] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:44.979276 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.979847 32087 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:44.976883  6366 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:44.980479 32265 raft_consensus.cc:2393] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 17: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:44.981380  6366 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:44.981937  6366 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:44.982698  6343 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:44.980718  6385 raft_consensus.cc:2804] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:15:44.983244  6342 raft_consensus.cc:2749] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:44.984946  6385 raft_consensus.cc:697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 24 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:44.985877 32087 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:44.981995 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.986037  6385 consensus_queue.cc:237] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:44.983700  6353 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:44.990561  6364 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:44.991714   399 raft_consensus.cc:1240] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:44.992781  6364 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 17 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:44.965097  6376 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:44.993619 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:44.980310 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:44.976065 32269 raft_consensus.cc:2468] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 9.
W20260709 13:15:44.996273 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 90101.5us
I20260709 13:15:44.998360 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:44.993934  6391 consensus_queue.cc:1059] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 13:15:45.005440  6331 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:45.005630 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:45.006150  6331 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:45.006363  6376 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:45.006510  6391 raft_consensus.cc:3055] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:45.006608  6331 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:45.007071  6391 raft_consensus.cc:740] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:45.007412  6342 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:45.009989   399 raft_consensus.cc:1240] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:45.011811 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:45.012574 32271 raft_consensus.cc:2393] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 16: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:45.013047  6353 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:45.013931  6330 consensus_queue.cc:1059] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:45.014937  6330 raft_consensus.cc:3055] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:45.015250  6330 raft_consensus.cc:740] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:45.015831  6353 consensus_queue.cc:1059] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:15:45.017104  6343 raft_consensus.cc:3055] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:15:45.017489  6343 raft_consensus.cc:740] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
W20260709 13:15:45.018610 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.018370  6343 consensus_queue.cc:260] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:45.019378  6343 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:45.022758 32267 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
I20260709 13:15:45.023780 32268 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:15:45.024134 32190 raft_consensus.cc:1240] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:45.016060  6330 consensus_queue.cc:260] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:45.025009  6360 consensus_queue.cc:1059] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:45.025441  6330 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:45.026012  6359 raft_consensus.cc:3055] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:45.026098  6360 consensus_queue.cc:1059] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:45.026440  6359 raft_consensus.cc:740] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:45.027293  6359 consensus_queue.cc:260] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:45.028607  6359 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:45.028474  6349 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:45.030720  6349 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:45.033300 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:44.998461 32165 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:45.007925  6391 consensus_queue.cc:260] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:45.039155  6391 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:45.041440 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:45.043641   402 raft_consensus.cc:1240] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:45.044314 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:45.037053 32165 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:45.045329 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:45.046348 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:45.047067 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:45.047612 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:45.046129 32165 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:45.048839 32124 raft_consensus.cc:1240] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:45.050028 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:45.051118 32119 raft_consensus.cc:1240] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 23. Current term is 24. Ops: []
I20260709 13:15:45.050208   369 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:45.054883   369 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:45.042760 32016 catalog_manager.cc:5697] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 16 to 17, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 17 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:45.101627 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:45.103030 32264 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
I20260709 13:15:45.104153 32121 raft_consensus.cc:1240] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:45.104668 32239 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:45.105389 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:45.108315 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:45.046810  6356 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:45.049674  6349 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:15:45.114125 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.053515  6387 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:45.103332   369 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:45.115531 32239 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:45.117128 32193 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:15:45.119118 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:45.050926  6367 consensus_queue.cc:1059] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 13:15:45.059927  6370 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:45.053810  6360 consensus_queue.cc:1059] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:15:45.127290 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:45.051748  6351 consensus_queue.cc:1059] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:15:45.027268  6331 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:45.108542  6321 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:45.129102 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:45.078627  6354 consensus_queue.cc:1059] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 13:15:45.113590  6376 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:45.120179  6219 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:45.138477 32239 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:45.121503  6349 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:45.123716  6387 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:45.143385 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:45.129308  6364 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:45.149277 32269 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 17.
I20260709 13:15:45.135727  6366 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:45.154491 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:45.154654 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:45.151523 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:45.155956  6366 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:45.157052 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:45.141755  6384 raft_consensus.cc:2749] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:45.159857 32239 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:45.152695 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:45.153291  6387 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:15:45.152312 32090 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.30.63.3:36651 timed out after 1.792s (SENT)
I20260709 13:15:45.162540 32239 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:45.157645 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:45.158478 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:45.135208  6321 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:45.149349  6349 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:45.166085 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:45.172277 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:15:45.166970 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.166996 32239 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:45.173986 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:45.179167 32190 raft_consensus.cc:2393] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 17: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:45.188697 32239 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:45.165234  6362 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:45.192988 32239 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:45.172546  6321 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:45.166188  6219 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:45.197849  6276 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:45.198455 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:45.200922 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:45.178632  6351 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:45.202737 32199 raft_consensus.cc:1240] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 20 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:45.181228  6384 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:45.201469  6156 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:45.208293 32239 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:45.208860   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 77475.7us
I20260709 13:15:45.190119  6398 ts_tablet_manager.cc:933] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339)
I20260709 13:15:45.204141 32271 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
I20260709 13:15:45.215032  6346 consensus_queue.cc:1059] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:45.216562  6346 raft_consensus.cc:3055] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:45.217028  6346 raft_consensus.cc:740] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:45.218008  6346 consensus_queue.cc:260] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:45.219508  6346 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:45.222841  6374 raft_consensus.cc:3055] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:45.223376  6374 raft_consensus.cc:740] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:45.226154  6279 raft_consensus.cc:3055] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:45.226640  6279 raft_consensus.cc:740] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:45.227473  6279 consensus_queue.cc:260] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:45.234431   369 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:45.240195 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:45.241830 32199 raft_consensus.cc:1240] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:45.241526 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:45.243840 32120 raft_consensus.cc:1240] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:45.245643 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:45.245805 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:45.247695 32268 raft_consensus.cc:2393] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 15: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:45.195996  6354 consensus_queue.cc:1059] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:15:45.249302  6364 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:45.252377 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:45.253273 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:45.229103  6362 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:45.249647 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:45.250213 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:45.250342   369 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:45.258608 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:45.259665 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:45.261695 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:15:45.274351  6396 log.cc:927] Time spent T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.130s	user 0.003s	sys 0.000s
I20260709 13:15:45.258315  6279 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:45.276499  6367 raft_consensus.cc:3055] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:45.276984  6367 raft_consensus.cc:740] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:45.277786  6367 consensus_queue.cc:260] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:45.278837  6375 raft_consensus.cc:3055] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:45.279261  6375 raft_consensus.cc:740] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:45.280056  6375 consensus_queue.cc:260] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:45.281092  6331 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:45.282749 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.282768 32120 raft_consensus.cc:1240] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: []
W20260709 13:15:45.250406  6395 log.cc:927] Time spent T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:15:45.224313  6374 consensus_queue.cc:260] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:45.259565  6393 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:15:45.296743  6219 consensus_queue.cc:1175] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "113b5461952d47e0944d463ea4e32801" responder_term: 13 status { last_received { term: 12 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:15:45.297983  6374 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:45.304498  6367 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:45.305527  6351 raft_consensus.cc:3055] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:45.305953  6351 raft_consensus.cc:740] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:15:45.306193 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.308943  6375 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:45.308540  6351 consensus_queue.cc:260] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:45.311111 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:45.313519 32190 raft_consensus.cc:1240] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 16. Current term is 17. Ops: []
W20260709 13:15:45.335915 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 183627us
W20260709 13:15:45.357117   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 106856us
I20260709 13:15:45.358749 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:45.367206   369 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:15:45.370285 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 54874.8us
I20260709 13:15:45.370723 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:45.371688 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:45.371114 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:45.377540  6401 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:45.377821   396 raft_consensus.cc:1240] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:45.381417 32090 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:45.383464 32090 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:45.385747  6353 raft_consensus.cc:2804] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:45.386196  6353 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:45.386616  6353 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:45.391572   396 raft_consensus.cc:1240] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:45.397646 32267 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 17.
I20260709 13:15:45.376639  6351 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:45.410749 32016 catalog_manager.cc:5697] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 17 to 18, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 18 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:45.411738 32269 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
I20260709 13:15:45.390821  6359 consensus_queue.cc:1059] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:15:45.397338  6342 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:45.472854 32265 raft_consensus.cc:1275] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:15:45.473738 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:45.474476 32266 raft_consensus.cc:2393] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 9: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:45.474758 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:15:45.470324 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 86935us
I20260709 13:15:45.477411 32090 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:45.477435 32264 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:15:45.478497 32090 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:45.469412 32016 catalog_manager.cc:5697] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 23 to 24, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 24 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:45.475687 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:45.476110 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:45.470534 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:45.482460 32269 raft_consensus.cc:2393] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 15: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:45.482885 32272 raft_consensus.cc:2393] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 17: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:45.480934  6398 tablet_copy_client.cc:323] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Beginning tablet copy session from remote peer at address 127.30.63.1:42339
I20260709 13:15:45.483923  6346 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:15:45.484452  6346 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:45.488767  6346 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:15:45.487463  6387 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:45.494110 32191 raft_consensus.cc:1240] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:45.495396  6342 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:45.496922  6279 raft_consensus.cc:3055] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:45.499969 32269 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:15:45.526012  6279 raft_consensus.cc:740] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:45.501734  6321 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:45.506265 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:45.527169 32119 raft_consensus.cc:2393] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 17: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:45.526940  6279 consensus_queue.cc:260] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:45.527426  6373 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:15:45.513681 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:45.528538 32115 raft_consensus.cc:2393] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 9: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:45.515481 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:45.517015 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:45.517077 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:45.517485 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:45.517933  6349 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:45.523339 32272 raft_consensus.cc:1275] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:15:45.534976 32268 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
I20260709 13:15:45.538002 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:45.523768  6387 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:45.538179 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:45.539065 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:45.553726 32271 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:15:45.552660 32116 raft_consensus.cc:2393] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 18: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:45.556294 32123 raft_consensus.cc:2393] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 15: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
W20260709 13:15:45.562009 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 82174.9us
I20260709 13:15:45.558208 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:15:45.563145 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 45216.1us
I20260709 13:15:45.566406 32269 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
I20260709 13:15:45.570151 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:45.570732 32115 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:45.572683 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:45.573554 32124 raft_consensus.cc:2393] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 19: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:45.577301 32120 raft_consensus.cc:1275] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:15:45.530267  6342 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:45.580960  6342 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:45.583392   401 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:15:45.586436  6405 consensus_queue.cc:1059] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:45.587332  6321 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:45.588619  6378 consensus_queue.cc:1048] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:15:45.580879 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:45.594789 32121 raft_consensus.cc:2393] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 17: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:45.595415  6349 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:45.596807 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:45.604262 32115 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
W20260709 13:15:45.605404 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 45447.9us
W20260709 13:15:45.607265 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.609081 32268 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 19.
I20260709 13:15:45.608907   396 raft_consensus.cc:2955] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 8 to 13, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:45.610647 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:45.611220 32116 raft_consensus.cc:2393] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 13: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:45.614171   401 raft_consensus.cc:1240] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:45.562305  6407 consensus_queue.cc:1059] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
W20260709 13:15:45.620034 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 92019.4us
I20260709 13:15:45.614163  6321 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.012s
I20260709 13:15:45.629370  6408 raft_consensus.cc:3055] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:45.629889  6408 raft_consensus.cc:740] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:45.630740  6408 consensus_queue.cc:260] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:45.632169  6408 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:45.635041 32270 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 15.
I20260709 13:15:45.637888  6349 consensus_queue.cc:1059] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:15:45.644956 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.623150  6353 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:45.663437 32118 raft_consensus.cc:1240] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:45.668525  6353 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:45.639158  6349 raft_consensus.cc:3055] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:45.672935  6349 raft_consensus.cc:740] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:45.666302 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:45.623590  6342 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:45.683327  6342 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:45.689399 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 126326us
W20260709 13:15:45.690467 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 48910.4us
I20260709 13:15:45.690282 32090 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:45.691676  6353 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:45.692113  6353 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:45.693641  6343 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:45.697173 32165 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:45.699015 32165 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:45.700124 32193 raft_consensus.cc:1240] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:45.701531 32090 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:45.709806 32090 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:45.714254 32090 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:45.717340 32090 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:45.718784 32090 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:45.692498  6353 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:45.698539  6279 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:45.708702  6330 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:45.726480  6405 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:15:45.765193 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 66245.4us
I20260709 13:15:45.784168 32266 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 17.
I20260709 13:15:45.716497  6343 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:45.785111  6405 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:45.781466  6413 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:45.765964  6387 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:45.785742  6410 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:45.819489  6410 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:45.819967  6410 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:45.789554 32165 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:45.700249  6406 raft_consensus.cc:2955] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Committing config change with OpId 14.13: config changed from index 8 to 13, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:15:45.830904 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 112222us
I20260709 13:15:45.832119 32165 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:45.827534 32016 catalog_manager.cc:5697] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 8 to 13, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New cstate: current_term: 14 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:45.834034 32090 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:45.837719 32165 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:45.839051 32090 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:45.790411  6408 raft_consensus.cc:3055] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:45.810760  6413 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:45.787083  6407 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:45.809440  6405 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:45.833498  6321 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:45.847002  6413 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:45.849992  6321 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:45.858357  6405 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:45.861383  6405 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:45.863132  6405 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:45.863611  6405 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:45.864044  6405 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:45.837002  6330 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.868259  6330 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:45.870471  6330 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:45.844139  6349 consensus_queue.cc:260] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:45.871383  6405 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:45.872076  6349 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:45.873646  6405 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:45.874306  6405 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:45.874718  6405 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:45.875234  6405 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:45.834863  6346 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:45.879431 32123 raft_consensus.cc:1240] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 25 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 24. Current term is 25. Ops: []
I20260709 13:15:45.880460  6346 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 25 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:45.883759  6405 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:45.890621   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:45.840945  6371 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:45.891479   396 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 15.
I20260709 13:15:45.895147 32162 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:45.897019  6321 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:45.842348  6408 raft_consensus.cc:740] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:45.899912  6321 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:45.912652 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 145232us
I20260709 13:15:45.915831  6321 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:15:45.945106 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 106114us
W20260709 13:15:45.947480 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 109826us
I20260709 13:15:45.948369 32165 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:45.950820 32090 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:45.932888  6408 consensus_queue.cc:260] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:45.958067 32165 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:45.960984  6330 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:45.964923  6405 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:45.967720  6409 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:45.968176  6409 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:45.969056 32165 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:45.972257 32165 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:45.973609 32165 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:45.975139 32165 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:45.976627 32165 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:45.970803  6331 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:45.978202  6331 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:45.978844  6331 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:45.975574  6349 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:45.975608  6330 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:45.994048 32259 tablet_service.cc:1558] Processing DeleteTablet for tablet ddd7dfc158794e3ab7427d0b86b46c8d with delete_type TABLET_DATA_TOMBSTONED (TS 6b3ed521ce8947db80c4b4828b355c06 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:45768
I20260709 13:15:45.955945  6377 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:46.001853  6408 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:45.968537  6409 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:15:46.033018 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 82262.4us
I20260709 13:15:46.035104 32090 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:46.037562  6425 tablet_replica.cc:333] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:15:46.039109  6425 raft_consensus.cc:2243] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:46.040023  6425 raft_consensus.cc:2272] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:46.043727  6425 ts_tablet_manager.cc:1916] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:45.965796  6405 raft_consensus.cc:2955] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
W20260709 13:15:46.053598 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 77094.3us
I20260709 13:15:46.054627 32165 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:46.058291 32165 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:46.059096 32090 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:46.059836 32165 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:46.063679  6377 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:46.068183  6349 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:46.067888  6415 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:46.061605  6417 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:46.082149  6330 consensus_queue.cc:1048] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:15:46.078202  6416 consensus_queue.cc:1048] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:15:46.087589  6415 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:46.099565  6415 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:46.101826  6409 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:46.074123  6421 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:46.106323  6409 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:46.089295  6343 raft_consensus.cc:993] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d: : Instructing follower 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:15:46.093392  6413 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:46.110111  6407 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:46.081845  6410 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:46.119374  6421 raft_consensus.cc:1081] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Signalling peer 6b3ed521ce8947db80c4b4828b355c06 to start an election
W20260709 13:15:46.157723 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 86464.3us
I20260709 13:15:46.117410  6423 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
I20260709 13:15:46.162485 32165 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:46.165259  6387 raft_consensus.cc:2804] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:46.165856  6387 raft_consensus.cc:697] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:46.166080  6321 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:46.165802 32165 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:46.155872  6349 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.171103  6406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:56870 (request call id 75) took 2255 ms. Trace:
I20260709 13:15:46.166914  6387 consensus_queue.cc:237] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:46.175393  6331 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:46.175920  6331 raft_consensus.cc:697] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:46.173477 32165 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:46.178364 32165 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:46.177354  6349 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:46.182752  6413 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:46.184795  6415 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:46.160609  6353 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:46.185597  6423 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:46.187462 32165 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:46.188468  6377 raft_consensus.cc:2764] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 13:15:46.189191  6377 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:46.189642  6377 raft_consensus.cc:697] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 17 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:46.190527  6377 consensus_queue.cc:237] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:46.193154  6423 raft_consensus.cc:697] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 19 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:46.193455  6353 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:46.196442  6410 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:46.194319  6423 consensus_queue.cc:237] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:46.200824  6331 consensus_queue.cc:237] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:46.205281  6321 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:46.206539   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:46.207108   396 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:15:46.212144 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 147769us
I20260709 13:15:46.213135 32090 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:46.217306 32090 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:46.219213   396 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:15:46.221046 32090 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:46.224342 32090 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:46.225546  6409 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:46.227602 32090 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:46.227291   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:46.229560   401 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:15:46.229951 32162 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:46.227939  6410 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:15:46.231787  6415 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:46.231604 32162 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:46.233074  6330 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:46.234890  6330 raft_consensus.cc:697] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:46.233803  6353 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:46.233784  6321 raft_consensus.cc:2804] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:46.236295  6321 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.236768  6321 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:46.211761  6349 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:46.241420  6330 consensus_queue.cc:237] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:46.243222 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 55839.4us
I20260709 13:15:46.227421  6407 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:15:46.270742 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:46.231600 32090 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:46.224689  6342 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:46.251005 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:46.255120 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:46.273512 32266 raft_consensus.cc:2393] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 15: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:46.261312 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:46.262247 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:46.262176 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:46.274714 32090 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:46.275838 32090 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:46.263418 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:46.263557 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:46.264076 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:46.267422 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:46.266983 32194 raft_consensus.cc:2955] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:15:46.269819 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:46.270298 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:46.271564 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:46.280561 32115 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:15:46.281320 32116 raft_consensus.cc:2393] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 15: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:46.272830 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:46.282251  6353 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:46.171641  6406 rpcz_store.cc:276] 0709 13:15:43.908508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.908677 (+   169us) service_pool.cc:224] Handling call
0709 13:15:43.912724 (+  4047us) log.cc:844] Serialized 487 byte log entry
0709 13:15:44.071434 (+158710us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b180035e5a0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bf043f3 00007fb59bf067c1 00007fb59bf06779 00007fb59bf06709 00007fb59bf066d1 00007fb59bf059cd 000000000038f354 000000000038f199 00007fb59bee783a
0709 13:15:46.161426 (+2089992us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8530,"raft.queue_time_us":15291,"raft.run_cpu_time_us":1717,"raft.run_wall_time_us":89760,"spinlock_wait_cycles":2936192,"thread_start_us":80087,"threads_started":1,"wal-append.queue_time_us":98957,"wal-append.run_cpu_time_us":1835,"wal-append.run_wall_time_us":1045589}
I20260709 13:15:46.294567 32123 raft_consensus.cc:2393] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 14: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:46.292569 32165 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:46.298287 32165 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:46.303002 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:46.306334 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:46.307737 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:46.308636 32121 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:15:46.309676 32165 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:46.311998 32269 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:15:46.314661 32090 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:46.316959 32118 raft_consensus.cc:2393] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 17: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:46.287204  6432 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:46.343058 32090 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:46.305078  6416 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.349380  6416 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:46.351980 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:46.352245  6416 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:46.353340 32272 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 17.
I20260709 13:15:46.353961 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:46.334079  6421 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:46.354651  6371 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:46.354882 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:46.356809 32090 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:46.312881  6349 raft_consensus.cc:2749] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:46.314368  6417 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:46.367329 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:46.356066  6405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:53184 (request call id 3) took 2433 ms. Trace:
I20260709 13:15:46.361366  6409 raft_consensus.cc:2804] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:46.430466 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:46.347517 32193 raft_consensus.cc:2955] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 8 to 13, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:46.355512  6342 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:46.432229  6279 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:46.367430  6421 raft_consensus.cc:697] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:46.368136  6415 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:46.469455 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:46.470108 32273 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:46.442880 32122 raft_consensus.cc:1275] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:15:46.473436 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:46.474362 32269 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 18.
I20260709 13:15:46.475739 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:46.477128 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:46.445500 32121 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:15:46.435559   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:46.457361 32134 tablet_copy_service.cc:140] P fcfc3281929645969ecedbb0c0af759d: Received BeginTabletCopySession request for tablet 0717a2686ee346b7a5a183e36fdfd173 from peer 94085cf341634eb686a95983b6b7f7e6 ({username='slave'} at 127.0.0.1:55358)
I20260709 13:15:46.446470  6409 raft_consensus.cc:697] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:46.440728  6405 rpcz_store.cc:276] 0709 13:15:43.908859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.908991 (+   132us) service_pool.cc:224] Handling call
0709 13:15:43.914562 (+  5571us) log.cc:844] Serialized 492 byte log entry
0709 13:15:43.999729 (+ 85167us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b1800206ec0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59be7ec0a 00007fb5a55be219 00007fb59bf06a40 00007fb59bf014e4 00007fb59bf01455 00007fb59ef4ab0b 00007fb59efcfb63 00007fb59eff7752 00007fb5a3fb7d29
0709 13:15:44.098151 (+ 98422us) spinlock_profiling.cc:243] Waited 954 us on lock 0x7b1800206ec0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bf043f3 00007fb59bf067c1 00007fb59bf06779 00007fb59bf06709 00007fb59bf066d1 00007fb59bf059cd 000000000038f354 000000000038f199 00007fb59bee783a
0709 13:15:46.334320 (+2236169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24150,"raft.queue_time_us":38661,"raft.run_cpu_time_us":2203,"raft.run_wall_time_us":8094,"spinlock_wait_cycles":36461568,"thread_start_us":48146,"threads_started":1,"wal-append.queue_time_us":130320,"wal-append.run_cpu_time_us":1983,"wal-append.run_wall_time_us":1051760}
I20260709 13:15:46.459422  6279 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:46.461625  6342 raft_consensus.cc:697] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:46.462661 32123 raft_consensus.cc:1275] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:15:46.482803 32115 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 16.
I20260709 13:15:46.486753 32116 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 16.
W20260709 13:15:46.487376 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 128137us
I20260709 13:15:46.509971 32165 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:46.511147 32165 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:46.494971 32009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ddd7dfc158794e3ab7427d0b86b46c8d with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 12)
I20260709 13:15:46.534497 32090 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:46.562863 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:46.563675 32271 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:46.564710 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:46.501483  6413 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.514165  6415 raft_consensus.cc:697] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:46.504526 32134 tablet_copy_service.cc:161] P fcfc3281929645969ecedbb0c0af759d: Beginning new tablet copy session on tablet 0717a2686ee346b7a5a183e36fdfd173 from peer 94085cf341634eb686a95983b6b7f7e6 at {username='slave'} at 127.0.0.1:55358: session id = 94085cf341634eb686a95983b6b7f7e6-0717a2686ee346b7a5a183e36fdfd173
I20260709 13:15:46.589249 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:46.590983 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:15:46.591192 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 80134.6us
I20260709 13:15:46.593374 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:46.587570 32017 catalog_manager.cc:5697] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 9 to 10, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 10 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:46.597263 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:46.607336 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:46.531976  6417 consensus_queue.cc:1048] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 13:15:46.571455  6407 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:46.613570 32271 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 21.
I20260709 13:15:46.574944  6387 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:46.574638  6442 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:46.618698 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:46.627738  6445 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:46.621290 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:46.616976 32264 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7594a5601f24445092c404115861232c"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:36084
I20260709 13:15:46.629698 32264 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:46.630445 32264 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:46.630688 32089 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:46.611785  6434 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.575793  6413 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:46.590430  6378 consensus_queue.cc:1048] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 13:15:46.671773  6321 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:46.643255 32089 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:46.618006  6407 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:46.647789 32116 raft_consensus.cc:1240] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:46.647843 32264 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:46.653220 32123 raft_consensus.cc:1240] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 20. Current term is 21. Ops: []
W20260709 13:15:46.654897  6440 log.cc:927] Time spent T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:15:46.661470  6279 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:46.728433 32265 raft_consensus.cc:1240] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:46.665284  6425 ts_tablet_manager.cc:1929] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.12
I20260709 13:15:46.633678  6331 consensus_queue.cc:1059] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.050s
I20260709 13:15:46.665987  6415 consensus_queue.cc:237] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:46.670943 32121 consensus_queue.cc:237] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
W20260709 13:15:46.674202  6437 log.cc:927] Time spent T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:15:46.624193  6421 consensus_queue.cc:237] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:46.629276  6445 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:46.639202  6416 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:46.608511  6409 consensus_queue.cc:237] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:46.625036  6349 consensus_queue.cc:1059] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
W20260709 13:15:46.724068 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 80841.9us
I20260709 13:15:46.643965  6434 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:46.726373  6407 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:46.743641 32266 raft_consensus.cc:2955] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:15:46.729493 32264 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:46.635453  6342 consensus_queue.cc:237] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:46.749035 32115 raft_consensus.cc:1240] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:46.734246  6425 log.cc:1199] T ddd7dfc158794e3ab7427d0b86b46c8d P 6b3ed521ce8947db80c4b4828b355c06: Deleting WAL directory at /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-2-root/wals/ddd7dfc158794e3ab7427d0b86b46c8d
I20260709 13:15:46.776391 32165 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:46.778825 32090 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:46.746917  6444 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.780872 32090 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:46.745527  6446 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:46.731014  6353 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:46.774020  6442 raft_consensus.cc:697] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:46.773883  6448 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:46.745705  6279 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.781664  6408 raft_consensus.cc:2749] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:15:46.807221 32162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 175107us
I20260709 13:15:46.801723 32273 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 19.
I20260709 13:15:46.812085 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:46.813831 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:46.814550 32193 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:46.825296 32193 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 20.
I20260709 13:15:46.790196  6416 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:46.826776 32238 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:15:46.836405 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 55613us
I20260709 13:15:46.792407  6349 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:46.851450 32090 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:46.856973  6465 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:46.863996 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 86167.6us
I20260709 13:15:46.788064  6444 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:46.864420 32090 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:46.870398 32090 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:46.828475  6279 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:46.789628  6446 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:46.809185  6448 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:46.868476  6408 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:46.900126 32165 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:46.864671  6432 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:15:46.901473 32165 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:46.871881  6405 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:15:46.899775  6356 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.877321 32134 tablet_copy_source_session.cc:215] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:46.908375  6377 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:46.909128  6469 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:46.912039  6279 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:15:46.916620  6449 log.cc:927] Time spent T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:15:46.917003  6455 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:15:46.917965  6462 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:46.918401  6444 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:46.866753  6465 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:46.879169  6413 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:46.891979  6321 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:46.929065  6356 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:46.941632  6356 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:46.941706  6465 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:46.937307  6462 raft_consensus.cc:697] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 17 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:46.944093  6462 consensus_queue.cc:237] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:46.944875  6445 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:46.935068  6469 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:46.948670  6377 raft_consensus.cc:697] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:46.949783  6377 consensus_queue.cc:237] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:46.904189  6458 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:46.952472  6458 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:46.953823  6443 raft_consensus.cc:3055] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:46.954409  6443 raft_consensus.cc:740] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:46.950253  6469 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:46.954890  6458 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:46.955499  6443 consensus_queue.cc:260] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:46.966184 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:46.972501 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:46.985121 32117 raft_consensus.cc:2393] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 16: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:15:46.978431 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:46.985726 32119 raft_consensus.cc:2393] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 16: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:15:46.981040 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:46.990510 32124 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:15:46.991648 32239 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:46.975854 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:46.975334  6279 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.001379 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:47.001748  6279 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:47.004227  6279 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:47.004904 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:47.005533 32115 raft_consensus.cc:3055] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:15:47.005831 32115 raft_consensus.cc:740] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:47.006083  6448 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:47.006589 32115 consensus_queue.cc:260] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:47.007833 32115 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:47.008752  6453 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.009260  6453 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:47.001382 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:47.011459  6453 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:46.830695 32009 catalog_manager.cc:5028] TS 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): tablet ddd7dfc158794e3ab7427d0b86b46c8d (table test-workload [id=9b9dc20f98e547b59efac9c530f28125]) successfully deleted
W20260709 13:15:47.012562 32009 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 181896us
I20260709 13:15:46.808105 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:47.024303 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.981825  6465 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.975473  6455 raft_consensus.cc:697] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 20 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:47.055634   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:47.057639   396 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
W20260709 13:15:47.057693   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 186601us
I20260709 13:15:47.059792   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:47.060478   396 raft_consensus.cc:2393] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 16: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:15:47.063037   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:47.064484   396 raft_consensus.cc:2393] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 16: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:15:46.878433  6442 consensus_queue.cc:237] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:47.051822  6448 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:15:47.065798 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 161101us
I20260709 13:15:47.050745  6353 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:47.071154 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:15:47.055649 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 183134us
I20260709 13:15:47.072368   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:47.072718 32236 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:47.073127   396 raft_consensus.cc:2393] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 12: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:15:47.068805 32115 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 20.
I20260709 13:15:47.073395 32090 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:47.073972 32236 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:47.077311 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:15:47.079562   369 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.012s	sys 0.002s
W20260709 13:15:47.115239   369 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.012s	sys 0.002s
I20260709 13:15:47.115343 32266 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
W20260709 13:15:47.115700   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 581879us
I20260709 13:15:47.070140  6419 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.077186 32090 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:47.113708   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:47.114010 32273 raft_consensus.cc:1275] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:15:47.075486 32193 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:15:47.172360 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:47.087951 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:15:47.133138   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 52653.9us
I20260709 13:15:47.068531  6448 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.061586  6465 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:47.174026   401 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:15:47.070878  6443 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:47.081158  6406 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:15:47.081485  6279 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:47.173326 32264 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:15:47.175086  6452 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.120484  6445 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:47.177204 32236 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:47.177865   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:47.211148   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:47.178771  6448 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:47.173290  6419 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:47.190634  6407 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:47.191792  6410 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:15:47.192075  6446 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:47.081337  6353 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:47.216542  6470 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:47.258211  6470 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.258677  6470 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:47.259467  6353 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:47.259603  6419 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:47.217134  6471 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.216945  6321 consensus_queue.cc:1059] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:15:47.261343  6321 raft_consensus.cc:3055] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:15:47.261749  6321 raft_consensus.cc:740] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:47.262530  6321 consensus_queue.cc:260] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:47.219228  6452 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:47.263468  6429 consensus_queue.cc:1059] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:47.223834  6480 consensus_queue.cc:1059] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:47.264772  6429 raft_consensus.cc:3055] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:47.225773  6455 consensus_queue.cc:237] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:47.265933  6480 raft_consensus.cc:3055] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:47.246735 32273 raft_consensus.cc:1240] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 20. Current term is 21. Ops: []
I20260709 13:15:47.266376  6480 raft_consensus.cc:740] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:47.265061  6452 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:47.267905   401 raft_consensus.cc:2393] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 17: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:15:47.229212  6465 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:47.267319  6480 consensus_queue.cc:260] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:47.268764  6429 raft_consensus.cc:740] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:47.269644  6480 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:47.248562 32268 raft_consensus.cc:1275] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:15:47.248728 32267 raft_consensus.cc:1275] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:15:47.260368  6410 raft_consensus.cc:697] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 21 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:47.260931  6471 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:47.225176   369 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:15:47.273028   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 47964.4us
W20260709 13:15:47.225346  6478 log.cc:927] Time spent T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:15:47.270512  6465 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.247133 32165 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:47.289290   369 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:47.277478 32264 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:15:47.271607  6410 consensus_queue.cc:237] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:47.296655 32122 raft_consensus.cc:1240] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:47.270598  6445 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:47.307899   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:47.308758   396 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:15:47.301652   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 56085.8us
I20260709 13:15:47.314253 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:47.314862   399 raft_consensus.cc:1275] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:15:47.316176 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:47.314913 32196 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 17.
I20260709 13:15:47.292001  6446 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.294816  6349 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:47.298174  6452 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:15:47.323146 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 232191us
W20260709 13:15:47.331892 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 254801us
I20260709 13:15:47.306196  6419 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:47.333379 32090 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:47.322841 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:47.330693   368 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:47.342782 32267 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 16.
I20260709 13:15:47.320173  6279 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:47.347581   396 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:15:47.295348  6465 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:47.350445 32090 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:47.305217  6376 consensus_queue.cc:1048] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.039s
I20260709 13:15:47.325205  6349 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.354691   369 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:47.269711  6429 consensus_queue.cc:260] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:47.348454  6364 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:47.355535  6421 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:15:47.375640 32239 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:47.379451   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:47.382946  6279 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:47.387354  6463 consensus_queue.cc:1048] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.093s
I20260709 13:15:47.380357   399 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 16.
I20260709 13:15:47.389914  6481 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:47.390415  6481 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.390789  6481 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:47.391072  6398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0717a2686ee346b7a5a183e36fdfd173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:47.391358  6434 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:47.393040   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:47.366693  6364 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.397112  6364 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:47.400480  6407 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:47.403384 32087 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:47.403460  6423 raft_consensus.cc:3055] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:15:47.406538  6423 raft_consensus.cc:740] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:47.407392  6423 consensus_queue.cc:260] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:47.408706  6423 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:15:47.403456  6465 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:47.417219  6429 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:47.330931  6446 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:47.422372  6446 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:47.360994  6405 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.064s
I20260709 13:15:47.428838  6353 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:15:47.361151  6413 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:47.429972  6321 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:15:47.431025 32087 consensus_peers.cc:597] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: afb482e4812e47d0a501b142e64cb73b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:47.361150  6349 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:47.431149  6481 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:47.431715 32087 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:47.429975  6413 raft_consensus.cc:697] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:47.433436  6416 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:47.433666  6413 consensus_queue.cc:237] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:47.434736 32087 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:47.359715  6471 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:47.429677  6364 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:47.436902 32122 raft_consensus.cc:1240] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:47.454380 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:47.455178 32122 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 13.
I20260709 13:15:47.437496 32115 raft_consensus.cc:1275] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:15:47.439924 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:47.440678 32264 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:15:47.442688 32124 raft_consensus.cc:1240] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:47.444177 32118 raft_consensus.cc:1240] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:47.435467  6353 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:15:47.451120 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 147294us
I20260709 13:15:47.458426 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:47.462941 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:47.466842 32193 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:15:47.463289 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:47.464186 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:47.468477 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:47.464026 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:47.470125 32197 raft_consensus.cc:2368] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 12. Current term is 13.
I20260709 13:15:47.464087 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:47.470893 32191 raft_consensus.cc:2468] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 9.
I20260709 13:15:47.469277 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:47.469311 32199 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:15:47.472224 32238 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:47.473493 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:47.474368 32193 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:15:47.484360 32120 raft_consensus.cc:1275] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:15:47.488159 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:47.495042 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:47.495503   396 raft_consensus.cc:2368] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 17. Current term is 18.
I20260709 13:15:47.500988 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:47.501149 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:47.503029 32162 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:47.501048 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:47.507931 32238 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:47.467109  6353 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.508791 32238 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:47.514673 32238 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:47.514873 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:47.515512 32121 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 19.
I20260709 13:15:47.516347 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:47.511143   369 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:47.521217 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:47.521872 32119 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 16.
I20260709 13:15:47.523360 32238 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:47.524925 32117 raft_consensus.cc:1240] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 21 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 20. Current term is 21. Ops: []
I20260709 13:15:47.485090  6465 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.576478 32119 raft_consensus.cc:1240] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:47.492290  6446 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:47.513860  6279 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:47.520668  6353 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:15:47.586796 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.503093  6419 raft_consensus.cc:697] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 16 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:47.524258  6393 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:47.520015  6480 raft_consensus.cc:2804] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:47.529340  6455 raft_consensus.cc:2804] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:47.569307  6445 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:47.510306  6463 consensus_queue.cc:1059] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.075s
I20260709 13:15:47.594190   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:47.509541  6331 consensus_queue.cc:1048] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.076s
I20260709 13:15:47.572557  6452 raft_consensus.cc:697] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 16 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:47.625731   401 raft_consensus.cc:2393] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 18: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:15:47.519343  6371 consensus_queue.cc:1048] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.074s
I20260709 13:15:47.573764  6470 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:47.591671  6446 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:47.877628 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 374620us
I20260709 13:15:47.849493 32017 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49550 (request call id 317) took 1391 ms. Trace:
I20260709 13:15:47.680542 32191 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:15:47.595723  6279 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.601912  6393 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.966331 32118 raft_consensus.cc:1275] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:15:47.769312  6495 log.cc:927] Time spent T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.132s	user 0.004s	sys 0.000s
W20260709 13:15:47.774044  6496 log.cc:927] Time spent T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.099s	user 0.000s	sys 0.003s
I20260709 13:15:47.601198  6455 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.625252  6445 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.767871  6429 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:47.763696  6464 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:47.769745  6382 log.cc:927] Time spent T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7: Append to log took a long time: real 0.109s	user 0.004s	sys 0.000s
I20260709 13:15:47.912567  6487 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.026103  6429 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:48.032256  6487 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:48.038604  6487 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:47.629906  6450 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.496s
I20260709 13:15:47.589381  6465 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:48.002938 32268 raft_consensus.cc:2393] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 17: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:47.914970  6476 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.799499  6451 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:47.638403  6463 raft_consensus.cc:3055] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:15:48.004755 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 481410us
I20260709 13:15:48.053007 32238 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:47.673642  6480 raft_consensus.cc:697] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 13 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:47.877130  6330 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:47.955439  6446 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:47.954037  6481 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:47.954901  6279 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:15:47.991573  6423 consensus_meta.cc:287] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.568s	user 0.011s	sys 0.000s
I20260709 13:15:48.006422  6445 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:47.974604  6393 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:48.087445 32116 raft_consensus.cc:1275] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:15:48.039883 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:48.088497 32118 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:15:47.597677  6473 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.372s
I20260709 13:15:47.713757  6448 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:48.004619  6455 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:47.820973  6349 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:48.031288  6464 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:48.091555   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:48.097657 32087 leader_election.cc:400] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Vote denied by peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025) with higher term. Message: Invalid argument: T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 17. Current term is 18.
I20260709 13:15:48.065650  6463 raft_consensus.cc:740] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:48.102232 32087 leader_election.cc:403] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:47.946532 32017 rpcz_store.cc:276] 0709 13:15:46.458431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.492902 (+ 34471us) service_pool.cc:224] Handling call
0709 13:15:47.849355 (+1356453us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:46.857804 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:46.858413 (+   609us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:46.858453 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:15:46.858473 (+    20us) tablet.cc:662] Decoding operations
0709 13:15:46.858811 (+   338us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:46.858874 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:46.858913 (+    39us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:15:46.859112 (+   199us) tablet.cc:701] Row locks acquired
0709 13:15:46.859132 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:15:46.859304 (+   172us) write_op.cc:270] Start()
0709 13:15:46.859419 (+   115us) write_op.cc:276] Timestamp: P: 1783602946859230 usec, L: 0
0709 13:15:46.859446 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:15:46.860162 (+   716us) log.cc:844] Serialized 535 byte log entry
0709 13:15:47.116895 (+256733us) op_driver.cc:464] REPLICATION: finished
0709 13:15:47.569650 (+452755us) write_op.cc:301] APPLY: starting
0709 13:15:47.572971 (+  3321us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:47.658362 (+ 85391us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:47.658516 (+   154us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:47.659543 (+  1027us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:47.659804 (+   261us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:15:47.659877 (+    73us) write_op.cc:312] APPLY: finished
0709 13:15:47.660150 (+   273us) log.cc:844] Serialized 25 byte log entry
0709 13:15:47.671957 (+ 11807us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:47.672070 (+   113us) write_op.cc:454] Released schema lock
0709 13:15:47.672134 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:47.789120 (+116986us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:47.789196 (+    76us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":375417,"apply.run_cpu_time_us":4890,"apply.run_wall_time_us":269848,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8317,"num_ops":1,"prepare.queue_time_us":244579,"prepare.run_cpu_time_us":2726,"prepare.run_wall_time_us":7857,"replication_time_us":206038,"thread_start_us":319132,"threads_started":2}]]}
I20260709 13:15:48.074273  6498 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:48.044687  6353 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:48.085988  6429 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:48.094760  6497 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.072991  6476 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:48.126008 32272 raft_consensus.cc:2393] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 15: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:48.131319  6506 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:48.121315  6501 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:48.087865  6491 consensus_queue.cc:1059] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:15:48.136899 32120 raft_consensus.cc:1275] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:48.125063 32118 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 18.
I20260709 13:15:48.142669 32194 raft_consensus.cc:2393] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 18: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:48.042272  6419 consensus_queue.cc:237] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:48.096352  6462 consensus_queue.cc:1059] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:15:48.081768  6451 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:48.103299  6442 consensus_queue.cc:1059] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:15:48.073143  6452 consensus_queue.cc:237] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:48.150746 32115 raft_consensus.cc:2393] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 17: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:48.148816   369 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:48.088019  6331 consensus_queue.cc:1059] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:15:48.156860  6491 raft_consensus.cc:3055] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:48.156392  6501 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:48.170516 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.080627  6330 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:48.095767  6474 consensus_queue.cc:1048] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:15:48.108045  6423 consensus_queue.cc:1048] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:15:48.190219  6501 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:48.191372  6501 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:48.190357  6330 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:48.192085  6501 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:48.196004  6501 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:48.111155  6387 consensus_queue.cc:1059] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:15:48.200794 32117 raft_consensus.cc:1275] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:15:48.145500  6498 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:48.208909  6487 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.212747  6499 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.214087  6349 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:48.226886  6451 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:48.228163 32191 raft_consensus.cc:606] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:48.316237 32191 raft_consensus.cc:614] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:48.229158  6442 raft_consensus.cc:3055] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:15:48.199643  6491 raft_consensus.cc:740] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:48.230383  6465 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:48.231460  6353 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:48.231822  6470 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:48.234851  6503 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025) with higher term. Message: Invalid argument: T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for earlier term 17. Current term is 18.
I20260709 13:15:48.143479  6480 consensus_queue.cc:237] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:48.238054  6417 raft_consensus.cc:3055] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:48.241351 32239 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:15:48.331573 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 90333.7us
W20260709 13:15:48.270977   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 122217us
I20260709 13:15:48.144840  6429 consensus_queue.cc:1059] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.095s
W20260709 13:15:48.312774 32162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 104357us
I20260709 13:15:48.339349   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:48.340444   396 raft_consensus.cc:2393] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 18: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:15:48.344319 32267 raft_consensus.cc:1240] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:48.235857 32016 catalog_manager.cc:5697] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d reported cstate change: config changed from index -1 to 10, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New cstate: current_term: 13 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:48.145761  6497 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:48.320840   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 185028us
I20260709 13:15:48.279386  6501 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:48.347934 32016 catalog_manager.cc:5697] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 16 to 17, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 17 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:48.358476 32266 raft_consensus.cc:1275] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:15:48.359179 32268 raft_consensus.cc:1275] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:15:48.358274 32016 catalog_manager.cc:5697] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 14 to 15, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 15 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:48.204100 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 151185us
I20260709 13:15:48.364013 32238 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:48.326591  6505 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:48.373193 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 258267us
W20260709 13:15:48.364953 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 274613us
I20260709 13:15:48.321429  6442 raft_consensus.cc:740] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:48.377360   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:48.372459 32016 catalog_manager.cc:5697] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 8 to 9, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 9 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:48.381304   396 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:48.327140  6465 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:48.389709 32121 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:15:48.311944  6487 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:48.331081  6417 raft_consensus.cc:740] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:48.396979  6511 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:48.400048 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:48.394064 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:48.350867  6470 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:48.427081 32191 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:15:48.447045 32191 raft_consensus.cc:606] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:48.315644  6498 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:48.436712 32118 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:15:48.392206 32016 catalog_manager.cc:5697] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 14 to 15, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 15 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:48.444816 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:48.445444 32121 raft_consensus.cc:2393] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 21: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:48.450639   396 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17.
I20260709 13:15:48.452854 32120 raft_consensus.cc:2393] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 17: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:48.380339  6429 consensus_queue.cc:1243] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer fcfc3281929645969ecedbb0c0af759d log is divergent from this leader: its last log entry 21.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:15:48.398809  6473 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.462592 32123 raft_consensus.cc:1240] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:48.481694 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:48.482606 32191 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17.
I20260709 13:15:48.486896 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:48.371296  6501 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:48.490720 32190 raft_consensus.cc:1275] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:15:48.491659 32197 raft_consensus.cc:1275] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:15:48.502117  6493 raft_consensus.cc:2804] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:48.503890  6509 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.504632  6509 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:48.434089  6505 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:48.507397  6505 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:48.512710  6451 consensus_queue.cc:1048] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:48.455677  6423 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.438226  6474 consensus_queue.cc:1048] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:15:48.456163  6508 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:48.460358  6387 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.327455  6499 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:48.524978 32190 raft_consensus.cc:1275] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:15:48.453485  6470 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:48.538091 32198 raft_consensus.cc:3055] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:48.491405  6353 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.540959 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:48.544744 32192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:15:48.558406 32192 raft_consensus.cc:606] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:48.558907 32192 raft_consensus.cc:614] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:48.438333  6465 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:48.470690  6448 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:48.477123  6464 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:48.542582  6493 raft_consensus.cc:697] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:48.537194 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:48.582049 32197 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:15:48.554553 32198 raft_consensus.cc:740] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:48.424994  6491 consensus_queue.cc:260] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:48.538050 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:48.530503  6443 raft_consensus.cc:3055] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:48.517990  6513 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:48.448176  6511 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:48.578969 32266 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:48.583487 32198 consensus_queue.cc:260] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:48.586258 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 222338us
I20260709 13:15:48.550094 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:48.517170  6515 consensus_queue.cc:1048] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.113s
I20260709 13:15:48.544093  6423 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:48.600324 32270 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:15:48.602317 32238 leader_election.cc:400] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 12. Current term is 13.
I20260709 13:15:48.471673  6473 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:48.574508  6520 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:48.608319 32238 leader_election.cc:403] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:48.608698 32266 raft_consensus.cc:1275] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:48.554618  6387 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:48.612368   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 213300us
I20260709 13:15:48.585482  6443 raft_consensus.cc:740] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:48.531579  6442 consensus_queue.cc:260] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:48.586097  6509 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:48.586577  6498 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:48.615953 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:15:48.600286  6446 consensus_meta.cc:287] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.513s	user 0.011s	sys 0.000s
I20260709 13:15:48.573029  6353 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:48.619756 32270 raft_consensus.cc:2393] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 17: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:48.622927   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:48.622079  6446 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:48.628778  6446 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:48.552616  6508 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:48.642521  6519 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.643026  6387 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:48.635087  6398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:38184 (request call id 609) took 3620 ms. Trace:
I20260709 13:15:48.624421  6448 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:15:48.643157  6519 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:48.645298  6517 log.cc:927] Time spent T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:15:48.646896  6522 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:15:48.643157  6473 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:48.600474  6513 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:15:48.649382  6499 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:48.639628  6497 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:48.640663  6506 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:48.652822  6511 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:48.653533  6465 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:15:48.654176  6510 log.cc:927] Time spent T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:15:48.651006  6487 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:48.657866  6525 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.632175  6493 consensus_queue.cc:237] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:48.658389  6525 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:48.618104  6520 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:48.661020  6501 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:48.661885  6513 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:48.661947  6520 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:48.643580  6398 rpcz_store.cc:276] 0709 13:15:45.042710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.042830 (+   120us) service_pool.cc:224] Handling call
0709 13:15:45.237239 (+194409us) ts_tablet_manager.cc:934] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339)
0709 13:15:47.368370 (+2131131us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:15:48.163558 (+795188us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:48.184169 (+ 20611us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:15:48.555412 (+371243us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:15:48.592787 (+ 37375us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:48.617878 (+ 25091us) ts_tablet_manager.cc:989] Replica registered.
0709 13:15:48.619854 (+  1976us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":82495,"tablet-copy.queue_time_us":80594,"thread_start_us":205897,"threads_started":2}
I20260709 13:15:48.662690  6508 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:48.825050 32272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50584 (request call id 903) took 1652 ms. Trace:
I20260709 13:15:48.826180  6508 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:48.827607  6508 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:48.821667 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:48.832620  6508 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:48.801059  6465 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 12. Current term is 13.
I20260709 13:15:48.835397  6398 tablet_copy_client.cc:806] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:48.834985  6417 consensus_queue.cc:260] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:48.836476  6398 tablet_copy_client.cc:670] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:48.837154 32195 raft_consensus.cc:3060] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:48.818864  6321 raft_consensus.cc:3055] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:48.805006  6468 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.692147 32119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55358 (request call id 886) took 1193 ms. Trace:
I20260709 13:15:48.781976 32123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 3339) took 1345 ms. Trace:
I20260709 13:15:48.717869 32198 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:48.757756   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:48.881886   396 raft_consensus.cc:2393] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 17: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:48.790263  6410 consensus_queue.cc:1048] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
I20260709 13:15:48.758646   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
W20260709 13:15:48.723196 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 120926us
I20260709 13:15:48.747659 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:48.887547 32270 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 16.
I20260709 13:15:48.741542  6536 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.886708 32271 raft_consensus.cc:1240] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:48.759552   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:48.775940  6423 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:48.874126 32162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 96072.8us
I20260709 13:15:48.783516 32194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56926 (request call id 1170) took 1467 ms. Trace:
I20260709 13:15:48.795539 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:48.901343  6448 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:48.902244  6448 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:48.799589  6471 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.907385  6476 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:48.765189  6387 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:48.909382  6417 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:48.866786  6321 raft_consensus.cc:740] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:48.772183  6353 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:48.801054  6371 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.911228  6491 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:48.799116  6364 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:15:48.729146 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 190793us
W20260709 13:15:48.702817 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.900193  6470 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:48.915776  6448 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:48.921018  6468 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:48.755726  6331 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:48.955174  6331 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:48.922588  6519 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:48.924889  6463 consensus_queue.cc:260] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:48.928109   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:48.928436  6387 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:48.967289  6387 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:48.825830 32272 rpcz_store.cc:276] 0709 13:15:47.172021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.172129 (+   108us) service_pool.cc:224] Handling call
0709 13:15:48.824502 (+1652373us) spinlock_profiling.cc:243] Waited 953 ms on lock 0x7b54000e29d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:15:48.824849 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2191078784}
I20260709 13:15:48.894860 32194 rpcz_store.cc:276] 0709 13:15:47.315590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.315923 (+   333us) service_pool.cc:224] Handling call
0709 13:15:48.782982 (+1467059us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b54002a7954. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:15:48.783259 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1885514624}
I20260709 13:15:48.876121 32123 rpcz_store.cc:276] 0709 13:15:47.436867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.441071 (+  4204us) service_pool.cc:224] Handling call
0709 13:15:47.484305 (+ 43234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:48.463058 (+978753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.781451 (+318393us) spinlock_profiling.cc:243] Waited 978 ms on lock 0x7b5400031454. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:15:48.781772 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2249269632}
I20260709 13:15:48.889425  6536 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:48.744287 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:48.942704   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
W20260709 13:15:48.795161  6455 consensus_meta.cc:287] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.676s	user 0.007s	sys 0.008s
I20260709 13:15:48.780695  6432 consensus_queue.cc:1048] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.166s
I20260709 13:15:48.946907  6371 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:48.757899  6416 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.961287  6463 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:48.968674   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:48.757375  6413 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.872854 32119 rpcz_store.cc:276] 0709 13:15:47.498477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.968121 (+469644us) service_pool.cc:224] Handling call
0709 13:15:47.971705 (+  3584us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:48.088396 (+116691us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:48.088423 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:48.093793 (+  5370us) log.cc:844] Serialized 26 byte log entry
0709 13:15:48.370559 (+276766us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:15:48.447284 (+ 76725us) log.cc:844] Serialized 14 byte log entry
0709 13:15:48.453874 (+  6590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.453977 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:48.629372 (+175395us) spinlock_profiling.cc:243] Waited 6.58 ms on lock 0x7b1800220240. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59be7ec0a 00007fb5a55be219 00007fb5a2ec558f 00007fb59bf04571 00007fb59bf067c1 00007fb59bf06779 00007fb59bf06709 00007fb59bf066d1 00007fb59bf059cd
0709 13:15:48.690882 (+ 61510us) raft_consensus.cc:1685] finished
0709 13:15:48.691166 (+   284us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:48.691702 (+   536us) inbound_call.cc:177] Queueing success response
0709 13:15:48.828260 (+136558us) spinlock_profiling.cc:243] Waited 7.94 ms on lock 0x7b1800220240. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bf04522 00007fb59bf067c1 00007fb59bf06779 00007fb59bf06709 00007fb59bf066d1 00007fb59bf059cd 000000000038f354 000000000038f199 00007fb59bee783a
Metrics: {"mutex_wait_us":23899,"prepare.queue_time_us":77630,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":134187,"raft.run_cpu_time_us":346,"raft.run_wall_time_us":33809,"spinlock_wait_cycles":33388672,"thread_start_us":391863,"threads_started":2,"wal-append.queue_time_us":450752}
I20260709 13:15:48.938555  6442 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:48.971688 32195 raft_consensus.cc:2468] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 18.
I20260709 13:15:48.757411  6429 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:48.975919 32266 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:15:48.978363  6371 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:48.971138  6387 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.660662  6525 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:48.993165  6413 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:48.995985  6413 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:48.997208  6321 consensus_queue.cc:260] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:49.003938  6321 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:15:49.003961 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.006160  6353 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.010160 32269 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 16.
I20260709 13:15:48.983606  6455 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:48.640759  6443 consensus_queue.cc:260] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:49.020797  6387 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:49.023468  6387 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:49.025743  6279 consensus_meta.cc:287] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.918s	user 0.013s	sys 0.013s
I20260709 13:15:49.026417  6279 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:49.028023 32265 raft_consensus.cc:1240] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:49.028684  6476 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.029546  6476 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:49.033494 32119 raft_consensus.cc:1275] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:49.033164 32022 catalog_manager.cc:5697] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 15 to 16, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 16 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:49.035264 32022 catalog_manager.cc:5697] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 15 to 16, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 16 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:49.016394  6429 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:49.041049 32270 raft_consensus.cc:1240] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 9. Current term is 10. Ops: []
W20260709 13:15:49.043064 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.043598  6455 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:49.045001  6468 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:15:49.046109  6393 consensus_meta.cc:287] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6: Time spent flushing consensus metadata: real 0.938s	user 0.013s	sys 0.015s
W20260709 13:15:49.043640 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.046651  6393 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:48.993167  6416 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:48.990095  6471 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:49.032418  6476 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:49.053436  6405 consensus_queue.cc:1048] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:15:49.058487  6443 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:49.060165  6536 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:49.046679  6353 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:49.062304 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:49.062819  6353 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:49.063180 32119 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 16.
I20260709 13:15:49.065624  6525 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:49.066365  6525 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:49.067356  6398 tablet_copy_client.cc:538] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:49.040795  6429 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:49.071306  6416 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:49.071645 32089 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:49.072840  6455 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:49.073583  6455 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:49.074579  6416 raft_consensus.cc:2804] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:49.082537  6416 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.083039  6416 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:49.076900  6525 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:49.084962   401 raft_consensus.cc:2393] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 15: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:15:49.086342  6455 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:15:49.086938   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 76726.6us
I20260709 13:15:49.088450  6393 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:49.086862 32198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:15:49.078821 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:49.089228 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.090317   396 raft_consensus.cc:1275] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:15:49.096840 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.080174  6279 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:49.098572 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:49.109465  6519 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:49.114931  6519 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:49.116784 32197 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:15:49.116943 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.117798  6519 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:49.118608 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.119050 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.119180  6448 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.119451 32197 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:15:49.119793  6448 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:49.121280 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.121722  6525 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:49.122094  6448 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:49.122371  6525 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:49.122843 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:49.123128  6470 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:49.123497 32197 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:49.123797  6470 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:49.125883 32265 raft_consensus.cc:1240] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 20. Current term is 21. Ops: []
I20260709 13:15:49.126046  6492 consensus_queue.cc:1048] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:49.126521 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:49.122666  6448 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:49.127782  6470 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:49.128834 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:49.117815 32194 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 21.
I20260709 13:15:49.129467 32269 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:15:49.129716 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.130761   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:49.131409  6429 consensus_queue.cc:1048] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:49.128552  6448 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:49.132786 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 55678.3us
I20260709 13:15:49.100602   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:49.133878 32239 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:15:49.051893  6445 consensus_meta.cc:287] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.935s	user 0.004s	sys 0.015s
I20260709 13:15:49.139039   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:49.140447 32193 raft_consensus.cc:1275] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:15:49.071519  6471 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:49.144490 32197 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 18.
I20260709 13:15:49.145764 32198 raft_consensus.cc:606] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:49.146441 32198 raft_consensus.cc:614] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:49.150811 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.143136 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:49.147243  6541 ts_tablet_manager.cc:933] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339)
W20260709 13:15:49.156314 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.157508 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.157624 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.158102 32197 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:15:49.156226 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:49.141782  6525 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:49.141651  6536 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.142848  6455 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:49.170398 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:49.150352  6405 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.175930 32266 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
I20260709 13:15:49.170035 32117 raft_consensus.cc:1240] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:49.160389  6398 tablet_bootstrap.cc:492] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap starting.
I20260709 13:15:49.144461  6519 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:49.171824  6448 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:49.189647   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:49.185930  6405 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:49.192425  6536 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:49.192531 32268 raft_consensus.cc:1275] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:15:49.192689 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.194679 32119 raft_consensus.cc:1240] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:49.194747  6405 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:49.182794  6471 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.152521  6445 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:49.196779  6471 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:49.203348  6537 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:49.203697  6493 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.169325  6514 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:49.194890  6536 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:49.167472  6463 consensus_queue.cc:1048] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:15:49.216197  6331 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:49.217912 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:15:49.221784 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 88001.9us
I20260709 13:15:49.228312 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.207209  6533 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:49.188431  6455 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:49.227455 32239 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:49.237334   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:49.237636  6470 raft_consensus.cc:2804] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:49.241123 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.242283 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.243042 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.243937 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.243670  6519 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:49.244925  6537 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:49.246568  6445 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:49.248574  6371 consensus_queue.cc:1048] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:15:49.249145 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.249670 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.267994 32194 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:15:49.253888  6536 raft_consensus.cc:2955] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 18 LEADER]: Committing config change with OpId 18.15: config changed from index -1 to 15, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:15:49.264205 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:49.274286 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.272446 32190 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 13.
I20260709 13:15:49.274952 32199 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 25.
I20260709 13:15:49.276250 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.256633  6455 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:49.253054 32267 raft_consensus.cc:1240] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:49.274501 32123 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 19.
I20260709 13:15:49.277981 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:49.216812  6493 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:49.277506 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:49.283641 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:49.285280 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:49.285706 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:49.287422 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:49.289086 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:49.290014 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:49.292281  6519 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:49.306206 32268 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:15:49.293179 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:49.294703 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:49.305961 32269 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
I20260709 13:15:49.295954  6471 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:49.298144  6514 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:49.307147 32266 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 18.
I20260709 13:15:49.297820 32265 raft_consensus.cc:1275] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:15:49.299726 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.301844  6416 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:49.302714 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:15:49.303435  6537 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:49.263870  6470 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.311721 32124 raft_consensus.cc:2393] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 25: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:49.303951 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:49.295328 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:49.313535 32119 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:15:49.262272  6541 tablet_copy_client.cc:323] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Beginning tablet copy session from remote peer at address 127.30.63.1:42339
I20260709 13:15:49.312903 32273 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:15:49.301852  6432 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.321229 32270 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 16.
I20260709 13:15:49.279744  6448 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:49.325958   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:49.313197  6514 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:49.328454 32197 raft_consensus.cc:1240] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:15:49.329816 32190 raft_consensus.cc:1275] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:15:49.314836  6470 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:49.333839 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:49.331315 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:49.327224 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:49.335000 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:49.338832 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:49.279873  6442 consensus_queue.cc:1048] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:15:49.351943 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:49.359298 32122 raft_consensus.cc:2393] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 14: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:49.362506 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:49.364976 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:49.367988 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:49.320102  6533 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:49.374974 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:49.375010 32123 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:15:49.378877 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:49.379626 32116 raft_consensus.cc:2393] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 19: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:49.379967 32191 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 19.
I20260709 13:15:49.380666 32124 raft_consensus.cc:2393] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 14: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:49.381368 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.384624 32194 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 20.
W20260709 13:15:49.392309  6549 log.cc:927] Time spent T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:15:49.397799  6547 log.cc:927] Time spent T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:15:49.398511 32087 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:49.400198 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:49.401530 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:49.401933 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.404759  6353 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:49.405606 32265 raft_consensus.cc:1275] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:49.405910  6353 raft_consensus.cc:697] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:49.407119 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:49.408730 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:49.409994 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:49.410892 32117 raft_consensus.cc:2393] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 13: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:49.411703 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:15:49.404911 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 50484.8us
I20260709 13:15:49.414449 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:49.412388 32192 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:15:49.416304   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:49.420118 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.420902 32192 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 18.
I20260709 13:15:49.423161 32192 raft_consensus.cc:2955] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index -1 to 15, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:15:49.425042 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.425853 32195 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 25.
I20260709 13:15:49.429239 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.430048 32196 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 19.
I20260709 13:15:49.417768 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:49.407413  6353 consensus_queue.cc:237] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:49.362417  6432 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:49.460671 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.461582 32198 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 21.
I20260709 13:15:49.465574 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.466491 32194 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17.
I20260709 13:15:49.477638 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:49.479676 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.493597 32239 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:49.472079  6471 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.498095 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.505146  6471 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:49.507936  6471 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:49.508097 32016 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49534 (request call id 319) took 2079 ms. Trace:
I20260709 13:15:49.509428 32266 raft_consensus.cc:2393] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 15: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:49.510015 32017 catalog_manager.cc:5697] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 19 to 20, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 20 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:49.481230  6493 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:49.519271   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:49.524763 32265 raft_consensus.cc:1275] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:49.528093 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.531540  6432 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:49.520740  6416 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:49.538626 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.540300 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:49.541322 32266 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:15:49.522181  6448 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:49.541968  6533 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:49.540342 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:49.542375  6448 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.551964  6448 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:49.553314 32119 raft_consensus.cc:1240] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 21 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 20. Current term is 21. Ops: []
I20260709 13:15:49.554781 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:49.543694 32116 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:15:49.557946 32118 raft_consensus.cc:1240] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:49.560441 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:49.562307 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:49.567838 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:49.568255 32116 raft_consensus.cc:1275] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:15:49.569463 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:49.570176 32271 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 24.
I20260709 13:15:49.571157 32266 raft_consensus.cc:1275] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:15:49.572742 32090 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:49.574352 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:49.574575  6476 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:49.575079  6476 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:49.574906  6505 consensus_queue.cc:1059] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:49.575595  6476 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:49.576393  6505 raft_consensus.cc:3055] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:15:49.576612 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.576884  6505 raft_consensus.cc:740] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:49.577872  6505 consensus_queue.cc:260] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:49.578454 32195 raft_consensus.cc:1275] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:15:49.574916 32090 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:49.562983 32272 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:15:49.582023 32123 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:15:49.585595 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.587872 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:49.589970 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:15:49.595451 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.589970 32239 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:49.598991 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:49.600769 32117 raft_consensus.cc:1275] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:15:49.581777  6491 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.604326 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:49.607954 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:49.609723 32239 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:49.621587 32123 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:15:49.586270  6471 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:49.584082  6537 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.623821 32090 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:49.607004  6505 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:15:49.628228 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.639912 32239 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:49.641695 32239 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:49.646104 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:49.514279 32016 rpcz_store.cc:276] 0709 13:15:47.428724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.459348 (+ 30624us) service_pool.cc:224] Handling call
0709 13:15:49.507839 (+2048491us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:48.935000 (+     0us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b180046bb20. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bf043f3 00007fb59bf067c1 00007fb59bf06779 00007fb59bf06709 00007fb59bf066d1 00007fb59bf059cd 000000000038f354 000000000038f199 00007fb59bee783a
0709 13:15:48.935442 (+   442us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:48.979395 (+ 43953us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:48.985910 (+  6515us) write_op.cc:435] Acquired schema lock
0709 13:15:48.991922 (+  6012us) tablet.cc:662] Decoding operations
0709 13:15:49.049986 (+ 58064us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:49.056196 (+  6210us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:49.056271 (+    75us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:15:49.057164 (+   893us) tablet.cc:701] Row locks acquired
0709 13:15:49.057215 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:15:49.057575 (+   360us) write_op.cc:270] Start()
0709 13:15:49.057807 (+   232us) write_op.cc:276] Timestamp: P: 1783602949057502 usec, L: 0
0709 13:15:49.057846 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:15:49.058918 (+  1072us) log.cc:844] Serialized 2120 byte log entry
0709 13:15:49.196731 (+137813us) op_driver.cc:464] REPLICATION: finished
0709 13:15:49.394131 (+197400us) write_op.cc:301] APPLY: starting
0709 13:15:49.394258 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:49.406572 (+ 12314us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:49.406616 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:49.410363 (+  3747us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:49.410699 (+   336us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:15:49.410775 (+    76us) write_op.cc:312] APPLY: finished
0709 13:15:49.411175 (+   400us) log.cc:844] Serialized 57 byte log entry
0709 13:15:49.411382 (+   207us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:49.411483 (+   101us) write_op.cc:454] Released schema lock
0709 13:15:49.411543 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:49.420321 (+  8778us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:49.420360 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":812,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":197062,"apply.run_cpu_time_us":10609,"apply.run_wall_time_us":22578,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25077,"num_ops":5,"prepare.queue_time_us":171631,"prepare.run_cpu_time_us":6565,"prepare.run_wall_time_us":124028,"replication_time_us":128175,"spinlock_wait_cycles":2609920,"thread_start_us":299880,"threads_started":2}]]}
I20260709 13:15:49.647363 32116 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 25.
I20260709 13:15:49.591571  6393 consensus_queue.cc:1048] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:15:49.648655  6279 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:49.625046  6533 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:49.625722  6471 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:15:49.664549 32165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.631675  6445 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:15:49.686295 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:15:49.687760 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 64061.6us
I20260709 13:15:49.615235  6491 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:49.648729  6455 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:49.675482 32238 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:49.708796 32165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.690932 32239 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:49.715030 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:49.631978  6537 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:49.668691  6471 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:15:49.724180 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 48773us
W20260709 13:15:49.739676 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:49.740396 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.688668  6525 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:15:49.721674  6432 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:49.747501 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.735093  6279 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:49.734508  6533 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:49.753274 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:49.753708 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.755873 32238 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:49.755950 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:49.755267 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.761318 32198 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:49.759554 32193 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:15:49.731864  6405 consensus_queue.cc:1059] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
W20260709 13:15:49.767596 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 76791.8us
I20260709 13:15:49.763716   369 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:49.750319  6432 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.774838 32116 raft_consensus.cc:2393] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 19: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:49.746081  6470 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:49.777166 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:49.771687  6455 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:15:49.796561 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 46111.4us
I20260709 13:15:49.776316  6432 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:49.809891 32238 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:49.776777  6533 raft_consensus.cc:697] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:15:49.817873 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 262495us
I20260709 13:15:49.777537  6463 consensus_queue.cc:1048] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:15:49.785303 32197 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 19.
W20260709 13:15:49.839270   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 244475us
I20260709 13:15:49.813650  6493 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:15:49.843093 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 45557.2us
I20260709 13:15:49.850378 32238 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:49.860558  6376 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:49.861245  6376 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:49.861788  6536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:53184 (request call id 4) took 3192 ms. Trace:
I20260709 13:15:49.862268  6536 rpcz_store.cc:276] 0709 13:15:46.669086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.669235 (+   149us) service_pool.cc:224] Handling call
0709 13:15:46.796462 (+127227us) log.cc:844] Serialized 492 byte log entry
0709 13:15:46.937671 (+141209us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b4c000fa940. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59d2bda20 00007fb59d2cea29 00007fb59d2cf13f 00007fb59d2932ab 00007fb59d2c0f3c 00007fb59d2c13fe 00007fb59d54e50b 00007fb59ef4d381 00007fb59ef4b26b 00007fb59ef51d53 00007fb59ef51cd9
0709 13:15:47.227725 (+290054us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b1800413800. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bf043f3 00007fb59bf067c1 00007fb59bf06779 00007fb59bf06709 00007fb59bf066d1 00007fb59bf059cd 000000000038f354 000000000038f199 00007fb59bee783a
0709 13:15:49.861633 (+2633908us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71873,"raft.queue_time_us":101190,"raft.run_cpu_time_us":3461,"raft.run_wall_time_us":92632,"spinlock_wait_cycles":7076992,"thread_start_us":161488,"threads_started":2,"wal-append.queue_time_us":107993,"wal-append.run_cpu_time_us":2441,"wal-append.run_wall_time_us":1157508}
I20260709 13:15:49.863896  6376 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:49.864615  6415 consensus_queue.cc:1059] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 13:15:49.866338 32191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 3558) took 1385 ms. Trace:
I20260709 13:15:49.866724 32191 rpcz_store.cc:276] 0709 13:15:48.485044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.486590 (+  1546us) service_pool.cc:224] Handling call
0709 13:15:49.866101 (+1379511us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b54000b3454. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:15:49.866258 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1612262272}
W20260709 13:15:49.869288  6527 log.cc:927] Time spent T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.394s	user 0.005s	sys 0.000s
I20260709 13:15:49.844266  6279 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:49.877698  6448 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:49.880671  6279 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:49.881227  6279 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:49.882413  6448 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:49.879997  6455 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:49.883829  6455 raft_consensus.cc:697] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:49.889737  6491 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:49.900743  6525 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:49.901479  6525 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:49.903735  6525 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:49.908563  6525 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:49.909160  6525 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:49.910182 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 59897.6us
I20260709 13:15:49.912883 32238 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:49.915026  6525 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:49.915623  6445 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:49.915536  6454 consensus_queue.cc:1048] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:49.896564  6537 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:49.916740 32238 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:49.921023 32198 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:15:49.923183  6445 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:15:49.935461 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 94142.3us
I20260709 13:15:49.926714  6445 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:49.945322  6279 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:49.933594  6455 consensus_queue.cc:237] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:49.947291 32165 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:49.938936  6525 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:15:49.953855 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 190245us
I20260709 13:15:49.959453 32089 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:15:49.975576 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 58977.3us
I20260709 13:15:49.964079  6321 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:49.976511 32238 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:49.976919 32090 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:49.967610  6470 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:15:49.986449 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 45364.6us
I20260709 13:15:50.001240 32090 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:15:50.002938   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 147391us
I20260709 13:15:49.944203  6533 consensus_queue.cc:237] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:49.993853  6448 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:49.995450  6405 raft_consensus.cc:2804] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:49.993134  6525 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:50.001775  6519 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:50.013429 32238 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:50.012008 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 80305.6us
W20260709 13:15:50.007416  6514 consensus_meta.cc:287] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.678s	user 0.015s	sys 0.000s
W20260709 13:15:50.020889 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.983515  6537 consensus_queue.cc:1048] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 13:15:50.026307  6448 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:50.029410  6557 log.cc:927] Time spent T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:15:50.030586  6572 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:50.031039  6448 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:50.031109  6572 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.031710  6572 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:50.033066 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:15:50.036881  6559 log.cc:927] Time spent T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.167s	user 0.002s	sys 0.002s
I20260709 13:15:50.037779  6353 raft_consensus.cc:3055] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:50.038204  6353 raft_consensus.cc:740] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:50.039216  6353 consensus_queue.cc:260] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.040688  6321 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:50.041092  6505 raft_consensus.cc:3055] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:50.041536  6505 raft_consensus.cc:740] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:50.041319  6321 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.042431  6505 consensus_queue.cc:260] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.043542  6321 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:50.044281  6321 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:15:50.050562 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.015094  6405 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.043618  6505 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:50.057581 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 61904.4us
I20260709 13:15:50.057969  6470 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:50.059391 32165 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:50.063573  6463 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:50.064060  6463 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.064466  6463 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:15:50.070000 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 60613.8us
I20260709 13:15:50.070858 32238 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:50.071776  6416 raft_consensus.cc:2804] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:50.072118 32238 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:50.072276  6416 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:50.073470  6536 consensus_queue.cc:1048] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:15:50.074448  6470 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:50.023394  6525 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.055403  6353 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:50.096873 32017 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49556 (request call id 318) took 1201 ms. Trace:
I20260709 13:15:50.078953  6279 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:50.061293 32090 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:50.060832  6405 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:50.025427  6514 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.087901  6416 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:50.115649 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 43610.3us
I20260709 13:15:50.091516  6448 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:50.084146  6471 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.084931  6321 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:15:50.097421 32017 rpcz_store.cc:276] 0709 13:15:48.896102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.896439 (+   337us) service_pool.cc:224] Handling call
0709 13:15:50.096802 (+1200363us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:49.534080 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:49.534615 (+   535us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:49.534664 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:15:49.534685 (+    21us) tablet.cc:662] Decoding operations
0709 13:15:49.535030 (+   345us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:49.535086 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:49.535116 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:15:49.535283 (+   167us) tablet.cc:701] Row locks acquired
0709 13:15:49.535303 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:15:49.535427 (+   124us) write_op.cc:270] Start()
0709 13:15:49.535535 (+   108us) write_op.cc:276] Timestamp: P: 1783602949535386 usec, L: 0
0709 13:15:49.535555 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:15:49.770747 (+235192us) log.cc:844] Serialized 535 byte log entry
0709 13:15:49.880960 (+110213us) op_driver.cc:464] REPLICATION: finished
0709 13:15:49.881482 (+   522us) write_op.cc:301] APPLY: starting
0709 13:15:49.881562 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:49.901044 (+ 19482us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b5400047c54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59efece28 00007fb5a2a27581 00007fb5a2a26d58 00007fb5a2a2b9f1 00007fb5a2a2b9a9 00007fb5a2a2b939 00007fb5a2a2b901 00007fb5a2a2ab2d 000000000038f354 000000000038f199
0709 13:15:49.989874 (+ 88830us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:49.992744 (+  2870us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:50.045042 (+ 52298us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:50.045266 (+   224us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:15:50.045312 (+    46us) write_op.cc:312] APPLY: finished
0709 13:15:50.045515 (+   203us) log.cc:844] Serialized 25 byte log entry
0709 13:15:50.045692 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:50.045772 (+    80us) write_op.cc:454] Released schema lock
0709 13:15:50.045809 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:50.046238 (+   429us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:50.046271 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":86484,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":251,"apply.run_cpu_time_us":4986,"apply.run_wall_time_us":164723,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8317,"num_ops":1,"prepare.queue_time_us":2206,"prepare.run_cpu_time_us":6525,"prepare.run_wall_time_us":367148,"replication_time_us":345253,"spinlock_wait_cycles":426929024}]]}
I20260709 13:15:50.118224   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:50.116963 32238 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:50.123350 32089 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:50.125837   400 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
I20260709 13:15:50.105000  6570 consensus_queue.cc:1048] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:15:50.130975  6279 raft_consensus.cc:2749] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:15:50.142243 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 81088.5us
I20260709 13:15:50.134250 32019 catalog_manager.cc:5697] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 14 to 16, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 16 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:50.176513 32089 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:15:50.180392 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 62079.9us
W20260709 13:15:50.181937 32162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 94576.1us
I20260709 13:15:50.146659  6574 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:50.187134  6574 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.187530  6574 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:50.178659 32019 catalog_manager.cc:5697] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 17 to 18, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 18 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:50.145859  6525 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:50.144451  6514 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:50.138249  6471 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:50.182845  6533 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:15:50.184736  6476 consensus_meta.cc:287] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.609s	user 0.013s	sys 0.002s
I20260709 13:15:50.160432  6568 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:50.178215  6569 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
W20260709 13:15:50.197309 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 80534.7us
I20260709 13:15:50.153910  6445 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.153402  6463 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.202514 32089 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:50.159093  6432 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:50.206753 32238 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:50.203565 32165 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:50.195995  6353 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:50.210218 32087 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:50.211509 32090 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:50.201421  6321 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:50.209090 32019 catalog_manager.cc:5697] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 16 to 17, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 17 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:50.202211  6415 consensus_queue.cc:1059] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:15:50.228940  6445 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:50.232841  6568 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:50.225903 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:50.241496 32124 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:50.213636  6353 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.233542  6589 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:50.234896 32090 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:50.225703 32089 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:15:50.243115 32162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 49856.5us
I20260709 13:15:50.239265 32019 catalog_manager.cc:5697] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 18 to 19, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 19 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:50.248103 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:15:50.249752 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 46279.5us
I20260709 13:15:50.249874 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:50.249980 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:50.250568  6588 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:50.250762 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:50.207891  6476 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.252933 32116 raft_consensus.cc:2393] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 14: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:50.210644  6533 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:15:50.239874  6505 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:50.254454  6574 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.242774  6568 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.251874  6353 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:50.251046  6588 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.255795 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:50.258980 32120 raft_consensus.cc:2368] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 20. Current term is 21.
I20260709 13:15:50.261060 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:50.261282 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:50.275223 32117 raft_consensus.cc:2393] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 21: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
W20260709 13:15:50.265013 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 58354.8us
I20260709 13:15:50.266975 32019 catalog_manager.cc:5697] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:50.261591 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:50.280108 32124 raft_consensus.cc:2468] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 18.
I20260709 13:15:50.283982 32238 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:50.284746   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:50.285784  6536 raft_consensus.cc:3055] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:50.286219  6536 raft_consensus.cc:740] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
W20260709 13:15:50.286077 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 51228.3us
I20260709 13:15:50.286594 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:50.287537 32165 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:50.287436  6536 consensus_queue.cc:260] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.257453  6463 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:50.288751  6321 consensus_queue.cc:1048] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:15:50.289196 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 63566.3us
I20260709 13:15:50.289332  6463 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:15:50.289927  6463 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.290104  6321 raft_consensus.cc:2804] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:50.290313 32089 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:50.290984 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:50.291265 32089 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:50.292047 32271 raft_consensus.cc:2393] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 18: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:50.292778  6584 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:50.293205  6584 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.293251   369 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:50.255456  6572 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.293695  6584 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:50.290565  6321 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.299870 32238 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:50.241565  6514 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:50.297230 32239 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:50.303129  6577 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:15:50.303416 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:50.303646  6577 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.303838  6279 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:50.304239 32272 raft_consensus.cc:2393] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 14: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:50.304598  6571 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:50.305007  6571 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.305374  6571 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:50.305742  6279 raft_consensus.cc:2804] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:50.305815 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:50.303658 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:50.306397  6279 raft_consensus.cc:697] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:50.306739 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:50.304107  6577 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:50.256213  6505 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:50.265503  6578 log.cc:927] Time spent T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:15:50.260756  6525 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.265009  6568 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:50.274567  6588 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:50.292157 32089 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:50.309576 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:50.259930  6574 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:50.300899  6393 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:50.302361  6321 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:50.301789 32019 catalog_manager.cc:5697] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:50.266553  6432 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:50.290387  6463 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:15:50.313454 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:50.317028 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:50.365892 32267 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:15:50.309857 32238 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:50.326205 32268 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 16.
I20260709 13:15:50.311986 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:50.368144 32271 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 21.
I20260709 13:15:50.302563  6536 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:50.328981 32239 leader_election.cc:400] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 20. Current term is 21.
I20260709 13:15:50.371783 32239 leader_election.cc:403] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:50.371392 32019 catalog_manager.cc:5697] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 16 to 17, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 17 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:50.262229  6491 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.053s
I20260709 13:15:50.310781  6445 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:15:50.238313  6569 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:50.329938  6393 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:50.314990  6505 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:50.307400  6279 consensus_queue.cc:237] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.340354 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:50.343369  6353 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.345867  6589 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:50.345867  6584 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:50.331635  6525 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.328694  6471 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.302767  6514 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:50.369974 32270 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17.
I20260709 13:15:50.308507  6415 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:15:50.377593 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 59036.1us
I20260709 13:15:50.375434 32019 catalog_manager.cc:5697] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 13 to 14, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 14 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:50.373747  6581 log.cc:927] Time spent T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.239s	user 0.000s	sys 0.002s
I20260709 13:15:50.377862 32271 raft_consensus.cc:2955] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index -1 to 15, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:15:50.381708  6455 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Advancing to term 21
W20260709 13:15:50.389066 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 79312.9us
I20260709 13:15:50.414143 32238 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:50.392670 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:50.393136 32165 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:50.396314 32267 raft_consensus.cc:1275] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:15:50.375317  6445 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:50.417908  6445 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:15:50.419289 32120 raft_consensus.cc:1240] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:50.382019  6393 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:50.421286  6519 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:50.415593 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:50.415817 32238 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:50.411332  6415 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.412035  6514 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:50.388815  6448 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:50.445187  6448 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:15:50.445713 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 52698.4us
I20260709 13:15:50.446998 32165 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:50.447117  6442 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:50.431015  6471 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:50.449820  6471 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:15:50.450331  6580 log.cc:927] Time spent T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:15:50.445251  6476 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:50.451012 32134 tablet_copy_service.cc:140] P fcfc3281929645969ecedbb0c0af759d: Received BeginTabletCopySession request for tablet afb482e4812e47d0a501b142e64cb73b from peer 94085cf341634eb686a95983b6b7f7e6 ({username='slave'} at 127.0.0.1:55358)
I20260709 13:15:50.451618 32134 tablet_copy_service.cc:161] P fcfc3281929645969ecedbb0c0af759d: Beginning new tablet copy session on tablet afb482e4812e47d0a501b142e64cb73b from peer 94085cf341634eb686a95983b6b7f7e6 at {username='slave'} at 127.0.0.1:55358: session id = 94085cf341634eb686a95983b6b7f7e6-afb482e4812e47d0a501b142e64cb73b
I20260709 13:15:50.431777 32115 raft_consensus.cc:1240] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:15:50.429488  6415 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:15:50.459362  6577 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.461485  6572 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:50.432775 32122 raft_consensus.cc:2368] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 14. Current term is 15.
I20260709 13:15:50.440573 32238 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:50.466122 32238 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:50.441879  6569 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:50.378772  6416 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.470106   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:50.448019  6442 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:50.435602  6584 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:50.471946  6448 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:50.476754 32238 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:50.452111  6588 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.480911 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:50.485265 32239 leader_election.cc:400] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 14. Current term is 15.
I20260709 13:15:50.485669 32239 leader_election.cc:403] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:15:50.485946 32115 raft_consensus.cc:1275] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:15:50.485133   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
W20260709 13:15:50.486757 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.489296  6416 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:50.491639  6577 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 22 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:50.503348 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:50.504622 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:50.505427 32264 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:50.464387  6514 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.480252  6470 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:50.522311  6573 consensus_queue.cc:1059] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:50.524024 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:50.530503 32268 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:50.526037 32090 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:50.494845  6519 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:50.531399 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:50.534844 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:50.536151 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:50.536758   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:50.478086  6443 consensus_queue.cc:1048] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:15:50.539520 32134 tablet_copy_source_session.cc:215] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:50.540776  6525 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:50.542451 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:50.545924 32272 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:15:50.542392 32265 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:15:50.478171  6405 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.480775  6463 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.550388 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:50.524837  6279 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:15:50.553118  6595 log.cc:927] Time spent T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:15:50.557044 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:50.559974 32265 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:50.570828 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:50.573258 32264 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17.
I20260709 13:15:50.575511 32122 raft_consensus.cc:2393] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 14: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
W20260709 13:15:50.575593 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 98923.7us
I20260709 13:15:50.493780  6571 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.525103  6371 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:50.576542 32238 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:50.529186  6533 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:50.575498 32165 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:50.541949  6514 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:50.497567  6393 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:50.579968 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 54063.9us
I20260709 13:15:50.581303 32238 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:50.589468  6353 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:50.591364  6321 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.582597  6537 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:50.593782  6537 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:50.595042  6415 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.596192  6537 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:50.582545  6525 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:50.601282  6443 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:15:50.605013 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 57890us
I20260709 13:15:50.583918  6376 consensus_queue.cc:1059] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:15:50.584009  6584 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:50.584065  6454 consensus_queue.cc:1048] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:15:50.609982  6405 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:50.610107  6321 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:50.638965  6463 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 26 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:50.640168  6376 raft_consensus.cc:3055] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:50.640568  6376 raft_consensus.cc:740] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:50.642195  6376 consensus_queue.cc:260] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:50.642990  6569 consensus_queue.cc:1048] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:50.617734 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:50.643024  6393 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:50.619760 32272 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 20.
I20260709 13:15:50.644757  6445 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.647876 32266 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 25.
I20260709 13:15:50.611577  6588 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:50.578595  6455 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 20. Current term is 21.
I20260709 13:15:50.582543  6468 raft_consensus.cc:3055] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:50.649935  6468 raft_consensus.cc:740] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:50.650823  6468 consensus_queue.cc:260] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:50.652083  6468 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:50.583279  6371 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.654814  6371 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:50.655441  6443 raft_consensus.cc:697] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:50.624377   396 raft_consensus.cc:1275] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:15:50.657850 32165 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:50.666566 32165 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:50.637113  6279 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 14. Current term is 15.
I20260709 13:15:50.663115 32273 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 21.
W20260709 13:15:50.630565 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 49362.5us
I20260709 13:15:50.631423  6505 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:50.632900   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 47775.9us
I20260709 13:15:50.669539  6463 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:50.669848 32165 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:50.636617   399 raft_consensus.cc:1240] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:50.675719  6463 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:50.635818  6514 raft_consensus.cc:2804] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:50.671736 32123 raft_consensus.cc:2368] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 18. Current term is 19.
I20260709 13:15:50.676481  6514 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:50.677548  6514 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:50.678351 32090 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:50.679171  6584 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:50.679317 32090 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:50.679561  6584 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.679915  6584 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:50.680461 32090 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
W20260709 13:15:50.674595   369 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.30.63.1:42339 timed out after 1.506s (SENT) [suppressed 1 similar messages]
I20260709 13:15:50.675735  6415 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 26 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:50.681097  6568 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:50.681587  6415 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:15:50.682281 32121 raft_consensus.cc:2368] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 for earlier term 15. Current term is 16.
I20260709 13:15:50.672166  6515 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:50.683403  6568 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:50.672816  6505 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:50.671635 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:15:50.672345 32070 auto_rebalancer.cc:629] Failed to schedule move for tablet c477d57775f149408ec3429ac3fd28f4: Illegal state: Replica 113b5461952d47e0944d463ea4e32801 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 26 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:50.656512  6443 consensus_queue.cc:237] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:50.643700  6376 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:50.634179 32268 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17.
I20260709 13:15:50.670001 32238 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:50.631778 32265 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 22.
I20260709 13:15:50.689478 32238 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:50.689836   369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.690119 32090 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:50.690207  6279 raft_consensus.cc:2764] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:15:50.691633  6525 consensus_queue.cc:1048] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:15:50.702360 32070 auto_rebalancer.cc:629] Failed to schedule move for tablet 7049b5c289c247ea8dda13c92984c95d: Illegal state: Replica 113b5461952d47e0944d463ea4e32801 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:15:50.703070  6405 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:15:50.747797  6455 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:50.747160   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:50.748340  6405 raft_consensus.cc:697] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 20 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:50.748427  6455 raft_consensus.cc:697] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:15:50.707716 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.749509  6405 consensus_queue.cc:237] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.705938  6505 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:50.752894  6505 raft_consensus.cc:697] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:50.685437  6371 consensus_queue.cc:1048] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:15:50.767606 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:50.768478 32198 raft_consensus.cc:2393] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 15: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:50.768507 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:50.770323 32190 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 20.
I20260709 13:15:50.725790 32090 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:50.732944   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:50.733129  6445 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 25 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:50.735666  6321 consensus_queue.cc:1059] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:15:50.741221 32239 leader_election.cc:400] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 18. Current term is 19.
I20260709 13:15:50.776444 32239 leader_election.cc:403] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:50.776690  6321 raft_consensus.cc:3055] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:50.777328  6321 raft_consensus.cc:740] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
W20260709 13:15:50.745755 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 56359.3us
I20260709 13:15:50.747244 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:50.779588 32199 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:50.747149 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:50.748528   399 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:50.753816  6505 consensus_queue.cc:237] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:50.760092  6398 tablet_bootstrap.cc:492] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=2 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:50.780359 32121 raft_consensus.cc:2368] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 25. Current term is 26.
I20260709 13:15:50.781193  6398 tablet_bootstrap.cc:492] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap complete.
I20260709 13:15:50.781999  6398 ts_tablet_manager.cc:1403] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6: Time spent bootstrapping tablet: real 1.664s	user 0.064s	sys 0.039s
W20260709 13:15:50.779825 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 54108.5us
I20260709 13:15:50.783511 32090 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:50.784237  6415 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:15:50.784349 32090 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:50.784762  6415 raft_consensus.cc:697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 22 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:50.785110 32239 leader_election.cc:400] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 25 election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 25. Current term is 26.
I20260709 13:15:50.785477 32239 leader_election.cc:403] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20260709 13:15:50.661659  6571 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:50.793445 32193 raft_consensus.cc:1240] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:15:50.785653  6415 consensus_queue.cc:237] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.785524  6416 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:15:50.794266  6537 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:50.794582  6445 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:15:50.794895  6537 raft_consensus.cc:697] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:50.795840  6537 consensus_queue.cc:237] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:50.744796  6568 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:50.797183  6568 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.773959 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:50.749622  6455 consensus_queue.cc:237] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.803112  6568 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:50.778565  6321 consensus_queue.cc:260] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:50.792434 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:50.792150  6398 raft_consensus.cc:359] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:15:50.809530 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:50.834084 32192 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 18.
I20260709 13:15:50.833869 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:50.835125 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:50.809437 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:50.811865 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:50.836606 32273 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 18.
I20260709 13:15:50.813709 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:50.817375 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:50.819118 32195 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:50.819059 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:50.819211   399 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 16.
I20260709 13:15:50.821157 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:50.799321 32190 raft_consensus.cc:2376] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 19. Re-sending same reply.
W20260709 13:15:50.823108 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.829854 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:50.844687 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:50.846076 32121 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:50.818702  6279 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:50.847545  6279 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.842664 32087 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:50.857316 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:50.857499 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:50.846239 32090 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:50.858769 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:50.794767  6416 raft_consensus.cc:697] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 21 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:50.860855   400 raft_consensus.cc:1240] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:15:50.861588 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:50.873476 32193 raft_consensus.cc:2393] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 19: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:50.858150 32266 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:15:50.871755 32264 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 13.
I20260709 13:15:50.875375 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:50.875643 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:50.876070 32191 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:15:50.876190   369 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:50.806653  6525 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:15:50.880004 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:50.882129 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:50.884413 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:50.885340 32264 raft_consensus.cc:2393] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 20: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:50.887308 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:50.888388 32192 raft_consensus.cc:2368] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 14. Current term is 15.
I20260709 13:15:50.888924 32195 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 21.
I20260709 13:15:50.889477 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:50.890410 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:50.891013 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:50.901422   369 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:50.892887 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:50.893754 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:50.904165 32120 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:15:50.884083 32197 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 19.
W20260709 13:15:50.896843   368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.897975   399 raft_consensus.cc:1275] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:15:50.833868  6398 raft_consensus.cc:740] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Initialized, Role: LEARNER
I20260709 13:15:50.799723  6584 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:50.915834 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:50.856899  6279 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:50.916846 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:50.920472 32270 raft_consensus.cc:1240] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:15:50.877686  6470 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.927754 32238 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:50.928756 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:50.929915  6279 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:50.930339  6279 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:50.930743  6279 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:50.930440 32238 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:50.932394  6533 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:50.895175  6321 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:50.898275  6577 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:50.952975 32199 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:15:50.954504 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:50.955966 32238 leader_election.cc:400] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 14. Current term is 15.
I20260709 13:15:50.898460  6353 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:50.958739 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:50.969821 32195 raft_consensus.cc:2368] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 25. Current term is 26.
I20260709 13:15:50.963235 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:50.968673 32198 raft_consensus.cc:2393] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 20: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:50.967132 32238 leader_election.cc:403] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 13:15:50.956337   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 55006us
I20260709 13:15:50.909591  6605 raft_consensus.cc:2804] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:50.976787 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:50.980532 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:50.962496 32239 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:50.989701 32197 raft_consensus.cc:2393] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 14: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:50.989049 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:50.990679 32193 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:50.992081  6455 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:50.993083  6519 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:50.993533  6519 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:50.993896  6519 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:50.956972  6492 raft_consensus.cc:2749] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:50.949476  6371 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:50.984416 32238 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:51.004346 32269 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
I20260709 13:15:51.020967 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:50.955955  6463 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:51.031472 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:51.032199 32198 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:51.031881  6463 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
W20260709 13:15:51.036989 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.042070 32192 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 21.
I20260709 13:15:51.036067 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:51.048310 32190 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:15:51.048434 32198 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 18.
I20260709 13:15:50.968979  6353 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:51.051054 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:51.052155 32192 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:51.051749 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:51.053334 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:50.982888  6605 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:51.054347 32191 raft_consensus.cc:2393] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 26: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:51.065992 32122 raft_consensus.cc:1275] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:15:51.058598 32190 raft_consensus.cc:2393] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 14: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:50.975576  6470 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:51.081104 32192 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 22.
I20260709 13:15:51.084739  6541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afb482e4812e47d0a501b142e64cb73b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.087277  6463 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:51.049927  6416 consensus_queue.cc:237] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:51.069357  6598 log.cc:927] Time spent T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:15:51.049897  6577 raft_consensus.cc:697] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 16 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:51.025759  6371 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:51.095094 32121 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 17.
I20260709 13:15:51.054587  6353 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:51.072086  6600 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:15:51.065017  6415 consensus_queue.cc:1048] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:15:51.075273  6605 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:51.088173  6519 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:51.013947  6398 consensus_queue.cc:260] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:15:51.117888  6371 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:51.119122  6584 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:51.120476  6455 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 14. Current term is 15.
I20260709 13:15:51.131312 32193 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 19.
W20260709 13:15:51.151679 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.158672  6470 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:51.181254 32090 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:51.116343  6514 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:51.228752 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 244449us
I20260709 13:15:51.229820 32238 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:51.231251 32238 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:51.236629 32089 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:51.237813 32238 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:51.239765 32238 leader_election.cc:400] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 25 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 25. Current term is 26.
I20260709 13:15:51.239982  6505 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:51.242594 32238 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:51.246114 32265 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:51.224426  6463 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.248849 32238 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:51.252722 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:51.243294  6505 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:51.221879  6455 consensus_queue.cc:1059] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:15:51.222113  6470 consensus_queue.cc:1048] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:15:51.244880  6405 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:51.263043 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:51.253590 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:51.268491 32264 raft_consensus.cc:2393] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 20: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:51.250538  6600 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:51.266239 32265 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:15:51.265439 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:51.261704  6505 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:51.249073  6577 consensus_queue.cc:237] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:51.272990  6443 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.302243 32267 raft_consensus.cc:1240] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:15:51.302435  6443 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:51.308574 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:51.309639 32193 raft_consensus.cc:2393] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 15: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:51.323119  6279 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:51.272804  6405 raft_consensus.cc:697] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:51.324923  6405 consensus_queue.cc:237] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:51.330598  6470 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:15:51.331373  6470 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:51.331998  6470 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:15:51.333076  6618 log.cc:927] Time spent T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:15:51.335825  6519 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:15:51.339578  6445 consensus_meta.cc:287] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.544s	user 0.005s	sys 0.004s
I20260709 13:15:51.340051  6445 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 18. Current term is 19.
I20260709 13:15:51.341816 32273 raft_consensus.cc:1240] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:51.253720  6463 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:51.344872   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 372485us
I20260709 13:15:51.346002  6279 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:51.270764  6600 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:51.351078 32273 raft_consensus.cc:1240] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:51.300388  6525 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 25. Current term is 26.
I20260709 13:15:51.354223 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:51.364826 32268 raft_consensus.cc:2393] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 14: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:51.352718 32272 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 19.
I20260709 13:15:51.365097 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:51.342998  6470 raft_consensus.cc:2764] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Leader election decision vote started in defunct term 21: won
I20260709 13:15:51.372352 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:51.375191 32266 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 18.
I20260709 13:15:51.379251 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:51.350121  6600 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:51.394577   369 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:51.343967  6505 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:51.414981   368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.417680   399 raft_consensus.cc:1275] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:15:51.419401  6321 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:15:51.430269  6505 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:51.431491  6443 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:51.432044  6562 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:51.438115  6463 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:51.439215  6398 ts_tablet_manager.cc:1434] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6: Time spent starting tablet: real 0.657s	user 0.009s	sys 0.003s
W20260709 13:15:51.439584  6398 ts_tablet_manager.cc:1467] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6: Tablet startup took 657ms
I20260709 13:15:51.439873  6514 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:15:51.439929  6398 ts_tablet_manager.cc:1469] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6: Trace:
0709 13:15:45.042710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.042830 (+   120us) service_pool.cc:224] Handling call
0709 13:15:45.237239 (+194409us) ts_tablet_manager.cc:934] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339)
0709 13:15:47.368370 (+2131131us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:15:48.163558 (+795188us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:48.184169 (+ 20611us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:15:48.555412 (+371243us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:15:48.592787 (+ 37375us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:48.617878 (+ 25091us) ts_tablet_manager.cc:989] Replica registered.
0709 13:15:48.619854 (+  1976us) inbound_call.cc:177] Queueing success response
0709 13:15:49.118141 (+498287us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:15:50.782317 (+1664176us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:15:50.782981 (+   664us) tablet_replica.cc:261] Starting instrumentation
0709 13:15:50.783587 (+   606us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":82495,"mutex_wait_us":1159,"raft.queue_time_us":8366,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":27221,"tablet-copy.queue_time_us":80594,"tablet-download-pool.queue_time_us":1092,"tablet-download-pool.run_cpu_time_us":1923,"tablet-download-pool.run_wall_time_us":228927,"thread_start_us":205897,"threads_started":2}
I20260709 13:15:51.445878 32265 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 15.
I20260709 13:15:51.458299 32271 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 26.
I20260709 13:15:51.461925 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:51.467128 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:51.463486  6562 raft_consensus.cc:697] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 17 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:51.463367  6353 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:51.470368  6562 consensus_queue.cc:237] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:51.472131  6353 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:51.472801 32273 raft_consensus.cc:2393] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 10: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:51.460067  6505 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:51.478541 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 297362us
W20260709 13:15:51.469345  6533 consensus_meta.cc:287] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.536s	user 0.014s	sys 0.000s
I20260709 13:15:51.483625 32267 raft_consensus.cc:1275] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:15:51.487943   401 raft_consensus.cc:1217] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.9->[13.10-13.10]   Dedup: 13.10->[]
I20260709 13:15:51.491873 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:51.500468 32124 raft_consensus.cc:1240] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:51.507170 32121 raft_consensus.cc:1240] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:51.509449 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:51.510883 32124 raft_consensus.cc:1240] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:15:51.512961 32124 raft_consensus.cc:1240] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:15:51.524508 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:51.527598  6600 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:51.528663 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 283302us
I20260709 13:15:51.532826 32134 tablet_copy_service.cc:342] P fcfc3281929645969ecedbb0c0af759d: Request end of tablet copy session 94085cf341634eb686a95983b6b7f7e6-0717a2686ee346b7a5a183e36fdfd173 received from {username='slave'} at 127.0.0.1:55358
I20260709 13:15:51.533334 32134 tablet_copy_service.cc:434] P fcfc3281929645969ecedbb0c0af759d: ending tablet copy session 94085cf341634eb686a95983b6b7f7e6-0717a2686ee346b7a5a183e36fdfd173 on tablet 0717a2686ee346b7a5a183e36fdfd173 with peer 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:51.534447 32124 raft_consensus.cc:1240] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:51.537073 32116 raft_consensus.cc:1240] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:51.507761  6533 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:51.540961 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:51.543190 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:51.543982 32273 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 19.
I20260709 13:15:51.546134   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
W20260709 13:15:51.548143 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 299356us
I20260709 13:15:51.562819   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:51.567116 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:51.571909 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:51.484836  6505 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:51.575242 32119 raft_consensus.cc:2393] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 14: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:51.546448  6568 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.581771 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:51.582865 32116 raft_consensus.cc:2393] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 15: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:51.594298 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:51.590046  6624 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.600800 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:51.602519 32198 raft_consensus.cc:3055] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:51.603004 32198 raft_consensus.cc:740] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:51.606562 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:51.601233  6624 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:51.608474 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 366536us
I20260709 13:15:51.568912  6617 consensus_queue.cc:1059] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 13:15:51.614076 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:51.632754 32119 raft_consensus.cc:2393] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 26: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:51.616994 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:51.633519 32193 raft_consensus.cc:2368] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14.
I20260709 13:15:51.619226 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:51.617399 32273 raft_consensus.cc:1240] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:51.609436 32198 consensus_queue.cc:260] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:51.636037 32198 raft_consensus.cc:3060] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:15:51.620040   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 182035us
I20260709 13:15:51.639853 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:51.642469 32195 raft_consensus.cc:1275] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:15:51.627418 32238 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:51.586666  6568 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:51.658072 32089 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:51.667505 32089 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:15:51.655139  6622 log.cc:927] Time spent T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:15:51.661486 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:51.670274 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:15:51.670955 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 52099.5us
I20260709 13:15:51.614955  6605 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:51.685885   400 raft_consensus.cc:1240] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:51.687526 32267 raft_consensus.cc:2393] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 15: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:51.660737  6353 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.659595  6629 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.693543 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:51.695190 32198 raft_consensus.cc:1275] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
W20260709 13:15:51.697657 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.699478 32198 pending_rounds.cc:85] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 9
I20260709 13:15:51.676296  6519 raft_consensus.cc:3055] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:51.672336  6415 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:51.699599 32238 leader_election.cc:400] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14.
I20260709 13:15:51.699221 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:51.711555 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:51.710059  6519 raft_consensus.cc:740] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:51.713702  6519 consensus_queue.cc:260] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:51.715160  6519 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:51.722705 32273 raft_consensus.cc:1275] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:15:51.724864 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:51.700752 32198 pending_rounds.cc:107] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:15:51.726955 32198 raft_consensus.cc:2889] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:51.728274 32267 raft_consensus.cc:1275] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:15:51.729594 32269 raft_consensus.cc:1275] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:15:51.732052 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:51.705439  6353 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:51.738283 32270 raft_consensus.cc:1240] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 15. Current term is 16. Ops: []
W20260709 13:15:51.704088  6628 log.cc:927] Time spent T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:15:51.779203 32120 raft_consensus.cc:1240] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 20. Current term is 21. Ops: []
I20260709 13:15:51.708442  6629 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:51.744767  6493 raft_consensus.cc:3055] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:51.754524 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:51.757213   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:51.757630  6541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:38184 (request call id 625) took 2789 ms. Trace:
I20260709 13:15:51.709143  6537 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:51.759701   369 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:51.765748  6635 log.cc:927] Time spent T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:15:51.687155  6605 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:51.768985 32090 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:51.774658 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:51.776017 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:51.786576 32121 raft_consensus.cc:2368] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14.
I20260709 13:15:51.710466 32117 raft_consensus.cc:2468] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 10.
W20260709 13:15:51.782161 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 114764us
I20260709 13:15:51.788457 32238 leader_election.cc:403] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:15:51.784614 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:51.789618 32124 raft_consensus.cc:1275] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:15:51.788349 32089 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:51.790012 32124 pending_rounds.cc:85] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d: Aborting all ops after (but not including) 8
I20260709 13:15:51.783051 32165 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:51.790297 32124 pending_rounds.cc:107] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:15:51.790580 32124 raft_consensus.cc:2889] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:51.746598  6624 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:51.802107 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:51.781152  6463 consensus_queue.cc:1059] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:15:51.806020  6455 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14.
W20260709 13:15:51.808207 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 112793us
I20260709 13:15:51.810691 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:51.810896 32198 raft_consensus.cc:1275] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:15:51.813359 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:51.815940 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:51.816720 32238 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:51.815198 32090 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:51.822638 32089 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:51.824139  6321 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:15:51.805410  6416 raft_consensus.cc:2804] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:51.825165  6577 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:51.825714  6416 raft_consensus.cc:697] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:51.826622 32117 raft_consensus.cc:1240] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 16 LEADER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:51.826980  6416 consensus_queue.cc:237] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:51.828125 32090 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:51.828811  6415 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:51.829182 32090 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:51.829317  6415 raft_consensus.cc:697] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 18 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:51.829445  6577 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:51.805160  6393 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:51.830096  6577 raft_consensus.cc:697] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:51.830368  6569 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:15:51.830888 32115 raft_consensus.cc:2410] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:15:51.830909  6569 raft_consensus.cc:697] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 26 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:51.831163  6577 consensus_queue.cc:237] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:51.832346  6569 consensus_queue.cc:237] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:51.833999  6630 consensus_queue.cc:1059] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:15:51.835271  6571 raft_consensus.cc:3055] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:15:51.835642  6571 raft_consensus.cc:740] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:51.836493  6571 consensus_queue.cc:260] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:51.781684  6493 raft_consensus.cc:740] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:51.842890  6568 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:51.843323  6634 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:51.843115  6415 consensus_queue.cc:237] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:51.781379  6541 rpcz_store.cc:276] 0709 13:15:48.968618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.970658 (+  2040us) service_pool.cc:224] Handling call
0709 13:15:49.162886 (+192228us) ts_tablet_manager.cc:934] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339)
0709 13:15:50.819031 (+1656145us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:15:51.418818 (+599787us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:51.418946 (+   128us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:15:51.660126 (+241180us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:15:51.690436 (+ 30310us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:51.757407 (+ 66971us) ts_tablet_manager.cc:989] Replica registered.
0709 13:15:51.757490 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":39312,"tablet-copy.queue_time_us":82221,"thread_start_us":61106,"threads_started":2}
I20260709 13:15:51.847599  6353 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:51.789168  6443 consensus_queue.cc:1059] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:15:51.785267  6600 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:51.822928  6537 raft_consensus.cc:697] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:51.853711 32089 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:51.856323  6572 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:51.786872  6371 consensus_queue.cc:1059] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.066s
W20260709 13:15:51.865373   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 73104.5us
I20260709 13:15:51.877205 32089 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:51.880882 32193 raft_consensus.cc:1275] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:15:51.883172   399 raft_consensus.cc:1275] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:15:51.883574   399 pending_rounds.cc:85] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6: Aborting all ops after (but not including) 11
I20260709 13:15:51.883781   399 pending_rounds.cc:107] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:15:51.859758  6533 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:51.884158   399 raft_consensus.cc:2889] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:51.838752  6455 consensus_queue.cc:1048] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:15:51.885515   396 raft_consensus.cc:1275] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:15:51.885885   396 pending_rounds.cc:85] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6: Aborting all ops after (but not including) 11
I20260709 13:15:51.886089   396 pending_rounds.cc:107] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:15:51.886305   396 raft_consensus.cc:2889] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:51.886348  6584 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:51.883677  6572 raft_consensus.cc:2804] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:51.888079  6572 raft_consensus.cc:697] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:51.890713 32266 raft_consensus.cc:1275] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:15:51.853087  6519 consensus_queue.cc:1048] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:15:51.908875 32121 raft_consensus.cc:1275] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
W20260709 13:15:51.909149  6650 log.cc:927] Time spent T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:15:51.909427 32121 pending_rounds.cc:85] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d: Aborting all ops after (but not including) 9
I20260709 13:15:51.909749 32121 pending_rounds.cc:107] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:15:51.910149 32121 raft_consensus.cc:2889] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:51.909821  6493 consensus_queue.cc:260] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:51.915195  6659 raft_consensus.cc:3055] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:51.917712  6659 raft_consensus.cc:740] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:51.918866  6659 consensus_queue.cc:260] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:51.903733  6541 tablet_copy_client.cc:806] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:51.911703  6572 consensus_queue.cc:237] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:51.930698   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 124724us
I20260709 13:15:51.912434  6443 raft_consensus.cc:3055] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:15:51.941502 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 158566us
I20260709 13:15:51.945410 32165 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:51.951771  6659 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:51.954828  6571 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:51.957511  6505 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:51.958345  6505 consensus_queue.cc:1048] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:51.967106  6659 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:51.970461 32239 leader_election.cc:400] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 13 election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 13. Current term is 14.
I20260709 13:15:51.971652  6533 consensus_queue.cc:1059] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:15:51.972781  6533 raft_consensus.cc:3055] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:15:51.972719  6634 consensus_queue.cc:1048] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:51.973356  6533 raft_consensus.cc:740] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:51.974651  6533 consensus_queue.cc:260] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:51.976193  6533 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:51.971661 32239 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:51.977873  6634 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:51.978516 32239 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:51.979516  6634 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:15:51.939920  6443 raft_consensus.cc:740] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:51.980288 32239 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:52.005146 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 128032us
I20260709 13:15:52.006814 32089 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:15:52.010218   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 46537.7us
I20260709 13:15:51.944761  6541 tablet_copy_client.cc:670] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:52.013397   368 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:51.943264  6629 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:52.010896  6631 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:15:52.047993 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 210029us
W20260709 13:15:52.038858  6648 log.cc:927] Time spent T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:15:51.951179  6371 consensus_queue.cc:1059] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.089s
W20260709 13:15:52.066816 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 107462us
I20260709 13:15:52.004626  6416 consensus_queue.cc:1048] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
W20260709 13:15:52.073508 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.075232 32165 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:15:52.076915 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 64523.1us
I20260709 13:15:52.044661  6492 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:51.983052  6443 consensus_queue.cc:260] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:52.086069 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 145576us
I20260709 13:15:52.068928  6584 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:52.010710  6537 consensus_queue.cc:237] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:52.140873  6658 log.cc:927] Time spent T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 13:15:52.143656  6653 log.cc:927] Time spent T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:15:52.145269  6493 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:15:52.146381  6660 log.cc:927] Time spent T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:15:52.150435 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 71807.2us
W20260709 13:15:52.154387 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 68409.7us
W20260709 13:15:52.138517  6646 log.cc:927] Time spent T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:15:52.153821 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 86804.2us
I20260709 13:15:52.155448  6492 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:52.190526 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.196276 32089 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:52.213775 32198 raft_consensus.cc:1275] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:15:52.193641  6492 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:52.261814  6661 log.cc:927] Time spent T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:15:52.238248  6569 consensus_queue.cc:1048] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
W20260709 13:15:52.316278 32239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.379396  6463 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.380744  6631 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.380908  6415 consensus_queue.cc:1048] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:52.381811 32090 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:52.383517 32089 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:52.236521  6672 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 13:15:52.395689  6416 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:15:52.238673  6617 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 13:15:52.384143  6680 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:52.386334  6577 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:52.416540  6405 consensus_queue.cc:1048] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:15:52.416905  6669 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:15:52.400312  6455 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.423852  6455 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:52.426257  6455 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:52.397270  6651 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.427089  6651 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:52.429327  6651 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:52.429931 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:52.430891 32194 raft_consensus.cc:2410] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:15:52.435792  6634 consensus_queue.cc:1048] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:52.437318   399 raft_consensus.cc:1275] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:52.409524  6600 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:15:52.441058  6649 log.cc:927] Time spent T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.501s	user 0.002s	sys 0.002s
I20260709 13:15:52.444417  6321 raft_consensus.cc:3055] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:52.444962  6321 raft_consensus.cc:740] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:52.403762  6631 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:52.445950  6321 consensus_queue.cc:260] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:52.447216  6321 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:52.397598  6463 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:52.452174  6654 raft_consensus.cc:3055] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:52.452739  6654 raft_consensus.cc:740] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:52.454140  6463 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:15:52.456754 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.441134  6600 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:52.458391   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:52.461529   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:52.462108  6659 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.462666  6659 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:52.448369  6663 log.cc:927] Time spent T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260709 13:15:52.466804  6519 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:52.453717  6654 consensus_queue.cc:260] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:52.467444  6519 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:52.467726  6455 consensus_queue.cc:1048] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:52.469694  6519 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:52.470851   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:52.480909 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:52.481738  6631 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:52.482940  6659 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:52.484112 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:52.485044 32123 raft_consensus.cc:2410] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:15:52.485131 32118 raft_consensus.cc:2393] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 19: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:52.485945 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:52.486599  6443 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:52.471529   402 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 19.
I20260709 13:15:52.491189 32236 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:52.492218  6631 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:52.497427 32239 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:52.511633 32239 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:52.487887  6600 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:52.492642  6631 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:52.519918 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:52.518014 32165 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:52.523320 32117 raft_consensus.cc:2410] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:15:52.529038 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:52.530139  6666 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:52.529038 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:52.530856  6666 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:52.531344 32265 raft_consensus.cc:2468] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:15:52.514983  6533 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:52.532476  6537 consensus_queue.cc:1048] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
W20260709 13:15:52.538661 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.540982  6533 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:52.541756 32266 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 16.
I20260709 13:15:52.545624  6571 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:52.549117 32165 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:52.550850 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:52.549659  6321 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:15:52.562233 32267 raft_consensus.cc:1275] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:15:52.565534 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:52.567669 32268 raft_consensus.cc:1275] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:15:52.568198 32268 pending_rounds.cc:85] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06: Aborting all ops after (but not including) 11
I20260709 13:15:52.568486 32268 pending_rounds.cc:107] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:15:52.568753 32268 raft_consensus.cc:2889] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:52.574241 32267 raft_consensus.cc:1275] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:15:52.580142 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.590621 32165 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:52.594928 32120 raft_consensus.cc:1275] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:15:52.523743  6631 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:52.411301  6680 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:52.599400  6321 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:52.599840 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:52.600181  6321 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:52.601811 32165 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:52.561630  6533 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:52.518675  6405 consensus_queue.cc:1059] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:15:52.604820 32165 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:52.611685 32090 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:52.562891  6670 raft_consensus.cc:2804] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:52.616321  6321 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:52.589594  6686 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:52.596447  6600 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:52.631157 32265 raft_consensus.cc:1275] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:15:52.635885 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:52.653621  6321 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:15:52.656570  6321 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:15:52.658607 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 47039.1us
I20260709 13:15:52.664158  6674 consensus_queue.cc:1048] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:52.668102  6674 consensus_queue.cc:1048] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:52.672731 32265 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 26 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
W20260709 13:15:52.654278 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 187857us
I20260709 13:15:52.606388  6659 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:52.574072  6571 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:52.604415  6685 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:52.687561  6321 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:52.688220  6321 raft_consensus.cc:697] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 15 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:52.689733 32090 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:52.619694  6670 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:52.677249  6505 raft_consensus.cc:2804] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:52.694242  6321 consensus_queue.cc:237] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:52.706866  6541 tablet_copy_client.cc:538] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:52.682968  6492 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:52.619230  6533 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:52.714620  6572 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.009s
I20260709 13:15:52.689215  6676 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:52.725950 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:52.681926  6639 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.037s
W20260709 13:15:52.727423 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 122706us
I20260709 13:15:52.696961  6405 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:52.689806  6666 leader_election.cc:290] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:52.713318  6505 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.677737  6600 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:52.732729 32165 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:52.692252  6670 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:52.721438  6584 consensus_meta.cc:287] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.604s	user 0.003s	sys 0.009s
I20260709 13:15:52.691642  6629 consensus_queue.cc:1048] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:15:52.737499 32270 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 16.
I20260709 13:15:52.728451  6686 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:52.769920 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.703547  6568 consensus_queue.cc:1048] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
W20260709 13:15:52.788794 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 47135.5us
I20260709 13:15:52.790095 32165 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:52.735766  6405 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.740190  6505 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:52.693580  6685 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:52.809880  6634 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
W20260709 13:15:52.810405  6665 log.cc:927] Time spent T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.326s	user 0.000s	sys 0.001s
I20260709 13:15:52.811193  6683 consensus_queue.cc:1059] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.120s
W20260709 13:15:52.813000  6687 log.cc:927] Time spent T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:15:52.812909  6709 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:52.771884  6584 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:15:52.802867  6658 log.cc:927] Time spent T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:15:52.807685  6405 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:52.858750  6321 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:52.733213  6676 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:52.859387  6321 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.860006  6321 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:15:52.881053 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 91010.9us
I20260709 13:15:52.882499 32165 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:52.792297  6686 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:52.872030  6693 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:52.880400  6683 raft_consensus.cc:3055] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:15:52.910769  6683 raft_consensus.cc:740] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:52.911808  6695 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.859400  6671 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:15:52.884742  6680 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:52.834769  6634 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:52.930661   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:52.921705   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:52.935490  6321 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:52.942824 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:15:52.914373  6689 log.cc:927] Time spent T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:15:52.958106 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:52.911691  6683 consensus_queue.cc:260] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:52.913527  6679 raft_consensus.cc:3055] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:52.915876  6711 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:53.006182  6666 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:52.878407  6675 consensus_queue.cc:1059] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.073s
I20260709 13:15:53.031886  6584 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:53.056067  6321 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:52.915489  6685 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:52.924973  6371 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:52.917861  6671 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:52.921854  6680 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:15:53.060959 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.919606  6686 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:53.080155   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:53.084860   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
W20260709 13:15:53.087230 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.065606  6705 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.912575  6695 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:53.104547  6321 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.105252  6321 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:53.058734  6679 raft_consensus.cc:740] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
W20260709 13:15:53.086305 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 203910us
I20260709 13:15:53.085335  6683 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:53.082571  6533 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:53.102154 32236 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
W20260709 13:15:53.118153 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:53.122339 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.936834  6693 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:53.124107  6703 log.cc:927] Time spent T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
W20260709 13:15:53.125159  6704 log.cc:927] Time spent T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:15:53.130471  6573 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:53.140884  6693 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:53.141209  6573 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:53.146888 32236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 44845.8us
I20260709 13:15:53.135421  6712 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:53.137260 32016 catalog_manager.cc:5697] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 16 to 18, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 18 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:52.681890 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:53.144300  6573 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:53.148550  6712 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:53.151759 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:53.153744  6712 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:53.154379  6712 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:53.086426  6600 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:53.093124  6715 raft_consensus.cc:2749] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:53.086292  6706 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:53.085547  6584 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:53.080314  6666 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:53.190994 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:53.194347 32123 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 17.
I20260709 13:15:53.190994 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:53.192086  6321 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:53.093317  6680 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:53.197589 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:53.198312 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:53.199893 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:53.087960  6371 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:53.204380 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:53.206943 32115 raft_consensus.cc:1240] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:53.210492 32190 raft_consensus.cc:1275] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:15:53.211074 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:53.073969  6711 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:53.107249  6705 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:53.207442 32119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56884 (request call id 3390) took 1508 ms (client timeout 1991 ms). Trace:
I20260709 13:15:53.089898  6671 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:53.216791 32119 rpcz_store.cc:269] 0709 13:15:51.692834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.693990 (+  1156us) service_pool.cc:224] Handling call
0709 13:15:53.201128 (+1507138us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b54000339d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:15:53.201264 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1853787520}
I20260709 13:15:53.218541 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:53.227094 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:53.227463 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:53.226260 32197 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
I20260709 13:15:53.230580 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:53.235826 32190 raft_consensus.cc:1275] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:15:53.228631  6679 consensus_queue.cc:260] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:53.239336  6584 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:53.241066  6707 log.cc:927] Time spent T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:15:53.241472  6705 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:53.242213  6634 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:53.243693  6671 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:53.246971  6711 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:53.247869 32195 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 26 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:15:53.249330 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:53.252432   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:53.253793 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:53.211812  6715 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.173096  6572 consensus_queue.cc:1048] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:15:53.273072 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:53.274376  6670 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:53.274989 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:53.275928 32194 raft_consensus.cc:2410] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:15:53.277791  6670 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:53.260530  6711 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:53.280004  6711 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:53.281865 32270 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 18.
I20260709 13:15:53.282228  6711 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:53.219347  6600 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.293514  6600 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:53.300078  6515 raft_consensus.cc:3055] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:53.307492  6600 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:15:53.308920  6701 log.cc:927] Time spent T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.413s	user 0.005s	sys 0.000s
I20260709 13:15:53.310257  6371 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:53.214731  6713 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:15:53.311267  6724 log.cc:927] Time spent T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:15:53.249209  6676 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:53.313253  6443 consensus_meta.cc:287] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.822s	user 0.010s	sys 0.002s
I20260709 13:15:53.317224 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:53.319803  6695 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:53.320866  6711 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:53.323144 32193 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:53.323738  6715 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:53.325639  6666 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:53.327208   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:53.330022  6674 raft_consensus.cc:1064] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:15:53.276274  6680 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:53.332445  6571 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:53.314741 32019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49550 (request call id 318) took 4076 ms. Trace:
I20260709 13:15:53.194726  6706 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:53.341171 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:53.343923   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:53.356175   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:53.383370   401 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 18.
I20260709 13:15:53.355394   369 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801
W20260709 13:15:53.360713 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.420432 32236 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:53.369505 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:15:53.448125   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 92857.2us
I20260709 13:15:53.349345  6623 raft_consensus.cc:1064] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:15:53.463598 32193 raft_consensus.cc:1275] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:15:53.363965  6541 tablet_bootstrap.cc:492] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6: Bootstrap starting.
W20260709 13:15:53.346650  6631 consensus_meta.cc:287] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.739s	user 0.005s	sys 0.005s
I20260709 13:15:53.348037  6679 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:53.480055  6562 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:53.497162  6562 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:53.497670  6562 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:53.344748  6515 raft_consensus.cc:740] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:53.501652  6515 consensus_queue.cc:260] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:53.503033  6515 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:53.491915  6631 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:53.507086  6631 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:53.509691   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:53.512416  6690 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:53.513100  6690 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:53.513605  6690 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:53.379292  6654 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:53.376118 32019 rpcz_store.cc:276] 0709 13:15:49.238364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.240813 (+  2449us) service_pool.cc:224] Handling call
0709 13:15:49.431795 (+190982us) spinlock_profiling.cc:243] Waited 88.5 ms on lock 0x7b5400047c54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5b090 00007fb59eff9f3a 00007fb5a4db01cc 00007fb5a4eae37e 00007fb5a336f2a4 00007fb5a336f232 00007fb5a336f161 00007fb5a336f0dc 00007fb5a336e392 00007fb59d32c48c 00007fb59d32b8c6
0709 13:15:53.314648 (+3882853us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:50.699703 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:50.700325 (+   622us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:50.700367 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:15:50.700385 (+    18us) tablet.cc:662] Decoding operations
0709 13:15:50.701391 (+  1006us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:50.701456 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:50.701484 (+    28us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:15:50.702359 (+   875us) tablet.cc:701] Row locks acquired
0709 13:15:50.702382 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:15:50.702569 (+   187us) write_op.cc:270] Start()
0709 13:15:50.702690 (+   121us) write_op.cc:276] Timestamp: P: 1783602950702486 usec, L: 0
0709 13:15:50.702714 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:15:50.847244 (+144530us) log.cc:844] Serialized 3200 byte log entry
0709 13:15:51.224893 (+377649us) op_driver.cc:464] REPLICATION: finished
0709 13:15:51.655532 (+430639us) write_op.cc:301] APPLY: starting
0709 13:15:51.660307 (+  4775us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:51.834912 (+174605us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:51.835011 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:51.885975 (+ 50964us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:51.886196 (+   221us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:15:51.886239 (+    43us) write_op.cc:312] APPLY: finished
0709 13:15:51.886485 (+   246us) log.cc:844] Serialized 81 byte log entry
0709 13:15:51.886646 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:51.886778 (+   132us) write_op.cc:454] Released schema lock
0709 13:15:51.886820 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:51.887680 (+   860us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:51.887761 (+    81us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":62077,"reported_tablets":12,"spinlock_wait_cycles":203452928,"child_traces":[["op",{"apply.queue_time_us":388475,"apply.run_cpu_time_us":13940,"apply.run_wall_time_us":238024,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37647,"num_ops":8,"prepare.queue_time_us":202182,"prepare.run_cpu_time_us":4646,"prepare.run_wall_time_us":147946,"replication_time_us":479472,"thread_start_us":326612,"threads_started":2}]]}
I20260709 13:15:53.447535  6569 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:53.527681 32239 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.059s	sys 0.059s
I20260709 13:15:53.447916  6573 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:15:53.529052 32239 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.059s	sys 0.059s
W20260709 13:15:53.531167 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 605589us
W20260709 13:15:53.533004 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.534045 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:53.482805  6666 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:53.522428  6505 consensus_meta.cc:287] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.698s	user 0.009s	sys 0.001s
I20260709 13:15:53.489935  6600 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.542902 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:53.545593 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:53.545864 32090 leader_election.cc:304] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:53.547235 32116 raft_consensus.cc:2393] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 11: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:53.336521  6405 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:53.544951   369 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:53.546496 32121 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 20.
I20260709 13:15:53.527985  6695 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.375403  6711 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:15:53.524961  6537 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.526674  6631 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.350868  6713 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
W20260709 13:15:53.560398 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.571771 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:53.572979 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:53.574185 32121 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 21.
I20260709 13:15:53.576010 32266 raft_consensus.cc:1275] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:15:53.578610 32239 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:53.582053 32118 raft_consensus.cc:2368] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 16. Current term is 17.
I20260709 13:15:53.557624  6705 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.596616 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:53.597735 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:53.598224 32269 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 18.
I20260709 13:15:53.587268 32239 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:53.600456 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:53.602470 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:53.604768 32115 raft_consensus.cc:2393] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 19: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:53.538019  6569 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:53.562707  6725 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.616009 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:53.562878  6662 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:53.542299  6573 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:53.607602 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:53.543419  6666 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:53.548683  6505 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:53.608902 32239 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:53.576378  6519 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:53.551702  6600 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:53.596616  6712 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:53.644548   400 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 19.
I20260709 13:15:53.669044 32236 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:53.567608  6537 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:53.563169  6695 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:53.672377  6695 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:53.672983  6695 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:15:53.673156 32116 raft_consensus.cc:2393] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 17: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:53.673380  6695 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.673712  6537 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:53.616968  6639 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:53.580226  6631 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:53.652575   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 107816us
I20260709 13:15:53.673775  6695 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:53.620249  6662 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:53.678817 32269 raft_consensus.cc:1240] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:53.680711   369 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:53.608332  6705 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:53.650624  6680 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:53.676246  6730 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:53.701321 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:53.704731 32265 raft_consensus.cc:1275] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:15:53.684532  6662 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:15:53.706571 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.710191 32268 raft_consensus.cc:1275] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:15:53.625583  6725 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:53.714387  6683 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:53.715154  6683 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:53.690442  6492 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:53.718108  6683 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:53.698494  6728 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:53.728034 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:53.698128  6715 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:53.731490 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 122659us
I20260709 13:15:53.678435  6519 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:53.735965 32266 raft_consensus.cc:1275] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:15:53.704452  6730 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.750697  6674 consensus_queue.cc:237] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:53.755616  6569 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:53.756268  6706 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:15:53.768998 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.775187  6519 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:53.780400   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:53.702404  6680 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:15:53.730381  6443 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:53.759793  6728 raft_consensus.cc:697] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:53.759332  6730 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:53.783949  6634 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:53.821303  6505 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:53.797802  6519 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.800149  6405 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:53.822769  6711 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:53.823436  6353 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.849210  6353 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:53.851246  6353 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:53.851364 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:53.851992 32265 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 16.
I20260709 13:15:53.852064  6600 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:53.853226  6631 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:53.815261  6573 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:53.854312  6735 log.cc:927] Time spent T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.105s	user 0.002s	sys 0.000s
I20260709 13:15:53.859234 32194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54182 (request call id 5013) took 1136 ms. Trace:
I20260709 13:15:53.859648 32194 rpcz_store.cc:276] 0709 13:15:52.722643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.725724 (+  3081us) service_pool.cc:224] Handling call
0709 13:15:53.859047 (+1133323us) spinlock_profiling.cc:243] Waited 547 ms on lock 0x7b54003a3c54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:15:53.859176 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1257215744}
W20260709 13:15:53.864028 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.844022 32090 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:53.798161  6443 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:53.905537 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 61653.4us
W20260709 13:15:53.937625 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.940044 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:53.984340 32265 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:15:53.872469  6713 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:53.833922  6634 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:54.074258  6631 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:54.075073  6631 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:53.843035  6519 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:54.079473  6600 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:54.080309  6600 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:54.083614   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:54.085799  6680 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:54.086433  6631 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:15:54.089588  6754 log.cc:927] Time spent T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:15:54.091066  6728 consensus_queue.cc:237] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:54.106412  6443 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:54.107496  6725 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:53.991747  6745 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.112778  6745 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:54.115541  6745 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:53.858959  6584 consensus_queue.cc:1048] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.135s
I20260709 13:15:53.992229  6679 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:54.122294  6679 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:53.983130  6405 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:54.153172  6405 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:54.153685  6405 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:54.151800  6662 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:54.191366 32122 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.035s	sys 0.094s
W20260709 13:15:54.193400 32122 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.036s	sys 0.094s
I20260709 13:15:54.174058  6680 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:54.198159 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 178582us
W20260709 13:15:54.177969  6562 consensus_meta.cc:287] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6: Time spent flushing consensus metadata: real 0.680s	user 0.007s	sys 0.006s
W20260709 13:15:54.227309  6690 consensus_meta.cc:287] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.713s	user 0.010s	sys 0.002s
I20260709 13:15:54.213862  6573 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:54.231096 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 58536.9us
I20260709 13:15:54.232755 32090 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:54.241209  6672 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:54.241863  6672 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.242239  6672 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:54.231350  6679 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:54.218537  6680 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:54.223487  6745 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:54.222270  6562 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:54.238888  6568 consensus_queue.cc:1048] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
W20260709 13:15:54.281526  6654 consensus_meta.cc:287] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.752s	user 0.012s	sys 0.000s
I20260709 13:15:54.282270  6321 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.282758  6321 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:54.286111  6680 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:54.261487  6573 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:54.295583  6573 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:54.274899  6745 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:54.301445  6662 leader_election.cc:290] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:54.303169  6745 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:15:54.306232  6695 consensus_meta.cc:287] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.617s	user 0.010s	sys 0.000s
I20260709 13:15:54.306903  6695 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:54.309211  6695 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:54.311437  6730 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:54.314221  6562 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:54.262143  6690 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:54.326007 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 306806us
W20260709 13:15:54.325474  6571 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.004s	sys 0.007s
W20260709 13:15:54.336537 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:54.331817  6571 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.005s	sys 0.008s
I20260709 13:15:54.328341  6672 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:54.338485  6721 log.cc:927] Time spent T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 1.065s	user 0.000s	sys 0.022s
I20260709 13:15:54.339931 32265 raft_consensus.cc:1240] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 18. Current term is 19. Ops: []
W20260709 13:15:54.347826  6741 log.cc:927] Time spent T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.593s	user 0.035s	sys 0.021s
I20260709 13:15:54.342538  6405 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:54.352170  6571 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:54.357146 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 124494us
I20260709 13:15:54.357533 32273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 4115) took 1618 ms. Trace:
I20260709 13:15:54.358407 32273 rpcz_store.cc:276] 0709 13:15:52.738271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.738420 (+   149us) service_pool.cc:224] Handling call
0709 13:15:52.738800 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:52.877761 (+138961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:52.877795 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:52.902612 (+ 24817us) log.cc:844] Serialized 26 byte log entry
0709 13:15:53.155393 (+252781us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:53.155449 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:53.155517 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:54.336066 (+1180549us) spinlock_profiling.cc:243] Waited 40.8 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:15:54.354573 (+ 18507us) raft_consensus.cc:1685] finished
0709 13:15:54.354602 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:54.356100 (+  1498us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":73241,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":73,"spinlock_wait_cycles":93913472,"thread_start_us":361792,"threads_started":2,"wal-append.queue_time_us":361835}
I20260709 13:15:54.372985  6405 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:54.376158  6705 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:54.382138 32199 raft_consensus.cc:1275] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:15:54.390445 32193 raft_consensus.cc:1275] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:15:54.360930  6662 consensus_queue.cc:1048] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:15:54.361048  6571 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:54.406773  6744 log.cc:927] Time spent T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.585s	user 0.010s	sys 0.043s
I20260709 13:15:54.408918 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:54.411087 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:54.412184 32191 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:15:54.412263 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:54.419143 32197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54182 (request call id 5015) took 1157 ms. Trace:
I20260709 13:15:54.419633 32197 rpcz_store.cc:276] 0709 13:15:53.261357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.408662 (+1147305us) service_pool.cc:224] Handling call
0709 13:15:54.419067 (+ 10405us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:54.420789 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:54.430413 32197 raft_consensus.cc:1240] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:54.433975 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:54.434855 32192 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 20.
I20260709 13:15:54.451828 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:54.432662   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:54.454906   401 raft_consensus.cc:2393] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 19: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:15:54.453497 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:54.456871 32195 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 20.
I20260709 13:15:54.428954 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:54.463200 32196 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 20.
I20260709 13:15:54.464821 32193 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:15:54.466095 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:54.466701 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:54.424814  6730 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:54.468701 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:54.469832 32195 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:15:54.470739  6680 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:54.470938 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:54.471300  6680 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:54.472074 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:54.469792 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:54.452330  6690 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:54.474900   399 raft_consensus.cc:1240] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:54.475307   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:54.474565 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:54.477288   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:54.480208 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:54.472668 32195 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 18.
I20260709 13:15:54.481101 32191 raft_consensus.cc:2393] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 20: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:54.480801 32197 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 19.
I20260709 13:15:54.483250  6713 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.484717 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:54.484977 32197 raft_consensus.cc:1275] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:15:54.486111 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:54.489279 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:54.490442 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:54.491242 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:54.493010 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:15:54.486321 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.489956 32122 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:15:54.496165 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:54.498522 32123 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 20.
I20260709 13:15:54.496917 32118 raft_consensus.cc:2393] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 15: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:54.500736 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:54.501981 32197 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:15:54.502787 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:54.504698 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:54.505393 32196 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17.
I20260709 13:15:54.506994 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:54.507663 32194 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
I20260709 13:15:54.508919 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:54.509613  6405 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:15:54.510988 32198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 3646) took 1253 ms. Trace:
I20260709 13:15:54.511973  6405 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:15:54.512681  6537 consensus_queue.cc:1048] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:54.511368 32198 rpcz_store.cc:276] 0709 13:15:53.259728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.369723 (+1109995us) service_pool.cc:224] Handling call
0709 13:15:54.387521 (+ 17798us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:54.387831 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:54.387863 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:54.390866 (+  3003us) log.cc:844] Serialized 26 byte log entry
0709 13:15:54.464455 (+ 73589us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:54.464499 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:54.464568 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:54.510795 (+ 46227us) raft_consensus.cc:1685] finished
0709 13:15:54.510813 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:54.510933 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":1485,"thread_start_us":34696,"threads_started":1,"wal-append.queue_time_us":84434}
I20260709 13:15:54.513553  6571 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:54.514282  6492 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:54.514914  6492 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:54.517256  6492 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:54.483893  6713 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:54.521920 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.522634  6763 consensus_queue.cc:1048] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:54.524107  6680 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:54.524415  6713 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:54.521234  6654 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.520275 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:54.526721 32191 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:54.497293  6705 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:54.529541  6654 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:54.529683  6705 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:54.531929  6654 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:54.532017  6705 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:54.529343 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:54.532734  6415 consensus_queue.cc:1048] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:54.495054  6690 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:54.497961  6672 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:54.538403 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:54.539113 32119 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:15:54.542150 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:54.543308   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:54.545691 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:54.547691   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:54.549777 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:54.550552 32118 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:54.553234 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:54.553267 32197 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17.
I20260709 13:15:54.548413   396 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:15:54.555812 32162 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:54.533722  6763 consensus_queue.cc:1048] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:15:54.560192 32191 raft_consensus.cc:2468] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:15:54.555614 32089 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:54.570887  6519 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:54.576922 32090 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:54.579445  6674 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:54.580073  6674 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.582347 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:54.583214 32119 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:54.585067 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:54.585536 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:54.586313 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:54.588989 32239 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:54.590574 32273 raft_consensus.cc:2393] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 16: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:54.591106 32089 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:54.594553 32122 raft_consensus.cc:1240] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:54.591178 32239 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:54.540074  6690 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:54.602487 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:54.603425 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:54.594565 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:54.604562 32272 raft_consensus.cc:2393] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 15: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
W20260709 13:15:54.605268 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 79802.7us
I20260709 13:15:54.560971  6443 raft_consensus.cc:2804] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:54.544293  6713 consensus_queue.cc:1059] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.021s
I20260709 13:15:54.547115  6584 consensus_queue.cc:1059] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:15:54.607558 32264 raft_consensus.cc:2393] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 10: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:54.605053 32239 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:54.612453 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:54.615517 32272 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
I20260709 13:15:54.580873  6679 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:54.616317 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:54.618227 32264 raft_consensus.cc:2393] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 16: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:54.610503 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:54.613425  6738 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:54.620005  6738 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:54.620234   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:54.622251  6738 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:54.622865  6697 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:54.623751  6679 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:54.624251  6679 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:54.626726 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:54.580484  6674 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:54.628018 32239 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:54.591944  6519 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:54.630604  6519 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:54.631237   403 raft_consensus.cc:1275] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 13 LEARNER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:15:54.631508  6415 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:54.630592  6505 consensus_queue.cc:1048] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:15:54.632129  6415 consensus_queue.cc:1048] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:54.633021  6519 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:54.605932  6705 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:15:54.634727 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 43844.8us
I20260709 13:15:54.635057  6705 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.635233   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:54.635828  6705 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:54.636087 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:54.637494 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:54.605741  6730 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:54.639165 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:54.640036 32120 raft_consensus.cc:1275] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:15:54.609441  6443 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.640980 32117 raft_consensus.cc:2368] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 10. Current term is 11.
I20260709 13:15:54.641137 32273 raft_consensus.cc:2393] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 20: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:54.638046 32115 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:15:54.641906 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:54.643738   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:54.652804   401 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 19.
I20260709 13:15:54.640098 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:54.653060 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:15:54.643710  6710 log.cc:927] Time spent T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 1.371s	user 0.009s	sys 0.017s
I20260709 13:15:54.644500 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:54.647848  6321 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:54.653088 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:54.642931 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:54.653651 32122 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 20.
I20260709 13:15:54.657934 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:54.658946 32122 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 20.
I20260709 13:15:54.657963 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:54.670095 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:54.670300  6321 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:54.662374 32190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56926 (request call id 1253) took 1383 ms. Trace:
I20260709 13:15:54.671156 32190 rpcz_store.cc:276] 0709 13:15:53.279423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.661633 (+1382210us) service_pool.cc:224] Handling call
0709 13:15:54.661917 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:54.662080 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:54.662105 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:54.662146 (+    41us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:15:54.662174 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:54.662230 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:54.662325 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:54.674547 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:54.686805 32116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56890 (request call id 4994) took 1116 ms. Trace:
I20260709 13:15:54.703298 32116 rpcz_store.cc:276] 0709 13:15:53.570363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.571426 (+  1063us) service_pool.cc:224] Handling call
0709 13:15:54.686643 (+1115217us) spinlock_profiling.cc:243] Waited 74.7 ms on lock 0x7b5400205b54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:15:54.686751 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171817856}
I20260709 13:15:54.650223  6680 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:54.687848  6321 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:54.655978  6730 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.682296 32269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 3396) took 1063 ms. Trace:
I20260709 13:15:54.651011  6519 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:54.656484  6443 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:54.706916 32269 rpcz_store.cc:276] 0709 13:15:53.618923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.739710 (+120787us) service_pool.cc:224] Handling call
0709 13:15:53.740133 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:53.760020 (+ 19887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:53.760050 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:53.760500 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:15:54.245210 (+484710us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:15:54.350634 (+105424us) log.cc:844] Serialized 14 byte log entry
0709 13:15:54.681770 (+331136us) spinlock_profiling.cc:243] Waited 8.82 ms on lock 0x7b54003e42a0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59ef6c733 00007fb59eff1dbf 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c
0709 13:15:54.681836 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:54.681929 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:54.681980 (+    51us) raft_consensus.cc:1685] finished
0709 13:15:54.682057 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:54.682229 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19471,"prepare.queue_time_us":137747,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":45953,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":22255,"spinlock_wait_cycles":20289280,"thread_start_us":549219,"threads_started":2,"wal-append.queue_time_us":543299}
I20260709 13:15:54.705123 32119 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 21.
I20260709 13:15:54.702255 32272 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:15:54.706584 32118 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 22.
I20260709 13:15:54.674433  6713 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:54.726878   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:54.751168 32267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 4112) took 2035 ms. Trace:
I20260709 13:15:54.726513  6321 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:54.757115  6321 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:54.757727  6321 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:54.763459 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:54.764642 32272 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:54.753713 32267 rpcz_store.cc:276] 0709 13:15:52.716052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.716982 (+   930us) service_pool.cc:224] Handling call
0709 13:15:52.717416 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:52.787419 (+ 70003us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:52.787818 (+   399us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:52.792919 (+  5101us) log.cc:844] Serialized 26 byte log entry
0709 13:15:52.885481 (+ 92562us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:52.885571 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.885670 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:54.643121 (+1757451us) spinlock_profiling.cc:243] Waited 41.9 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:15:54.720284 (+ 77163us) raft_consensus.cc:1685] finished
0709 13:15:54.720313 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:54.751069 (+ 30756us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1743,"raft.queue_time_us":94429,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":59,"spinlock_wait_cycles":96311168,"thread_start_us":157934,"threads_started":2,"wal-append.queue_time_us":475131}
I20260709 13:15:54.770381 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:54.771081 32267 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:54.711386  6519 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.708134  6730 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:54.711866  6680 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:54.773643  6695 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:54.779120  6519 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:54.828210 32272 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17.
I20260709 13:15:54.841910 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:54.765491  6713 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:54.875092  6321 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:54.878005  6321 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:54.895243  6321 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:54.912231  6735 log.cc:927] Time spent T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:15:54.912503   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
W20260709 13:15:54.900921  6772 log.cc:927] Time spent T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:15:54.949018  6321 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:54.937254 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:54.950450 32272 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 10.
I20260709 13:15:54.951225 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:54.952039 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:54.842793  6777 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:54.875423  6712 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:54.976974  6712 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:54.979794  6712 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:54.900599  6778 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.981073  6778 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:54.961575 32090 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:54.985594  6568 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:54.986312  6568 raft_consensus.cc:697] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:54.987407  6568 consensus_queue.cc:237] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:54.962713  6713 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:54.963804  6779 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.989818  6779 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:54.990670 32265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 3400) took 1237 ms. Trace:
I20260709 13:15:54.991245 32265 rpcz_store.cc:276] 0709 13:15:53.752852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.174786 (+421934us) service_pool.cc:224] Handling call
0709 13:15:54.194616 (+ 19830us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:54.341931 (+147315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:54.990342 (+648411us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54001ba3d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:15:54.990596 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":328527232}
I20260709 13:15:54.965598  6680 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:54.829159  6695 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:54.993307 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 165797us
I20260709 13:15:54.997998 32165 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:54.999661 32165 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:55.001461 32165 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:55.007422 32165 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:54.953418  6693 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:55.014951  6695 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:54.996695  6777 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:55.022985  6777 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:55.003329  6779 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:55.029888  6679 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:54.959702  6690 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:55.031486 32120 raft_consensus.cc:2393] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 21: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:54.983812  6778 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:55.002687  6680 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:54.999846  6753 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:55.032888  6680 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:55.033345  6680 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:55.033267  6753 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:55.034191 32268 raft_consensus.cc:1275] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:15:55.035463  6753 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:55.036240  6693 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:55.004608  6713 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:55.038439  6693 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:55.039801  6730 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:55.042557  6738 consensus_queue.cc:1059] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:55.042716   369 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:55.050420 32267 raft_consensus.cc:2468] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:15:55.032205  6679 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:55.058244 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:55.059643  6693 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:55.052738  6674 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:54.980491  6712 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:55.071424 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:55.074838 32267 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 13.
I20260709 13:15:55.012708  6784 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:15:55.079267 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 71966.7us
I20260709 13:15:55.058243  6777 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:55.081437 32165 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:55.083478 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:55.085919  6662 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:55.080423  6777 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:55.086671  6662 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:55.088176  6777 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:55.084942  6789 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.089030  6789 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:55.090516  6705 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:55.091957 32264 raft_consensus.cc:1240] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:55.086241 32268 raft_consensus.cc:2393] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 19: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:55.074452  6693 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:55.091666  6789 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:55.093633  6662 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:55.096014  6789 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:55.097658 32165 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:55.084853  6790 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:55.074272  6697 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:55.102658  6789 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:15:55.103135  6697 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:15:55.105336 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:55.083909  6655 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:55.106729  6655 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:55.107111  6655 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:55.107211  6697 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:55.108793 32165 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:55.114107  6674 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:55.078869  6712 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:55.121402  6712 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:15:55.121742  6623 raft_consensus.cc:1068] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d: Unable to promote non-voter 94085cf341634eb686a95983b6b7f7e6: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }.
  Pending config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:55.123904  6666 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:55.126619  6600 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:55.126893 32238 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:55.128384  6600 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:55.129753  6605 raft_consensus.cc:3055] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:55.130188  6605 raft_consensus.cc:740] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:55.131052  6605 consensus_queue.cc:260] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:55.132970 32238 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:55.072474  6443 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:55.135936  6519 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:55.137112  6705 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:55.158725  6655 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:55.170802  6443 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:55.170949  6655 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 21 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:55.146618  6600 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:55.164086  6605 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:55.163645 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:55.180369 32190 raft_consensus.cc:2393] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 15: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:55.165496 32238 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:55.246932 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 81540us
I20260709 13:15:55.248006 32238 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:55.253156 32238 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:55.254868 32238 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:55.261603 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:55.171082  6519 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:55.258709 32238 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:55.246992 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 144473us
I20260709 13:15:55.164702  6634 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:55.246274  6600 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:55.287495 32238 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:55.289856 32090 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:55.282922 32165 leader_election.cc:400] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 16. Current term is 17.
I20260709 13:15:55.250340  6712 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:55.292574 32238 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:55.257922  6533 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:55.260083  6690 raft_consensus.cc:2804] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:55.256402  6790 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:15:55.257078  6697 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:55.294574 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:55.291332 32165 leader_election.cc:403] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:55.303610 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:55.298302 32090 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:55.298926 32238 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:55.295720  6690 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:55.300627  6674 consensus_queue.cc:1048] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:55.291086  6600 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:55.259331  6680 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:55.308868  6321 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 16. Current term is 17.
I20260709 13:15:55.295593  6568 raft_consensus.cc:2804] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:55.296445  6634 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:55.311916 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:55.313191 32238 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:55.313998  6693 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:55.314186 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:15:55.360805 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 47669us
I20260709 13:15:55.315928 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:55.302471  6695 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:55.298066  6519 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:55.329177 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:15:55.366909 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 239486us
I20260709 13:15:55.338471  6690 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:55.371466 32190 raft_consensus.cc:1240] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:55.344502  6669 raft_consensus.cc:2804] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:55.354872  6533 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:55.377683 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:55.378587 32268 raft_consensus.cc:2393] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 18: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:55.365082  6705 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:55.379493 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:15:55.384065 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 159915us
I20260709 13:15:55.359608  6568 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.404778 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:55.360526  6634 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:55.419910 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:55.420104 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:55.423913 32191 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:15:55.426632 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:15:55.428539   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 45839.9us
I20260709 13:15:55.430301 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:55.430790 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:55.431483 32192 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 19.
I20260709 13:15:55.435155 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:55.435747 32197 raft_consensus.cc:2376] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11. Re-sending same reply.
I20260709 13:15:55.437479 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:55.438319 32191 raft_consensus.cc:2376] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17. Re-sending same reply.
I20260709 13:15:55.364954  6443 consensus_queue.cc:1048] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:15:55.442967 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:55.439849 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:55.430737  6669 raft_consensus.cc:697] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:55.445547 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:55.455840 32191 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:55.449460 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:55.443671 32268 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:15:55.421350  6568 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:55.457463 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:55.443317 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:55.462013 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:55.426407  6634 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:55.414662  6533 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:55.474287 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:15:55.475466 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 802971us
I20260709 13:15:55.478020 32191 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 18.
I20260709 13:15:55.479169 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:55.482616 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:55.484543 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:55.463433 32165 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:55.476298 32087 leader_election.cc:304] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:55.528323 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:55.529670 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:55.530803 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:55.531862 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:15:55.534296  6795 log.cc:927] Time spent T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:15:55.537143  6796 log.cc:927] Time spent T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:15:55.430488  6794 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:55.546838  6794 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:55.549157  6794 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:55.549964  6669 consensus_queue.cc:237] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:55.553391  6680 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:55.473264  6533 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:55.564509   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:55.564903   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:55.565727   402 raft_consensus.cc:2393] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 14: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:15:55.566327 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:55.566959 32192 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 18.
I20260709 13:15:55.575419 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:55.576274 32198 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:15:55.580039 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 103879us
I20260709 13:15:55.532380 32268 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:15:55.582352 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 119003us
I20260709 13:15:55.583606 32165 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:55.585558 32165 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:55.588572   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:55.585547   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:55.603989 32087 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:55.621232 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:55.582669  6537 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:55.631022   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
W20260709 13:15:55.630326 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 44829.4us
I20260709 13:15:55.590296  6779 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:55.636835 32165 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:55.625440  6672 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:55.624961  6697 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:55.626539  6693 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:55.661934 32089 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:55.663223   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:55.671468 32089 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:55.679593 32016 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59534 (request call id 186) took 5664 ms. Trace:
I20260709 13:15:55.613531  6666 consensus_queue.cc:1048] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:15:55.671653 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:55.706869 32268 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 15.
I20260709 13:15:55.703918 32198 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 16.
I20260709 13:15:55.660163  6672 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.660826  6778 raft_consensus.cc:2764] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:15:55.692239  6662 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:55.657825  6519 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:55.728170  6705 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:55.730710  6519 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:55.680166 32016 rpcz_store.cc:276] 0709 13:15:50.015212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.020726 (+  5514us) service_pool.cc:224] Handling call
0709 13:15:55.679475 (+5658749us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:53.687960 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:53.873222 (+185262us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:53.874648 (+  1426us) write_op.cc:435] Acquired schema lock
0709 13:15:53.905192 (+ 30544us) tablet.cc:662] Decoding operations
0709 13:15:54.108365 (+203173us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:54.108486 (+   121us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:54.108540 (+    54us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:15:54.108825 (+   285us) tablet.cc:701] Row locks acquired
0709 13:15:54.108851 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:15:54.109047 (+   196us) write_op.cc:270] Start()
0709 13:15:54.109209 (+   162us) write_op.cc:276] Timestamp: P: 1783602954108982 usec, L: 0
0709 13:15:54.109245 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:15:54.110301 (+  1056us) log.cc:844] Serialized 530 byte log entry
0709 13:15:54.516734 (+406433us) op_driver.cc:464] REPLICATION: finished
0709 13:15:54.551808 (+ 35074us) write_op.cc:301] APPLY: starting
0709 13:15:54.551924 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:54.673561 (+121637us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:54.712824 (+ 39263us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:54.714888 (+  2064us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:54.715169 (+   281us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:15:54.715249 (+    80us) write_op.cc:312] APPLY: finished
0709 13:15:54.715517 (+   268us) log.cc:844] Serialized 25 byte log entry
0709 13:15:54.767845 (+ 52328us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:54.776393 (+  8548us) write_op.cc:454] Released schema lock
0709 13:15:54.781506 (+  5113us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:54.875664 (+ 94158us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:54.884729 (+  9065us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":851352,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":34768,"apply.run_cpu_time_us":5741,"apply.run_wall_time_us":265502,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8317,"num_ops":1,"prepare.queue_time_us":307292,"prepare.run_cpu_time_us":10544,"prepare.run_wall_time_us":614651,"raft.queue_time_us":85326,"raft.run_cpu_time_us":4945,"raft.run_wall_time_us":61842,"replication_time_us":387734,"thread_start_us":470953,"threads_started":4,"wal-append.queue_time_us":221296}]]}
I20260709 13:15:55.705322  6763 raft_consensus.cc:2749] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:15:55.731540   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 270201us
I20260709 13:15:55.715922  6672 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:55.698697  6693 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:55.739540 32264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36080 (request call id 3404) took 1153 ms. Trace:
I20260709 13:15:55.701251  6784 consensus_queue.cc:1059] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.036s
I20260709 13:15:55.670854  6697 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:55.742786   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 300423us
I20260709 13:15:55.741801 32264 rpcz_store.cc:276] 0709 13:15:54.586558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.628599 (+ 42041us) service_pool.cc:224] Handling call
0709 13:15:54.628888 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:55.092369 (+463481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.739288 (+646919us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54004277d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:15:55.739478 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1064543104}
I20260709 13:15:55.787226  6755 raft_consensus.cc:3055] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:15:55.787873  6755 raft_consensus.cc:740] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:55.788898  6755 consensus_queue.cc:260] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:55.790239  6755 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:55.796672  6680 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:15:55.831343   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 50911.5us
W20260709 13:15:55.839675   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 56687.1us
W20260709 13:15:55.842060 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 170678us
I20260709 13:15:55.800429  6568 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:55.832368   369 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:55.848914 32089 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:55.859983   369 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:55.860388 32089 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:55.868005  6562 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:55.864753  6584 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:55.870565  6584 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.872030  6584 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:55.877900 32089 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:55.883301 32165 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:55.884260   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:55.840356  6600 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:55.862623  6807 log.cc:927] Time spent T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:15:55.885001 32165 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:55.886162   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:55.890410 32089 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:55.898300 32265 raft_consensus.cc:1275] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:15:55.901129 32165 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:55.902437  6321 raft_consensus.cc:2749] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:55.905102 32165 leader_election.cc:400] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 10. Current term is 11.
I20260709 13:15:55.905776 32165 leader_election.cc:403] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:15:55.875825  6808 raft_consensus.cc:2804] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:55.922420 32089 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:55.923803 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:55.924029 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:55.924417 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:55.925770 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:55.889024  6784 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:55.926846 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:55.926337 32270 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:55.928643 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:55.947175 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:55.947712 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:55.924414  6821 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:55.929890 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:55.930822 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:55.950369 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:55.931306 32115 raft_consensus.cc:2393] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 12: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:55.931706  6537 consensus_queue.cc:1048] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:55.906591  6713 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:15:55.957927 32120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56884 (request call id 3414) took 1310 ms (client timeout 1648 ms). Trace:
I20260709 13:15:55.933612  6824 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:15:55.921768  6781 log.cc:927] Time spent T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.900s	user 0.009s	sys 0.000s
I20260709 13:15:55.937049 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:55.941015  6697 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:55.966367 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:55.951892 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:55.951896 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:55.918751  6443 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:55.930858  6405 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:15:56.054950   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 207810us
W20260709 13:15:56.060470 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 127325us
I20260709 13:15:55.957896 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:55.958178 32117 raft_consensus.cc:1240] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 20. Current term is 21. Ops: []
I20260709 13:15:55.958016 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:55.960130  6321 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 10. Current term is 11.
W20260709 13:15:55.960659 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 55626.6us
W20260709 13:15:55.958933 32120 rpcz_store.cc:269] 0709 13:15:54.647034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.652803 (+  5769us) service_pool.cc:224] Handling call
0709 13:15:55.957725 (+1304922us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b54002e2f54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:15:55.957871 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":859911168}
I20260709 13:15:56.067679 32165 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:55.961301 32273 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36080 (request call id 3407) took 1373 ms (client timeout 1508 ms). Trace:
W20260709 13:15:56.068782 32273 rpcz_store.cc:269] 0709 13:15:54.587566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.610287 (+ 22721us) service_pool.cc:224] Handling call
0709 13:15:55.961078 (+1350791us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b54002b8ed4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:15:55.961243 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49744128}
W20260709 13:15:56.069312 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.066160   368 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:55.941838  6600 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:55.997380 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:56.001523 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:56.074489 32165 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:56.074704 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:56.075003 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:56.075729 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:56.075686 32165 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:55.945798  6784 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:56.076386 32124 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:56.076658  6321 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:56.076818  6784 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:56.075856  6777 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:56.080093 32191 raft_consensus.cc:1275] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:15:56.082845 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:56.083361 32191 raft_consensus.cc:2376] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17. Re-sending same reply.
I20260709 13:15:56.084509 32196 raft_consensus.cc:1240] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:15:56.084663 32124 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:15:55.964092  6824 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:15:56.011338  6812 log.cc:927] Time spent T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:15:56.089722  6824 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:56.013780  6584 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:56.014829  6634 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:56.093433 32272 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:56.094581  6634 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:56.018638  6541 tablet_bootstrap.cc:492] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:56.095901  6541 tablet_bootstrap.cc:492] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6: Bootstrap complete.
I20260709 13:15:56.096625  6541 ts_tablet_manager.cc:1403] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6: Time spent bootstrapping tablet: real 2.788s	user 0.069s	sys 0.025s
I20260709 13:15:56.097100 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:56.097942 32190 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:56.019531  6568 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:55.997304  6693 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:56.001704  6654 raft_consensus.cc:3055] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:56.072996 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:55.884491  6669 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:15:56.063740   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 154304us
I20260709 13:15:56.064327 32121 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:55.927074  6808 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:56.066926 32123 raft_consensus.cc:2376] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 22. Re-sending same reply.
I20260709 13:15:56.062119 32115 raft_consensus.cc:2376] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 21. Re-sending same reply.
I20260709 13:15:56.071297   368 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:56.100240 32272 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 16.
I20260709 13:15:56.104969 32087 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:56.108992 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:56.109797 32089 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:56.113662 32165 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:56.112087   368 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:56.114804  6321 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:56.116091 32165 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:56.117065  6779 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:15:56.117287  6690 consensus_meta.cc:287] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.741s	user 0.012s	sys 0.000s
I20260709 13:15:56.117889  6690 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:56.120838 32267 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 11.
I20260709 13:15:56.121249  6541 raft_consensus.cc:359] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:15:56.122550  6541 raft_consensus.cc:740] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Initialized, Role: LEARNER
I20260709 13:15:56.063653  6443 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:56.125797 32087 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:56.135048 32273 raft_consensus.cc:1240] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:15:56.135617  6784 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:56.135145  6753 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:56.136907  6753 raft_consensus.cc:697] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 16 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:56.137959  6784 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:56.137787  6753 consensus_queue.cc:237] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:56.140156  6815 log.cc:927] Time spent T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:15:56.101506  6778 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:56.127463 32165 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:56.175305 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 47949us
I20260709 13:15:56.101759  6835 raft_consensus.cc:2749] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:15:56.178831 32269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 4143) took 1395 ms. Trace:
I20260709 13:15:56.102993  6654 raft_consensus.cc:740] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:56.123585  6541 consensus_queue.cc:260] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:15:56.193523 32269 rpcz_store.cc:276] 0709 13:15:54.783549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.466224 (+682675us) service_pool.cc:224] Handling call
0709 13:15:55.478328 (+ 12104us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:55.478850 (+   522us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:55.478875 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:55.583403 (+104528us) log.cc:844] Serialized 26 byte log entry
0709 13:15:55.799781 (+216378us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:55.799837 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.799928 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:56.139571 (+339643us) spinlock_profiling.cc:243] Waited 5.67 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:15:56.141356 (+  1785us) raft_consensus.cc:1685] finished
0709 13:15:56.141389 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:56.178733 (+ 37344us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16539,"raft.queue_time_us":4101,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":25623,"spinlock_wait_cycles":13048064,"thread_start_us":180161,"threads_started":1,"wal-append.queue_time_us":306651}
I20260709 13:15:56.181918 32165 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:56.188119 32121 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:15:56.196669  6321 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:15:56.189162 32190 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 12.
I20260709 13:15:56.024554  6533 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:56.196913 32116 raft_consensus.cc:1240] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:15:56.108516  6405 raft_consensus.cc:697] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 18 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:56.128880  6809 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:56.111749  6808 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:56.236886 32265 raft_consensus.cc:1240] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:56.200525 32165 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:56.239850 32165 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:56.241508 32165 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:56.242928  6779 raft_consensus.cc:2749] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:15:56.244295  6321 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:56.245198  6321 raft_consensus.cc:2804] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:56.245721  6321 raft_consensus.cc:697] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 15 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:56.246642  6321 consensus_queue.cc:237] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:56.142706  6537 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:15:56.143882  6443 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:56.226284  6690 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:56.300347  6405 consensus_queue.cc:237] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:56.192034  6784 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:56.319952  6654 consensus_queue.cc:260] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:56.338542  6654 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:56.229362  6533 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:56.230307  6809 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:56.144698  6828 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:15:56.341728  6809 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:56.342530 32117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55358 (request call id 954) took 1679 ms. Trace:
I20260709 13:15:56.342911 32117 rpcz_store.cc:276] 0709 13:15:54.663498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.687102 (+ 23604us) service_pool.cc:224] Handling call
0709 13:15:55.957997 (+1270895us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:56.071207 (+113210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:56.342313 (+271106us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54002e2f50. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff08ad 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:15:56.342472 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2922159488}
I20260709 13:15:56.263595  6790 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:56.344573  6790 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:56.267298  6817 log.cc:927] Time spent T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.388s	user 0.002s	sys 0.000s
I20260709 13:15:56.270151  6584 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:56.286324  6833 log.cc:927] Time spent T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:15:56.288718  6834 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:56.178050  6562 consensus_queue.cc:1059] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.121s
I20260709 13:15:56.156275  6669 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:15:56.361891 32270 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 18.
W20260709 13:15:56.366313 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 231237us
W20260709 13:15:56.366762  6672 consensus_meta.cc:287] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.623s	user 0.011s	sys 0.002s
I20260709 13:15:56.347186 32017 catalog_manager.cc:5697] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 20 to 21, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 21 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:56.363000  6828 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:56.401484 32017 catalog_manager.cc:5697] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 16 to 17, leader changed from 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 17 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:56.424134 32017 catalog_manager.cc:5697] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:56.429354  6562 raft_consensus.cc:3055] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:56.429826  6562 raft_consensus.cc:740] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:56.430874  6562 consensus_queue.cc:260] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:56.432219  6562 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:56.386960  6832 consensus_queue.cc:1048] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:15:56.470829 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:56.431044 32017 catalog_manager.cc:5697] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 18 to 20, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 20 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:56.443430  6680 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:56.452311  6809 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:56.368204  6834 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:56.455134  6730 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:15:56.463681  6816 log.cc:927] Time spent T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.583s	user 0.005s	sys 0.002s
W20260709 13:15:56.467727 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.471800 32267 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 17.
I20260709 13:15:56.488791   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:56.312426  6824 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:56.477289 32017 catalog_manager.cc:5697] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d reported cstate change: config changed from index -1 to 15, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New cstate: current_term: 18 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:56.477344 32273 raft_consensus.cc:1275] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:15:56.481025 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:15:56.486627 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 245179us
I20260709 13:15:56.489630   402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:56.493957 32264 raft_consensus.cc:2393] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 21: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:56.493443 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:56.492810 32017 catalog_manager.cc:5697] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 16 to 17, leader changed from 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 17 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:56.489719   369 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:56.499090  6321 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:56.500254 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:56.501109 32192 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 18.
I20260709 13:15:56.503393 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:56.505892 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:56.506724 32190 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:15:56.512117   400 raft_consensus.cc:1240] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 20. Current term is 21. Ops: []
I20260709 13:15:56.514423 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:56.476187  6680 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:56.519315 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:56.499794  6321 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:56.486112  6844 consensus_queue.cc:1059] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.005s
I20260709 13:15:56.524271 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:56.542025 32191 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:15:56.494413  6790 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:56.411779  6672 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:56.530447 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:56.496949 32017 catalog_manager.cc:5697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 20 to 22, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 22 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:56.556013 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:56.555928 32017 catalog_manager.cc:5697] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 18 to 19, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 19 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:56.523650  6827 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:56.533471 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:56.539103 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:56.532011 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:56.560662 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:56.566080   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:56.540323   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:56.415858  6828 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:56.571261 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:56.572070 32193 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:56.551203   402 raft_consensus.cc:1240] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:56.540918  6753 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:56.557670 32017 catalog_manager.cc:5697] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 19 to 21, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 21 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:56.525067 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:56.569924 32194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 3678) took 1106 ms. Trace:
I20260709 13:15:56.539829  6623 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:56.579216 32190 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:56.576975 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:56.574450 32017 catalog_manager.cc:5697] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 13 to 16, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 16 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:56.603382 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 110070us
I20260709 13:15:56.604161 32124 raft_consensus.cc:1240] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:56.605314 32165 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:56.575467 32194 rpcz_store.cc:276] 0709 13:15:55.449716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.452928 (+  3212us) service_pool.cc:224] Handling call
0709 13:15:55.477265 (+ 24337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:55.572892 (+ 95627us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:55.572923 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:55.588737 (+ 15814us) log.cc:844] Serialized 26 byte log entry
0709 13:15:55.723335 (+134598us) spinlock_profiling.cc:243] Waited 5.02 ms on lock 0x7b4800002958. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a3f1aaa1 00007fb5a3f11b37 00007fb5a3f119ca 00007fb5a400926f 00007fb5a4008f37 00007fb5a401d55c 00007fb5a401d508 00007fb5a401d488 00007fb5a401d443 00007fb5a401c6ec 00007fb5a2f46a96
0709 13:15:55.802659 (+ 79324us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:55.805128 (+  2469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.805232 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:56.462895 (+657663us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:15:56.554115 (+ 91220us) raft_consensus.cc:1685] finished
0709 13:15:56.554146 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:56.554342 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":138,"raft.run_cpu_time_us":2911,"raft.run_wall_time_us":245770,"spinlock_wait_cycles":14012032,"thread_start_us":166897,"threads_started":1,"wal-append.queue_time_us":253716}
I20260709 13:15:56.606814 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:56.606726 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:56.616766 32190 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 21.
I20260709 13:15:56.626022 32191 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 22.
I20260709 13:15:56.572022  6827 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:56.635576 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:56.637755 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:56.703773 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:56.706382 32198 raft_consensus.cc:2368] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 17. Current term is 18.
I20260709 13:15:56.709914   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:56.710525  6809 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.711205  6809 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:56.713373  6848 log.cc:927] Time spent T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 13:15:56.714926  6828 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:56.715124  6541 ts_tablet_manager.cc:1434] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6: Time spent starting tablet: real 0.618s	user 0.018s	sys 0.016s
W20260709 13:15:56.715615  6541 ts_tablet_manager.cc:1467] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6: Tablet startup took 618ms
W20260709 13:15:56.703020  6755 consensus_meta.cc:287] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.912s	user 0.012s	sys 0.003s
I20260709 13:15:56.576033  6669 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:56.581080  6577 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.574971  6843 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:56.731830 32119 raft_consensus.cc:2410] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:15:56.721704 32193 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:15:56.578794  6847 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:15:56.618871  6837 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.560662  6808 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:56.747604 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:56.718191  6827 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:56.721980  6850 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.756495 32117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:53200
I20260709 13:15:56.607511  6753 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:56.757277 32117 raft_consensus.cc:606] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:56.760807 32117 raft_consensus.cc:614] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:15:56.761538 32272 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36084 (request call id 4170) took 1452 ms (client timeout 1501 ms). Trace:
W20260709 13:15:56.762260 32272 rpcz_store.cc:269] 0709 13:15:55.309155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.315671 (+  6516us) service_pool.cc:224] Handling call
0709 13:15:56.761322 (+1445651us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b5400068e54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:15:56.761465 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1682335104}
I20260709 13:15:56.717545  6777 consensus_queue.cc:1059] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:15:56.631942  6623 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:56.770932   400 raft_consensus.cc:2393] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 15: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
W20260709 13:15:56.755089  6840 log.cc:927] Time spent T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
I20260709 13:15:56.777148 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:56.753026  6847 raft_consensus.cc:2764] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:15:56.785477 32193 raft_consensus.cc:2368] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 15. Current term is 16.
I20260709 13:15:56.792280  6730 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.793025  6730 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:56.738934  6577 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:56.738062  6669 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:56.810427 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:15:56.811594  6845 log.cc:927] Time spent T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:15:56.767964  6850 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:56.814461  6824 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:56.806296  6808 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:56.751331  6837 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:56.808911  6834 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:56.741856  6843 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:56.827646 32193 raft_consensus.cc:2368] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 11. Current term is 12.
I20260709 13:15:56.837553  6519 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:56.879642  6794 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:15:56.880131  6810 log.cc:927] Time spent T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 1.033s	user 0.004s	sys 0.000s
I20260709 13:15:56.880359  6794 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:56.897913 32265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36084 (request call id 4175) took 1310 ms. Trace:
I20260709 13:15:56.898545 32265 rpcz_store.cc:276] 0709 13:15:55.587254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.919529 (+332275us) service_pool.cc:224] Handling call
0709 13:15:55.925040 (+  5511us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:56.237491 (+312451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:56.897664 (+660173us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b540014d054. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:15:56.897847 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":716466048}
W20260709 13:15:56.862845  6851 log.cc:927] Time spent T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:15:56.913156 32197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 3677) took 1466 ms. Trace:
I20260709 13:15:56.913960 32197 rpcz_store.cc:276] 0709 13:15:55.447237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.447564 (+   327us) service_pool.cc:224] Handling call
0709 13:15:55.447869 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:55.461310 (+ 13441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:55.461340 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:55.472249 (+ 10909us) log.cc:844] Serialized 26 byte log entry
0709 13:15:55.696521 (+224272us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:15:55.841235 (+144714us) log.cc:844] Serialized 14 byte log entry
0709 13:15:55.841589 (+   354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.841667 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:56.879448 (+1037781us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b4400022b4c. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59bd8cdb1 00007fb59be2ac85 00007fb59be2b6a2 00007fb59eb9d1db 00007fb59eb98aaf 00007fb59eb8c86e 00007fb59eb8bbb6 00007fb59eb8b7d8 00007fb59eb95221 00007fb59eb951d9 00007fb59eb95169
0709 13:15:56.886551 (+  7103us) raft_consensus.cc:1685] finished
0709 13:15:56.912940 (+ 26389us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:56.913090 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23911,"prepare.queue_time_us":156027,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":3218,"raft.queue_time_us":15753,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":101032,"spinlock_wait_cycles":8831872,"thread_start_us":307404,"threads_started":2,"wal-append.queue_time_us":292205}
I20260709 13:15:56.922396   401 raft_consensus.cc:1217] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.14->[18.15-18.15]   Dedup: 18.15->[]
W20260709 13:15:56.932451 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 327235us
I20260709 13:15:56.933358 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:56.934223 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:15:56.935699 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 180956us
I20260709 13:15:56.937724 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:56.938434 32265 raft_consensus.cc:2368] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 16. Current term is 17.
I20260709 13:15:56.939558 32122 raft_consensus.cc:2368] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 16. Current term is 17.
I20260709 13:15:56.942977 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:56.917121  6821 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:56.946565 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:56.931228  6818 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:56.954620 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:15:56.955482 32165 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.30.63.1:42339 timed out after 1.648s (SENT) [suppressed 10 similar messages]
I20260709 13:15:56.962980 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:56.964288  6779 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:56.964963  6779 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:56.967880  6779 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:56.970366  6654 consensus_meta.cc:287] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.631s	user 0.009s	sys 0.013s
I20260709 13:15:56.970451  6672 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:56.950424  6821 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:56.980477  6519 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:56.981101  6519 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:56.982402  6821 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:56.983309  6519 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:56.984036   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:56.984742   401 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:56.989024   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:56.991364 32089 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:56.993408  6577 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:56.995330  6755 raft_consensus.cc:2804] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:56.996308  6755 raft_consensus.cc:697] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
W20260709 13:15:56.716003  6541 ts_tablet_manager.cc:1469] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6: Trace:
0709 13:15:48.968618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.970658 (+  2040us) service_pool.cc:224] Handling call
0709 13:15:49.162886 (+192228us) ts_tablet_manager.cc:934] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339)
0709 13:15:50.819031 (+1656145us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:15:51.418818 (+599787us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:51.418946 (+   128us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:15:51.660126 (+241180us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:15:51.690436 (+ 30310us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:51.757407 (+ 66971us) ts_tablet_manager.cc:989] Replica registered.
0709 13:15:51.757490 (+    83us) inbound_call.cc:177] Queueing success response
0709 13:15:52.482852 (+725362us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b1800458680. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59be7ec0a 00007fb5a55be219 00007fb59bda8ed8 00007fb59bf03de2 00007fb5a3f68d23 00007fb5a3f6855d 00007fb5a40043d8 00007fb5a4035f4e 00007fb5a401afdd
0709 13:15:53.308318 (+825466us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:15:56.096901 (+2788583us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:15:56.097459 (+   558us) tablet_replica.cc:261] Starting instrumentation
0709 13:15:56.098040 (+   581us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":39312,"mutex_wait_us":1702,"raft.queue_time_us":106929,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":113,"spinlock_wait_cycles":27378048,"tablet-copy.queue_time_us":82221,"tablet-download-pool.queue_time_us":31843,"tablet-download-pool.run_cpu_time_us":9847,"tablet-download-pool.run_wall_time_us":651018,"thread_start_us":300228,"threads_started":3}
I20260709 13:15:56.997524  6755 consensus_queue.cc:237] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:57.001685  6321 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:57.003552  6854 raft_consensus.cc:3055] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:57.004061  6854 raft_consensus.cc:740] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:57.011461 32192 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 19.
I20260709 13:15:57.017154   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:57.018647 32162 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
W20260709 13:15:56.951035  6443 consensus_meta.cc:287] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.629s	user 0.016s	sys 0.009s
I20260709 13:15:57.020692 32162 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:57.025496 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:57.029452   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:57.033516 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:57.019924  6850 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:56.977104  6818 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:57.023180  6730 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:57.019742  6623 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:15:57.045053 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 89596.3us
I20260709 13:15:57.026153  6790 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:57.065596  6321 consensus_queue.cc:1059] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 13:15:57.070444 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:57.037397  6843 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:57.072927 32165 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:57.048015   401 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 20.
I20260709 13:15:57.054733 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:57.076524 32121 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 17.
I20260709 13:15:57.055938  6794 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:57.062114 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:57.027192  6753 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:57.063383 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:57.068601 32271 raft_consensus.cc:1275] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:57.086349 32273 raft_consensus.cc:2393] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 18: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:57.078732  6321 raft_consensus.cc:3055] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:15:57.024940  6443 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:57.087790 32196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:15:57.088263 32197 raft_consensus.cc:3060] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:57.088443 32196 raft_consensus.cc:606] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 17 LEADER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:57.069679  6654 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:57.083408   400 raft_consensus.cc:1240] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:57.089746  6654 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:57.091811  6654 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:57.092815 32116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56884 (request call id 3426) took 1159 ms. Trace:
I20260709 13:15:57.093226 32116 rpcz_store.cc:276] 0709 13:15:55.933329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.075973 (+142644us) service_pool.cc:224] Handling call
0709 13:15:56.196647 (+120674us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:56.209294 (+ 12647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.092573 (+883279us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b5400032850. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff08ad 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:15:57.092747 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276412288}
I20260709 13:15:57.093982 32118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56890 (request call id 5026) took 1157 ms. Trace:
I20260709 13:15:57.094466 32118 rpcz_store.cc:276] 0709 13:15:55.936442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.957633 (+ 21191us) service_pool.cc:224] Handling call
0709 13:15:57.093735 (+1136102us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b5400205b54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:15:57.093912 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1465974016}
I20260709 13:15:57.097091 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:57.079926 32266 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 21.
I20260709 13:15:57.097858 32265 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 22.
I20260709 13:15:57.099152 32119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56884 (request call id 3419) took 1173 ms. Trace:
I20260709 13:15:57.099653 32119 rpcz_store.cc:276] 0709 13:15:55.925374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.925516 (+   142us) service_pool.cc:224] Handling call
0709 13:15:57.098916 (+1173400us) spinlock_profiling.cc:243] Waited 802 ms on lock 0x7b54000339d4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:15:57.099080 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1845474176}
I20260709 13:15:57.102826 32197 raft_consensus.cc:2468] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 21.
I20260709 13:15:57.070798 32162 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:57.087137  6321 raft_consensus.cc:740] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:57.104090  6321 consensus_queue.cc:260] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:57.105365  6321 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:15:57.115820  6680 consensus_meta.cc:287] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.573s	user 0.013s	sys 0.005s
I20260709 13:15:57.116323  6680 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:57.045147  6861 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:15:57.121789 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 49026.7us
I20260709 13:15:57.132184 32165 leader_election.cc:400] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 16. Current term is 17.
I20260709 13:15:57.132616 32165 leader_election.cc:403] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:15:57.078361   369 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:57.089768  6443 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:57.037566  6854 consensus_queue.cc:260] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:57.135285  6854 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:57.138548  6818 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:57.070096  6837 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:57.156999 32162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 86303.3us
I20260709 13:15:57.157608 32270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36084 (request call id 4158) took 1854 ms. Trace:
I20260709 13:15:57.157894 32272 raft_consensus.cc:1275] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:15:57.157953 32270 rpcz_store.cc:276] 0709 13:15:55.302912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.303369 (+   457us) service_pool.cc:224] Handling call
0709 13:15:57.157439 (+1854070us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b540014c654. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:15:57.157552 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1423544576}
I20260709 13:15:57.159317  6680 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:57.159798  6778 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.159897  6680 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:57.160429  6778 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:57.160553  6680 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:57.162951  6778 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:57.163228  6680 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:57.163594  6778 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.163972  6680 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:57.166246 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:57.167786 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:57.169121  6790 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:57.169198 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:57.170415 32190 raft_consensus.cc:2410] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:15:57.128129  6794 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:57.172475 32199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:15:57.173197 32199 raft_consensus.cc:606] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:57.173568 32199 raft_consensus.cc:614] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:57.176079 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:57.119738  6669 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:57.171941  6794 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:57.178124   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:57.178194 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:57.179060 32195 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
W20260709 13:15:57.179243 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 54983.5us
I20260709 13:15:57.179898  6794 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:57.182852  6623 consensus_queue.cc:1048] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:57.185539  6577 consensus_queue.cc:1048] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:57.187810  6569 consensus_queue.cc:1059] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:57.189529  6846 raft_consensus.cc:3055] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:15:57.189909  6846 raft_consensus.cc:740] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:57.190753  6846 consensus_queue.cc:260] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:57.192092  6846 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:57.195184 32124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56890 (request call id 5027) took 1258 ms. Trace:
I20260709 13:15:57.195715 32124 rpcz_store.cc:276] 0709 13:15:55.936882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.088298 (+151416us) service_pool.cc:224] Handling call
0709 13:15:56.088519 (+   221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:56.604740 (+516221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.194900 (+590160us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b5400032fd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:15:57.195113 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1185436032}
I20260709 13:15:57.200839   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:57.201555   400 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:15:57.201711 32191 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "fcfc3281929645969ecedbb0c0af759d"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:15:57.202477 32191 raft_consensus.cc:606] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Received request to transfer leadership to TS fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:57.202888 32191 raft_consensus.cc:614] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:57.203008 32236 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:57.203890  6730 consensus_queue.cc:1059] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:15:57.205037  6730 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:57.205485  6730 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:57.205641  6674 raft_consensus.cc:3055] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:57.206004  6730 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:57.206070  6674 raft_consensus.cc:740] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:57.207259  6674 consensus_queue.cc:260] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:57.208496  6674 raft_consensus.cc:3060] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:57.208796  6519 raft_consensus.cc:3055] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:15:57.209285  6519 raft_consensus.cc:740] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:57.210286  6519 consensus_queue.cc:260] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:57.186360  6753 raft_consensus.cc:2955] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:57.217520 32239 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:57.223114 32193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:15:57.273957 32193 raft_consensus.cc:606] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 26 FOLLOWER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:57.274682 32193 raft_consensus.cc:614] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 26 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:15:57.229141  6849 log.cc:927] Time spent T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.458s	user 0.000s	sys 0.004s
I20260709 13:15:57.279253 32193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:15:57.280103 32193 raft_consensus.cc:606] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:57.234433 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:57.284641 32193 raft_consensus.cc:614] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:57.235337 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:57.235637 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:57.286087 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:15:57.236486 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:57.288837 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:57.289470  6519 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:57.237866 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:57.293104 32122 raft_consensus.cc:2393] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 21: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:57.239290 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:57.245113 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:15:57.245843   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 167572us
I20260709 13:15:57.297106 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:57.297673 32134 tablet_copy_service.cc:342] P fcfc3281929645969ecedbb0c0af759d: Request end of tablet copy session 94085cf341634eb686a95983b6b7f7e6-afb482e4812e47d0a501b142e64cb73b received from {username='slave'} at 127.0.0.1:55358
I20260709 13:15:57.246532  6865 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:57.298199 32134 tablet_copy_service.cc:434] P fcfc3281929645969ecedbb0c0af759d: ending tablet copy session 94085cf341634eb686a95983b6b7f7e6-afb482e4812e47d0a501b142e64cb73b on tablet afb482e4812e47d0a501b142e64cb73b with peer 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:57.298290 32119 raft_consensus.cc:2393] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 20: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:57.298312  6865 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.300151 32121 raft_consensus.cc:2468] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 19.
I20260709 13:15:57.200450  6809 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:57.264876  6779 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 16. Current term is 17.
I20260709 13:15:57.254081 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:57.302542   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:57.303485   400 raft_consensus.cc:2393] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 21: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:15:57.303732   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
W20260709 13:15:57.264146 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 132146us
W20260709 13:15:57.231432  6562 consensus_meta.cc:287] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6: Time spent flushing consensus metadata: real 0.751s	user 0.007s	sys 0.012s
I20260709 13:15:57.281279  6794 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:57.317097 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:57.318300 32196 raft_consensus.cc:2393] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 21: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:57.164201  6778 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:57.320868  6778 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:57.300414  6865 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:57.337107 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:57.338264 32115 raft_consensus.cc:2393] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 19: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:57.340000 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:57.342250 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:57.343178 32115 raft_consensus.cc:2393] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 17: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
W20260709 13:15:57.282117 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 97706.5us
I20260709 13:15:57.349324 32239 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:57.350601  6794 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:57.352799 32239 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:57.355932   399 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
I20260709 13:15:57.414796  6865 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:57.416833  6794 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:15:57.361775  6827 consensus_meta.cc:287] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6: Time spent flushing consensus metadata: real 0.594s	user 0.011s	sys 0.005s
I20260709 13:15:57.362519 32090 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:15:57.417994 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 55563.1us
I20260709 13:15:57.418632  6623 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:15:57.370846 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 252105us
I20260709 13:15:57.419039  6623 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.419427  6623 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:57.419935 32238 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:57.421538 32238 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:57.419044 32090 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:57.424666  6674 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:15:57.425036  6674 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.425074  6763 consensus_queue.cc:1048] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:57.425546  6674 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:15:57.386881   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:57.388497   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:57.426846  6623 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:57.427989  6794 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:57.428495  6794 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.428876  6794 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:15:57.428957 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 76373.3us
I20260709 13:15:57.400738 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:57.401610 32272 raft_consensus.cc:2955] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:57.402925 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:57.407847  6753 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.433878  6753 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:57.435953  6753 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:57.436620 32197 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 21.
I20260709 13:15:57.429917 32239 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:57.445499 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:57.446424 32192 raft_consensus.cc:2393] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 18: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:57.447922 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:57.456770 32197 raft_consensus.cc:1275] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:15:57.459188 32197 raft_consensus.cc:1275] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:15:57.461810 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:57.473958 32162 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:57.475327  6778 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:57.475955  6778 raft_consensus.cc:697] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
W20260709 13:15:57.477157 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 55681.9us
I20260709 13:15:57.477064  6778 consensus_queue.cc:237] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:57.478029 32238 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:57.492550 32197 raft_consensus.cc:1275] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:57.510912 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:57.511487 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:57.512336 32195 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 21.
I20260709 13:15:57.511698 32087 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:57.513432 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:57.514922 32115 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:57.515179  6888 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:57.515728  6888 raft_consensus.cc:697] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:57.516611  6888 consensus_queue.cc:237] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:57.472963  6827 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:57.520740 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:57.521535 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:57.522609 32190 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 22.
I20260709 13:15:57.524137 32115 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 18.
I20260709 13:15:57.525380   369 leader_election.cc:304] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:57.502898  6519 raft_consensus.cc:2749] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:15:57.547729 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:57.490013  6730 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:57.559227  6866 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:15:57.570825  6674 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:57.669281 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:57.669960 32199 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 20.
I20260709 13:15:57.546129  6680 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:57.671315  6674 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 23 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:57.670976  6680 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:15:57.597815  6856 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:57.671823 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:57.672986 32124 raft_consensus.cc:2368] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 20. Current term is 21.
I20260709 13:15:57.672616  6856 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:57.673377  6680 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:57.671326 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:57.675462  6856 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:57.571988  6519 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:57.677035  6519 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:57.679534  6519 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:57.590369  6865 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:57.596601 32195 raft_consensus.cc:1240] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 18. Current term is 19. Ops: []
W20260709 13:15:57.597453 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.684792 32124 raft_consensus.cc:1240] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:57.598558  6866 raft_consensus.cc:697] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 20 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:57.596422  6784 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:57.599839  6827 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:57.550635  6492 raft_consensus.cc:2804] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:57.705721 32089 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:57.614914  6824 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:57.549932  6623 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 22 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:57.646798   403 raft_consensus.cc:1240] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:57.652992  6730 leader_election.cc:290] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:57.657900   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:57.658839  6860 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:57.661288  6889 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:57.665577 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:57.727089 32191 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:57.668545 32198 raft_consensus.cc:1275] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:15:57.584682   399 raft_consensus.cc:2955] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:57.682024 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:57.682024   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:57.686964 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:57.688688 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:57.704949 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:57.709013 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:57.712859 32194 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 18.
I20260709 13:15:57.716331 32165 leader_election.cc:400] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 16. Current term is 17.
I20260709 13:15:57.717028 32273 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:57.717880 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:57.732436 32272 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 20.
I20260709 13:15:57.733496 32165 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:57.734078 32124 raft_consensus.cc:2393] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 19: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:57.734421 32089 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:57.732509 32121 raft_consensus.cc:2410] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:15:57.719182 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:57.735656 32089 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:57.735966 32122 raft_consensus.cc:2393] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 21: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:57.734498 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:57.736786 32264 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:57.742854 32089 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:57.720613  6824 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:57.720700  6569 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:15:57.756726 32089 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:57.727896  6492 raft_consensus.cc:697] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:57.747702  6755 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:57.747879  6537 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:57.744774  6854 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:57.769840 32191 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 22.
I20260709 13:15:57.748085  6763 raft_consensus.cc:2749] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:57.788414 32264 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 22.
I20260709 13:15:57.722326  6784 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:57.735999  6860 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:57.786808  6854 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.781701  6755 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:15:57.803267 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:57.757930  6818 consensus_queue.cc:1048] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:15:57.809238 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:57.810326 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:57.811169 32271 raft_consensus.cc:2393] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 19: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:15:57.812690  6755 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:15:57.812853 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 334870us
I20260709 13:15:57.813730 32238 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:57.817337 32192 raft_consensus.cc:2955] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:57.822465  6854 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:57.823849 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:57.824776  6854 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:57.810392 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:57.781319  6821 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:57.825778 32268 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 20.
I20260709 13:15:57.827248   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:57.765612  6753 consensus_queue.cc:1048] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:15:57.830333 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:57.793253   399 raft_consensus.cc:1275] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:15:57.837303 32272 raft_consensus.cc:1275] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:15:57.813757  6784 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:57.828848 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:57.839504 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:57.840338 32267 raft_consensus.cc:2368] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 20. Current term is 21.
I20260709 13:15:57.840762 32273 raft_consensus.cc:1275] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:15:57.840765 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:57.842136 32264 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:15:57.852378 32238 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:57.878998 32090 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:57.880774 32264 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 23.
I20260709 13:15:57.865715  6519 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:15:57.917382  6899 log.cc:927] Time spent T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:15:57.793190  6866 consensus_queue.cc:237] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:57.919556  6415 raft_consensus.cc:1064] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:15:57.922432 32089 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:57.890880  6569 consensus_queue.cc:1048] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:57.925463 32017 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49534 (request call id 320) took 5516 ms. Trace:
I20260709 13:15:57.931562  6892 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:57.927171  6821 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:15:57.933454 32019 catalog_manager.cc:5697] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 17 to 18, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 18 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:57.935042  6415 consensus_queue.cc:237] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 13, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:57.853766  6492 consensus_queue.cc:237] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:57.894963  6537 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:57.897928  6824 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:57.853705  6854 consensus_queue.cc:1048] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:15:57.873597  6794 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:57.924860 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 72600.2us
I20260709 13:15:57.993635  6784 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.936134 32019 catalog_manager.cc:5697] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 17 to 18, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 18 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:58.026170  6784 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:57.992462  6821 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:58.027344 32019 catalog_manager.cc:5697] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 15 to 16, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 16 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:58.028175  6821 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.028752  6821 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:58.004429  6669 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.029734  6669 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:57.984404 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 60313.5us
I20260709 13:15:58.032291  6854 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:58.010573 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:58.011308 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 276280us
W20260709 13:15:58.018976 32239 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.001s	sys 0.009s
W20260709 13:15:58.033979 32239 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.002s	sys 0.009s
W20260709 13:15:58.034358 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 604442us
W20260709 13:15:57.939641 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 60713.9us
I20260709 13:15:58.028474  6784 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:58.032755 32089 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:58.048513 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:58.046625 32238 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:58.046765 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:58.008399  6843 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.053962 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:58.057415 32165 leader_election.cc:400] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 20. Current term is 21.
I20260709 13:15:58.061079 32239 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:58.060480 32238 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:58.049933  6623 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:57.929302 32017 rpcz_store.cc:276] 0709 13:15:52.437375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.437605 (+   230us) service_pool.cc:224] Handling call
0709 13:15:57.925399 (+5487794us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:56.999199 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:56.999813 (+   614us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:56.999850 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:15:56.999871 (+    21us) tablet.cc:662] Decoding operations
0709 13:15:57.001047 (+  1176us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:57.001141 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:57.001178 (+    37us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:15:57.002415 (+  1237us) tablet.cc:701] Row locks acquired
0709 13:15:57.002437 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:15:57.002599 (+   162us) write_op.cc:270] Start()
0709 13:15:57.002721 (+   122us) write_op.cc:276] Timestamp: P: 1783602957002540 usec, L: 0
0709 13:15:57.002746 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:15:57.003421 (+   675us) log.cc:844] Serialized 4006 byte log entry
0709 13:15:57.379266 (+375845us) op_driver.cc:464] REPLICATION: finished
0709 13:15:57.382374 (+  3108us) write_op.cc:301] APPLY: starting
0709 13:15:57.382460 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:57.399700 (+ 17240us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:57.399822 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:57.601568 (+201746us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:57.601958 (+   390us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:15:57.602029 (+    71us) write_op.cc:312] APPLY: finished
0709 13:15:57.602448 (+   419us) log.cc:844] Serialized 97 byte log entry
0709 13:15:57.602692 (+   244us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:57.602870 (+   178us) write_op.cc:454] Released schema lock
0709 13:15:57.602942 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:57.605458 (+  2516us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:57.605490 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":595765,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":2844,"apply.run_cpu_time_us":16916,"apply.run_wall_time_us":223062,"cfile_cache_hit":42,"cfile_cache_hit_bytes":46027,"num_ops":10,"prepare.queue_time_us":258885,"prepare.run_cpu_time_us":136242,"prepare.run_wall_time_us":367819,"raft.queue_time_us":19751,"raft.run_cpu_time_us":1096,"raft.run_wall_time_us":7811,"replication_time_us":376354,"thread_start_us":579678,"threads_started":4,"wal-append.queue_time_us":353516}]]}
I20260709 13:15:58.064533  6821 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:58.059137 32165 leader_election.cc:403] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:15:58.091326 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:58.095329 32165 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:58.106187  6897 log.cc:927] Time spent T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:15:58.108093  6898 log.cc:927] Time spent T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:15:58.069711  6889 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:15:58.120126 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 59125.5us
I20260709 13:15:58.120990 32239 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:15:58.119184 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 58776.8us
I20260709 13:15:58.122694 32238 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:58.054082  6779 consensus_queue.cc:1059] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:15:58.128393  6904 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:58.098995  6863 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 20. Current term is 21.
I20260709 13:15:58.128391 32239 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:58.050319  6854 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:58.138248 32165 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:58.141481 32090 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:58.069279  6843 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:58.147446 32089 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:58.148092 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:58.148744 32197 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:15:58.129487  6519 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:15:58.176302 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:58.153795 32165 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:58.176991 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 138354us
W20260709 13:15:58.176721 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 48474.8us
I20260709 13:15:58.184415 32165 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:58.184932 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:58.189332 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:15:58.191407 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 44067.9us
I20260709 13:15:58.199363 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:58.200842 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:58.138641  6860 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:58.206215 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:58.205310 32239 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:58.147380  6863 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:58.211899  6863 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:15:58.213358 32165 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:58.148948  6569 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:15:58.219074 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:58.154415 32238 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:58.219911 32239 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:58.182761  6892 raft_consensus.cc:2764] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Leader election decision vote started in defunct term 22: won
I20260709 13:15:58.220088   399 raft_consensus.cc:1275] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:15:58.149261  6778 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:58.222119 32165 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:58.290134 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:58.293545 32197 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 23.
I20260709 13:15:58.136111  6900 consensus_queue.cc:1059] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.093s
I20260709 13:15:58.183290  6891 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:58.183591  6674 consensus_queue.cc:1048] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.106s
I20260709 13:15:58.223193  6863 raft_consensus.cc:2749] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:58.183454  6904 raft_consensus.cc:2764] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Leader election decision vote started in defunct term 21: won
W20260709 13:15:58.306954 32162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 73818.1us
I20260709 13:15:58.234390  6910 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:15:58.230500  6505 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:58.289873  6519 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:58.295498  6730 raft_consensus.cc:2804] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:58.311918  6821 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:58.320158  6892 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:15:58.318825  6794 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:58.324564  6569 raft_consensus.cc:697] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 22 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:58.287341  6755 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:58.344297  6863 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.352380  6519 raft_consensus.cc:697] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:58.368780  6827 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.378387  6918 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:58.378927  6918 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.379293  6918 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:58.378484  6827 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:58.383625 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 229289us
W20260709 13:15:58.381817  6903 log.cc:927] Time spent T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
I20260709 13:15:58.384636 32238 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:58.337411  6911 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.057s
I20260709 13:15:58.377800  6863 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:58.389047  6863 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:58.373142  6730 raft_consensus.cc:697] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 19 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:58.367182  6505 raft_consensus.cc:697] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 18 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:58.387621  6519 consensus_queue.cc:237] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:58.391304 32238 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:58.406977  6505 consensus_queue.cc:237] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:58.394073  6906 log.cc:927] Time spent T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:15:58.426213  6680 raft_consensus.cc:993] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801: : Instructing follower 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:15:58.426826  6680 raft_consensus.cc:1081] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 17 LEADER]: Signalling peer 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:15:58.427841  6680 raft_consensus.cc:3055] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:58.428220  6680 raft_consensus.cc:740] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:58.428830  6914 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.396088  6856 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.435858 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:58.436542 32124 raft_consensus.cc:1275] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:15:58.405074  6902 log.cc:927] Time spent T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
W20260709 13:15:58.444657 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 53427.7us
I20260709 13:15:58.451452 32238 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:58.392084  6894 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:58.395226  6763 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.446272 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:58.447160  6794 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:58.391589  6863 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:58.471155 32116 raft_consensus.cc:2368] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 17. Current term is 18.
I20260709 13:15:58.474478 32238 leader_election.cc:400] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 17. Current term is 18.
I20260709 13:15:58.491535 32238 leader_election.cc:403] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:15:58.461566  6779 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:58.499586   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 112466us
I20260709 13:15:58.463464  6854 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:58.503288 32238 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:58.429571  6914 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:58.492213  6892 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:58.449682  6856 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:58.518158 32239 leader_election.cc:400] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 17. Current term is 18.
I20260709 13:15:58.514618  6912 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:58.522419  6912 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:58.525121  6912 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:58.525540  6918 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:58.501549  6894 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 17. Current term is 18.
I20260709 13:15:58.515419  6891 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:58.519961   400 raft_consensus.cc:1275] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:15:58.521943 32239 leader_election.cc:403] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:15:58.538810  6794 raft_consensus.cc:3060] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:58.528018  6918 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:58.517634 32238 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:58.496569  6888 consensus_queue.cc:1048] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:15:58.471587  6763 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:58.502125  6779 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:58.498420  6863 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:58.562873 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 45360.6us
I20260709 13:15:58.564535 32238 leader_election.cc:400] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 15. Current term is 16.
I20260709 13:15:58.467474  6569 consensus_queue.cc:237] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:58.565025 32238 leader_election.cc:403] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:15:58.577144 32238 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:58.587007 32238 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:58.590108  6889 raft_consensus.cc:2804] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:15:58.590651  6889 raft_consensus.cc:697] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:58.591142 32238 leader_election.cc:400] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 11. Current term is 12.
I20260709 13:15:58.591658 32238 leader_election.cc:403] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:15:58.591445  6889 consensus_queue.cc:237] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:58.592945 32238 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
W20260709 13:15:58.593940 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 371879us
I20260709 13:15:58.594746 32165 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:58.597903 32165 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:58.598402   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:15:58.599438   403 raft_consensus.cc:2393] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 21: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:15:58.563809  6916 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:58.506129  6680 consensus_queue.cc:260] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:58.550369  6405 consensus_queue.cc:1048] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.054s
I20260709 13:15:58.603601  6930 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 11. Current term is 12.
I20260709 13:15:58.582859  6827 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:58.520208  6730 consensus_queue.cc:237] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:58.582880  6892 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 15. Current term is 16.
I20260709 13:15:58.603936  6894 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:58.603974  6901 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:58.610608  6915 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:58.607467  6519 raft_consensus.cc:2804] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:58.604395  6755 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:58.641665  6763 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:58.661495 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:58.665373 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:58.666043 32264 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:58.634613  6519 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:58.634174  6894 raft_consensus.cc:697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
W20260709 13:15:58.669232 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 76384.6us
I20260709 13:15:58.687758 32238 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:58.688557 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:58.678833 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:58.679800 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:58.676291  6794 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339) with higher term. Message: Invalid argument: T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 17. Current term is 18.
I20260709 13:15:58.612326  6928 consensus_queue.cc:1048] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:15:58.711932  6669 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:58.715960  6894 consensus_queue.cc:237] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:58.687427  6900 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.699084 32119 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 21.
I20260709 13:15:58.699911 32090 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:58.690418 32238 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:58.687475  6519 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:58.722663 32264 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 21.
I20260709 13:15:58.730077 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:58.706485  6888 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:58.732661   369 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
W20260709 13:15:58.738668 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 140866us
I20260709 13:15:58.739162 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:58.707440  6505 consensus_queue.cc:1048] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:15:58.744158 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:58.745019 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:58.733572  6890 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:58.745612 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:58.734874  6755 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:15:58.747394 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:58.745723 32165 leader_election.cc:400] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 20. Current term is 21.
I20260709 13:15:58.753690 32266 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 18.
I20260709 13:15:58.754464 32165 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:58.751681 32272 raft_consensus.cc:2410] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 for term 20 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:15:58.740644  6809 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:15:58.748320 32268 raft_consensus.cc:2393] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 15: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:58.757983 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:58.732998  6900 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:58.750634  6778 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:58.765256 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:58.766628 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:58.767325 32124 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:15:58.757685  6809 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.777128 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:58.760623  6755 raft_consensus.cc:697] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 23 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:58.792914 32272 raft_consensus.cc:2468] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 18.
I20260709 13:15:58.765548  6928 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:58.795604 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:58.796830 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:58.797180 32124 raft_consensus.cc:2393] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 21: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:58.798215 32119 raft_consensus.cc:1275] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:15:58.798434 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:58.798884 32165 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:58.768945  6809 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:58.800879 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:58.810523 32268 raft_consensus.cc:2393] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 21: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:15:58.812368 32165 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:58.816751 32165 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:58.818279 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:58.818859 32264 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:58.799827 32272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:36080
I20260709 13:15:58.828485 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:58.829172 32191 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 18.
I20260709 13:15:58.818198  6778 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:58.832048 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:58.834053 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:58.835654 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:58.821259  6940 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:58.824156  6928 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:58.836258 32198 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17.
I20260709 13:15:58.839221 32191 raft_consensus.cc:2393] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 21: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:15:58.853610 32264 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 18.
I20260709 13:15:58.854373 32272 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:58.854918 32272 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:58.863055 32272 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:58.865373 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:58.880821 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:58.889128 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:58.896361 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:58.844959  6755 consensus_queue.cc:237] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:15:58.886175  6938 log.cc:927] Time spent T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:15:58.904686  6894 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:58.905365  6894 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:58.888320  6854 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:58.909224  6854 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:58.909870   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:58.911139  6928 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:58.911681  6928 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:58.912539 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:58.913157  6894 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:58.899569  6940 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:58.926704  6940 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:58.939249 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:15:58.942441  6939 log.cc:927] Time spent T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:15:58.936549  6778 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:58.968232  6940 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:59.003497  6779 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:59.018146  6914 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:59.026407  6854 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:59.032285 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:59.033033 32192 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 16.
I20260709 13:15:59.038542  6914 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.039108  6914 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:59.040307  6910 raft_consensus.cc:3055] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:59.040853  6910 raft_consensus.cc:740] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:15:59.041994  6914 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:59.055110 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:59.056182 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:15:59.056705 32164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.058164 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:59.059713 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:59.059724 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:59.061017 32264 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 12.
I20260709 13:15:58.951246  6918 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.066300 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:58.997584  6900 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:58.998350  6778 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:59.087438 32124 raft_consensus.cc:1275] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:15:59.072650  6918 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:59.090715  6918 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:59.093806  6778 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:15:59.097714 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 356904us
I20260709 13:15:59.108728 32089 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:59.111338 32195 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 21.
I20260709 13:15:59.105877 32165 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:59.024289  6888 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:15:59.120946   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 221558us
I20260709 13:15:59.123883 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:59.124549 32192 raft_consensus.cc:2410] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:15:59.118237  6921 raft_consensus.cc:2804] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:59.126257  6921 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:59.126636  6921 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:59.128458   369 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:59.128968 32267 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 19.
I20260709 13:15:59.042104  6910 consensus_queue.cc:260] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:59.133528  6562 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:59.134863   369 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:15:59.136389   369 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:59.137570  6808 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:59.138067  6808 raft_consensus.cc:697] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:59.138365   369 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:59.138782  6846 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:59.139320  6914 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:59.138959  6808 consensus_queue.cc:237] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:59.139344  6680 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:59.140488   369 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:59.141394  6562 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:59.141803   369 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:59.142565  6562 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:59.144162 32272 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:59.147928  6910 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:59.151016  6843 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:59.157864  6863 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:59.156670  6519 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:59.160176  6519 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:59.160040  6856 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:59.167737  6928 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:59.173804  6921 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:59.175568  6921 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:59.207779 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 105148us
W20260709 13:15:59.214046 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 105213us
I20260709 13:15:59.220950 32116 raft_consensus.cc:1240] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:59.220753 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:59.223065   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
W20260709 13:15:59.236223 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.237841  6569 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:59.239210  6680 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:59.239765 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:59.242360   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:59.243366  6730 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:59.243891   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:59.246723   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:59.247272  6778 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:59.281177  6680 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:59.281432  6778 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:59.285018  6778 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:59.267342 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:59.285722 32124 raft_consensus.cc:1275] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:15:59.281436  6730 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:59.167840  6809 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:59.250906 32268 raft_consensus.cc:1240] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:59.279088   400 raft_consensus.cc:3055] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:59.291697   402 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
W20260709 13:15:59.292824   401 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38164 (request call id 606) took 1635 ms (client timeout 2153 ms). Trace:
W20260709 13:15:59.293370   401 rpcz_store.cc:269] 0709 13:15:57.657442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.657613 (+   171us) service_pool.cc:224] Handling call
0709 13:15:59.292344 (+1634731us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b54008a1454. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff52fa 00007fb5a3fb6b17 00007fb59d5316d4 00007fb59d531662 00007fb59d531591 00007fb59d53150c 00007fb59d5307c2 00007fb59d32c48c 00007fb59d32b8c6 00007fb59d32b26f
0709 13:15:59.292559 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1770686336}
I20260709 13:15:59.273428  6900 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:59.302870  6900 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:59.269672  6863 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:59.304966  6680 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:59.289911   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:59.306085   395 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 21.
I20260709 13:15:59.305019  6863 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:59.311223  6863 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:59.287173 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:59.313779 32196 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 19.
I20260709 13:15:59.314632 32239 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:59.316902  6889 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:15:59.318711 32162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.289310   400 raft_consensus.cc:740] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:59.326704  6809 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 22 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:59.328611   400 consensus_queue.cc:260] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:59.330667   400 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:59.328965  6894 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:15:59.331079   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:59.336642 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:59.337185   403 raft_consensus.cc:2393] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 22: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:15:59.337447 32197 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 21.
I20260709 13:15:59.331718 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:59.338376 32198 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 21.
I20260709 13:15:59.339128  6900 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:15:59.348697 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 52112.2us
I20260709 13:15:59.361032  6730 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:59.361202 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:59.362428 32198 raft_consensus.cc:2368] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 22. Current term is 23.
I20260709 13:15:59.366227 32019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49556 (request call id 319) took 4346 ms. Trace:
I20260709 13:15:59.369151 32089 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:59.370661  6405 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:59.373824  6405 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:59.376493 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:59.377755 32198 raft_consensus.cc:2368] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 21. Current term is 22.
I20260709 13:15:59.379871  6405 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:59.381168 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:59.382772 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:59.383519 32197 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:59.385320 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:59.385596 32190 raft_consensus.cc:1275] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:15:59.386113 32191 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 13.
I20260709 13:15:59.387320 32199 raft_consensus.cc:1275] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:15:59.387573 32192 raft_consensus.cc:1275] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:15:59.389992   400 raft_consensus.cc:2410] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:15:59.390987 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:59.391778 32193 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:59.393224 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:59.388873 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:59.388954 32192 pending_rounds.cc:85] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 9
I20260709 13:15:59.402897 32195 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:15:59.398953 32192 pending_rounds.cc:107] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:15:59.404196 32192 raft_consensus.cc:2889] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:59.404348 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:59.405320 32191 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:15:59.406380   368 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:59.408406  6827 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:59.408794  6827 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:59.409160  6827 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:15:59.416105 32163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.426278 32267 raft_consensus.cc:1275] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:15:59.428738 32162 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:59.429765  6921 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:59.431793 32162 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:59.433416 32191 raft_consensus.cc:1275] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:15:59.438952   396 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEARNER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:15:59.424883  6730 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:59.454079  6519 consensus_queue.cc:1048] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:15:59.453926  6730 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:59.444411 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:59.445482  6492 consensus_queue.cc:1048] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:59.446794 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:59.447348  6894 consensus_queue.cc:1048] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:59.458560  6921 raft_consensus.cc:2749] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:59.459442 32196 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:59.461391 32238 leader_election.cc:400] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 22. Current term is 23.
I20260709 13:15:59.461489   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:15:59.461891 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:59.463020 32238 leader_election.cc:400] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 election: Vote denied by peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517) with higher term. Message: Invalid argument: T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for earlier term 21. Current term is 22.
I20260709 13:15:59.461493 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:59.465058 32272 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:59.464970 32238 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:59.466794 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:59.467514 32267 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 17.
I20260709 13:15:59.467967  6894 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:59.469497   368 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:59.470680  6808 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:15:59.368369 32019 rpcz_store.cc:276] 0709 13:15:55.019208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.019375 (+   167us) service_pool.cc:224] Handling call
0709 13:15:59.365940 (+4346565us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:58.368394 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:58.427537 (+ 59143us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:58.427586 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:15:58.427605 (+    19us) tablet.cc:662] Decoding operations
0709 13:15:58.428223 (+   618us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:58.428282 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:58.428314 (+    32us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:15:58.428699 (+   385us) tablet.cc:701] Row locks acquired
0709 13:15:58.428720 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:15:58.428877 (+   157us) write_op.cc:270] Start()
0709 13:15:58.429000 (+   123us) write_op.cc:276] Timestamp: P: 1783602958428828 usec, L: 0
0709 13:15:58.429024 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:15:58.490023 (+ 60999us) log.cc:844] Serialized 1299 byte log entry
0709 13:15:58.594802 (+104779us) op_driver.cc:464] REPLICATION: finished
0709 13:15:58.740718 (+145916us) write_op.cc:301] APPLY: starting
0709 13:15:58.744766 (+  4048us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:58.904052 (+159286us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:58.904160 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:58.906367 (+  2207us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:58.906666 (+   299us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:15:58.906709 (+    43us) write_op.cc:312] APPLY: finished
0709 13:15:58.906913 (+   204us) log.cc:844] Serialized 41 byte log entry
0709 13:15:58.913189 (+  6276us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:58.913326 (+   137us) write_op.cc:454] Released schema lock
0709 13:15:58.913400 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:58.917014 (+  3614us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:58.917070 (+    56us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":749249,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":129657,"apply.run_cpu_time_us":7859,"apply.run_wall_time_us":180185,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16697,"num_ops":3,"prepare.queue_time_us":275907,"prepare.run_cpu_time_us":4250,"prepare.run_wall_time_us":149304,"replication_time_us":165633,"thread_start_us":201714,"threads_started":2}]]}
I20260709 13:15:59.457819  6730 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:59.471091  6808 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.479781 32197 raft_consensus.cc:2468] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 19.
I20260709 13:15:59.494541 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:59.484791  6808 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:59.499823  6921 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.500418  6921 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:59.501866 32196 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 22.
I20260709 13:15:59.503543  6921 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:59.505482 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:15:59.508973 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 64097.9us
I20260709 13:15:59.507548   368 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:15:59.509917 32090 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:59.511339 32090 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:59.512092  6674 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:15:59.512892  6674 raft_consensus.cc:697] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 21 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:15:59.514127  6674 consensus_queue.cc:237] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:59.496019  6827 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:59.525362 32165 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:59.521636  6405 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:59.526583 32272 raft_consensus.cc:2468] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:15:59.533686  6894 consensus_queue.cc:1048] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:15:59.527915  6827 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:59.527494  6921 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:59.567528  6824 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:59.538108 32165 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:59.552767 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:59.569844 32191 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:15:59.534147 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 44636.1us
I20260709 13:15:59.529881   403 raft_consensus.cc:1240] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:59.529166 32193 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 19.
I20260709 13:15:59.538391 32238 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:59.576475 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:59.579057 32165 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:59.580787  6900 consensus_queue.cc:1048] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:15:59.582428  6900 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:15:59.584422 32273 raft_consensus.cc:1275] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 16. (term mismatch)
I20260709 13:15:59.585093 32273 pending_rounds.cc:85] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06: Aborting all ops after (but not including) 15
I20260709 13:15:59.585441 32264 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:15:59.586920 32165 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:59.585413 32273 pending_rounds.cc:107] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06: Aborting uncommitted NO_OP operation due to leader change: 19.16
I20260709 13:15:59.587847 32273 raft_consensus.cc:2889] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:59.536711  6492 raft_consensus.cc:2804] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:15:59.589598 32272 raft_consensus.cc:1240] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:15:59.569586  6824 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.595206 32267 raft_consensus.cc:1240] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:59.600426  6936 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:59.600808 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:59.602044 32124 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 21.
I20260709 13:15:59.603061  6910 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:59.603546  6910 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.603943  6910 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:59.615857  6405 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:59.596215  6824 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:59.625734 32191 raft_consensus.cc:2468] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 20.
I20260709 13:15:59.563843  6808 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:15:59.630245 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 53802.5us
I20260709 13:15:59.631356   368 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
W20260709 13:15:59.632980 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 94748.8us
I20260709 13:15:59.628410  6921 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:59.615535  6492 raft_consensus.cc:697] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 22 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:59.635160 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:59.632018 32019 catalog_manager.cc:5697] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:59.643761 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:59.639983 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:59.638644  6809 raft_consensus.cc:2804] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:15:59.651633 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:59.662741 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:59.635396  6936 consensus_queue.cc:1059] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.022s
I20260709 13:15:59.663079 32089 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:15:59.669327 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:59.667629 32238 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:15:59.643213  6894 consensus_queue.cc:1048] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:15:59.673098 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:59.670919 32019 catalog_manager.cc:5697] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:59.673235  6953 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:59.681010  6953 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:15:59.681483  6953 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:59.671136  6730 consensus_queue.cc:1048] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:15:59.671172  6889 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.018s
I20260709 13:15:59.687757  6910 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:59.689617 32087 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:15:59.675712  6936 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:59.700737  6666 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:15:59.701958 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:59.705333  6913 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:15:59.705821  6492 consensus_queue.cc:237] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:59.708007  6666 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.708508  6666 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:59.702728  6936 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:59.709465  6936 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:59.710327  6730 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:59.699608  6894 consensus_queue.cc:1048] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 13:15:59.719662  6623 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.720502  6623 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:59.722477  6837 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:15:59.723304  6837 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:59.725772  6889 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:15:59.732832 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 86090.4us
I20260709 13:15:59.773257 32019 catalog_manager.cc:5697] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 10 to 11, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:15:59.804811 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 70773.7us
W20260709 13:15:59.805440 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 85732.5us
I20260709 13:15:59.726410  6889 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:15:59.809165 32116 raft_consensus.cc:1275] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:15:59.809720  6889 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:15:59.797662 32238 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:59.816848 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:59.817103  6889 raft_consensus.cc:2804] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:59.817747  6889 raft_consensus.cc:697] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 19 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:59.818789  6889 consensus_queue.cc:237] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:59.821719 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:59.823240  6894 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:15:59.823827  6894 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
W20260709 13:15:59.817373 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 69351.3us
I20260709 13:15:59.711058  6730 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:15:59.833169  6808 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 22 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:59.840837 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:15:59.846855  6730 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:59.849153 32238 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:15:59.854064 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:59.854609  6953 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:15:59.857324  6953 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:59.858059  6910 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:59.826097  6623 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:15:59.834250 32019 catalog_manager.cc:5697] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:59.862293  6894 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:15:59.863430  6894 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:59.863919  6894 raft_consensus.cc:697] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:15:59.864758 32116 raft_consensus.cc:1240] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:59.834342  6519 consensus_queue.cc:1048] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:15:59.848277 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:15:59.870273 32196 raft_consensus.cc:3060] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:59.862330 32019 catalog_manager.cc:5697] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:59.873934 32165 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:15:59.876505 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:15:59.890652 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:15:59.891537 32122 raft_consensus.cc:1275] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:15:59.894891 32197 raft_consensus.cc:1240] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:15:59.895068 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:15:59.896821 32195 raft_consensus.cc:1240] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 19. Current term is 20. Ops: [19.17-19.17]
I20260709 13:15:59.883836 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:15:59.903023 32019 catalog_manager.cc:5697] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 18 to 20, leader changed from 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 20 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:15:59.911201 32115 raft_consensus.cc:3060] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:59.898185  6809 raft_consensus.cc:697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 20 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:15:59.975703 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:15:59.984870 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 145981us
I20260709 13:15:59.962769  6863 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:15:59.961768  6837 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:16:00.010046 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 176181us
I20260709 13:15:59.969285  6730 consensus_queue.cc:1059] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:16:00.015580 32165 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:00.015023 32089 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:16:00.028231 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 112866us
I20260709 13:15:59.979110  6519 consensus_queue.cc:1059] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.036s
I20260709 13:16:00.041543 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:00.042304 32199 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 18.
I20260709 13:16:00.044788 32165 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:00.048596  6405 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:00.049003  6405 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:00.049386  6405 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:59.988701  6623 consensus_queue.cc:1059] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:15:59.993794  6666 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:00.036988  6863 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:59.964910  6894 consensus_queue.cc:237] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:00.072398 32196 raft_consensus.cc:2468] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 22.
I20260709 13:16:00.082720   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:00.066956  6519 raft_consensus.cc:3055] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:00.090201  6519 raft_consensus.cc:740] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:16:00.091056 32124 raft_consensus.cc:2393] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 22: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:16:00.067245  6863 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:00.062335  6505 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.169s
I20260709 13:16:00.047575  6809 consensus_queue.cc:237] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.17, Last appended by leader: 17, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:00.098804  6863 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:16:00.118582 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 131414us
I20260709 13:16:00.106642  6827 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:00.099030  6623 consensus_queue.cc:1059] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.023s
W20260709 13:16:00.123184  6966 log.cc:927] Time spent T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:16:00.123680  6666 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 22 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:00.129119  6888 raft_consensus.cc:3055] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:16:00.129690  6888 raft_consensus.cc:740] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:16:00.130853  6824 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:00.130775  6888 consensus_queue.cc:260] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:00.134599  6824 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:00.135442  6975 consensus_queue.cc:1048] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:16:00.132308  6888 raft_consensus.cc:3060] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:00.111085  6519 consensus_queue.cc:260] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:16:00.180176 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 142932us
W20260709 13:16:00.181370 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 91129.2us
I20260709 13:16:00.197916  6980 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:00.198889  6972 log.cc:927] Time spent T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:16:00.198690  6980 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:16:00.200536  6967 log.cc:927] Time spent T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:16:00.201869  6889 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:00.202546  6889 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:00.203058  6890 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:00.203667  6890 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:16:00.207930  6971 log.cc:927] Time spent T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:16:00.169380  6827 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:00.221975  6973 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:00.222635  6973 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:00.224808   396 raft_consensus.cc:1240] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 20 LEADER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 19. Current term is 20. Ops: []
I20260709 13:16:00.233817 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:00.236351  6405 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:00.239089 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:00.190707  6674 raft_consensus.cc:3055] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:16:00.242830 32115 raft_consensus.cc:2468] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 22.
W20260709 13:16:00.243848 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 50204.2us
I20260709 13:16:00.247368 32165 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:00.250897  6827 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:16:00.252596  6963 log.cc:927] Time spent T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:16:00.244298 32269 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 22.
I20260709 13:16:00.244065  6674 raft_consensus.cc:740] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:16:00.286612  6674 consensus_queue.cc:260] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:00.291179  6890 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:00.288290  6674 raft_consensus.cc:3060] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:00.299955   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
W20260709 13:16:00.274602  6936 consensus_meta.cc:287] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06: Time spent flushing consensus metadata: real 0.564s	user 0.015s	sys 0.005s
W20260709 13:16:00.294705  6971 log.cc:927] Time spent T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:16:00.260879  6973 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:00.323726   368 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
W20260709 13:16:00.327813 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 99302us
I20260709 13:16:00.321223  6889 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:00.310922  6936 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:00.342455 32239 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:00.343708 32239 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:00.344087   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:16:00.344933   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:00.337635 32089 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:00.329597  6809 raft_consensus.cc:2804] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:00.345878  6809 raft_consensus.cc:697] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 22 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:16:00.346285  6973 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:00.346974  6968 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:00.346787  6809 consensus_queue.cc:237] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:00.347939  6968 consensus_queue.cc:1059] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:00.348883  6890 raft_consensus.cc:3055] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:00.349225  6890 raft_consensus.cc:740] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:16:00.350018  6890 consensus_queue.cc:260] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:00.356060  6921 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:00.356447  6910 raft_consensus.cc:2804] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:00.357009  6910 raft_consensus.cc:697] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 13 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:16:00.358665  6910 consensus_queue.cc:237] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:00.356727  6921 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:00.366437  6863 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:00.365960  6921 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:16:00.368770 32162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 255257us
I20260709 13:16:00.366715 32238 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:00.365960  6936 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:00.376644 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:00.387949  6405 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:00.390727  6980 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:00.393617  6569 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:00.394867 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:00.382503  6900 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:00.395788  6900 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:00.394793 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:00.397949  6900 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:00.398615 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:00.385030 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:16:00.393637 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 58670.6us
W20260709 13:16:00.374090 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 126821us
I20260709 13:16:00.401386 32165 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:00.408861 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.417851 32120 raft_consensus.cc:1240] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:00.419130 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:00.421314 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:00.421813  6936 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:00.419806 32198 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 22.
I20260709 13:16:00.422055 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:00.422227  6936 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:00.427156 32196 raft_consensus.cc:1275] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:16:00.431092 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:00.434686 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:00.434978 32272 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:00.436484 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:00.438541  6968 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:00.438706 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:00.406379  6894 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.383697  6978 raft_consensus.cc:2764] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:16:00.440502 32119 raft_consensus.cc:1240] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 18. Current term is 19. Ops: []
I20260709 13:16:00.380842  6921 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:00.384716  6987 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:00.439199  6968 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:00.461522  6997 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:00.456421  6921 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:00.464697 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:00.475666 32196 raft_consensus.cc:1275] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:16:00.462014  6900 raft_consensus.cc:2749] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:00.434540  6936 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:00.432919  6863 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:00.485502  6968 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:00.465808  6894 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:16:00.488260 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 86995us
I20260709 13:16:00.492273  6894 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:00.494872 32165 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:00.474925  6965 consensus_queue.cc:1048] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:16:00.502300   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:00.504931 32269 raft_consensus.cc:1240] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:00.514516 32270 raft_consensus.cc:1275] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:16:00.477751  6997 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:00.519212  6997 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:00.522819 32165 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:00.523893  6995 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:00.524639  6995 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:00.491551  6987 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:00.527712  6987 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:00.538120 32165 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:00.543373 32272 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 20.
I20260709 13:16:00.543286 32165 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:00.560571 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 112637us
I20260709 13:16:00.561216 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:00.562551 32239 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:00.558455 32165 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:16:00.560731 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 99608.3us
I20260709 13:16:00.553844  6995 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:00.567557 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:00.568435 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:00.568737 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:00.569548 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:00.569726 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:00.570698 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:00.571295  6894 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:00.571465 32239 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:00.572088  6894 consensus_queue.cc:1059] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:00.572520 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:00.579054  6921 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:00.554103  6987 raft_consensus.cc:2749] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:00.585476 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:00.586603 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:00.587690 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:00.587900 32272 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:16:00.594348 32239 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:00.596354 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 229686us
I20260709 13:16:00.595234 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:00.595650 32165 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:00.599984  6987 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:00.600672  6987 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:16:00.601550 32264 raft_consensus.cc:2393] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 15: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:16:00.601886  6997 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:00.602401  6997 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:00.602775  6987 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:00.586978  6863 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:00.604782 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:00.606842 32165 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:00.608736 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:00.598021  6889 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:00.647697 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:00.591938  6980 consensus_queue.cc:1059] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
W20260709 13:16:00.649533 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.610831  6900 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:00.607582  6863 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.608542  6730 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:16:00.654104 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 57531.7us
I20260709 13:16:00.609874  6995 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:16:00.660118 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 53867.7us
W20260709 13:16:00.656843 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 47169.5us
W20260709 13:16:00.679337  7002 log.cc:927] Time spent T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:16:00.680687 32124 raft_consensus.cc:1275] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 13:16:00.681533 32124 pending_rounds.cc:85] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d: Aborting all ops after (but not including) 13
I20260709 13:16:00.681854 32124 pending_rounds.cc:107] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:16:00.682183 32124 raft_consensus.cc:2889] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:00.684821  6837 raft_consensus.cc:3055] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:00.685449  6837 raft_consensus.cc:740] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:16:00.696466  6975 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.655548  6863 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:16:00.711357 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 104320us
I20260709 13:16:00.654883  6987 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:00.719110 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:00.718365 32238 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:00.719836 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:16:00.731539 32236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.731671  6888 raft_consensus.cc:3055] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:00.732175  6888 raft_consensus.cc:740] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:16:00.686573  6837 consensus_queue.cc:260] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:00.733253  6837 raft_consensus.cc:3060] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:00.733155  6888 consensus_queue.cc:260] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:00.734510  6888 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:00.735500 32117 raft_consensus.cc:1240] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:00.736781  6997 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:00.717332  6890 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:00.698133  6975 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:16:00.761874 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 43582.6us
I20260709 13:16:00.763269 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:00.763370  6997 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.765563  6997 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:00.767666  6997 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:00.768036 32122 raft_consensus.cc:1275] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:16:00.770439 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:16:00.779117 32237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.783269 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:00.784406 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:00.786581 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:00.787227 32264 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 23.
I20260709 13:16:00.752900  6987 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:00.790910 32090 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:16:00.803977 32264 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:16:00.805799 32089 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:00.807605  6975 leader_election.cc:290] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:00.807967  6987 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:00.781322  6936 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:16:00.817045  6674 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:16:00.784503  6992 consensus_queue.cc:1048] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:16:00.799715  6519 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:16:00.821317 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 52260.5us
I20260709 13:16:00.825214 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:00.820721  6975 raft_consensus.cc:2764] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Leader election decision vote started in defunct term 21: won
I20260709 13:16:00.820943  6674 raft_consensus.cc:697] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 20 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:16:00.796792  6894 consensus_queue.cc:1048] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:16:00.804414  6980 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:00.828444  6674 consensus_queue.cc:237] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:00.828891  6980 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:00.829377  6980 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:00.827459 32273 raft_consensus.cc:1240] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:16:00.792845  6666 consensus_queue.cc:1059] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:16:00.863894 32265 raft_consensus.cc:1240] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260709 13:16:00.870796  7008 consensus_queue.cc:1048] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:16:00.872212  6863 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:00.874096   396 raft_consensus.cc:1275] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
W20260709 13:16:00.881626 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.876601 32118 raft_consensus.cc:1240] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 18. Current term is 19. Ops: []
W20260709 13:16:00.882983 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 86817.9us
I20260709 13:16:00.887430 32264 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 20 index: 18. (index mismatch)
I20260709 13:16:00.881469 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:00.891319 32191 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:16:00.896306 32191 raft_consensus.cc:1275] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 18. (index mismatch)
I20260709 13:16:00.901558 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:00.903450 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:16:00.880746  7005 log.cc:927] Time spent T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.069s	user 0.003s	sys 0.000s
I20260709 13:16:00.885375   396 pending_rounds.cc:85] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6: Aborting all ops after (but not including) 13
I20260709 13:16:00.909615   396 pending_rounds.cc:107] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:16:00.910012   396 raft_consensus.cc:2889] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:00.912007 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:00.882714  6666 raft_consensus.cc:3055] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:00.876832  6997 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.881914  6936 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:00.874358  6863 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 23 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:00.918746 32264 raft_consensus.cc:1240] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 17. Current term is 18. Ops: []
I20260709 13:16:00.878067  6964 consensus_queue.cc:1048] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 13:16:00.925451 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:00.928205 32264 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:00.915814  6666 raft_consensus.cc:740] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:16:00.950564  7015 consensus_queue.cc:1048] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 13:16:00.968950  7013 consensus_queue.cc:1059] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:16:00.973197  6666 consensus_queue.cc:260] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:00.975821  6863 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:00.979383  6863 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:00.977005  6666 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:00.977658 32196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05806ba48f814549969547f21c7101c3"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:16:00.985103 32196 raft_consensus.cc:606] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 15 LEADER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:00.926623  6987 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:00.986563  6987 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:00.920042  6997 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:16:00.991955 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.999989 32193 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:16:01.005398 32199 raft_consensus.cc:1240] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 23 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 22. Current term is 23. Ops: []
I20260709 13:16:01.007966  6889 raft_consensus.cc:3055] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:16:01.008564  6889 raft_consensus.cc:740] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:16:01.009645  6889 consensus_queue.cc:260] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:16:01.020438   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 104291us
I20260709 13:16:01.027561 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:01.041198 32194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:16:01.041785 32194 raft_consensus.cc:606] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:01.042107 32194 raft_consensus.cc:614] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:01.045965 32194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bdc1594189c43f49251261c5d073447"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:16:01.046584 32194 raft_consensus.cc:606] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:01.046950 32194 raft_consensus.cc:614] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:01.027362  6965 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.027s
I20260709 13:16:01.060853  6997 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:01.071820 32267 raft_consensus.cc:2410] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:16:01.073963 32264 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 23.
I20260709 13:16:01.075047 32271 raft_consensus.cc:1240] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 22. Current term is 23. Ops: []
I20260709 13:16:01.026517  6889 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:01.026315  6827 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.053s
I20260709 13:16:01.089063 32198 raft_consensus.cc:1240] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 18. Current term is 19. Ops: []
I20260709 13:16:01.089531 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:01.090402 32198 raft_consensus.cc:1240] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 17. Current term is 18. Ops: []
I20260709 13:16:01.090677 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:01.090840 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:01.091316 32192 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:01.091857 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:16:01.096990   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 107612us
I20260709 13:16:01.097637   369 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:01.099967 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:01.101068 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:01.104619 32190 raft_consensus.cc:2393] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 22: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:16:01.107110  7025 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:01.098438  6991 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.010s
I20260709 13:16:01.108268 32197 raft_consensus.cc:1240] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 13 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:01.105962 32194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6565a440fcf14a499c191f2835d21508"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:43952
I20260709 13:16:01.095096  6863 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:01.115293  7019 consensus_queue.cc:1048] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.013s
I20260709 13:16:01.117149 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:01.117822  6980 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:01.109722  6973 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:01.119459  6973 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:01.120339 32190 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 23.
I20260709 13:16:01.115298   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:01.121572  6973 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:01.122723 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:01.123672 32238 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:01.124060 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:01.124523  6980 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 23 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:01.123448 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:01.130586 32268 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 18.
I20260709 13:16:01.126705 32190 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 21.
I20260709 13:16:01.144106  6913 consensus_queue.cc:1059] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:01.135593  6973 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:01.145115  6973 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.145545  6973 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:01.147825  6987 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:01.144268 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:01.152050 32190 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:16:01.153061 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:01.153654  6890 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:01.154222  6890 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:01.154755  6913 raft_consensus.cc:3055] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:01.155275  6913 raft_consensus.cc:740] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:16:01.153816 32190 raft_consensus.cc:2393] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 18: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:16:01.157078 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:01.157418 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:01.156474 32269 raft_consensus.cc:1275] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:01.158303  6623 consensus_queue.cc:1059] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:01.159376  6824 raft_consensus.cc:3055] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:16:01.159734  6824 raft_consensus.cc:740] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:16:01.160063 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:01.161511 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:01.161598 32190 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:01.162115 32197 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:16:01.160631  6824 consensus_queue.cc:260] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:01.196614 32238 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:01.198102 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.199995 32238 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:01.203156 32238 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:01.213644 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:01.214228  6863 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:01.214372 32165 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:01.214958  6863 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:01.215404  6910 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:01.215801  6910 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:01.216180  6910 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:01.218876 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:01.219568 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:01.222728 32238 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:01.224598 32238 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:01.226316  6623 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:16:01.227584 32193 raft_consensus.cc:1275] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:16:01.156342  6913 consensus_queue.cc:260] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:01.217803 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:01.230206 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:01.164287  6890 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:01.216261 32165 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:01.218400 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:01.234896 32122 raft_consensus.cc:1275] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:01.233394  6913 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:01.233943 32090 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:16:01.243674 32118 raft_consensus.cc:1275] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:16:01.246747 32270 raft_consensus.cc:2393] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 20: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:16:01.218077  6730 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:01.230844  6519 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:01.257856  6405 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:01.234107  6888 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:16:01.258527 32190 raft_consensus.cc:2468] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 19.
I20260709 13:16:01.258661  6405 raft_consensus.cc:697] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 18 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:16:01.253301 32089 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:01.259821 32165 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:01.233938  7012 raft_consensus.cc:2749] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:16:01.267023 32165 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:01.259080  6900 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:01.260630  6519 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:01.243511  6674 consensus_queue.cc:1059] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.038s
I20260709 13:16:01.265218  6824 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:01.281085  6405 consensus_queue.cc:237] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:01.304921 32198 raft_consensus.cc:1275] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:16:01.306097 32192 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 20.
W20260709 13:16:01.306257 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 81770.7us
I20260709 13:16:01.307237 32194 raft_consensus.cc:606] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:01.307667 32194 raft_consensus.cc:614] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:01.258832  6730 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:16:01.305207  7023 log.cc:927] Time spent T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:16:01.326288 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 59405.3us
I20260709 13:16:01.327255 32165 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:01.281083  6519 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:01.324484  6730 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:01.316313  6921 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:01.316507  6990 raft_consensus.cc:2749] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:16:01.329468 32238 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:01.315388  7015 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:16:01.332530   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 229973us
I20260709 13:16:01.336002 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:01.341666 32238 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:01.326222  6863 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:16:01.344399 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 96368.2us
I20260709 13:16:01.329312  6987 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:01.352509 32165 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:01.343145  7006 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:16:01.450428   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 64341.4us
W20260709 13:16:01.462806 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.331442  6888 consensus_queue.cc:1048] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:16:01.340361  7015 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:01.339829  6900 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:01.373703  6936 raft_consensus.cc:2804] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:16:01.469928  7023 log.cc:927] Time spent T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:16:01.443533  6995 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:01.472291  6987 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:01.483569  7015 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:01.478379  7008 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:01.562770  6987 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.593832  7010 raft_consensus.cc:493] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:16:01.594373  7007 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:01.594555  7010 raft_consensus.cc:515] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:16:01.597275  7032 log.cc:927] Time spent T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 13:16:01.594072  7033 log.cc:927] Time spent T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
W20260709 13:16:01.581542  6982 log.cc:927] Time spent T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:16:01.606622   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 142139us
I20260709 13:16:01.613498 32089 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:01.613935   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:01.625054 32089 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:01.596536  7007 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.600322  6900 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.600883  6987 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:01.563300  6995 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:01.643836 32089 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
W20260709 13:16:01.649593 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 297209us
I20260709 13:16:01.650348 32165 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:01.599728  6973 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:01.653338 32089 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:01.653818 32165 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:01.655076 32165 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:01.655071  7027 log.cc:927] Time spent T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.341s	user 0.000s	sys 0.001s
I20260709 13:16:01.660874  6975 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:16:01.661659  7024 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:01.662312  7024 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:16:01.665349  7035 log.cc:927] Time spent T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:16:01.622823  6888 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.600276  7008 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:01.638794  6990 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:16:01.677279 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 123882us
I20260709 13:16:01.649042  6666 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:16:01.679354 32269 raft_consensus.cc:1240] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 13:16:01.688416 32165 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:01.657209  6992 raft_consensus.cc:2749] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:01.701586 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:01.706856  6730 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:01.708817 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:16:01.709355  7030 log.cc:927] Time spent T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.354s	user 0.001s	sys 0.000s
I20260709 13:16:01.647394  6900 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:16:01.736855 32162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 69090.5us
I20260709 13:16:01.651090  7007 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:01.670148  6912 consensus_queue.cc:1048] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.125s
I20260709 13:16:01.680540  7051 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:01.702381  7014 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:01.678224  6888 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:01.760346   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:01.764891  7052 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:16:01.770020  7052 raft_consensus.cc:697] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 23 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:16:01.771660  6997 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:01.771389  7052 consensus_queue.cc:237] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:01.773252  7015 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:01.738566  7010 leader_election.cc:290] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:01.775563  7015 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:01.789511  7014 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:16:01.790751  7038 log.cc:927] Time spent T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
W20260709 13:16:01.778076  7042 log.cc:927] Time spent T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:16:01.779868  7007 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:01.757265  6569 consensus_queue.cc:1048] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:16:01.780139  6519 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:01.781862  6973 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 24 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:01.782742  6995 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:01.784821  6730 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:01.735663  6936 raft_consensus.cc:697] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 19 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:16:01.837620  7024 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:01.899214  6809 consensus_queue.cc:1048] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:16:01.898962  6936 consensus_queue.cc:237] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:16:01.900944  6889 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
W20260709 13:16:01.902261 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 213922us
I20260709 13:16:01.829761  6900 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:16:01.828449  6824 consensus_meta.cc:287] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d: Time spent flushing consensus metadata: real 0.546s	user 0.007s	sys 0.007s
I20260709 13:16:01.920534 32165 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:01.922254 32165 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:01.776273  6863 consensus_queue.cc:1048] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:16:01.777403  7045 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:16:01.834723 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:01.837694 32272 raft_consensus.cc:1240] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 22. Current term is 23. Ops: []
I20260709 13:16:01.846328 32267 raft_consensus.cc:1240] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:01.854763 32271 raft_consensus.cc:1275] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:16:01.861274 32087 leader_election.cc:304] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
W20260709 13:16:01.843374  6910 consensus_meta.cc:287] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.614s	user 0.014s	sys 0.000s
W20260709 13:16:01.892271   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 55359.5us
I20260709 13:16:01.897569  6519 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:01.933499 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:01.943377 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:01.944288 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:01.944927 32191 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:01.948068 32192 raft_consensus.cc:1240] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260709 13:16:01.949005 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:01.920265  7006 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:16:01.953197 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:01.953789 32192 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:01.955120 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f089b75ada024eb9bbf7e4b953063dd4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:01.956228   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:01.958526 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:01.923090  7015 raft_consensus.cc:493] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:16:01.941642  6980 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:16:01.943040  6900 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:01.941495  6995 consensus_queue.cc:1048] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:16:01.981326  6837 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:01.981731  6980 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:01.971055  6973 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.985389  6973 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:01.968479  7006 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:01.987679  6973 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:01.988638 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:16:01.990288  6921 consensus_meta.cc:287] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.654s	user 0.007s	sys 0.003s
I20260709 13:16:01.990883  6921 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:01.991393 32165 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:01.942468  6910 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:01.991196 32192 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:16:01.994554  6910 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:01.995358  6910 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:01.920097  6889 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:16:01.998122  7036 log.cc:927] Time spent T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:16:01.998757  6889 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:01.973374  7015 raft_consensus.cc:515] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:02.002812  7015 leader_election.cc:290] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:02.006709 32193 raft_consensus.cc:2393] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 17: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:16:02.010355 32195 raft_consensus.cc:1240] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:02.014359   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:01.951452  7007 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:02.014775   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:02.020965 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:02.014292   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:02.022575 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:16:02.062695 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 201496us
I20260709 13:16:02.064890 32265 raft_consensus.cc:2393] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 18: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:16:01.988435  7006 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:01.991752  6921 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:02.071192 32198 raft_consensus.cc:1275] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:16:02.074993 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:16:02.077280 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 125305us
W20260709 13:16:02.078044 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 58164.7us
W20260709 13:16:02.087432 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 136280us
I20260709 13:16:02.065351  7008 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:02.021831  7014 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:02.093566 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:02.101166  7008 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.077076  6921 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:02.104683  7008 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:02.106580  6921 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:02.106633  7008 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:02.101228  6888 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:02.120843 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:02.122900 32165 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:02.134470 32191 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 22.
I20260709 13:16:02.138711  7014 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:02.138293  6900 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:02.156888 32193 raft_consensus.cc:1240] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:02.144970  6980 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:02.200047 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:02.148825  7037 consensus_queue.cc:1059] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.054s
I20260709 13:16:02.197005  6623 raft_consensus.cc:3055] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:16:02.221218  7067 log.cc:927] Time spent T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:16:02.229719  7007 raft_consensus.cc:993] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801: : Instructing follower 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:16:02.230366  6921 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:02.214673  6890 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.183313  7014 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:02.222379  6623 raft_consensus.cc:740] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:16:02.233724  7007 raft_consensus.cc:1081] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 15 LEADER]: Signalling peer 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:16:02.357795 32268 raft_consensus.cc:1240] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 19 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 18. Current term is 19. Ops: [18.16-18.16]
W20260709 13:16:02.360687  6965 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.005s	sys 0.022s
W20260709 13:16:02.371595  6965 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.007s	sys 0.024s
W20260709 13:16:02.380328  7076 log.cc:927] Time spent T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:16:02.381544  7014 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:16:02.384013  7079 log.cc:927] Time spent T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:16:02.384310  6987 consensus_meta.cc:287] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801: Time spent flushing consensus metadata: real 0.732s	user 0.010s	sys 0.000s
I20260709 13:16:02.315383  6890 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:02.384797  6987 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:02.318671  6921 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:02.391755 32196 raft_consensus.cc:2393] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 24: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:16:02.396518 32194 raft_consensus.cc:1240] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 24 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 23. Current term is 24. Ops: []
W20260709 13:16:02.397426  7075 log.cc:927] Time spent T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:16:02.397635   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:02.398695 32199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56926 (request call id 1339) took 1300 ms. Trace:
I20260709 13:16:02.399065 32199 rpcz_store.cc:276] 0709 13:16:01.098050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.199733 (+101683us) service_pool.cc:224] Handling call
0709 13:16:01.235225 (+ 35492us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:01.242700 (+  7475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:01.242728 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:01.258787 (+ 16059us) log.cc:844] Serialized 26 byte log entry
0709 13:16:02.014229 (+755442us) spinlock_profiling.cc:243] Waited 7.25 ms on lock 0x7b180022f7e0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bee6e07 00007fb5a4d41ab9 00007fb59bf0369b 00007fb59bf0193f 00007fb59bf03c02 00007fb59eb8b20b 00007fb59eb90d23 00007fb59eb910d1 00007fb59efaca0f
0709 13:16:02.150918 (+136689us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:16:02.150958 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.151022 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:02.398380 (+247358us) raft_consensus.cc:1685] finished
0709 13:16:02.398402 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:02.398613 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33717,"raft.queue_time_us":18365,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":9919,"spinlock_wait_cycles":16669568,"thread_start_us":136526,"threads_started":1,"wal-append.queue_time_us":933297}
I20260709 13:16:02.401058  6987 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 24 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:16:02.444495 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 302705us
W20260709 13:16:02.446054 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 304192us
I20260709 13:16:02.370604  6623 consensus_queue.cc:260] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:02.452001  6975 consensus_queue.cc:1059] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:16:02.461685  6921 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:02.462401  6890 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:02.471635  6975 consensus_queue.cc:1048] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:02.468997  6623 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:02.473850  6992 raft_consensus.cc:3055] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:02.474354  6992 raft_consensus.cc:740] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:16:02.475175  6992 consensus_queue.cc:260] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:02.476508  6992 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:02.485886 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:02.487720 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:02.489667 32196 raft_consensus.cc:1240] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:02.489713 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:02.491580 32192 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:16:02.490754 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee05beb4092f41ddb391480547d90df0" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:02.490698 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:02.500396 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:02.495924  7040 consensus_queue.cc:1059] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.005s
I20260709 13:16:02.498903 32162 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:02.505613 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:02.506273 32199 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:16:02.507261 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:02.508014 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:02.514451 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:02.517207  7040 raft_consensus.cc:3055] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:16:02.517743  7040 raft_consensus.cc:740] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:16:02.518534  7040 consensus_queue.cc:260] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:02.520012  7040 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:02.520826  6889 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:02.521343  6889 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:02.518481 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:02.531711 32165 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:02.533072 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:16:02.537540 32089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.532958  6837 consensus_queue.cc:1059] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.005s
I20260709 13:16:02.538755  6980 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:02.537215 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:02.540021 32273 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 19.
I20260709 13:16:02.541507 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:02.541947 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:02.542109 32198 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:16:02.546492 32117 raft_consensus.cc:2410] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:16:02.522964  6921 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:02.549165 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:02.539541  7008 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:02.552659  7008 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:02.553848  6824 raft_consensus.cc:3055] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:16:02.554452  6824 raft_consensus.cc:740] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:16:02.554798  7008 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:02.546049 32165 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:02.553777 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:02.556960 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:02.539593  7080 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.559689  7080 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:02.562531 32199 raft_consensus.cc:2393] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 19: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:16:02.563840 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:02.541047  6900 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:02.535717  7086 consensus_queue.cc:1048] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:16:02.580693 32273 raft_consensus.cc:1275] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:16:02.582911 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:02.550149  6995 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.581552 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:02.591794 32264 raft_consensus.cc:1240] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:02.583623 32269 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 17.
I20260709 13:16:02.604470 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:02.610491  6889 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:02.614188   369 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:02.615471 32267 raft_consensus.cc:2393] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 24: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:16:02.569199  7052 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:02.539335  6980 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:02.621273 32272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05806ba48f814549969547f21c7101c3"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:36080
I20260709 13:16:02.623530 32272 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:02.623917 32272 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:02.575237  6824 consensus_queue.cc:260] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:02.621598  7039 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:02.628161 32265 raft_consensus.cc:1240] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:02.630174 32121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:02.630650 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:02.631271 32124 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:16:02.626752  6405 consensus_queue.cc:1059] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:16:02.619059 32117 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:16:02.631147 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:02.568907  7087 consensus_queue.cc:1059] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.052s
W20260709 13:16:02.619366  7081 log.cc:927] Time spent T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:16:02.628209 32239 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:02.642030 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:02.653412 32119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d002861120de41408d48712b6bd491e1"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:53200
I20260709 13:16:02.656906 32119 raft_consensus.cc:606] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:02.654759 32165 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:02.613883  6936 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:02.662936 32270 raft_consensus.cc:1275] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:16:02.663187  7087 consensus_queue.cc:1059] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:02.664816  7087 raft_consensus.cc:3055] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:16:02.627913  7052 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:02.666810 32116 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:16:02.670949 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:16:02.677531 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.679877 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:02.666010  7050 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:02.669289  7060 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:16:02.684701   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:02.685353 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:02.686710 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:02.687510 32123 raft_consensus.cc:2393] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 17: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:16:02.690954  7070 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.691550  7070 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:02.673207  7037 raft_consensus.cc:3055] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:02.692983  7037 raft_consensus.cc:740] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:16:02.693783  7037 consensus_queue.cc:260] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:02.694962  7037 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:02.694490   368 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:02.698031  6980 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:02.698256  7024 raft_consensus.cc:3060] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:02.692977 32116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:02.699940 32116 raft_consensus.cc:2393] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 19: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:16:02.701294   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:02.701759  7070 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:02.703195 32120 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 16. (term mismatch)
I20260709 13:16:02.703606 32120 pending_rounds.cc:85] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d: Aborting all ops after (but not including) 15
I20260709 13:16:02.703827 32120 pending_rounds.cc:107] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 18.16
I20260709 13:16:02.704173 32120 raft_consensus.cc:2917] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Aborting config change with OpId 18.16: Aborted: Op aborted by new leader
I20260709 13:16:02.704535 32120 raft_consensus.cc:2889] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:02.711971 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 55110.9us
I20260709 13:16:02.713910 32238 leader_election.cc:304] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:02.620263  6995 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:02.718163 32238 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:02.665266  7087 raft_consensus.cc:740] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:16:02.678853  7052 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:02.724498 32238 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:02.712775 32165 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:02.751930 32238 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:02.724551  6980 raft_consensus.cc:2749] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:02.674784  6936 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:02.731021  7008 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:16:02.769979 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 64920.2us
I20260709 13:16:02.711227  7060 consensus_queue.cc:1048] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:16:02.775561 32238 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:02.778118 32238 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:02.743506 32272 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:02.779549 32269 raft_consensus.cc:1240] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 15. Current term is 16. Ops: []
W20260709 13:16:02.781317 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 60813.7us
I20260709 13:16:02.754635  6889 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:16:02.754360  7050 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:02.799826 32272 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:02.800122 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:02.801739 32191 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
I20260709 13:16:02.800841   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:16:02.802742   399 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:02.805518  7080 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:02.777657  7044 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:02.806216  7044 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:02.806593  7044 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:02.799429 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:02.809250  6980 raft_consensus.cc:2804] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:02.809691  6980 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:16:02.810104  6980 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:02.814328   399 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:16:02.815637  6900 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:02.736567  7069 consensus_queue.cc:1059] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 13:16:02.825392 32236 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:16:02.781149  6890 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:02.828131 32198 raft_consensus.cc:1275] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:16:02.828174   401 raft_consensus.cc:1240] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 15. Current term is 16. Ops: []
W20260709 13:16:02.829561 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 51516.2us
I20260709 13:16:02.830889 32238 leader_election.cc:304] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:02.832172 32238 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:02.781486  6888 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:16:02.835974 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:02.832250 32239 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:16:02.839526 32165 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:02.851840 32239 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:16:02.855108 32089 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:16:02.873601  7095 raft_consensus.cc:2804] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:02.874184  7095 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.874580  7095 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:02.877331 32115 raft_consensus.cc:1275] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 23 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 14. (term mismatch)
I20260709 13:16:02.877779 32115 pending_rounds.cc:85] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d: Aborting all ops after (but not including) 13
I20260709 13:16:02.877993 32115 pending_rounds.cc:107] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d: Aborting uncommitted NO_OP operation due to leader change: 22.14
I20260709 13:16:02.878209 32115 raft_consensus.cc:2889] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:02.864024  6889 raft_consensus.cc:2804] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:02.881458  6889 raft_consensus.cc:697] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:16:02.881806  6936 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:02.882380  6936 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.882413  6889 consensus_queue.cc:237] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:02.882937  6936 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:02.893525 32122 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:16:02.866657  6900 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:16:02.829440  7050 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:02.845634  6910 consensus_queue.cc:1059] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 13:16:02.918362  6890 raft_consensus.cc:697] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:16:02.930146  7037 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:02.922590 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 70877.3us
I20260709 13:16:02.928038 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:02.926891 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:02.931517 32273 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 15.
I20260709 13:16:02.930697  7037 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:02.938601  7037 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:02.942487 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:02.943241 32273 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 18.
I20260709 13:16:02.944864 32090 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:16:02.945837  6990 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:02.946209  6990 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.946514  6990 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:02.949842  6995 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:02.952718  7052 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:02.953421 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:02.954425 32265 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 23.
I20260709 13:16:02.954973  7052 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:02.916836  6991 consensus_queue.cc:1048] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:16:02.956743  7050 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:02.918989  7097 raft_consensus.cc:2749] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:02.964226  6936 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:02.967160 32090 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:16:02.974140 32272 raft_consensus.cc:1240] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 23. Current term is 24. Ops: [23.15-23.15]
W20260709 13:16:02.980348 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 148223us
I20260709 13:16:02.981504 32238 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
W20260709 13:16:02.992035 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 93420.7us
I20260709 13:16:02.976106  6980 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:02.997522 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:16:02.998557  7084 log.cc:927] Time spent T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.533s	user 0.005s	sys 0.000s
I20260709 13:16:02.999150 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:03.013079 32264 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
I20260709 13:16:02.983417  6569 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:03.013862  6569 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.014300  6569 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:03.000125 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:03.017349 32199 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 18.
I20260709 13:16:02.990756  6975 consensus_queue.cc:1059] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:16:03.000929 32193 raft_consensus.cc:1240] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 24 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 13:16:02.978216  7060 consensus_queue.cc:1048] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
W20260709 13:16:03.022069  7089 log.cc:927] Time spent T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
I20260709 13:16:03.024988 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:03.025943 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:03.026715 32120 raft_consensus.cc:2393] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 19: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:16:03.033121  6953 consensus_queue.cc:1059] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:16:03.033318 32165 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:03.034574  6995 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:03.034997  6995 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.035356  6995 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:03.038780  6824 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:03.040740   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:16:03.047112 32268 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 19.
I20260709 13:16:03.052712  6405 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.046449 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:03.053174  6405 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:03.011291  7008 raft_consensus.cc:697] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:16:03.063251 32165 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:02.930552  6890 consensus_queue.cc:237] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:03.041471  7024 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:03.089844  6405 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:03.073244  6995 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:03.094554  6995 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:03.097222  6888 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:03.097384 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:03.097756  6888 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.098193  6888 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:03.098467  7104 raft_consensus.cc:2804] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:03.099042  7104 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.099377  7104 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:03.062263  6569 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:03.098397 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:03.101496 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:03.101727 32267 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 19.
I20260709 13:16:03.102022 32269 raft_consensus.cc:3060] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:03.102435  6900 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:16:03.103012  6900 raft_consensus.cc:697] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 19 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:16:03.104053   401 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 16. (term mismatch)
I20260709 13:16:03.104377   401 pending_rounds.cc:85] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6: Aborting all ops after (but not including) 15
I20260709 13:16:03.104610   401 pending_rounds.cc:107] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 18.16
I20260709 13:16:03.104838   401 raft_consensus.cc:2917] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Aborting config change with OpId 18.16: Aborted: Op aborted by new leader
I20260709 13:16:03.105171   401 raft_consensus.cc:2889] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [term 19 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:03.105783 32117 raft_consensus.cc:1240] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:16:03.091434  7015 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:03.067440  7008 consensus_queue.cc:237] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:03.103860  6900 consensus_queue.cc:237] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:03.071970  7087 consensus_queue.cc:260] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:03.052011  6980 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:16:03.121815 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 47161.9us
I20260709 13:16:03.123426 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
W20260709 13:16:03.129920 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 148523us
I20260709 13:16:03.130720 32238 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:03.135805 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 203708us
I20260709 13:16:03.140921 32239 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:03.148573  7102 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:03.156327  7087 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:03.160142  6569 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 24 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:03.129127  7052 consensus_queue.cc:1059] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:16:03.116130  7097 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.045s
I20260709 13:16:03.165977  6921 raft_consensus.cc:3055] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:03.085019  7095 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:03.189003 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 24 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:16:03.191963 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 61308.1us
W20260709 13:16:03.193112 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 52298.1us
I20260709 13:16:03.199044 32239 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:16:03.199153  7105 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:03.199632  6995 consensus_queue.cc:1059] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:16:03.200825  6995 raft_consensus.cc:3055] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:16:03.201195  6995 raft_consensus.cc:740] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:16:03.197132  6980 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:03.202104  6995 consensus_queue.cc:260] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:03.203397  6995 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:03.203477 32019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59534 (request call id 187) took 3644 ms. Trace:
I20260709 13:16:03.204810  7040 consensus_queue.cc:1048] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:03.215139 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 24 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:03.210722 32239 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:03.203938 32019 rpcz_store.cc:276] 0709 13:15:59.558861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.562589 (+  3728us) service_pool.cc:224] Handling call
0709 13:16:03.203389 (+3640800us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:00.335210 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:00.353317 (+ 18107us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:00.353378 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:16:00.353399 (+    21us) tablet.cc:662] Decoding operations
0709 13:16:00.354283 (+   884us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:00.354376 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:00.354408 (+    32us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:16:00.355155 (+   747us) tablet.cc:701] Row locks acquired
0709 13:16:00.355212 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:16:00.355405 (+   193us) write_op.cc:270] Start()
0709 13:16:00.355575 (+   170us) write_op.cc:276] Timestamp: P: 1783602960355339 usec, L: 0
0709 13:16:00.355632 (+    57us) op_driver.cc:348] REPLICATION: starting
0709 13:16:00.356362 (+   730us) log.cc:844] Serialized 2477 byte log entry
0709 13:16:00.818285 (+461923us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b1800342c40. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bee6e07 00007fb5a4d41ab9 00007fb59bf0369b 00007fb59bf0193f 00007fb59bf01455 00007fb59ef6e190 00007fb59ef67ae7 00007fb59ef66dd9 00007fb59ef71930
0709 13:16:01.039324 (+221039us) op_driver.cc:464] REPLICATION: finished
0709 13:16:01.204790 (+165466us) write_op.cc:301] APPLY: starting
0709 13:16:01.204919 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:01.211840 (+  6921us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:01.211893 (+    53us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:01.939152 (+727259us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:01.980743 (+ 41591us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:16:01.980816 (+    73us) write_op.cc:312] APPLY: finished
0709 13:16:01.981154 (+   338us) log.cc:844] Serialized 65 byte log entry
0709 13:16:02.140883 (+159729us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:02.149011 (+  8128us) write_op.cc:454] Released schema lock
0709 13:16:02.154865 (+  5854us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:02.302610 (+147745us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:02.311978 (+  9368us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":112160,"apply.run_cpu_time_us":24584,"apply.run_wall_time_us":1022253,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29267,"num_ops":6,"prepare.queue_time_us":172107,"prepare.run_cpu_time_us":13253,"prepare.run_wall_time_us":175746,"raft.queue_time_us":461688,"raft.run_cpu_time_us":15159,"raft.run_wall_time_us":193455,"replication_time_us":659296,"spinlock_wait_cycles":14317824,"thread_start_us":421018,"threads_started":5,"wal-append.queue_time_us":298663,"wal-append.run_cpu_time_us":53085,"wal-append.run_wall_time_us":1440518}]]}
I20260709 13:16:03.230232 32090 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:16:03.193955  6921 raft_consensus.cc:740] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:16:03.242532 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:03.242331 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:03.249536 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:03.250844 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:03.243218 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:03.256668 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:03.232384  7111 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:03.263635 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:03.254968 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:03.269331 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:03.260222  7111 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.183117  6990 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:03.247155  6666 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:03.246201  7106 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:03.322301 32122 raft_consensus.cc:2393] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 19: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
W20260709 13:16:03.328060   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 87109.2us
W20260709 13:16:03.313373  7089 log.cc:927] Time spent T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:16:03.288549  7111 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:03.260499  6980 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.056s
I20260709 13:16:03.307195  6666 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.338486   369 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:03.321971  7097 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.341957 32238 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:03.350304 32239 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:03.350732 32238 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:03.308111  7044 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:03.362337  7044 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:03.362910  6921 consensus_queue.cc:260] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:03.372035 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:03.372737 32193 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:03.342885  6666 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:03.374869 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:03.382174 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:03.383133 32199 raft_consensus.cc:2393] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 19: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
W20260709 13:16:03.385192  7120 log.cc:927] Time spent T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.074s	user 0.003s	sys 0.000s
I20260709 13:16:03.392477 32193 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 16.
I20260709 13:16:03.393018 32269 raft_consensus.cc:2468] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 19.
I20260709 13:16:03.396117 32165 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:03.400286  7052 raft_consensus.cc:2804] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:16:03.401561  7052 raft_consensus.cc:697] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 19 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:16:03.402737  7052 consensus_queue.cc:237] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:03.397226 32089 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:16:03.405135 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:03.406811 32122 raft_consensus.cc:2393] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 17: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
W20260709 13:16:03.406912   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 68501.9us
I20260709 13:16:03.365195  7097 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:16:03.409540 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 59310.6us
I20260709 13:16:03.409770  6623 raft_consensus.cc:2804] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:03.414309  6562 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:03.409811  7105 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:03.415803  7097 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:03.363933  6888 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:03.418807 32239 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:03.419099  6623 raft_consensus.cc:697] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 16 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:16:03.437345  6623 consensus_queue.cc:237] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:03.411094  6889 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:03.439100  7116 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:03.439730  7116 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:03.442319  7116 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:03.444794  7104 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:03.449075 32197 raft_consensus.cc:2410] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 24 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:16:03.449326 32270 raft_consensus.cc:2368] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 17. Current term is 18.
I20260709 13:16:03.450621  7111 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:03.451730  6888 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:03.452696  7111 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:03.455529  7104 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:03.410200  7122 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:03.463491 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:03.464148 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:03.465915 32192 raft_consensus.cc:2393] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 16: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:16:03.466784 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:03.467921 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:03.468854 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:03.469838 32194 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:03.477072 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:03.477733 32196 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:03.471109  7008 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:03.481248  7008 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:03.483412  7008 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:03.484660   369 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:03.485618  7024 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:03.494131 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:03.468849  7097 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:03.501071  7097 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:03.503348  7097 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:16:03.505324  7123 log.cc:927] Time spent T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:16:03.505928   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:03.511014  6936 raft_consensus.cc:1064] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:16:03.511088 32194 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 18.
W20260709 13:16:03.511555  6936 raft_consensus.cc:1068] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06: Unable to promote non-voter 94085cf341634eb686a95983b6b7f7e6: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:16:03.523152  7115 log.cc:927] Time spent T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:16:03.525185 32196 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 18.
I20260709 13:16:03.535172  6990 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:03.456977  6666 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:03.540867  7095 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:03.541029  7101 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:16:03.541898 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 129747us
I20260709 13:16:03.555634 32239 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:03.552434 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:03.556649 32268 raft_consensus.cc:2393] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 16: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:16:03.568243 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:03.576030  6666 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:03.582724  6980 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:03.585469 32272 raft_consensus.cc:2393] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d in current term 19: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
W20260709 13:16:03.586280  7110 log.cc:927] Time spent T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 13:16:03.587073  6405 raft_consensus.cc:993] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d: : Instructing follower 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:16:03.587550  6405 raft_consensus.cc:1081] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Signalling peer 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:16:03.596290  7107 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:03.596935  7107 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:03.598948  7107 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:03.609344 32238 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:03.610513 32238 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:03.611985  7102 raft_consensus.cc:2804] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:03.612550  7015 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:03.612998   401 raft_consensus.cc:1240] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:03.613113  7015 raft_consensus.cc:697] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:16:03.613997  7015 consensus_queue.cc:237] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:03.615027  7102 raft_consensus.cc:697] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:16:03.615904  7102 consensus_queue.cc:237] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:16:03.620755 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 60007.9us
I20260709 13:16:03.622577  6921 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:03.631705 32192 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:16:03.636750 32165 leader_election.cc:400] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 17. Current term is 18.
I20260709 13:16:03.657143  6980 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:16:03.662168   396 raft_consensus.cc:1275] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:16:03.665596 32165 leader_election.cc:403] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:16:03.671658  6980 consensus_queue.cc:1048] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:16:03.678861 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:03.679548 32117 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 23.
I20260709 13:16:03.682518  7107 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651) with higher term. Message: Invalid argument: T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 for earlier term 17. Current term is 18.
I20260709 13:16:03.689062 32090 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:03.697592 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:03.698011 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:03.698704 32120 raft_consensus.cc:3060] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:03.700134 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:03.700783 32122 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:16:03.701206 32124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:03.703747 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:03.708447 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:03.709095 32117 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 23.
I20260709 13:16:03.723004 32122 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 18.
I20260709 13:16:03.715348 32089 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:03.726480 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:03.693876  6666 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:16:03.728732 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:03.730278 32272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d002861120de41408d48712b6bd491e1"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:36084
I20260709 13:16:03.726687 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:03.730855 32272 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:03.731123 32270 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:03.731252 32272 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:03.659198 32017 catalog_manager.cc:5697] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 16 to 18, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 18 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:16:03.733230 32271 raft_consensus.cc:2393] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 23: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:16:03.734627 32117 raft_consensus.cc:1275] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:16:03.735874  6405 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:16:03.740149  7107 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.754637  7107 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:03.763547 32269 raft_consensus.cc:1240] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Rejecting Update request from peer 94085cf341634eb686a95983b6b7f7e6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:03.766160  7116 consensus_queue.cc:1059] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:16:03.767201  7116 raft_consensus.cc:3055] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:03.767511  7116 raft_consensus.cc:740] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:16:03.763857  7107 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:03.774859 32120 raft_consensus.cc:2468] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 18.
I20260709 13:16:03.775566  7116 consensus_queue.cc:260] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:03.777894  7116 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:03.782477 32198 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:16:03.784787 32195 raft_consensus.cc:1275] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:16:03.792701 32272 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:03.804816 32195 raft_consensus.cc:1275] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:16:03.805707 32120 raft_consensus.cc:1240] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 19. Current term is 20. Ops: []
I20260709 13:16:03.794775  7102 consensus_queue.cc:1048] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:16:03.811021 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 68784.7us
I20260709 13:16:03.813374 32272 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:03.815164 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:03.816020 32195 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:03.817540 32165 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:16:03.818333  6921 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:03.818660  7107 consensus_queue.cc:1059] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:03.818696  6921 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:03.819533  7107 raft_consensus.cc:3055] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:16:03.819939  6921 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:03.819954  7107 raft_consensus.cc:740] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:16:03.820986  7107 consensus_queue.cc:260] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:03.822211  7107 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:03.826525 32271 raft_consensus.cc:1240] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 19. Current term is 20. Ops: []
I20260709 13:16:03.828336 32193 raft_consensus.cc:1275] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:16:03.740305 32017 catalog_manager.cc:5697] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 24 to 26, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 26 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:16:03.796797 32239 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:03.830134 32239 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:16:03.831171 32239 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:03.831355 32195 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 20.
I20260709 13:16:03.807206  6980 consensus_queue.cc:1048] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:03.776511 32270 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 20.
I20260709 13:16:03.832768  7015 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:03.833438  7015 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:03.833513  6980 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:03.833837  7015 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.834239  7015 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:03.834806  6921 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:03.839994  6980 consensus_queue.cc:1048] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:16:03.842299 32238 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:03.843030  6980 raft_consensus.cc:2804] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:16:03.843966 32117 raft_consensus.cc:1275] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:16:03.845322 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:03.845502 32239 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:03.845887 32117 raft_consensus.cc:3055] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:16:03.846428 32117 raft_consensus.cc:740] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:16:03.847092 32117 consensus_queue.cc:260] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:03.847929 32117 raft_consensus.cc:3060] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:03.857975 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:03.849172  7102 consensus_queue.cc:1048] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:16:03.866904 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:03.843508  6980 raft_consensus.cc:697] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:16:03.867832 32123 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:16:03.864985 32017 catalog_manager.cc:5697] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:16:03.876135 32017 catalog_manager.cc:5697] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 13 to 15, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 15 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:16:03.860606  7097 consensus_queue.cc:1048] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.023s
I20260709 13:16:03.891021  7015 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:03.893976  7015 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 24 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:03.898679 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:03.899416 32196 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:03.899257  6980 consensus_queue.cc:237] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:03.918267 32196 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 24.
I20260709 13:16:03.920102 32165 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:16:03.920199 32238 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:03.888010 32017 catalog_manager.cc:5697] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 14 to 16, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 16 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:16:03.924327 32270 raft_consensus.cc:1240] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Rejecting Update request from peer 113b5461952d47e0944d463ea4e32801 for earlier term 19. Current term is 20. Ops: []
I20260709 13:16:03.917136 32090 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:16:03.924705 32017 catalog_manager.cc:5697] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 12 to 14, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 14 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:16:03.926115  6405 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:16:03.926590  6405 raft_consensus.cc:697] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 20 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:16:03.928850 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:03.932363 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:03.934195 32017 catalog_manager.cc:5697] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 17 to 19, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 19 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:16:03.936344 32017 catalog_manager.cc:5697] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 12 to 14, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 14 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:16:03.940236 32115 raft_consensus.cc:2468] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 23.
I20260709 13:16:03.927480  7101 raft_consensus.cc:2804] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:16:03.941485  6405 consensus_queue.cc:237] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:03.944389 32165 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:16:03.961201  7100 raft_consensus.cc:2764] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 24 FOLLOWER]: Leader election decision vote started in defunct term 23: won
I20260709 13:16:03.962291  7107 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:03.968547  7103 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 LEADER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:03.961544  6992 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.007266 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:03.972186  7101 raft_consensus.cc:697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:16:03.988816  6921 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 23 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:04.018415 32117 raft_consensus.cc:2468] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 20.
I20260709 13:16:04.034039 32115 raft_consensus.cc:1275] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:16:04.062572  7134 log.cc:927] Time spent T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:16:04.025063  6992 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:04.083809  6992 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:04.049556  6921 consensus_queue.cc:1048] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:16:04.064821  7101 consensus_queue.cc:237] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:04.124148  7107 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:04.124769  7107 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:04.125038 32271 raft_consensus.cc:1275] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:16:04.128826  6995 consensus_queue.cc:1048] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:04.136895 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:04.174551 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:04.175256 32195 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 24.
I20260709 13:16:04.179209 32089 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:16:04.191351  6913 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:04.196300  6913 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.196813  6913 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:04.242118 32195 raft_consensus.cc:1275] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:16:04.250742  7094 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.262399  7094 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:16:04.270668 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 81071.8us
I20260709 13:16:04.273561 32120 raft_consensus.cc:1275] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:16:04.281571 32117 raft_consensus.cc:1275] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:16:04.281764 32190 raft_consensus.cc:1275] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:16:04.272493  7094 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:04.305527 32198 raft_consensus.cc:1275] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:16:04.272341  7015 consensus_queue.cc:1048] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:16:04.313493 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:04.314177 32193 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17.
I20260709 13:16:04.290521  7103 consensus_queue.cc:1048] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:16:04.309392  7052 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:04.353760  7145 consensus_queue.cc:1048] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.018s
W20260709 13:16:04.361817   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 102743us
I20260709 13:16:04.378700  7158 consensus_queue.cc:1048] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:16:04.381413 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 93711.5us
I20260709 13:16:04.395270 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:04.329440  7052 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:04.431270  7052 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:04.397846 32271 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 24.
W20260709 13:16:04.475538   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 45975.9us
I20260709 13:16:04.414544  7107 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:04.488284 32272 raft_consensus.cc:1275] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:16:04.501396 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:04.502491 32271 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17.
W20260709 13:16:04.515910 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 45194.7us
I20260709 13:16:04.445632  6913 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:16:04.533964   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 51515.8us
I20260709 13:16:04.539819 32192 raft_consensus.cc:1240] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:04.473879  7103 consensus_queue.cc:1048] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:16:04.568575 32191 raft_consensus.cc:1275] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:16:04.579243   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 62292.4us
I20260709 13:16:04.582360  7097 consensus_queue.cc:1048] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:16:04.587138 32193 raft_consensus.cc:1275] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:16:04.588131 32193 pending_rounds.cc:85] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801: Aborting all ops after (but not including) 10
I20260709 13:16:04.588384 32193 pending_rounds.cc:107] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:16:04.588708 32193 raft_consensus.cc:2889] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:04.635483  7152 log.cc:927] Time spent T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:16:04.646550  7142 log.cc:927] Time spent T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.430s	user 0.003s	sys 0.000s
I20260709 13:16:04.658872  6890 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:04.659632  6890 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:04.662184  6890 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:04.686177 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:04.689126 32194 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 24.
W20260709 13:16:04.685664  7127 log.cc:927] Time spent T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:16:04.759851 32238 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:04.760941  6890 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:04.768790 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:04.769470 32197 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:04.790570 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:04.805011  6405 consensus_queue.cc:1048] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:16:04.812100 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:04.804384 32089 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:16:04.821404 32121 raft_consensus.cc:1275] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:16:04.766252  6890 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:04.820601  7148 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:04.838678 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:04.839447 32165 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:04.840618 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:04.844669 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:04.845646 32115 raft_consensus.cc:2393] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 24: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:16:04.864987 32197 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 25.
I20260709 13:16:04.835199  6890 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:04.881901 32165 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:04.842859  7148 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.837183  7107 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:04.843082  6913 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 25 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:04.847719  7162 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:16:04.898548 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 53885.4us
I20260709 13:16:04.893898  7148 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:04.899006  7153 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.893489  7166 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:16:04.854341  7164 consensus_queue.cc:1048] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.070s
W20260709 13:16:04.930375 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 124180us
W20260709 13:16:04.932366 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 62259.4us
W20260709 13:16:04.945680 32162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 56197.8us
I20260709 13:16:04.952366 32089 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:16:04.925202  7072 consensus_queue.cc:1048] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:16:04.934449  7153 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:04.970885  7153 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:04.983685  7095 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:16:04.984278  7095 raft_consensus.cc:697] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 25 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:16:04.985096  7095 consensus_queue.cc:237] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:04.991039 32269 raft_consensus.cc:1275] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:16:04.991578 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:04.992132 32267 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:04.994102 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:05.061093 32117 raft_consensus.cc:3060] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:05.076270 32117 raft_consensus.cc:1275] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:16:05.082954  6890 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:16:05.085130  7176 log.cc:927] Time spent T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:16:05.089516  6980 raft_consensus.cc:1064] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:16:05.096159  7183 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:16:05.096045  6980 consensus_queue.cc:237] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 15, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:05.096804  7183 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:05.098800  7184 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:16:05.100477   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:05.101146   396 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 15.
I20260709 13:16:05.115103 32267 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 25.
I20260709 13:16:05.110356 32162 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:16:05.121829 32198 raft_consensus.cc:1275] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 24 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:16:05.123500 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:05.124351 32123 raft_consensus.cc:2393] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 24: Already voted for candidate fcfc3281929645969ecedbb0c0af759d in this term.
I20260709 13:16:05.126818  7078 consensus_queue.cc:1048] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:05.131412 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:05.132323 32270 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 15.
I20260709 13:16:05.134456  7186 consensus_queue.cc:1059] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:05.135520  7186 raft_consensus.cc:3055] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:05.135879  7186 raft_consensus.cc:740] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:16:05.136694  7186 consensus_queue.cc:260] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:05.142256  7186 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:05.099083  7183 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:16:05.167342 32238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.167764   369 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:16:05.168540  7153 raft_consensus.cc:2804] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:05.168995  7153 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.169359  7153 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:05.166754  7015 consensus_queue.cc:1048] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.014s
I20260709 13:16:05.158984  7166 raft_consensus.cc:2804] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:05.187856  7166 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:16:05.199851  7166 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:05.209483  7148 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:05.212273  7148 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:05.212450  6921 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:05.213368  6921 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:05.215371  6921 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:05.221974  6890 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 24 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:05.226297 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
W20260709 13:16:05.251549 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 59275.1us
I20260709 13:16:05.255833 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:05.256445 32270 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:05.265902 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:05.267485 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:05.267755 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:05.269625 32273 raft_consensus.cc:2393] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 15: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:16:05.277129 32195 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 24.
I20260709 13:16:05.278774 32238 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:05.277973 32165 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:05.285247 32270 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 18.
I20260709 13:16:05.259141  6921 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.289979  6995 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:05.293529  6921 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:05.307895  6921 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:05.293030  7101 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:16:05.312798 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:05.313985 32090 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:16:05.315332  7148 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:05.315846  7148 raft_consensus.cc:697] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 18 LEADER]: Becoming Leader. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:16:05.316715  7148 consensus_queue.cc:237] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:05.329073   396 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [term 19 LEARNER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:16:05.331691  6890 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:16:05.333057  7101 raft_consensus.cc:697] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:16:05.334050  7101 consensus_queue.cc:237] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:05.335080  7166 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:05.338282 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:05.342176 32190 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:16:05.276777  7153 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:05.350989  7050 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:16:05.354194  7191 log.cc:927] Time spent T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:16:05.357120 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:05.357910 32190 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:05.372355 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:05.373528 32273 raft_consensus.cc:3060] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:05.387140 32190 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 16.
I20260709 13:16:05.389230   368 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:16:05.371552  7153 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:05.390581 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:05.399334  7116 raft_consensus.cc:2804] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:05.399986  7116 raft_consensus.cc:697] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 16 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:16:05.401010  7116 consensus_queue.cc:237] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:05.397207 32165 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:05.411612  6921 raft_consensus.cc:2749] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:05.432036 32273 raft_consensus.cc:2468] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 16.
I20260709 13:16:05.447721 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:05.441812  7166 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:05.450836 32196 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:05.462491 32019 catalog_manager.cc:5697] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:05.466207   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:16:05.471390 32162 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:05.464242 32019 catalog_manager.cc:5697] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 18 to 20, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 20 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:05.479724 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 80417.4us
I20260709 13:16:05.487391  7166 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:16:05.494724 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 78728.2us
I20260709 13:16:05.479862 32019 catalog_manager.cc:5697] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 20 to 22, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 22 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:05.505286 32019 catalog_manager.cc:5697] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 18 to 19, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 19 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:16:05.506757 32019 catalog_manager.cc:5697] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 17 to 19, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 19 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:05.511989 32196 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 18.
I20260709 13:16:05.476424 32017 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49550 (request call id 319) took 5850 ms. Trace:
I20260709 13:16:05.518258 32017 rpcz_store.cc:276] 0709 13:15:59.630515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.648161 (+ 17646us) service_pool.cc:224] Handling call
0709 13:16:05.476353 (+5828192us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:04.265947 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:04.266565 (+   618us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:04.266605 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:16:04.266624 (+    19us) tablet.cc:662] Decoding operations
0709 13:16:04.299637 (+ 33013us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:04.308881 (+  9244us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:04.311418 (+  2537us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:16:04.424830 (+113412us) tablet.cc:701] Row locks acquired
0709 13:16:04.424848 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:16:04.425032 (+   184us) write_op.cc:270] Start()
0709 13:16:04.425164 (+   132us) write_op.cc:276] Timestamp: P: 1783602964424976 usec, L: 0
0709 13:16:04.425182 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:16:04.425907 (+   725us) log.cc:844] Serialized 3210 byte log entry
0709 13:16:04.809992 (+384085us) op_driver.cc:464] REPLICATION: finished
0709 13:16:05.054520 (+244528us) write_op.cc:301] APPLY: starting
0709 13:16:05.054632 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:05.162980 (+108348us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:05.163081 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:05.183325 (+ 20244us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:05.189118 (+  5793us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:16:05.192075 (+  2957us) write_op.cc:312] APPLY: finished
0709 13:16:05.221990 (+ 29915us) log.cc:844] Serialized 81 byte log entry
0709 13:16:05.222170 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:05.222289 (+   119us) write_op.cc:454] Released schema lock
0709 13:16:05.222341 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:05.275883 (+ 53542us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:05.279155 (+  3272us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":30,"spinlock_wait_cycles":25984,"child_traces":[["op",{"apply.queue_time_us":176759,"apply.run_cpu_time_us":13292,"apply.run_wall_time_us":212830,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37647,"num_ops":8,"prepare.queue_time_us":234416,"prepare.run_cpu_time_us":36831,"prepare.run_wall_time_us":262931,"raft.queue_time_us":187958,"raft.run_cpu_time_us":14164,"raft.run_wall_time_us":165868,"replication_time_us":337686,"thread_start_us":339721,"threads_started":4,"wal-append.queue_time_us":141845}]]}
I20260709 13:16:05.538784  7101 raft_consensus.cc:2955] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 19 LEADER]: Committing config change with OpId 19.17: config changed from index 15 to 17, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:05.540653   396 raft_consensus.cc:2955] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Committing config change with OpId 19.17: config changed from index 15 to 17, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:05.556806 32193 raft_consensus.cc:2955] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Committing config change with OpId 19.17: config changed from index 15 to 17, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:05.585444 32273 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 25 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:16:05.594259  7159 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:16:05.658490 32196 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 25 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:16:05.671437  6666 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:16:05.657428 32122 raft_consensus.cc:2955] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Committing config change with OpId 19.17: config changed from index 15 to 17, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:05.708906 32019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59534 (request call id 188) took 2135 ms. Trace:
I20260709 13:16:05.709342 32019 rpcz_store.cc:276] 0709 13:16:03.573808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.580657 (+  6849us) service_pool.cc:224] Handling call
0709 13:16:05.708837 (+2128180us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:05.606856 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:05.607438 (+   582us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:05.607474 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:16:05.607491 (+    17us) tablet.cc:662] Decoding operations
0709 13:16:05.608288 (+   797us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:05.608377 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:05.608410 (+    33us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:16:05.637879 (+ 29469us) tablet.cc:701] Row locks acquired
0709 13:16:05.637898 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:16:05.638069 (+   171us) write_op.cc:270] Start()
0709 13:16:05.638197 (+   128us) write_op.cc:276] Timestamp: P: 1783602965638017 usec, L: 0
0709 13:16:05.638220 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:16:05.639018 (+   798us) log.cc:844] Serialized 2100 byte log entry
0709 13:16:05.657618 (+ 18600us) op_driver.cc:464] REPLICATION: finished
0709 13:16:05.660323 (+  2705us) write_op.cc:301] APPLY: starting
0709 13:16:05.660413 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:05.663416 (+  3003us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:05.663522 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:05.697161 (+ 33639us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:05.697347 (+   186us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:16:05.697389 (+    42us) write_op.cc:312] APPLY: finished
0709 13:16:05.697607 (+   218us) log.cc:844] Serialized 57 byte log entry
0709 13:16:05.697764 (+   157us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:05.697858 (+    94us) write_op.cc:454] Released schema lock
0709 13:16:05.697895 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:05.698255 (+   360us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:05.698283 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":21148,"reported_tablets":7,"spinlock_wait_cycles":379776,"child_traces":[["op",{"apply.queue_time_us":2450,"apply.run_cpu_time_us":7809,"apply.run_wall_time_us":37878,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20950,"num_ops":5,"prepare.queue_time_us":96409,"prepare.run_cpu_time_us":3722,"prepare.run_wall_time_us":32500,"replication_time_us":19240,"thread_start_us":121383,"threads_started":1}]]}
I20260709 13:16:05.724041 32016 catalog_manager.cc:5697] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 10 to 12, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 12 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:05.728345 32016 catalog_manager.cc:5697] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 18 to 21, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 21 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:05.734237 32016 catalog_manager.cc:5697] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 20 to 23, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 23 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:05.736291 32016 catalog_manager.cc:5697] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 15 to 17, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 17 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:16:05.738755 32016 catalog_manager.cc:5697] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 17 to 18, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 18 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:05.741761 32016 catalog_manager.cc:5697] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 19 to 22, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 22 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:05.739521  7182 raft_consensus.cc:476] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 LEADER]: Not starting pre-election -- already a leader
I20260709 13:16:05.744287 32016 catalog_manager.cc:5697] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:05.805594 32019 catalog_manager.cc:5697] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 15 to 16, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 16 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:05.807133 32019 catalog_manager.cc:5697] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 15 to 17, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:05.808728 32019 catalog_manager.cc:5697] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:05.828750  6666 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.829349  6666 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:05.833474 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 25 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:05.834453 32196 raft_consensus.cc:2410] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcfc3281929645969ecedbb0c0af759d for term 25 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:16:05.831449  6666 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:05.845338 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 25 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:05.854220 32090 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:05.855296  6666 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:05.856534 32273 raft_consensus.cc:1275] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:16:05.858955  6824 consensus_queue.cc:1048] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:05.867964 32196 raft_consensus.cc:1275] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 24 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:16:05.875181 32196 raft_consensus.cc:1275] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:16:05.866200 32022 catalog_manager.cc:5697] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 12 to 13, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 13 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:16:05.883288  7148 consensus_queue.cc:1048] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:16:05.880025  7182 consensus_queue.cc:1048] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:16:05.899483 32022 catalog_manager.cc:5697] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 16 to 19, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 19 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:05.902072 32122 raft_consensus.cc:1275] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:16:05.915408  7145 consensus_queue.cc:1048] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:16:05.938681 32022 catalog_manager.cc:5697] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 18 to 19, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 19 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:05.947525 32016 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49534 (request call id 321) took 4959 ms. Trace:
I20260709 13:16:05.955397 32022 catalog_manager.cc:5697] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 19 to 21, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 21 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:05.948176 32016 rpcz_store.cc:276] 0709 13:16:00.987953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.988216 (+   263us) service_pool.cc:224] Handling call
0709 13:16:02.144249 (+1156033us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b5400047c54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5b090 00007fb59eff9f3a 00007fb5a4db01cc 00007fb5a4eae37e 00007fb5a336f2a4 00007fb5a336f232 00007fb5a336f161 00007fb5a336f0dc 00007fb5a336e392 00007fb59d32c48c 00007fb59d32b8c6
0709 13:16:05.947377 (+3803128us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:05.749527 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:05.750122 (+   595us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:05.750165 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:16:05.750182 (+    17us) tablet.cc:662] Decoding operations
0709 13:16:05.751038 (+   856us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:05.751114 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:05.751147 (+    33us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:16:05.751829 (+   682us) tablet.cc:701] Row locks acquired
0709 13:16:05.751847 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:16:05.752001 (+   154us) write_op.cc:270] Start()
0709 13:16:05.752116 (+   115us) write_op.cc:276] Timestamp: P: 1783602965751952 usec, L: 0
0709 13:16:05.752140 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:16:05.754888 (+  2748us) log.cc:844] Serialized 2828 byte log entry
0709 13:16:05.761025 (+  6137us) op_driver.cc:464] REPLICATION: finished
0709 13:16:05.761357 (+   332us) write_op.cc:301] APPLY: starting
0709 13:16:05.761445 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:05.766190 (+  4745us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:05.766282 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:05.771467 (+  5185us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:05.771650 (+   183us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:16:05.771697 (+    47us) write_op.cc:312] APPLY: finished
0709 13:16:05.771956 (+   259us) log.cc:844] Serialized 73 byte log entry
0709 13:16:05.772128 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:05.772241 (+   113us) write_op.cc:454] Released schema lock
0709 13:16:05.772286 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:05.772668 (+   382us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:05.772702 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":29060,"reported_tablets":33,"spinlock_wait_cycles":410042752,"child_traces":[["op",{"apply.queue_time_us":112,"apply.run_cpu_time_us":10281,"apply.run_wall_time_us":11262,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29330,"num_ops":7,"prepare.queue_time_us":138,"prepare.run_cpu_time_us":3661,"prepare.run_wall_time_us":7577,"replication_time_us":8733}]]}
I20260709 13:16:05.978358 32120 consensus_queue.cc:237] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:06.020881 32273 raft_consensus.cc:1275] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:16:06.023835  7169 consensus_queue.cc:1048] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:06.047180 32190 raft_consensus.cc:1275] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:16:06.069844 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:06.125675  7116 consensus_queue.cc:1048] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:16:06.158038  7211 log.cc:927] Time spent T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:16:06.163089   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 76100.7us
W20260709 13:16:06.358610 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 270193us
I20260709 13:16:06.366969   396 raft_consensus.cc:1275] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:16:06.392223  7213 log.cc:927] Time spent T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.238s	user 0.005s	sys 0.000s
I20260709 13:16:06.456539 32017 catalog_manager.cc:5697] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 18 to 20, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 20 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:16:06.492322 32017 catalog_manager.cc:5697] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 17 to 18, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 18 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:16:06.533448 32193 raft_consensus.cc:1275] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:16:06.554453  7226 consensus_queue.cc:1048] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:06.576968  7145 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.582935 32115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:53200
I20260709 13:16:06.583683 32115 raft_consensus.cc:606] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 20 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:16:06.606267 32115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "375545897daf43fa925e7b181b2a634b"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:53200
I20260709 13:16:06.606948 32115 raft_consensus.cc:606] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 18 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:16:06.608644 32022 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49556 (request call id 320) took 3348 ms. Trace:
I20260709 13:16:06.613407 32017 catalog_manager.cc:5697] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 21 to 22, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 22 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:16:06.625751  7225 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:06.627120  7225 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:06.629202  7225 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:06.636381  7235 consensus_queue.cc:1048] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:06.647050 32115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:53200
I20260709 13:16:06.647648 32115 raft_consensus.cc:606] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:06.651121 32115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:53200
I20260709 13:16:06.651685 32115 raft_consensus.cc:606] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:16:06.657534 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:06.658706 32115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:53200
I20260709 13:16:06.659286 32115 raft_consensus.cc:606] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 13 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:16:06.609342 32022 rpcz_store.cc:276] 0709 13:16:03.260298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.270564 (+ 10266us) service_pool.cc:224] Handling call
0709 13:16:03.402911 (+132347us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b5400047c54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5b090 00007fb59eff9f3a 00007fb5a4db01cc 00007fb5a4eae37e 00007fb5a336f2a4 00007fb5a336f232 00007fb5a336f161 00007fb5a336f0dc 00007fb5a336e392 00007fb59d32c48c 00007fb59d32b8c6
0709 13:16:06.608546 (+3205635us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:06.003076 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:06.003621 (+   545us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:06.003654 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:16:06.003670 (+    16us) tablet.cc:662] Decoding operations
0709 13:16:06.021517 (+ 17847us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:06.021575 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:06.021603 (+    28us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:16:06.021998 (+   395us) tablet.cc:701] Row locks acquired
0709 13:16:06.022018 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:16:06.022164 (+   146us) write_op.cc:270] Start()
0709 13:16:06.022275 (+   111us) write_op.cc:276] Timestamp: P: 1783602966022120 usec, L: 0
0709 13:16:06.022300 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:16:06.023835 (+  1535us) log.cc:844] Serialized 1682 byte log entry
0709 13:16:06.028984 (+  5149us) op_driver.cc:464] REPLICATION: finished
0709 13:16:06.029342 (+   358us) write_op.cc:301] APPLY: starting
0709 13:16:06.029423 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:06.031886 (+  2463us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:06.031987 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:06.037116 (+  5129us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:06.037323 (+   207us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:16:06.037380 (+    57us) write_op.cc:312] APPLY: finished
0709 13:16:06.037628 (+   248us) log.cc:844] Serialized 49 byte log entry
0709 13:16:06.044307 (+  6679us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:06.065242 (+ 20935us) write_op.cc:454] Released schema lock
0709 13:16:06.077576 (+ 12334us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:06.091908 (+ 14332us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:06.091969 (+    61us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8787,"reported_tablets":34,"spinlock_wait_cycles":7232768,"child_traces":[["op",{"apply.queue_time_us":141,"apply.run_cpu_time_us":7189,"apply.run_wall_time_us":56814,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16760,"num_ops":4,"prepare.queue_time_us":113,"prepare.run_cpu_time_us":3340,"prepare.run_wall_time_us":26464,"replication_time_us":6534}]]}
I20260709 13:16:06.665998 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:06.702194 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:06.666466 32017 catalog_manager.cc:5697] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 19 to 20, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 20 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:16:06.703408 32017 catalog_manager.cc:5697] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 18 to 20, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to fcfc3281929645969ecedbb0c0af759d (127.30.63.1). New cstate: current_term: 20 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:16:06.705058 32017 catalog_manager.cc:5697] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 13 to 18, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 18 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:16:06.706570 32017 catalog_manager.cc:5697] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
W20260709 13:16:06.678532 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 125979us
I20260709 13:16:06.577534  7145 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:06.710374  7145 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:06.710997 32270 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17.
I20260709 13:16:06.714033 32090 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:16:06.714924  7078 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:06.715426  7078 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:06.715901  7078 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:06.719353  6995 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.719931  6995 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:06.722177  6995 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:06.726879 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:06.729334 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:06.730098 32270 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 17.
I20260709 13:16:06.736235 32165 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:06.738001  6995 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:06.738478  6995 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.738881  6995 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:16:06.748997 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 371824us
I20260709 13:16:06.755681 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
W20260709 13:16:06.762564 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 210054us
I20260709 13:16:06.708117 32017 catalog_manager.cc:5697] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 22 to 24, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 24 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:16:06.770994 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:06.770761 32017 catalog_manager.cc:5697] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:16:06.778501 32017 catalog_manager.cc:5697] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 17 to 19, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 19 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:06.849207   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 69558.6us
I20260709 13:16:06.748508  6995 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:06.764678  7078 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:06.858305  7078 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:06.859517 32115 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 17.
I20260709 13:16:06.881458 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:06.894526  6824 raft_consensus.cc:993] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:16:06.894850  7148 raft_consensus.cc:993] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:16:06.895100  6824 raft_consensus.cc:1081] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:16:06.895314  7148 raft_consensus.cc:1081] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 13 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:16:06.899184 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:06.911540 32196 raft_consensus.cc:2393] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3ed521ce8947db80c4b4828b355c06 in current term 18: Already voted for candidate 113b5461952d47e0944d463ea4e32801 in this term.
I20260709 13:16:06.914776 32194 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54172
I20260709 13:16:06.915371 32194 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:06.915740 32194 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:06.916006   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 66243.3us
I20260709 13:16:06.917502 32192 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54172
I20260709 13:16:06.918054 32192 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:06.918524 32192 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:06.942714 32115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:06.943497 32115 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:06.947741 32194 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:16:06.944918 32192 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:06.960155 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:06.971524 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:06.971565 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:06.973227 32120 raft_consensus.cc:3055] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:06.973609 32120 raft_consensus.cc:740] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:16:06.975797 32192 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:06.983457 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:06.984283 32267 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:06.991537 32194 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:06.992668 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:06.999778 32268 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:07.018561 32162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 59960.8us
I20260709 13:16:07.026400 32270 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17.
I20260709 13:16:07.027230 32268 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:16:07.008838 32120 consensus_queue.cc:260] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:16:07.029829 32165 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:07.029454 32115 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
I20260709 13:16:07.030799 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:07.036024 32273 raft_consensus.cc:3060] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:07.037895 32267 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 20.
I20260709 13:16:07.042706 32120 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:07.030745  7233 raft_consensus.cc:993] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:16:07.041097  7229 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:07.051319  7229 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:07.054610  7229 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:07.059652 32273 raft_consensus.cc:2468] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
I20260709 13:16:07.061156  7221 raft_consensus.cc:2804] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:07.061751  7221 raft_consensus.cc:697] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:16:07.062645  7221 consensus_queue.cc:237] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } }
I20260709 13:16:07.030813  6995 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:07.076813 32120 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:16:07.085160 32123 raft_consensus.cc:3055] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:16:07.079612 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 73740.7us
I20260709 13:16:07.095147 32123 raft_consensus.cc:740] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
W20260709 13:16:07.101294   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 144025us
W20260709 13:16:07.102329 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 74657.8us
I20260709 13:16:07.077606  7233 raft_consensus.cc:1081] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 18 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
W20260709 13:16:07.105405 32088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:07.108909 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 79157.6us
I20260709 13:16:07.110111 32165 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:16:07.103480 32123 consensus_queue.cc:260] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:07.111507 32123 raft_consensus.cc:3060] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:07.111995 32165 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:16:07.124136 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 44808.2us
I20260709 13:16:07.129297 32090 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:16:07.123692  7245 raft_consensus.cc:2804] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:07.125669  7246 raft_consensus.cc:2804] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:16:07.135113 32238 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:07.137737  7245 raft_consensus.cc:697] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:16:07.138775  7245 consensus_queue.cc:237] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:07.142798  7246 raft_consensus.cc:697] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 20 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:16:07.143738  7246 consensus_queue.cc:237] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:07.149626  7228 raft_consensus.cc:993] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d: : Instructing follower 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:16:07.150154  7228 raft_consensus.cc:1081] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Signalling peer 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:16:07.154381  7226 raft_consensus.cc:2955] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:07.155453 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:07.155840  7225 raft_consensus.cc:2764] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260709 13:16:07.164340  7242 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:07.174472 32272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:36084
I20260709 13:16:07.175199 32272 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:07.175529 32272 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:07.164248 32123 raft_consensus.cc:2468] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 20.
I20260709 13:16:07.183746 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:07.191684   369 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:07.209424 32199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "375545897daf43fa925e7b181b2a634b"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54172
I20260709 13:16:07.210179 32199 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:07.210808 32199 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:16:07.214169 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 76508.1us
I20260709 13:16:07.222622 32272 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:07.234079 32272 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:07.241344 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:07.247782 32191 raft_consensus.cc:2955] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:07.257390   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:16:07.258016   399 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:07.263414  7226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:56870 (request call id 76) took 1295 ms. Trace:
I20260709 13:16:07.263875  7226 rpcz_store.cc:276] 0709 13:16:05.954984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.955506 (+   522us) service_pool.cc:224] Handling call
0709 13:16:05.975975 (+ 20469us) spinlock_profiling.cc:243] Waited 5.68 ms on lock 0x7b54000f4ea0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59ef6e520 00007fb59eff7b42 00007fb59eff6800 00007fb59efef9fa 00007fb5a3fb74c9 00007fb59d533c54 00007fb59d533be2 00007fb59d533b11 00007fb59d533a8c 00007fb59d532d42
0709 13:16:05.992434 (+ 16459us) log.cc:844] Serialized 487 byte log entry
0709 13:16:07.248425 (+1255991us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":3314,"raft.queue_time_us":78003,"raft.run_cpu_time_us":2128,"raft.run_wall_time_us":172456,"spinlock_wait_cycles":13065984,"thread_start_us":311408,"threads_started":2,"wal-append.queue_time_us":208592}
I20260709 13:16:07.266052  7148 raft_consensus.cc:993] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:16:07.266705 32199 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:07.271339 32199 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:07.248956  7250 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:07.287295   399 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 18.
I20260709 13:16:07.289736 32236 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:16:07.290551  7240 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:07.291159  7240 raft_consensus.cc:697] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:16:07.292150  7240 consensus_queue.cc:237] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:07.293056 32009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0717a2686ee346b7a5a183e36fdfd173 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:07.305073  7148 raft_consensus.cc:1081] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 20 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
W20260709 13:16:07.306630 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 61509.7us
I20260709 13:16:07.316756 32120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:07.317602 32120 raft_consensus.cc:3055] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:07.317981 32120 raft_consensus.cc:740] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:16:07.318884 32120 consensus_queue.cc:260] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:07.320465 32120 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:07.328292 32190 raft_consensus.cc:1240] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 20 LEADER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 19. Current term is 20. Ops: []
I20260709 13:16:07.335690 32120 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 18.
I20260709 13:16:07.340019 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:07.342638 32266 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:07.341027 32117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:07.344976 32117 raft_consensus.cc:3055] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:16:07.345350 32117 raft_consensus.cc:740] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:16:07.346196 32117 consensus_queue.cc:260] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:07.347086 32199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54172
I20260709 13:16:07.347626 32199 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:07.348050 32199 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:07.347431 32117 raft_consensus.cc:3060] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:16:07.357368 32090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.359290 32199 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:07.361194 32199 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:07.364519 32117 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 19.
I20260709 13:16:07.364810 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:07.378168 32265 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:07.364791 32266 raft_consensus.cc:2468] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 19.
I20260709 13:16:07.382057 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:07.382592 32123 raft_consensus.cc:3055] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:16:07.382886 32123 raft_consensus.cc:740] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:16:07.386613 32123 consensus_queue.cc:260] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:07.387506 32123 raft_consensus.cc:3060] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:07.398263 32123 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 21.
I20260709 13:16:07.401551 32265 raft_consensus.cc:2468] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 21.
I20260709 13:16:07.407725 32165 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:16:07.421060 32165 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:16:07.427771  7246 raft_consensus.cc:2804] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:16:07.441650  7246 raft_consensus.cc:697] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 19 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:16:07.442584  7246 consensus_queue.cc:237] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:07.428928  7245 raft_consensus.cc:2804] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:16:07.447021  7245 raft_consensus.cc:697] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 21 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:16:07.447871  7245 consensus_queue.cc:237] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:07.439333   395 raft_consensus.cc:2955] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:07.487423  7240 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:07.487987  7240 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:07.500491   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:07.502229  7240 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:07.503688 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:07.507601 32123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:07.509502 32239 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:07.517153  7240 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:07.542276 32019 catalog_manager.cc:5697] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 11 to 12, VOTER 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) evicted. New cstate: current_term: 13 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:07.576363 32265 raft_consensus.cc:1275] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:16:07.583143 32017 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49550 (request call id 320) took 1887 ms. Trace:
I20260709 13:16:07.580144  7246 consensus_queue.cc:1048] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 13:16:07.582783 32016 catalog_manager.cc:5697] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:16:07.585542 32016 catalog_manager.cc:5697] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:16:07.587642 32016 catalog_manager.cc:5697] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 22 to 24, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 24 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:07.594816 32259 tablet_service.cc:1558] Processing DeleteTablet for tablet 0717a2686ee346b7a5a183e36fdfd173 with delete_type TABLET_DATA_TOMBSTONED (TS 6b3ed521ce8947db80c4b4828b355c06 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:45768
I20260709 13:16:07.584264 32017 rpcz_store.cc:276] 0709 13:16:05.693767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.693919 (+   152us) service_pool.cc:224] Handling call
0709 13:16:07.580896 (+1886977us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:07.064518 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:07.097690 (+ 33172us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:07.097728 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:16:07.097748 (+    20us) tablet.cc:662] Decoding operations
0709 13:16:07.098716 (+   968us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:07.098773 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:07.098801 (+    28us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:16:07.099846 (+  1045us) tablet.cc:701] Row locks acquired
0709 13:16:07.099870 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:16:07.100058 (+   188us) write_op.cc:270] Start()
0709 13:16:07.100188 (+   130us) write_op.cc:276] Timestamp: P: 1783602967100007 usec, L: 0
0709 13:16:07.100213 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:16:07.123959 (+ 23746us) log.cc:844] Serialized 3974 byte log entry
0709 13:16:07.429821 (+305862us) op_driver.cc:464] REPLICATION: finished
0709 13:16:07.481870 (+ 52049us) write_op.cc:301] APPLY: starting
0709 13:16:07.481950 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:07.500577 (+ 18627us) spinlock_profiling.cc:243] Waited 983 us on lock 0x7b180029d2e0. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb5a4dccde1 00007fb5a4dd95b1 00007fb59bf04522 00007fb59bf067c1 00007fb59bf06779 00007fb59bf06709 00007fb59bf066d1 00007fb59bf059cd 000000000038f354 000000000038f199 00007fb59bee783a
0709 13:16:07.522661 (+ 22084us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:07.522691 (+    30us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:07.538528 (+ 15837us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:07.538809 (+   281us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:16:07.538873 (+    64us) write_op.cc:312] APPLY: finished
0709 13:16:07.539193 (+   320us) log.cc:844] Serialized 97 byte log entry
0709 13:16:07.540773 (+  1580us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:07.540934 (+   161us) write_op.cc:454] Released schema lock
0709 13:16:07.540983 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:07.544815 (+  3832us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:07.544847 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":195864,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":51804,"apply.run_cpu_time_us":14628,"apply.run_wall_time_us":59552,"cfile_cache_hit":42,"cfile_cache_hit_bytes":46027,"num_ops":10,"prepare.queue_time_us":203604,"prepare.run_cpu_time_us":19502,"prepare.run_wall_time_us":164109,"raft.queue_time_us":102462,"raft.run_cpu_time_us":4013,"raft.run_wall_time_us":53980,"replication_time_us":329470,"spinlock_wait_cycles":2343552,"thread_start_us":414395,"threads_started":4,"wal-append.queue_time_us":198267}]]}
I20260709 13:16:07.607754 32117 raft_consensus.cc:1275] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:16:07.611420  7246 consensus_queue.cc:1048] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:07.619148 32117 raft_consensus.cc:1275] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:16:07.622723  7246 consensus_queue.cc:1048] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:07.641438 32265 raft_consensus.cc:1275] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:16:07.654842  7245 consensus_queue.cc:1048] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:07.671626 32266 raft_consensus.cc:1275] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:16:07.674764  7246 consensus_queue.cc:1048] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:07.700078 32268 consensus_queue.cc:237] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:07.715106 32120 raft_consensus.cc:1275] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:16:07.717736 32022 catalog_manager.cc:5697] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d reported cstate change: term changed from 15 to 16, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 16 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } }
I20260709 13:16:07.724086 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:07.747267  7268 tablet_replica.cc:333] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:07.748467  7268 raft_consensus.cc:2243] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:07.749369  7268 raft_consensus.cc:2272] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.739954  7242 consensus_queue.cc:1048] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:16:07.838985  7268 ts_tablet_manager.cc:1916] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:16:07.891465  7258 log.cc:927] Time spent T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:16:07.971375 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 137102us
I20260709 13:16:07.974243   399 raft_consensus.cc:1275] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:16:07.994135   399 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 19 index: 18. (index mismatch)
I20260709 13:16:08.002799  7145 consensus_queue.cc:1048] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:08.004074 32120 raft_consensus.cc:1275] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:16:08.008082  7231 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:16:08.010532 32120 raft_consensus.cc:1275] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:16:08.029912 32120 raft_consensus.cc:1275] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:16:08.076913  7278 consensus_queue.cc:1048] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:08.078989  7278 consensus_queue.cc:1048] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:16:08.080842  7221 consensus_queue.cc:1048] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:08.098093  7240 raft_consensus.cc:2955] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 19 LEADER]: Committing config change with OpId 19.18: config changed from index 17 to 18, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:08.116091 32265 raft_consensus.cc:1275] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:16:08.128904 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 254642us
I20260709 13:16:08.129567   395 raft_consensus.cc:2955] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Committing config change with OpId 19.18: config changed from index 17 to 18, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:16:08.165369  7295 log.cc:927] Time spent T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:16:08.173440 32009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet afb482e4812e47d0a501b142e64cb73b with cas_config_opid_index 17: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:08.148751  7286 consensus_queue.cc:1048] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
W20260709 13:16:08.279788 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 390546us
W20260709 13:16:08.311017 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 181371us
I20260709 13:16:08.341234 32120 raft_consensus.cc:1275] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 19 index: 18. (index mismatch)
I20260709 13:16:08.369433 32022 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49534 (request call id 322) took 1478 ms. Trace:
I20260709 13:16:08.370286 32017 catalog_manager.cc:5697] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 18 to 19, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 19 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:08.372434  7268 ts_tablet_manager.cc:1929] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.11
I20260709 13:16:08.384507 32017 catalog_manager.cc:5697] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 20 to 21, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 21 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:08.397724 32017 catalog_manager.cc:5697] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 13 to 14, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 14 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:08.369889 32022 rpcz_store.cc:276] 0709 13:16:06.891141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.909094 (+ 17953us) service_pool.cc:224] Handling call
0709 13:16:07.234048 (+324954us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400047c54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5b090 00007fb59eff9f3a 00007fb5a4db01cc 00007fb5a4eae37e 00007fb5a336f2a4 00007fb5a336f232 00007fb5a336f161 00007fb5a336f0dc 00007fb5a336e392 00007fb59d32c48c 00007fb59d32b8c6
0709 13:16:08.369365 (+1135317us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:07.761159 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:07.844398 (+ 83239us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:07.874761 (+ 30363us) write_op.cc:435] Acquired schema lock
0709 13:16:07.878091 (+  3330us) tablet.cc:662] Decoding operations
0709 13:16:07.899698 (+ 21607us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:07.899760 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:07.899791 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:16:07.899989 (+   198us) tablet.cc:701] Row locks acquired
0709 13:16:07.900004 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:16:07.900154 (+   150us) write_op.cc:270] Start()
0709 13:16:07.900271 (+   117us) write_op.cc:276] Timestamp: P: 1783602967900110 usec, L: 0
0709 13:16:07.900293 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:16:07.900971 (+   678us) log.cc:844] Serialized 535 byte log entry
0709 13:16:07.956872 (+ 55901us) op_driver.cc:464] REPLICATION: finished
0709 13:16:07.968649 (+ 11777us) write_op.cc:301] APPLY: starting
0709 13:16:07.971496 (+  2847us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:07.978358 (+  6862us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:07.978448 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:07.979123 (+   675us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:07.979268 (+   145us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:16:07.979312 (+    44us) write_op.cc:312] APPLY: finished
0709 13:16:07.979505 (+   193us) log.cc:844] Serialized 25 byte log entry
0709 13:16:07.979673 (+   168us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:07.979748 (+    75us) write_op.cc:454] Released schema lock
0709 13:16:07.979782 (+    34us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:07.989623 (+  9841us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:07.989673 (+    50us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":27,"spinlock_wait_cycles":279531904,"child_traces":[["op",{"apply.queue_time_us":364,"apply.run_cpu_time_us":2722,"apply.run_wall_time_us":12704,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4190,"num_ops":1,"prepare.queue_time_us":1612,"prepare.run_cpu_time_us":3410,"prepare.run_wall_time_us":155831,"replication_time_us":56374}]]}
I20260709 13:16:08.375321 32019 catalog_manager.cc:5697] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 17 to 18, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 18 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:08.403332 32017 catalog_manager.cc:5697] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 19 to 20, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 20 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:08.405711 32017 catalog_manager.cc:5697] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 16 to 18, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 18 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:08.436478   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 121879us
W20260709 13:16:08.467973 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 86346.2us
I20260709 13:16:08.509083  7285 consensus_queue.cc:1048] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:16:08.509944 32265 raft_consensus.cc:1275] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:16:08.448999  7268 log.cc:1199] T 0717a2686ee346b7a5a183e36fdfd173 P 6b3ed521ce8947db80c4b4828b355c06: Deleting WAL directory at /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-2-root/wals/0717a2686ee346b7a5a183e36fdfd173
W20260709 13:16:08.550045   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 377118us
W20260709 13:16:08.722028   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 166125us
I20260709 13:16:08.723665  7268 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45768 (request call id 20) took 1129 ms. Trace:
I20260709 13:16:08.724382  7268 rpcz_store.cc:276] 0709 13:16:07.594235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.594543 (+   308us) service_pool.cc:224] Handling call
0709 13:16:07.746905 (+152362us) ts_tablet_manager.cc:1151] Deleting tablet 0717a2686ee346b7a5a183e36fdfd173
0709 13:16:07.746996 (+    91us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:16:08.314476 (+567480us) tablet_metadata.cc:665] Metadata flushed
0709 13:16:08.372293 (+ 57817us) tablet_metadata.cc:665] Metadata flushed
0709 13:16:08.723555 (+351262us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":151319,"thread_start_us":126816,"threads_started":1}
I20260709 13:16:08.726558 32118 raft_consensus.cc:2955] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Committing config change with OpId 19.18: config changed from index 17 to 18, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:16:08.730690   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 170651us
I20260709 13:16:08.736478 32009 catalog_manager.cc:5028] TS 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): tablet 0717a2686ee346b7a5a183e36fdfd173 (table test-workload [id=9b9dc20f98e547b59efac9c530f28125]) successfully deleted
W20260709 13:16:08.773566 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 214504us
W20260709 13:16:08.803458  7294 log.cc:927] Time spent T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.073s	user 0.003s	sys 0.000s
I20260709 13:16:08.915125 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:08.915649 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 90803.5us
W20260709 13:16:08.933008 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 107511us
I20260709 13:16:08.942983  7277 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:08.954774  7277 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:16:08.975299 32090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 58466.3us
I20260709 13:16:08.983068  7278 consensus_queue.cc:1048] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:16:09.006394  7277 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:09.008826 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:09.010360 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "fcfc3281929645969ecedbb0c0af759d" is_pre_election: true
I20260709 13:16:09.013499 32165 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:09.019654   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:09.018383  7284 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:16:09.029136   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 52489.6us
W20260709 13:16:09.069185  7318 log.cc:927] Time spent T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:16:09.103415 32118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "002126350f9348faac039e490fafb4d7"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:53200
I20260709 13:16:09.103988 32118 raft_consensus.cc:606] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 16 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:16:09.136600 32122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10940646da924abea9f371781da8acee"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:53200
I20260709 13:16:09.137195 32122 raft_consensus.cc:606] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 20 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:16:09.142779 32122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:53200
I20260709 13:16:09.143548 32122 raft_consensus.cc:606] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:16:09.143939 32122 raft_consensus.cc:614] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:09.146653 32118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afc0578da01e4736bf535c5df1439723"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:53200
I20260709 13:16:09.147437 32118 raft_consensus.cc:606] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:16:09.150097 32118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:53200
I20260709 13:16:09.150825 32118 raft_consensus.cc:606] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:16:09.152216 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:09.153869 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:09.164944  7289 raft_consensus.cc:993] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:16:09.165495  7289 raft_consensus.cc:1081] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 16 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:16:09.166965 32199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "002126350f9348faac039e490fafb4d7"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54172
I20260709 13:16:09.167416 32199 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:09.167708 32199 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:09.178678 32019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59534 (request call id 193) took 1047 ms. Trace:
I20260709 13:16:09.179073 32019 rpcz_store.cc:276] 0709 13:16:08.131718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.131928 (+   210us) service_pool.cc:224] Handling call
0709 13:16:09.178600 (+1046672us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:08.727611 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:08.728215 (+   604us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:08.728248 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:16:08.728266 (+    18us) tablet.cc:662] Decoding operations
0709 13:16:08.772030 (+ 43764us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:08.772104 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:08.772136 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:16:08.772361 (+   225us) tablet.cc:701] Row locks acquired
0709 13:16:08.772377 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:16:08.772533 (+   156us) write_op.cc:270] Start()
0709 13:16:08.772682 (+   149us) write_op.cc:276] Timestamp: P: 1783602968772482 usec, L: 0
0709 13:16:08.772709 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:16:08.819952 (+ 47243us) log.cc:844] Serialized 530 byte log entry
0709 13:16:09.122336 (+302384us) op_driver.cc:464] REPLICATION: finished
0709 13:16:09.171968 (+ 49632us) write_op.cc:301] APPLY: starting
0709 13:16:09.172054 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:09.173186 (+  1132us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:09.173300 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:09.174166 (+   866us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:09.174369 (+   203us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:16:09.174421 (+    52us) write_op.cc:312] APPLY: finished
0709 13:16:09.174607 (+   186us) log.cc:844] Serialized 25 byte log entry
0709 13:16:09.174786 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:09.174871 (+    85us) write_op.cc:454] Released schema lock
0709 13:16:09.174915 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:09.175311 (+   396us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:09.175342 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":223289,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":49383,"apply.run_cpu_time_us":3329,"apply.run_wall_time_us":3334,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8317,"num_ops":1,"prepare.queue_time_us":314343,"prepare.run_cpu_time_us":6228,"prepare.run_wall_time_us":204603,"replication_time_us":349475,"thread_start_us":170454,"threads_started":2}]]}
I20260709 13:16:09.192869 32199 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:09.211925 32119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:09.212574 32119 raft_consensus.cc:3055] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:09.212895 32119 raft_consensus.cc:740] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:16:09.213631 32119 consensus_queue.cc:260] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:09.214699 32119 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:09.223450 32017 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49550 (request call id 321) took 1605 ms. Trace:
I20260709 13:16:09.227584 32199 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:09.224360 32019 catalog_manager.cc:5697] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 17 to 18, VOTER 113b5461952d47e0944d463ea4e32801 (127.30.63.2) evicted. New cstate: current_term: 19 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:09.229045 32017 rpcz_store.cc:276] 0709 13:16:07.617914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.618115 (+   201us) service_pool.cc:224] Handling call
0709 13:16:07.641823 (+ 23708us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b5400047c54. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5b090 00007fb59eff9f3a 00007fb5a4db01cc 00007fb5a4eae37e 00007fb5a336f2a4 00007fb5a336f232 00007fb5a336f161 00007fb5a336f0dc 00007fb5a336e392 00007fb59d32c48c 00007fb59d32b8c6
0709 13:16:09.223389 (+1581566us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:08.962336 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:09.084945 (+122609us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:09.084977 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:16:09.084993 (+    16us) tablet.cc:662] Decoding operations
0709 13:16:09.085706 (+   713us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:09.085752 (+    46us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:09.085777 (+    25us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:16:09.086353 (+   576us) tablet.cc:701] Row locks acquired
0709 13:16:09.086367 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:16:09.086500 (+   133us) write_op.cc:270] Start()
0709 13:16:09.086599 (+    99us) write_op.cc:276] Timestamp: P: 1783602969086455 usec, L: 0
0709 13:16:09.086615 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:16:09.087253 (+   638us) log.cc:844] Serialized 2056 byte log entry
0709 13:16:09.184706 (+ 97453us) op_driver.cc:464] REPLICATION: finished
0709 13:16:09.194540 (+  9834us) write_op.cc:301] APPLY: starting
0709 13:16:09.194888 (+   348us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:09.204714 (+  9826us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:09.204845 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:09.214052 (+  9207us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:09.214230 (+   178us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:16:09.214274 (+    44us) write_op.cc:312] APPLY: finished
0709 13:16:09.214634 (+   360us) log.cc:844] Serialized 57 byte log entry
0709 13:16:09.215405 (+   771us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:09.215510 (+   105us) write_op.cc:454] Released schema lock
0709 13:16:09.215557 (+    47us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":315668,"reported_tablets":12,"spinlock_wait_cycles":38707968,"child_traces":[["op",{"apply.queue_time_us":4836,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20950,"num_ops":5,"prepare.queue_time_us":499510,"prepare.run_cpu_time_us":3743,"prepare.run_wall_time_us":134288,"replication_time_us":71340}]]}
I20260709 13:16:09.224417 32119 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 17.
I20260709 13:16:09.237401 32165 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:16:09.238986  7284 raft_consensus.cc:2804] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:09.239498  7284 raft_consensus.cc:697] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 17 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:16:09.240298  7284 consensus_queue.cc:237] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:09.245172 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:09.245832 32265 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:09.253028 32181 tablet_service.cc:1558] Processing DeleteTablet for tablet afb482e4812e47d0a501b142e64cb73b with delete_type TABLET_DATA_TOMBSTONED (TS 113b5461952d47e0944d463ea4e32801 not found in new config with opid_index 18) from {username='slave'} at 127.0.0.1:46032
I20260709 13:16:09.257256 32016 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49556 (request call id 322) took 1481 ms. Trace:
I20260709 13:16:09.257759 32265 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 17.
I20260709 13:16:09.257725 32016 rpcz_store.cc:276] 0709 13:16:07.775907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.776053 (+   146us) service_pool.cc:224] Handling call
0709 13:16:09.257191 (+1481138us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":3}
I20260709 13:16:09.301462  7334 tablet_replica.cc:333] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:09.302719  7334 raft_consensus.cc:2243] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:09.312763  7334 raft_consensus.cc:2272] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:09.336979 32019 catalog_manager.cc:5697] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 16 to 17, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 17 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:09.373916  7334 ts_tablet_manager.cc:1916] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:09.374830  7305 raft_consensus.cc:993] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:16:09.375362  7289 raft_consensus.cc:1081] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 20 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:16:09.377197 32199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10940646da924abea9f371781da8acee"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54172
I20260709 13:16:09.377839 32199 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:09.378199 32199 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:09.390297 32199 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:09.392318 32199 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:09.393960 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:09.394069 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:09.394568 32118 raft_consensus.cc:3055] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:16:09.394636 32266 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:09.395031 32118 raft_consensus.cc:740] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:16:09.395823 32118 consensus_queue.cc:260] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:09.402323 32266 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 21.
I20260709 13:16:09.405105 32118 raft_consensus.cc:3060] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:09.408960 32165 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:09.409859  7277 raft_consensus.cc:2804] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:16:09.410343  7277 raft_consensus.cc:697] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 21 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:16:09.411147  7277 consensus_queue.cc:237] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:09.429718  7334 ts_tablet_manager.cc:1929] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.17
I20260709 13:16:09.430246  7334 log.cc:1199] T afb482e4812e47d0a501b142e64cb73b P 113b5461952d47e0944d463ea4e32801: Deleting WAL directory at /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602730526113-30972-0/minicluster-data/ts-1-root/wals/afb482e4812e47d0a501b142e64cb73b
I20260709 13:16:09.497517 32008 catalog_manager.cc:5028] TS 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): tablet afb482e4812e47d0a501b142e64cb73b (table test-workload [id=9b9dc20f98e547b59efac9c530f28125]) successfully deleted
I20260709 13:16:09.568892  7289 raft_consensus.cc:993] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:16:09.576411  7290 raft_consensus.cc:1081] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:16:09.615324  7290 raft_consensus.cc:993] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:16:09.615993  7290 raft_consensus.cc:1081] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:16:09.618870 32192 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54172
I20260709 13:16:09.621451 32192 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:09.623726 32192 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:09.672806 32199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afc0578da01e4736bf535c5df1439723"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54172
I20260709 13:16:09.683415 32199 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:09.689352 32199 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:09.690564 32117 raft_consensus.cc:1275] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:16:09.692452 32019 catalog_manager.cc:5697] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 20 to 21, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 21 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:09.701316  7245 consensus_queue.cc:1048] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:09.721108 32118 raft_consensus.cc:2468] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 21.
I20260709 13:16:09.730880 32192 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:09.730916 32272 raft_consensus.cc:1275] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:16:09.735328  7281 consensus_queue.cc:1048] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:09.738000 32192 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:09.739336   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:16:09.746176   395 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:09.749985 32199 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:09.759727 32118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:09.767222 32118 raft_consensus.cc:3055] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:09.763581 32199 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:09.765614 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:09.766309 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:09.768317 32122 raft_consensus.cc:3055] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:09.768702 32122 raft_consensus.cc:740] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:16:09.769968 32122 consensus_queue.cc:260] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:09.767717 32118 raft_consensus.cc:740] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:16:09.772276 32266 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:09.771725 32122 raft_consensus.cc:3060] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:09.801671   395 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 15.
I20260709 13:16:09.776558 32118 consensus_queue.cc:260] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:09.812350 32122 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
I20260709 13:16:09.827610 32266 raft_consensus.cc:2468] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
I20260709 13:16:09.832767 32165 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:16:09.834532  7245 raft_consensus.cc:2804] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:09.835089  7245 raft_consensus.cc:697] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:16:09.836283  7245 consensus_queue.cc:237] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:09.838689 32118 raft_consensus.cc:3060] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:09.847380 32162 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:16:09.850214  7281 raft_consensus.cc:2804] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:09.850965  7281 raft_consensus.cc:697] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 15 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:16:09.856230 32265 raft_consensus.cc:1275] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:16:09.865617  7278 consensus_queue.cc:1048] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:09.852427  7281 consensus_queue.cc:237] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:09.918893 32118 raft_consensus.cc:2468] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 15.
W20260709 13:16:09.933918   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 74753.6us
I20260709 13:16:10.001247 32118 raft_consensus.cc:1275] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:16:10.003350  7281 consensus_queue.cc:1048] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:10.019598 32022 catalog_manager.cc:5697] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 17 to 18, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 18 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:10.022910 32022 catalog_manager.cc:5697] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 14 to 15, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 15 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:10.155231 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:10.246331 32265 raft_consensus.cc:1275] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:16:10.249542  7221 consensus_queue.cc:1048] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:10.306926 32124 raft_consensus.cc:1275] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:16:10.308852  7286 consensus_queue.cc:1048] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:10.335690 32118 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:16:10.338737  7221 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:16:10.371068   395 raft_consensus.cc:1275] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:16:10.372632  7281 consensus_queue.cc:1048] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:16:10.603245 32192 consensus_queue.cc:237] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
W20260709 13:16:10.627441 32162 consensus_peers.cc:597] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a933d5409ea04be9bd937643b14efae4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:10.628525 32267 raft_consensus.cc:1275] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:10.630688 32122 raft_consensus.cc:1275] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:10.631664  7281 consensus_queue.cc:1048] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:10.633721  7284 consensus_queue.cc:1048] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:10.669106  7281 raft_consensus.cc:2955] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:16:10.675868 32122 raft_consensus.cc:2955] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:16:10.678453 32267 raft_consensus.cc:2955] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:16:10.720993 32016 catalog_manager.cc:5697] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d reported cstate change: config changed from index -1 to 11, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New cstate: current_term: 14 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:16:10.724186 32265 consensus_queue.cc:237] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
W20260709 13:16:10.783846 32236 consensus_peers.cc:597] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7beffc7d75824f0085f2b522bab2bc79. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:10.787556 32192 raft_consensus.cc:1275] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:16:10.790251 32118 raft_consensus.cc:1275] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:16:10.791960  7352 consensus_queue.cc:1048] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:10.794665  7285 consensus_queue.cc:1048] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:10.862671  7285 raft_consensus.cc:2955] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:16:10.872706 32118 raft_consensus.cc:2955] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:16:10.873816 32192 raft_consensus.cc:2955] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:16:10.899951 32022 catalog_manager.cc:5697] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 reported cstate change: config changed from index -1 to 11, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New cstate: current_term: 18 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:16:10.954123 32265 consensus_queue.cc:237] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
W20260709 13:16:10.984118 32236 consensus_peers.cc:597] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7049b5c289c247ea8dda13c92984c95d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:10.990397 32196 raft_consensus.cc:1275] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:16:10.994959  7308 consensus_queue.cc:1048] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:11.018247 32118 raft_consensus.cc:1275] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:16:11.020263  7308 consensus_queue.cc:1048] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:11.025923  7352 raft_consensus.cc:2955] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:16:11.033352 32196 raft_consensus.cc:2955] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
W20260709 13:16:11.062839   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 147262us
I20260709 13:16:11.082254 32019 catalog_manager.cc:5697] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: config changed from index -1 to 14, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New cstate: current_term: 19 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:11.096093 32118 consensus_queue.cc:237] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:16:11.113185  7366 ts_tablet_manager.cc:933] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:11.136229 32124 raft_consensus.cc:2955] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:16:11.158026 32267 raft_consensus.cc:1275] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:16:11.161581 32199 raft_consensus.cc:1275] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Refusing update from remote peer fcfc3281929645969ecedbb0c0af759d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:16:11.162303  7305 consensus_queue.cc:1048] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:16:11.164561 32087 consensus_peers.cc:597] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 95f5e8022e3d4b9e9f240b21076de4c3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:11.164852  6824 consensus_queue.cc:1048] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:11.233713  7367 raft_consensus.cc:2955] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:16:11.237922 32267 raft_consensus.cc:2955] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:16:11.253185 32192 raft_consensus.cc:2955] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:16:11.278092  7366 tablet_copy_client.cc:323] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Beginning tablet copy session from remote peer at address 127.30.63.2:44517
I20260709 13:16:11.282924 32209 tablet_copy_service.cc:140] P 113b5461952d47e0944d463ea4e32801: Received BeginTabletCopySession request for tablet a933d5409ea04be9bd937643b14efae4 from peer 94085cf341634eb686a95983b6b7f7e6 ({username='slave'} at 127.0.0.1:56926)
I20260709 13:16:11.283614 32209 tablet_copy_service.cc:161] P 113b5461952d47e0944d463ea4e32801: Beginning new tablet copy session on tablet a933d5409ea04be9bd937643b14efae4 from peer 94085cf341634eb686a95983b6b7f7e6 at {username='slave'} at 127.0.0.1:56926: session id = 94085cf341634eb686a95983b6b7f7e6-a933d5409ea04be9bd937643b14efae4
I20260709 13:16:11.280285 32019 catalog_manager.cc:5697] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: config changed from index -1 to 13, NON_VOTER 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) added. New cstate: current_term: 18 leader_uuid: "fcfc3281929645969ecedbb0c0af759d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } } }
I20260709 13:16:11.295126 32209 tablet_copy_source_session.cc:215] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:11.319242  7366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a933d5409ea04be9bd937643b14efae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:11.417377  7374 ts_tablet_manager.cc:933] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:11.460676  7366 tablet_copy_client.cc:806] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:11.464148  7366 tablet_copy_client.cc:670] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:11.467257  7374 tablet_copy_client.cc:323] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Beginning tablet copy session from remote peer at address 127.30.63.3:36651
I20260709 13:16:11.477129 32282 tablet_copy_service.cc:140] P 6b3ed521ce8947db80c4b4828b355c06: Received BeginTabletCopySession request for tablet 7beffc7d75824f0085f2b522bab2bc79 from peer 94085cf341634eb686a95983b6b7f7e6 ({username='slave'} at 127.0.0.1:50584)
I20260709 13:16:11.477751 32282 tablet_copy_service.cc:161] P 6b3ed521ce8947db80c4b4828b355c06: Beginning new tablet copy session on tablet 7beffc7d75824f0085f2b522bab2bc79 from peer 94085cf341634eb686a95983b6b7f7e6 at {username='slave'} at 127.0.0.1:50584: session id = 94085cf341634eb686a95983b6b7f7e6-7beffc7d75824f0085f2b522bab2bc79
I20260709 13:16:11.484324 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:11.486552 32282 tablet_copy_source_session.cc:215] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:11.491770  7374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7beffc7d75824f0085f2b522bab2bc79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:11.497628  7366 tablet_copy_client.cc:538] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:11.529806  7366 tablet_bootstrap.cc:492] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap starting.
I20260709 13:16:11.542402  7374 tablet_copy_client.cc:806] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:11.543114  7374 tablet_copy_client.cc:670] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:11.575570  7374 tablet_copy_client.cc:538] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:11.614127  7374 tablet_bootstrap.cc:492] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap starting.
I20260709 13:16:11.617280  7376 ts_tablet_manager.cc:933] T 7049b5c289c247ea8dda13c92984c95d P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:11.633531 32124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7594a5601f24445092c404115861232c"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
mode: GRACEFUL
new_leader_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:53200
I20260709 13:16:11.634253 32124 raft_consensus.cc:606] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 25 LEADER]: Received request to transfer leadership to TS 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:11.643090 32118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:53200
I20260709 13:16:11.643705 32118 raft_consensus.cc:606] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 18 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:16:11.665346 32118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04"
dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
mode: GRACEFUL
new_leader_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:53200
I20260709 13:16:11.666570 32118 raft_consensus.cc:606] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Received request to transfer leadership to TS 113b5461952d47e0944d463ea4e32801
I20260709 13:16:11.668965 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:16:11.670662 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:11.670928  7376 tablet_copy_client.cc:323] T 7049b5c289c247ea8dda13c92984c95d P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Beginning tablet copy session from remote peer at address 127.30.63.3:36651
I20260709 13:16:11.672673 32282 tablet_copy_service.cc:140] P 6b3ed521ce8947db80c4b4828b355c06: Received BeginTabletCopySession request for tablet 7049b5c289c247ea8dda13c92984c95d from peer 94085cf341634eb686a95983b6b7f7e6 ({username='slave'} at 127.0.0.1:50584)
I20260709 13:16:11.673239 32282 tablet_copy_service.cc:161] P 6b3ed521ce8947db80c4b4828b355c06: Beginning new tablet copy session on tablet 7049b5c289c247ea8dda13c92984c95d from peer 94085cf341634eb686a95983b6b7f7e6 at {username='slave'} at 127.0.0.1:50584: session id = 94085cf341634eb686a95983b6b7f7e6-7049b5c289c247ea8dda13c92984c95d
I20260709 13:16:11.706663 32282 tablet_copy_source_session.cc:215] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:11.725591  7379 ts_tablet_manager.cc:933] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6: Initiating tablet copy from peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339)
I20260709 13:16:11.729442  7376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7049b5c289c247ea8dda13c92984c95d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:11.757062  7379 tablet_copy_client.cc:323] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Beginning tablet copy session from remote peer at address 127.30.63.1:42339
I20260709 13:16:11.759243 32134 tablet_copy_service.cc:140] P fcfc3281929645969ecedbb0c0af759d: Received BeginTabletCopySession request for tablet 95f5e8022e3d4b9e9f240b21076de4c3 from peer 94085cf341634eb686a95983b6b7f7e6 ({username='slave'} at 127.0.0.1:55358)
I20260709 13:16:11.759838 32134 tablet_copy_service.cc:161] P fcfc3281929645969ecedbb0c0af759d: Beginning new tablet copy session on tablet 95f5e8022e3d4b9e9f240b21076de4c3 from peer 94085cf341634eb686a95983b6b7f7e6 at {username='slave'} at 127.0.0.1:55358: session id = 94085cf341634eb686a95983b6b7f7e6-95f5e8022e3d4b9e9f240b21076de4c3
I20260709 13:16:11.766950  6824 raft_consensus.cc:993] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d: : Instructing follower 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:16:11.767624  7367 raft_consensus.cc:1081] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 25 LEADER]: Signalling peer 6b3ed521ce8947db80c4b4828b355c06 to start an election
I20260709 13:16:11.769572 32267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7594a5601f24445092c404115861232c"
dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
 from {username='slave'} at 127.0.0.1:36084
I20260709 13:16:11.770205 32267 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 25 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:11.770599 32267 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:11.773329 32134 tablet_copy_source_session.cc:215] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:11.777812  7379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95f5e8022e3d4b9e9f240b21076de4c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:11.792181  7376 tablet_copy_client.cc:806] T 7049b5c289c247ea8dda13c92984c95d P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:11.795544 32267 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 26 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:11.799551  7376 tablet_copy_client.cc:670] T 7049b5c289c247ea8dda13c92984c95d P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:11.801509 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:11.801710 32267 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 26 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:11.802183 32122 raft_consensus.cc:3055] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:16:11.802538 32122 raft_consensus.cc:740] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 25 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:16:11.803355 32122 consensus_queue.cc:260] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:11.804832 32122 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:11.811852 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: true dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:11.812551 32199 raft_consensus.cc:3060] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:11.824007 32199 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 26.
I20260709 13:16:11.829327  7376 tablet_copy_client.cc:538] T 7049b5c289c247ea8dda13c92984c95d P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:11.830004 32238 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:11.832726  7352 raft_consensus.cc:2804] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:16:11.835896  7352 raft_consensus.cc:697] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 26 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:16:11.837019  7352 consensus_queue.cc:237] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:11.851504  7376 tablet_bootstrap.cc:492] T 7049b5c289c247ea8dda13c92984c95d P 94085cf341634eb686a95983b6b7f7e6: Bootstrap starting.
I20260709 13:16:11.855073 32122 raft_consensus.cc:2468] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 26.
I20260709 13:16:11.859591 32022 catalog_manager.cc:5697] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 25 to 26, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 26 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:11.869104  7367 raft_consensus.cc:993] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:16:11.869635  7367 raft_consensus.cc:1081] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 18 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:16:11.871367 32199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54172
I20260709 13:16:11.871913 32199 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:11.872272 32199 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:11.881531 32199 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:16:11.889598  7379 tablet_copy_client.cc:806] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:11.894913 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:11.890085 32199 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:11.895663 32267 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:11.891407  7366 tablet_bootstrap.cc:492] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:11.898522 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:11.900142 32122 raft_consensus.cc:3055] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:16:11.900470 32122 raft_consensus.cc:740] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:16:11.900723  7379 tablet_copy_client.cc:670] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:11.901876  7366 tablet_bootstrap.cc:492] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap complete.
I20260709 13:16:11.902999  7366 ts_tablet_manager.cc:1403] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6: Time spent bootstrapping tablet: real 0.373s	user 0.044s	sys 0.019s
I20260709 13:16:11.901667 32122 consensus_queue.cc:260] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:16:11.905670 32122 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:11.908380 32267 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 19.
I20260709 13:16:11.909859  7379 tablet_copy_client.cc:538] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:11.911942  7366 raft_consensus.cc:359] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:16:11.912884  7366 raft_consensus.cc:740] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Initialized, Role: LEARNER
I20260709 13:16:11.913564  7366 consensus_queue.cc:260] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:16:11.918360  7366 ts_tablet_manager.cc:1434] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:16:11.920326 32209 tablet_copy_service.cc:342] P 113b5461952d47e0944d463ea4e32801: Request end of tablet copy session 94085cf341634eb686a95983b6b7f7e6-a933d5409ea04be9bd937643b14efae4 received from {username='slave'} at 127.0.0.1:56926
I20260709 13:16:11.920822 32209 tablet_copy_service.cc:434] P 113b5461952d47e0944d463ea4e32801: ending tablet copy session 94085cf341634eb686a95983b6b7f7e6-a933d5409ea04be9bd937643b14efae4 on tablet a933d5409ea04be9bd937643b14efae4 with peer 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:11.918264 32122 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 19.
I20260709 13:16:11.925134 32165 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:16:11.934823  7284 raft_consensus.cc:2804] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:16:11.945343  7379 tablet_bootstrap.cc:492] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap starting.
I20260709 13:16:11.990651  7284 raft_consensus.cc:697] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 19 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:16:12.006673  6824 raft_consensus.cc:993] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d: : Instructing follower 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:16:12.007201  6824 raft_consensus.cc:1081] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Signalling peer 113b5461952d47e0944d463ea4e32801 to start an election
I20260709 13:16:12.008978 32199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04"
dest_uuid: "113b5461952d47e0944d463ea4e32801"
 from {username='slave'} at 127.0.0.1:54172
I20260709 13:16:12.009498 32199 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:12.009811 32199 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:12.011616  7284 consensus_queue.cc:237] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:16:12.020462  7374 tablet_bootstrap.cc:492] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:12.021849 32199 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:12.090130  7374 tablet_bootstrap.cc:492] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap complete.
I20260709 13:16:12.094328  7374 ts_tablet_manager.cc:1403] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6: Time spent bootstrapping tablet: real 0.480s	user 0.042s	sys 0.015s
I20260709 13:16:12.097563  7374 raft_consensus.cc:359] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
W20260709 13:16:12.092626 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 64672.8us
I20260709 13:16:12.091324 32199 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:12.102021 32122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "fcfc3281929645969ecedbb0c0af759d"
I20260709 13:16:12.102577 32122 raft_consensus.cc:3055] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:12.102895 32122 raft_consensus.cc:740] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:16:12.103626 32122 consensus_queue.cc:260] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:12.088792 32019 catalog_manager.cc:5697] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 18 to 19, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 19 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:12.104741 32122 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:12.111775 32122 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
I20260709 13:16:12.116797 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:12.117522 32266 raft_consensus.cc:3060] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:12.127617 32266 raft_consensus.cc:2468] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
I20260709 13:16:12.135908  7374 raft_consensus.cc:740] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Initialized, Role: LEARNER
I20260709 13:16:12.137034 32272 raft_consensus.cc:1240] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 17. Current term is 18. Ops: []
I20260709 13:16:12.137816  7374 consensus_queue.cc:260] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:16:12.151024  7374 ts_tablet_manager.cc:1434] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 13:16:12.153040 32282 tablet_copy_service.cc:342] P 6b3ed521ce8947db80c4b4828b355c06: Request end of tablet copy session 94085cf341634eb686a95983b6b7f7e6-7beffc7d75824f0085f2b522bab2bc79 received from {username='slave'} at 127.0.0.1:50584
I20260709 13:16:12.153563 32282 tablet_copy_service.cc:434] P 6b3ed521ce8947db80c4b4828b355c06: ending tablet copy session 94085cf341634eb686a95983b6b7f7e6-7beffc7d75824f0085f2b522bab2bc79 on tablet 7beffc7d75824f0085f2b522bab2bc79 with peer 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:12.162118 32165 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:12.174638  7278 raft_consensus.cc:2804] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:12.190176  7278 raft_consensus.cc:697] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:16:12.193153  7278 consensus_queue.cc:237] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:16:12.231630 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 53656.1us
W20260709 13:16:12.282624 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 60117.8us
W20260709 13:16:12.284071   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 45779.1us
W20260709 13:16:12.294095   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 49399.7us
W20260709 13:16:12.386250 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 80820.7us
I20260709 13:16:12.404739   395 raft_consensus.cc:1217] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.10->[14.11-14.11]   Dedup: 14.11->[]
I20260709 13:16:12.416815 32124 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 26 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:16:12.462939 32016 catalog_manager.cc:5697] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 17 to 18, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 18 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:12.469587  7352 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.017s
W20260709 13:16:12.513880 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 98009.4us
I20260709 13:16:12.521552 32124 raft_consensus.cc:1275] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:16:12.592636 32162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 174564us
I20260709 13:16:12.621795 32267 raft_consensus.cc:1275] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:16:12.617185  7390 consensus_queue.cc:1048] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:16:12.645851 32199 raft_consensus.cc:1275] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 26 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:16:12.649578   395 raft_consensus.cc:1217] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.10->[18.11-18.11]   Dedup: 18.11->[]
I20260709 13:16:12.672350 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:12.676695  7379 tablet_bootstrap.cc:492] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:12.677686  7379 tablet_bootstrap.cc:492] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6: Bootstrap complete.
I20260709 13:16:12.678423  7379 ts_tablet_manager.cc:1403] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6: Time spent bootstrapping tablet: real 0.733s	user 0.042s	sys 0.033s
I20260709 13:16:12.703174  7379 raft_consensus.cc:359] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:16:12.704324  7379 raft_consensus.cc:740] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Initialized, Role: LEARNER
I20260709 13:16:12.680658  7390 consensus_queue.cc:1048] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:16:12.712942 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 61327.3us
W20260709 13:16:12.716029 32162 consensus_peers.cc:597] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 -> Peer 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025): Couldn't send request to peer 94085cf341634eb686a95983b6b7f7e6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:12.722121 32124 raft_consensus.cc:1275] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:16:12.705114  7379 consensus_queue.cc:260] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:16:12.753257  7401 consensus_queue.cc:1048] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:12.774591  7376 tablet_bootstrap.cc:492] T 7049b5c289c247ea8dda13c92984c95d P 94085cf341634eb686a95983b6b7f7e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:12.778939  7376 tablet_bootstrap.cc:492] T 7049b5c289c247ea8dda13c92984c95d P 94085cf341634eb686a95983b6b7f7e6: Bootstrap complete.
I20260709 13:16:12.779834  7376 ts_tablet_manager.cc:1403] T 7049b5c289c247ea8dda13c92984c95d P 94085cf341634eb686a95983b6b7f7e6: Time spent bootstrapping tablet: real 0.929s	user 0.050s	sys 0.013s
I20260709 13:16:12.797209 32267 raft_consensus.cc:1275] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:16:12.831861  7392 consensus_queue.cc:1048] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:16:12.839231  7379 ts_tablet_manager.cc:1434] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6: Time spent starting tablet: real 0.160s	user 0.005s	sys 0.004s
I20260709 13:16:12.788041  7376 raft_consensus.cc:359] T 7049b5c289c247ea8dda13c92984c95d P 94085cf341634eb686a95983b6b7f7e6 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:16:12.849267  7376 raft_consensus.cc:740] T 7049b5c289c247ea8dda13c92984c95d P 94085cf341634eb686a95983b6b7f7e6 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Initialized, Role: LEARNER
I20260709 13:16:12.850018  7376 consensus_queue.cc:260] T 7049b5c289c247ea8dda13c92984c95d P 94085cf341634eb686a95983b6b7f7e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:16:12.851466 32134 tablet_copy_service.cc:342] P fcfc3281929645969ecedbb0c0af759d: Request end of tablet copy session 94085cf341634eb686a95983b6b7f7e6-95f5e8022e3d4b9e9f240b21076de4c3 received from {username='slave'} at 127.0.0.1:55358
I20260709 13:16:12.851956 32134 tablet_copy_service.cc:434] P fcfc3281929645969ecedbb0c0af759d: ending tablet copy session 94085cf341634eb686a95983b6b7f7e6-95f5e8022e3d4b9e9f240b21076de4c3 on tablet 95f5e8022e3d4b9e9f240b21076de4c3 with peer 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:12.872082  7376 ts_tablet_manager.cc:1434] T 7049b5c289c247ea8dda13c92984c95d P 94085cf341634eb686a95983b6b7f7e6: Time spent starting tablet: real 0.088s	user 0.007s	sys 0.000s
I20260709 13:16:12.869916  7281 consensus_queue.cc:1048] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:16:12.883613 32282 tablet_copy_service.cc:342] P 6b3ed521ce8947db80c4b4828b355c06: Request end of tablet copy session 94085cf341634eb686a95983b6b7f7e6-7049b5c289c247ea8dda13c92984c95d received from {username='slave'} at 127.0.0.1:50584
I20260709 13:16:12.884126 32282 tablet_copy_service.cc:434] P 6b3ed521ce8947db80c4b4828b355c06: ending tablet copy session 94085cf341634eb686a95983b6b7f7e6-7049b5c289c247ea8dda13c92984c95d on tablet 7049b5c289c247ea8dda13c92984c95d with peer 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:12.941165  7390 raft_consensus.cc:1064] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:16:12.946497  7390 consensus_queue.cc:237] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:13.070243   401 raft_consensus.cc:1217] T 7049b5c289c247ea8dda13c92984c95d P 94085cf341634eb686a95983b6b7f7e6 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.13->[19.14-19.14]   Dedup: 19.14->[]
I20260709 13:16:13.226790  7415 raft_consensus.cc:1064] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:16:13.232370  7415 consensus_queue.cc:237] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 9, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:13.304533   401 raft_consensus.cc:1275] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEARNER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:16:13.306746  7352 consensus_queue.cc:1048] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:13.377142 30972 tablet_server.cc:179] TabletServer@127.30.63.1:0 shutting down...
W20260709 13:16:13.465485 32239 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20260709 13:16:13.504676 32239 consensus_peers.cc:597] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:13.523576 32239 consensus_peers.cc:597] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:13.531584 32239 consensus_peers.cc:597] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:13.590674   401 raft_consensus.cc:1275] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6 [term 14 LEARNER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:16:13.596597   401 raft_consensus.cc:3060] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEARNER]: Advancing to term 19
I20260709 13:16:13.608512  7278 consensus_queue.cc:1048] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:13.618753 32194 raft_consensus.cc:1275] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:16:13.620680  7308 consensus_queue.cc:1048] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:16:13.646919 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 47145us
W20260709 13:16:14.090883 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 317131us
W20260709 13:16:14.173717  7432 log.cc:927] Time spent T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:16:14.179239  7411 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:14.179934  7411 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:16:14.203895  7406 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:14.206053  7401 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:16:14.439446 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 148437us
W20260709 13:16:14.424229 32220 debug-util.cc:398] Leaking SignalData structure 0x7b0800394e20 after lost signal to thread 30975
W20260709 13:16:14.493911 32220 debug-util.cc:398] Leaking SignalData structure 0x7b08003a5aa0 after lost signal to thread 32056
W20260709 13:16:14.495637 32220 debug-util.cc:398] Leaking SignalData structure 0x7b08001e35e0 after lost signal to thread 32148
I20260709 13:16:14.504691  7438 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:14.505525  7450 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:14.506385  7450 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:14.509953  7415 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:14.510288  7408 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:14.510756  7415 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:14.505371  7438 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:16:14.510910  7408 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:14.514645  7438 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:14.514891  7408 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:16:14.516696 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 76559.8us
I20260709 13:16:14.519145  7443 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:16:14.522200  7439 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:14.523010  7439 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:14.529671  7411 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:14.233026  7406 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:14.294343  7436 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:14.534844 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:14.246280  7401 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:14.519908  7443 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:14.515368  7438 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:14.566039  7448 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:14.566886  7448 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:14.570266  7401 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:14.578086  7308 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:14.628726  7445 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:16:14.629297  7445 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:14.630970  7406 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:14.631352  7445 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:14.577925  7438 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:14.596199  7411 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:16:14.633008  7443 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:14.633718  7450 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:14.634183   395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38176 (request call id 627) took 1028 ms. Trace:
I20260709 13:16:14.628739  7308 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:14.634759   395 rpcz_store.cc:276] 0709 13:16:13.605939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.633359 (+1027420us) service_pool.cc:224] Handling call
0709 13:16:14.633674 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:14.633870 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:14.633897 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:14.633941 (+    44us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:16:14.633974 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.634028 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:14.634128 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:14.625630  7401 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:16:14.634384  7438 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:14.636008  7401 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:14.638141  7401 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:14.572329  7436 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:14.633442  7411 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:14.640779  7436 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:14.641559  7411 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:14.636322  7308 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:14.634297  7447 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:16:14.656836  7447 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:14.659114  7447 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:14.660832  7446 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:14.661429  7446 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:14.663655  7446 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:14.654366  7450 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:14.665210  7450 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:14.667326  7450 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:14.675323   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:14.675462   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:14.678140  7453 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:14.678732  7453 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:14.681423  7448 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:14.685178  7439 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:14.648505  7308 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:14.689107  7308 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:16:14.691491  7308 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:14.697190  7453 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:14.697566  7411 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:14.697751  7415 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:14.651503  7445 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:14.698004  7436 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:14.698644  7437 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:14.699189  7442 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:14.699926  7450 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:16:14.676208 32165 consensus_peers.cc:597] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:14.731628 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 55501.1us
I20260709 13:16:14.691391  7401 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:14.700443  7451 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:14.705744  7398 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:14.710482  7448 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:14.738899 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:14.742226  7457 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:14.743057  7457 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:14.738885 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:14.749082 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:14.751160 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:14.729501  7445 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:16:14.755110  7445 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:14.755792  7445 raft_consensus.cc:493] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:16:14.756965 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:14.738420  7437 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:14.760756  7443 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:14.761198  7437 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:14.761822  7437 raft_consensus.cc:493] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:16:14.762409  7437 raft_consensus.cc:515] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:14.763991  7390 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:14.761487  7443 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:14.764639  7390 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:14.766374  7443 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:14.767345  7390 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:14.735190  7450 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:14.768142  7457 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:14.724921  7411 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:16:14.770900 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 46093.9us
W20260709 13:16:14.774510   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 68128.3us
I20260709 13:16:14.733400  7436 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:14.770586  7415 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:14.794886 32267 raft_consensus.cc:1275] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:16:14.777269  7390 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:14.735853  7401 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:14.745923  7448 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:14.815392  7448 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:14.779001  7446 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:14.800011  7415 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:14.819684  7415 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:14.820847  7390 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:14.821861  7401 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:14.823043 32192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 5370) took 1368 ms. Trace:
I20260709 13:16:14.823271  7390 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:14.823460 32192 rpcz_store.cc:276] 0709 13:16:13.454988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.822092 (+1367104us) service_pool.cc:224] Handling call
0709 13:16:14.822518 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:14.822723 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:14.822749 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:14.822792 (+    43us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:16:14.822823 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.822875 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:14.822988 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:14.798641  7438 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:14.827111  7438 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:14.756415  7445 raft_consensus.cc:515] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:14.803591  7436 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:14.734098  7442 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:14.805864  7447 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:14.806380  7352 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:14.806494  7450 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:14.816184  7446 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:14.807350  7453 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:14.806835 32016 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49556 (request call id 340) took 1408 ms. Trace:
I20260709 13:16:14.807986  7454 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:14.811760  7411 leader_election.cc:290] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:14.812738  7455 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:14.739275  7398 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:14.813091  7437 leader_election.cc:290] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:14.737715  7451 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:16:14.830235 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 76695.3us
I20260709 13:16:14.806828  7439 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:14.854450  7447 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:14.848922  7436 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:14.854792 32016 rpcz_store.cc:276] 0709 13:16:13.398064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.398272 (+   208us) service_pool.cc:224] Handling call
0709 13:16:14.806746 (+1408474us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":127638,"reported_tablets":4}
I20260709 13:16:14.864248 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:14.864187 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:14.849093  7448 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:14.863198 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:14.905987 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:14.906586 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:14.888702  7438 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:14.866056  7437 raft_consensus.cc:493] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:16:14.909346 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:14.909684  7437 raft_consensus.cc:515] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:14.866593 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:14.913555 32197 raft_consensus.cc:2468] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 18.
I20260709 13:16:14.855695  7450 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:14.905812 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:14.854331  7352 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:16:14.927937   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 150981us
I20260709 13:16:14.861687  7411 raft_consensus.cc:493] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:16:14.888931  7308 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:14.888833  7455 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:14.968314 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:16:15.055248 32220 debug-util.cc:398] Leaking SignalData structure 0x7b08002ad220 after lost signal to thread 32223
I20260709 13:16:14.935497 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:15.021601 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:15.148399 32199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54182 (request call id 5369) took 1693 ms. Trace:
W20260709 13:16:15.132195   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 130479us
I20260709 13:16:15.148984 32199 rpcz_store.cc:276] 0709 13:16:13.454712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.247891 (+793179us) service_pool.cc:224] Handling call
0709 13:16:14.248193 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:14.568969 (+320776us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:14.569014 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:14.569075 (+    61us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:14.569120 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.148098 (+578978us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b5400211bd4. stack: 00007fb59bed2343 00007fb59bed2240 00007fb59b8611d4 00007fb5a559f304 00007fb5a559f299 00007fb59ef5a571 00007fb59eff1e01 00007fb59eff083e 00007fb5a3fb5419 00007fb59d52cbd4 00007fb59d52cb62 00007fb59d52ca91 00007fb59d52ca0c 00007fb59d52bcc2 00007fb59d32c48c 00007fb59d32b8c6
0709 13:16:15.148145 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:15.148299 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":737097088}
I20260709 13:16:14.961982 32089 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:16:15.145831 32087 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:14.997952  7409 raft_consensus.cc:493] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:16:15.174602 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:16:15.163933 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 202034us
I20260709 13:16:14.954183  7449 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:15.169164   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:15.178402 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:14.930276  7436 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:14.908075  7439 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:15.181522 32269 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 14.
I20260709 13:16:15.059242  7447 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:14.978340  7445 leader_election.cc:290] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:15.135222  7393 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:15.013504  7461 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:15.136379  7278 consensus_queue.cc:1048] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:16:15.174626 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:14.999210  7446 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:15.212397 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:15.098723  7352 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:15.032177  7398 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:15.188107 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:14.861025  7453 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:15.151520  7401 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:15.223948  7460 raft_consensus.cc:493] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:15.224303  7401 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:14.962615  7406 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:15.225528  7406 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:15.226377  7418 raft_consensus.cc:493] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:16:15.226624  7401 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:15.009048  7415 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:15.193176 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:15.226999  7418 raft_consensus.cc:515] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:15.227378  7415 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:15.227783  7406 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:15.051076  7451 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:15.195822 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:15.228853   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:15.229209  7471 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:14.930117  7448 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:14.999934  7442 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:15.175137  7305 raft_consensus.cc:2804] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:15.229784  7471 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:15.230455  7305 raft_consensus.cc:493] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:15.230878  7305 raft_consensus.cc:3060] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:14.865211  7454 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:15.237366 32266 raft_consensus.cc:2468] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 17.
I20260709 13:16:15.210603  7393 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:16:15.208779 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 87060.8us
I20260709 13:16:14.997347  7411 raft_consensus.cc:515] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:14.930572  7450 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:16:15.215065   399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:15.215564  7446 raft_consensus.cc:493] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:16:15.209695  7447 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:16:15.216470 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:15.217365  7465 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:15.221037 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.221459  7468 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:15.221658  7452 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:15.222038  7352 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:15.222121  7444 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:15.223507 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:15.183110  7409 raft_consensus.cc:515] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:15.208132   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:15.154590  7308 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:15.215634 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f415b574b5d492a8f6bbb83d1c0b0f6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:15.324311 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:15.324919 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:16:15.304311 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 131408us
I20260709 13:16:15.189051  7449 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:15.326349   401 raft_consensus.cc:2468] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 18.
I20260709 13:16:15.327551  7449 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:15.212733  7461 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:15.329598  7461 leader_election.cc:290] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:16:15.288937 32220 debug-util.cc:398] Leaking SignalData structure 0x7b08000fa340 after lost signal to thread 32297
W20260709 13:16:15.330224 32220 debug-util.cc:398] Leaking SignalData structure 0x7b08000fa360 after lost signal to thread 32298
W20260709 13:16:15.331350 32220 debug-util.cc:398] Leaking SignalData structure 0x7b08000fac20 after lost signal to thread 427
W20260709 13:16:15.331800 32220 debug-util.cc:398] Leaking SignalData structure 0x7b08000fada0 after lost signal to thread 7379
I20260709 13:16:15.294687 32199 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 16.
I20260709 13:16:15.301391  7468 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:16:15.305042  7352 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:15.334395  7468 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:15.308230 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:15.338340   368 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:16:15.340554  7449 raft_consensus.cc:2804] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:15.340996  7449 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:15.341338  7449 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:15.308598  7436 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:15.295383  7447 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:15.310096  7471 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:15.254496  7460 raft_consensus.cc:515] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:15.310774 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:15.311357 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:15.313570 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:15.313995  7450 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:15.314405  7452 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:15.315248 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:15.316195 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.317121  7469 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:15.297883  7465 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:15.318404  7448 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:15.319662  7418 leader_election.cc:290] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:15.319736  7437 leader_election.cc:290] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:15.321756  7411 leader_election.cc:290] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:15.275028  7446 raft_consensus.cc:515] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:15.348912 32269 raft_consensus.cc:2468] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 11.
I20260709 13:16:15.350576 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.350608 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.370816 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:15.377947 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:15.385922 32197 raft_consensus.cc:2468] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 22.
I20260709 13:16:15.385696   399 raft_consensus.cc:2468] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 18.
I20260709 13:16:15.393035   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:15.394289   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd9953c536c4b5fa2ebab1015a61b53" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:15.385053  7362 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:15.379004  7469 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:15.404199  7455 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:15.411339  7415 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:15.427755   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:15.431634 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.433718 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.457656 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.411815  7362 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:16:15.468924 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 135528us
I20260709 13:16:15.470499 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.426719  7455 raft_consensus.cc:493] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:16:15.429522  7461 raft_consensus.cc:493] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:15.474288 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.435323  7411 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:15.435541  7468 raft_consensus.cc:493] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:15.478169 32266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:16:15.464922  7392 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.956s	user 0.008s	sys 0.002s
I20260709 13:16:15.486320 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.490635   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:15.490885  7442 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:15.491420  7442 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:15.491878  7444 raft_consensus.cc:493] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:15.492514  7444 raft_consensus.cc:515] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:15.493574  7442 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:15.494771  7444 leader_election.cc:290] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:15.491446 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:15.498983  7455 raft_consensus.cc:515] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:15.499917   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:15.473152  7407 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:15.501387  7455 leader_election.cc:290] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:15.503304  7411 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:16:15.504778  7452 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:15.471894  7448 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:15.505585  7448 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:15.492827  7469 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:15.507659  7448 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:15.507980   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf85dc23ac44824a3668eb1b1f3aa42" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:15.473726  7436 raft_consensus.cc:493] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:16:15.509272   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:15.475587  7465 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:15.509441  7436 raft_consensus.cc:515] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:15.510802 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb71ae3e84c459773fd53510d6e04" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.511548  7436 leader_election.cc:290] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:15.511754 32192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.512382 32196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.512856 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.478955  7427 raft_consensus.cc:493] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:15.514722  7427 raft_consensus.cc:515] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:15.516731   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:15.482903  7468 raft_consensus.cc:515] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:15.500950  7407 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:15.496727 32090 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:15.489035   395 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 19.
I20260709 13:16:15.468226  7459 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:15.521028 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.526038 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.528118 32090 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:16:15.529740   396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:15.474444  7439 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:15.528391 32089 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 
I20260709 13:16:15.531355 32090 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:16:15.482962  7392 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.974s	user 0.008s	sys 0.002s
I20260709 13:16:15.534857 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.537462  7457 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:15.541412 32090 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:15.537895  7418 raft_consensus.cc:2804] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:15.552003 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.553414   403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:15.560397 32090 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:15.562630 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.564558 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.565110 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.563424 32191 raft_consensus.cc:2468] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcfc3281929645969ecedbb0c0af759d in term 24.
I20260709 13:16:15.577229 32090 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:15.554687  7418 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:15.591789 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.592607 32090 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:15.530725  7461 raft_consensus.cc:515] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:15.569070  7427 leader_election.cc:290] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:15.573381  7465 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:15.601686 32090 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:15.622594  7448 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:15.565562  7450 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:15.605788  7463 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:15.606213  7473 raft_consensus.cc:2804] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:15.626137  7473 raft_consensus.cc:493] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:15.626550  7473 raft_consensus.cc:3060] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:15.626578  7461 leader_election.cc:290] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:15.599982  7418 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:15.606559  7475 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:15.606805  7436 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:15.608767  7446 leader_election.cc:290] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:15.613579  7362 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:15.613991   398 raft_consensus.cc:2955] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:15.599399  7468 leader_election.cc:290] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:15.588706  7460 leader_election.cc:290] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:15.608111  7449 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:15.618036 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.633486   400 raft_consensus.cc:2393] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 17: Already voted for candidate 94085cf341634eb686a95983b6b7f7e6 in this term.
I20260709 13:16:15.633911  7449 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 17 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:15.634853 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:15.640182  7473 raft_consensus.cc:515] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:15.642258  7454 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:15.642660  7473 leader_election.cc:290] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 23 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:15.618553  7411 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:15.620141  7352 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:15.624791 32090 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:16:15.646436 32090 leader_election.cc:304] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:15.647825  7437 raft_consensus.cc:2804] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:15.648203  7437 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:15.648605  7437 raft_consensus.cc:3060] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:15.650246 32090 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:15.654439  7411 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:15.656397 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.657608  7460 raft_consensus.cc:2804] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:15.658047  7460 raft_consensus.cc:493] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:16:15.658420  7460 raft_consensus.cc:3060] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:15.661413 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:15.663915 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:15.664464 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:15.665189 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:15.665678 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:15.677603  7393 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:15.679241  7409 leader_election.cc:290] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:15.684764  7453 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:15.686342 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:15.693341 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:15.697551 32264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:15.538672  7459 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:15.705215  7460 raft_consensus.cc:515] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:15.717550  7308 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:15.718111 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:15.675926  7437 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:15.720059 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:15.717180 32270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:15.724225 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:15.724684 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:15.726545 32195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.732669  7428 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:15.733356  7428 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:15.733886  7447 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:15.735635  7428 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:15.737627  7437 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:15.740510  7460 leader_election.cc:290] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:15.744980 32268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:15.738502  7466 raft_consensus.cc:1064] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:16:15.746440 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:15.748116 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f28f3141aec48eb9ada8a4f63ca7e32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.749552  7466 consensus_queue.cc:237] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 12, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:15.751209  7459 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:15.756716  7305 raft_consensus.cc:515] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:15.759866  7305 leader_election.cc:290] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:15.759622  7470 raft_consensus.cc:2955] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:15.762985 32199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375545897daf43fa925e7b181b2a634b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.763250 32193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aaa20c2aed4029bc6031c8bf5b7c71" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.763621 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a2e596cd6e4340bfea0e5a0e0609d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.766047 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.767059 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.767827 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.780870 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359bcc57ad77431cae0df4de7bf9b026" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.781301  7407 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:15.784878 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:15.785254   394 raft_consensus.cc:1240] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:15.787413 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.795606 32016 catalog_manager.cc:5697] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 11 to 12, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:15.805146 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.810597   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:15.809795   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:15.812630 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.813266   394 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 20.
I20260709 13:16:15.812630   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5708596452c34a319a19ae8a5b24b2df" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:15.822383 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.827931 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.824761  7308 consensus_queue.cc:1059] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:16:15.823197 32190 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 20.
I20260709 13:16:15.839057 32236 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:16:15.830726  7308 raft_consensus.cc:3055] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:15.852087 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b50ebff7ac4d9cbf8fc12c43ace31e" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.853725 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:16:15.857617   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 298508us
I20260709 13:16:15.847669  7308 raft_consensus.cc:740] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:16:15.873746 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fe55ed2a71411c95a6ffde95f58270" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.879855 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.848743  7478 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:15.884202 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:15.885422 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:15.891434   394 raft_consensus.cc:1275] T 7049b5c289c247ea8dda13c92984c95d P 94085cf341634eb686a95983b6b7f7e6 [term 19 LEARNER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:16:15.890133 32238 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:15.895507  7481 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:15.885035  7478 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:15.900460  7481 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:15.901185  7478 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:15.902906  7481 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:15.895895  7466 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:15.904177  7308 consensus_queue.cc:260] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:15.905524  7308 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:15.908162  7478 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:15.910832  7478 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:15.914721   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:16:15.915381   394 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:15.921285  7447 consensus_queue.cc:1048] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:16:15.923591 32271 raft_consensus.cc:1240] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 20. Current term is 21. Ops: []
I20260709 13:16:15.942210 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7049b5c289c247ea8dda13c92984c95d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.944131   394 raft_consensus.cc:2468] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 21.
I20260709 13:16:15.945758 32236 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:16:15.952708  7447 raft_consensus.cc:2804] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:16:15.960664 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea547a3502e4ffeacd79e160d8f60e6" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:15.961604  7470 raft_consensus.cc:493] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:16:15.962208  7470 raft_consensus.cc:515] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:15.964035 32191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002126350f9348faac039e490fafb4d7" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:15.964248  7470 leader_election.cc:290] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:15.965742 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11511d6fc4864afe9cef218fd4e0c0dc" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:15.966435   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:15.873162  7418 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: NON_VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: true } }
I20260709 13:16:15.968782 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a452e0dc995431dac6d83c19fd00a32" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:15.973062 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7594a5601f24445092c404115861232c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:15.976488 32238 leader_election.cc:304] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:15.985302 32238 leader_election.cc:304] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:15.984699 32089 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:15.948344  7457 consensus_queue.cc:1059] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.024s
I20260709 13:16:15.995916 32238 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:15.981596  7447 raft_consensus.cc:697] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:16:15.993597  7408 raft_consensus.cc:2749] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:16.006640 32089 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:16.009758  7436 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:16:16.014783   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 120059us
I20260709 13:16:16.017501 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0324508029249e0a1ff9d3eb1936981" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:16.017967 32089 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:15.996604  7392 raft_consensus.cc:2749] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:16.005607  7470 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:16:16.022921 32162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 132360us
W20260709 13:16:16.015558   369 consensus_peers.cc:597] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:16.023454 32089 leader_election.cc:304] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:16.025743  7305 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:16.026201 32089 leader_election.cc:304] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:16.027134  7305 raft_consensus.cc:2749] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:16.027551 32089 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:16.028394  7305 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:16.022890  7470 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:16.024163 32162 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:16.033869  7470 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:16:16.034164   369 consensus_peers.cc:597] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:16.034953   369 consensus_peers.cc:597] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:16.035619   369 consensus_peers.cc:597] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:16.036286   369 consensus_peers.cc:597] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:16.037253 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:16.041854  7481 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:16.042465  7481 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:16.045643  7418 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:16.045971 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:16.048005   369 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:16.049055 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:16.049687   369 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:16.050267  7428 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:16.051877  7481 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:16.055692  7491 raft_consensus.cc:493] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
W20260709 13:16:16.077907 32089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 48726.3us
I20260709 13:16:16.079162 32089 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:16.019492  7436 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:16:16.084216 32162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 60186us
I20260709 13:16:16.085031 32162 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:16.087253 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:16.023738  7460 raft_consensus.cc:2804] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:16.076126  7398 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:16:16.093793 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:16.095929   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaeda9c539745d5b9b44fb7acb8b438" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:16.096673   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b1d1e505fa4808b5b8fabb554df626" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:16.097412 32197 raft_consensus.cc:1275] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:16:16.101420 32089 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:16.092100 32190 raft_consensus.cc:2955] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:16.105557 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:16.079984  7404 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:16.110790 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d63bb58dbda1427191933eb8353d8d75" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:16.056325  7491 raft_consensus.cc:515] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:16:16.113056 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 53679.7us
I20260709 13:16:16.113969   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6ce5ae89cb4ad08c24a3a10d6fc0c2" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:16.118053 32089 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:16.102329  7447 consensus_queue.cc:237] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:16.128679  7445 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:16.130287 32089 leader_election.cc:304] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
W20260709 13:16:16.140012 32162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 45290.3us
I20260709 13:16:16.097162  7460 raft_consensus.cc:493] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:16.102566  7444 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:16.147228  7409 raft_consensus.cc:3055] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:16:16.150733  7491 leader_election.cc:290] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:16.152808  7476 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:16.156039  7483 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:16.175879  7483 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:16.156651  7451 raft_consensus.cc:2749] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:16:16.111264  7404 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:16.179251  7404 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:16.158028  7471 raft_consensus.cc:1064] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801: attempting to promote NON_VOTER 94085cf341634eb686a95983b6b7f7e6 to VOTER
I20260709 13:16:16.171670  7409 raft_consensus.cc:740] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:16:16.116343  7436 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:16.156391  7459 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:16.167445  7460 raft_consensus.cc:3060] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:16.191041  7409 consensus_queue.cc:260] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:16.192407  7409 raft_consensus.cc:3060] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:16:16.193161 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 78301.8us
I20260709 13:16:16.219117   395 raft_consensus.cc:1240] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 20. Current term is 21. Ops: []
I20260709 13:16:16.224887   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb482e4812e47d0a501b142e64cb73b" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 20 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:16.228049 32087 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:16.229316 32087 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:16.230150   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f89f60951b564577beff269254a33cde" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:16.230325 32087 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:16.238709 32087 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801
I20260709 13:16:16.239269 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d002861120de41408d48712b6bd491e1" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:16.240216 32087 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:16.198724  7459 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:16.244436  7470 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:16.222950  7483 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:16.235601  7436 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:16.237635  7437 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:16.237838  7450 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:16.242791  7457 raft_consensus.cc:2804] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:16.259614 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:16.242930  7475 raft_consensus.cc:2804] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:16.257462 32087 leader_election.cc:304] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:16.264402 32087 leader_election.cc:304] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:16.252840  7461 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:16.265487  7461 raft_consensus.cc:2749] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:16.266273   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7dfc158794e3ab7427d0b86b46c8d" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:16.267194  7470 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:16.266346  7437 raft_consensus.cc:2749] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:16.286237   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db983b299754e0eba1ba5726c892858" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:16.260080  7457 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:16.262277  7475 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:16.260613  7436 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:16.291785  7457 raft_consensus.cc:3060] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:16.293344  7475 raft_consensus.cc:3060] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:16:16.313318 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 112510us
W20260709 13:16:16.315250   369 consensus_peers.cc:597] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:16.316820   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6021998dccdb415f9b8203cebee0292c" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:16:16.286181  7404 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:16:16.316118   369 consensus_peers.cc:597] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:16.324864 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 64036.5us
W20260709 13:16:16.327723 32165 consensus_peers.cc:597] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:16.317116  7449 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:16:16.323179   369 consensus_peers.cc:597] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:16.334842 32165 consensus_peers.cc:597] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:16.336279 32165 consensus_peers.cc:597] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:16.336225   369 consensus_peers.cc:597] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:16.337697 32165 consensus_peers.cc:597] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:16.339301   369 leader_election.cc:336] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:16.341308 32271 raft_consensus.cc:1240] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Rejecting Update request from peer fcfc3281929645969ecedbb0c0af759d for earlier term 20. Current term is 21. Ops: []
W20260709 13:16:16.341392 32239 consensus_peers.cc:597] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:16.340324   369 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:16.343729 32239 consensus_peers.cc:597] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:16.345260  7436 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:16:16.345727 32239 consensus_peers.cc:597] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:16.346454 32239 consensus_peers.cc:597] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:16.338120  7471 consensus_queue.cc:237] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 13, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:16:16.347105 32239 consensus_peers.cc:597] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:16.347858 32239 leader_election.cc:336] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:16.348349 32239 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:16.355285  7460 raft_consensus.cc:515] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:16.356632  7459 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:16.335541  7449 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:16.358915  7449 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:16.360035  7450 consensus_queue.cc:1059] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:16.361600  7411 raft_consensus.cc:3055] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:16:16.361781  7404 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:16.362151  7411 raft_consensus.cc:740] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: fcfc3281929645969ecedbb0c0af759d, State: Running, Role: LEADER
I20260709 13:16:16.363343  7411 consensus_queue.cc:260] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:16.366561  7494 raft_consensus.cc:2955] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:16.369416 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:16.370781 32238 leader_election.cc:304] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:16.370864  7308 consensus_queue.cc:1048] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:16:16.372442  7478 raft_consensus.cc:2749] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:16.374185 32089 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:16.375511  7436 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:16:16.375653 32089 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:16.376722  7436 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:16:16.378038 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:16.379338 32089 leader_election.cc:304] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:16.380856   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:16:16.382099 30972 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:16.389179  7392 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:16.384053 30972 tablet_replica.cc:333] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:16.388861  7457 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:16.386126  7450 raft_consensus.cc:2749] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:16:16.398145 32165 consensus_peers.cc:597] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:16.398662 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 60394us
W20260709 13:16:16.399745 32165 consensus_peers.cc:597] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:16.400388 32165 consensus_peers.cc:597] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:16.400995 32165 consensus_peers.cc:597] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:16.404928 32165 consensus_peers.cc:597] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:16.405580 32165 consensus_peers.cc:597] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:16.409744 32197 raft_consensus.cc:1240] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Rejecting Update request from peer 6b3ed521ce8947db80c4b4828b355c06 for earlier term 19. Current term is 20. Ops: []
I20260709 13:16:16.412384  7457 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:16:16.386499 32239 leader_election.cc:336] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:16.418149 32239 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:16.417678  7464 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:16.419184  7460 leader_election.cc:290] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 25 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:16.416734 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:16.421092  7466 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:16:16.422338 32239 leader_election.cc:336] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:16.420266  7475 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:16.429550  7411 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:16.430485  7475 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Requested vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:16.423951  7476 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:16.431543 32239 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:16.432833  7466 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:16:16.434443 32239 leader_election.cc:336] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:16.435730 32239 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:16.437206  7466 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:16:16.437397 32239 leader_election.cc:336] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:16.439070 32239 leader_election.cc:304] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:16.441203   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 103366us
W20260709 13:16:16.442170   369 leader_election.cc:336] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:16.442692   369 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:16.444108  7466 raft_consensus.cc:2749] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:16.445232 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:16.446544 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:16:16.414413 32165 consensus_peers.cc:597] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:16.451699   369 leader_election.cc:336] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:16.454016   369 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:16.460356  7449 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:16.453472  7464 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:16:16.461468   369 leader_election.cc:336] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:16.448302 32239 leader_election.cc:336] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:16.461995   369 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:16.452554 32165 consensus_peers.cc:597] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:16.462813  7464 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:16.462162 32239 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:16.463070 32165 leader_election.cc:336] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:16.473186 32165 leader_election.cc:304] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:16.464123  7447 consensus_queue.cc:1059] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.009s
W20260709 13:16:16.466482 32239 consensus_peers.cc:597] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:16.470784 32087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:16.475761 32239 leader_election.cc:336] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:16.463994   369 leader_election.cc:336] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:16.476171 32239 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:16.476349   369 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:16.480346 32239 leader_election.cc:336] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:16.480927 32239 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:16.483567 32087 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:16.482848  7464 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:16.482930  7392 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:16:16.495663 32239 leader_election.cc:336] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:16.502192 32239 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:16.479595  7404 raft_consensus.cc:2749] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:16.485392 32087 leader_election.cc:304] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
W20260709 13:16:16.492499 32165 leader_election.cc:336] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:16.532908 32165 leader_election.cc:304] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:16.498029  7470 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:16.509884  7415 raft_consensus.cc:3055] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:16:16.533684  7415 raft_consensus.cc:740] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:16:16.534027  7491 raft_consensus.cc:2749] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:16:16.535183 32165 leader_election.cc:336] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:16.493574  7475 raft_consensus.cc:2749] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:16.466639  7466 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:16.515693 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:16.520516   398 raft_consensus.cc:1275] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6 [term 19 LEARNER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:16:16.523216 32272 consensus_queue.cc:237] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:16.527503 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:16.538214 30972 raft_consensus.cc:2243] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:16.539044 32165 leader_election.cc:304] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:16.539907  7491 raft_consensus.cc:2749] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:16:16.541462 32087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:40025, user_credentials={real_user=slave}} blocked reactor thread for 56148.8us
I20260709 13:16:16.541386  7491 consensus_queue.cc:1048] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:16:16.542531 32089 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:16.543645  7460 raft_consensus.cc:2749] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:16.544229  7418 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:16.545353 30972 raft_consensus.cc:2272] T 9d001b18973b4cbf86649781d9445577 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:16.528874 32239 consensus_peers.cc:597] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:16.546533 32239 consensus_peers.cc:597] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:16.547147 32239 leader_election.cc:336] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:16.548231 30972 tablet_replica.cc:333] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:16.542531 32087 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:16.549916 32087 leader_election.cc:304] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:16.550840   394 raft_consensus.cc:1275] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:16:16.551225  7475 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:16.551839  7475 raft_consensus.cc:2749] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:16.552670  7470 consensus_queue.cc:1048] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:16.553371 32087 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:16.531961  7352 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:16.534816  7415 consensus_queue.cc:260] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:16.560053  7415 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:16.547518 32239 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:16.561518 32239 leader_election.cc:336] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:16.561980 32239 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:16.565320 30972 raft_consensus.cc:2243] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:16.512614   369 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:16.566524  7475 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:16.566524  7428 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:16:16.567922   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 55407.1us
I20260709 13:16:16.573833  7392 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:16.574658  7392 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:16.575280   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:16:16.577117 30972 raft_consensus.cc:2272] T 359bcc57ad77431cae0df4de7bf9b026 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:16.578229   395 raft_consensus.cc:2955] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:16.587756 30972 tablet_replica.cc:333] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:16.588742 30972 raft_consensus.cc:2243] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:16:16.590196 32272 raft_consensus.cc:2955] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:16.598464   394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64767c8d367b4cc1b7e2ffbcbf73ce29" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:16:16.600793 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:16.613692 32197 raft_consensus.cc:1275] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:16:16.615010   369 leader_election.cc:336] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:16.615522   369 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:16.615576  7392 raft_consensus.cc:2955] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:16.618665   394 raft_consensus.cc:2955] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:16:16.670395 32239 leader_election.cc:336] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:16.672104 32239 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:16.679445  7464 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:16:16.680758   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 65780.5us
I20260709 13:16:16.687024 30972 raft_consensus.cc:2272] T cb6ba4c5418c4645a86d8c0dd19e918b P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:16.687251 32016 catalog_manager.cc:5697] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 11 to 12, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:16.700480 32265 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 20.
I20260709 13:16:16.706467  7447 consensus_queue.cc:1048] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:16.709718   398 raft_consensus.cc:2955] T 7049b5c289c247ea8dda13c92984c95d P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:16.712755  7308 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:16.712823 32239 leader_election.cc:336] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:16.714457 32239 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:16.714960 32009 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7beffc7d75824f0085f2b522bab2bc79 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:16:16.715529 32239 consensus_peers.cc:597] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:16.716080 32239 leader_election.cc:336] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:16.716136  7392 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:16:16.710048 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 44174.8us
I20260709 13:16:16.716495 32239 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:16.721990 32239 leader_election.cc:336] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:16.723364  7392 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:16.722772 32190 raft_consensus.cc:2955] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:16.722549 32239 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:16.724794  7308 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:16:16.726378 32239 leader_election.cc:336] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:16.728413 32239 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:16.729482  7447 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:16:16.730618 32239 leader_election.cc:336] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:16.731577 32239 leader_election.cc:336] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:16.731999 32239 leader_election.cc:304] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:16.627027  7352 raft_consensus.cc:2955] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 19 LEADER]: Committing config change with OpId 19.15: config changed from index 14 to 15, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:16.644796 32194 raft_consensus.cc:2955] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:16.748438  7447 raft_consensus.cc:2749] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:16.750439 32239 leader_election.cc:336] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:16.751063 32239 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:16.754287  7466 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:16:16.755839 32239 leader_election.cc:336] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:16.758046 32239 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:16.757407 32265 raft_consensus.cc:1275] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:16:16.760272  7466 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:16:16.789286   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 102649us
I20260709 13:16:16.790130   398 raft_consensus.cc:1275] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
W20260709 13:16:16.790987   369 leader_election.cc:336] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:16.788285 32022 catalog_manager.cc:5697] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: config changed from index 12 to 13, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New cstate: current_term: 18 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:16.793560 32022 catalog_manager.cc:5697] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 20 to 21, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 21 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:16.797811  7415 consensus_queue.cc:1048] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:16:16.800077 30972 tablet_replica.cc:333] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:16.803031 30972 raft_consensus.cc:2243] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:16.803902 30972 raft_consensus.cc:2272] T 7049b5c289c247ea8dda13c92984c95d P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:16.806962 30972 tablet_replica.cc:333] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:16.808012 30972 raft_consensus.cc:2243] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Raft consensus shutting down.
W20260709 13:16:16.814421 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 53569.3us
I20260709 13:16:16.817605 32165 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:16.836926  7492 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:16:16.837548  7492 raft_consensus.cc:697] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 20 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:16:16.838629  7404 consensus_queue.cc:1048] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:16:16.838519  7492 consensus_queue.cc:237] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:16.846091 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0265ef82085f409c9de498f37135c550" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:16.846748 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314924e72a7f4efa9cbae136ba7cd259" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:16.851348 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5e9c133ed6a41a3ae8f20d028374729" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:16.861347   369 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:16.863227  7449 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:16.880575 32089 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:16.881747  7411 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:16.898492 30972 raft_consensus.cc:2272] T a75997deb5a741f998b671928aad3637 P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:16.904736 32089 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:16.929278  7491 raft_consensus.cc:2955] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 19 LEADER]: Committing config change with OpId 19.15: config changed from index 13 to 15, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:16.934389 32273 raft_consensus.cc:2955] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 13 to 15, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:16.912206 32019 catalog_manager.cc:5697] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 19 to 20, leader changed from 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 20 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:16.950212 32019 catalog_manager.cc:5697] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 reported cstate change: config changed from index 14 to 15, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:16.953979  7418 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:16:16.962335 32194 consensus_queue.cc:237] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:16:16.968032   369 leader_election.cc:336] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:16.973449   395 raft_consensus.cc:2955] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 13 to 15, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:16.980540 30972 tablet_replica.cc:333] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:16.981540 30972 raft_consensus.cc:2243] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:16:16.982657 30972 raft_consensus.cc:2272] T ab526b36e2374499ab98f72175e85ec3 P fcfc3281929645969ecedbb0c0af759d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:16.985430 30972 tablet_replica.cc:333] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
W20260709 13:16:16.986214 32009 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 76245.4us
I20260709 13:16:16.989346 32087 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:16.986275 30972 raft_consensus.cc:2243] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:16.969571   369 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:17.000797  7418 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:16:17.001680 30972 raft_consensus.cc:2272] T f89f60951b564577beff269254a33cde P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.005404 32087 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:17.006284  7418 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:16:17.009418 32272 raft_consensus.cc:1275] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:16:17.010331 32239 leader_election.cc:336] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:17.010809 32239 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:17.012465 32239 leader_election.cc:336] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:17.013346 32239 leader_election.cc:336] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:17.013733 32239 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:17.015218 32165 leader_election.cc:336] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:17.015688 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:17.017825 32239 leader_election.cc:336] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:17.017951   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 52051.7us
I20260709 13:16:17.018314 32239 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:17.018621   369 leader_election.cc:336] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:17.019002   369 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:17.019798  7415 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:17.017398  7491 consensus_queue.cc:1048] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:16:17.019557 32022 catalog_manager.cc:5697] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 reported cstate change: config changed from index 13 to 15, 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:17.020659 30972 tablet_replica.cc:333] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.022344  7476 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:17.022549  7447 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:17.023102  7308 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:17.023154  7464 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:16:17.022516 32165 leader_election.cc:336] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:17.024552 30972 raft_consensus.cc:2243] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.027115   395 raft_consensus.cc:1275] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:16:17.030917 32165 leader_election.cc:304] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:17.032032 32165 leader_election.cc:336] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:17.032421 32165 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:17.038834 32165 leader_election.cc:336] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:17.039238 30972 raft_consensus.cc:2272] T 95f5e8022e3d4b9e9f240b21076de4c3 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.039314 32165 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:17.040360 32239 consensus_peers.cc:597] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:17.040457 32165 leader_election.cc:336] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:17.041121 32165 leader_election.cc:304] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:17.026345  7449 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:16:17.042412 32165 leader_election.cc:336] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:17.043002 32239 leader_election.cc:336] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:17.043741 32165 leader_election.cc:304] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:17.045094 32165 leader_election.cc:336] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:17.045473 32165 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:17.046710 32239 leader_election.cc:336] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:17.047063 32239 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:17.043097  7492 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:17.043237  7493 raft_consensus.cc:2749] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:17.053252  7493 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:17.053745  7494 raft_consensus.cc:2749] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:16:17.053968 32009 catalog_manager.cc:4755] TS fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7beffc7d75824f0085f2b522bab2bc79: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:16:17.041924  7491 consensus_queue.cc:1048] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:16:17.038133  7476 raft_consensus.cc:2749] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:17.042116  7404 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:17.058457  7415 raft_consensus.cc:2749] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:16:17.078845 30972 tablet_replica.cc:333] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.079794 30972 raft_consensus.cc:2243] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.080382 30972 raft_consensus.cc:2272] T dea547a3502e4ffeacd79e160d8f60e6 P fcfc3281929645969ecedbb0c0af759d [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:17.087507 32239 consensus_peers.cc:597] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:17.091747 30972 tablet_replica.cc:333] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.092694 30972 raft_consensus.cc:2243] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.092361  7476 raft_consensus.cc:2955] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:17.093395 30972 raft_consensus.cc:2272] T 06fe55ed2a71411c95a6ffde95f58270 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.097312   395 raft_consensus.cc:2955] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
W20260709 13:16:17.140782 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 95699.3us
W20260709 13:16:17.145798 32165 leader_election.cc:336] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:17.146242 32165 leader_election.cc:304] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:17.140147  7411 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:17.150671  7411 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:17.151576  7491 raft_consensus.cc:2749] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:17.152990  7411 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:16:17.153146 32165 leader_election.cc:336] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:17.153559 32165 leader_election.cc:304] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:17.154119 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:17.154247  7491 raft_consensus.cc:2749] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:17.166687 32019 catalog_manager.cc:5697] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: config changed from index 12 to 13, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New cstate: current_term: 14 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:17.172803 30972 tablet_replica.cc:333] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.173766 30972 raft_consensus.cc:2243] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.174345 30972 raft_consensus.cc:2272] T 375545897daf43fa925e7b181b2a634b P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.183509 30972 tablet_replica.cc:333] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.184343 30972 raft_consensus.cc:2243] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.184993 30972 raft_consensus.cc:2272] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.186407  7475 raft_consensus.cc:493] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:16:17.186914  7475 raft_consensus.cc:515] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:17.188243 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc0578da01e4736bf535c5df1439723" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:17.191622 32089 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:17.193547  7409 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:17.195258  7457 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:17.195984  7457 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:17.198262  7457 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:17.203958 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:17.204248 32267 raft_consensus.cc:2955] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER fcfc3281929645969ecedbb0c0af759d (127.30.63.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } } }
I20260709 13:16:17.208411  7475 leader_election.cc:290] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:17.211148 30972 tablet_replica.cc:333] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.217254 32008 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a933d5409ea04be9bd937643b14efae4 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:17.220674   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:17.223076 30972 raft_consensus.cc:2243] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Raft consensus shutting down.
W20260709 13:16:17.224488 32165 consensus_peers.cc:597] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:17.233934 30972 raft_consensus.cc:2272] T 0cf85dc23ac44824a3668eb1b1f3aa42 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.235687 32190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e09eecc9b2466db338be646fedba5f" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:17.235973 32197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980228c6820f4e3aab0ccf2eace31a25" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:17.236855 30972 tablet_replica.cc:333] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.237709 30972 raft_consensus.cc:2243] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:16:17.238217 32089 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:17.238557 30972 raft_consensus.cc:2272] T c477d57775f149408ec3429ac3fd28f4 P fcfc3281929645969ecedbb0c0af759d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.239348  7475 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:17.253257 30972 tablet_replica.cc:333] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.264891 32087 leader_election.cc:304] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6
I20260709 13:16:17.266587  7475 raft_consensus.cc:2749] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:17.270009 30972 raft_consensus.cc:2243] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.270848 30972 raft_consensus.cc:2272] T a08fb71ae3e84c459773fd53510d6e04 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.274003 30972 tablet_replica.cc:333] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.275206 30972 raft_consensus.cc:2243] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:16:17.276969 30972 raft_consensus.cc:2272] T 7f6867d296184651b908c8f457d74e4a P fcfc3281929645969ecedbb0c0af759d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.296932 30972 tablet_replica.cc:333] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.297958 30972 raft_consensus.cc:2243] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.298650 30972 raft_consensus.cc:2272] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.311368 30972 tablet_replica.cc:333] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.312299 30972 raft_consensus.cc:2243] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:16:17.314785 30972 raft_consensus.cc:2272] T 3868446e9dc747d9b702abc7c2888f8a P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.323832 30972 tablet_replica.cc:333] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.325026 30972 raft_consensus.cc:2243] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.325672 30972 raft_consensus.cc:2272] T e3aaa20c2aed4029bc6031c8bf5b7c71 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.336042 30972 tablet_replica.cc:333] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.337003 30972 raft_consensus.cc:2243] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.337715 30972 raft_consensus.cc:2272] T 0aaeda9c539745d5b9b44fb7acb8b438 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.340993 30972 tablet_replica.cc:333] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.354640 30972 raft_consensus.cc:2243] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:16:17.355971 30972 raft_consensus.cc:2272] T 0717a2686ee346b7a5a183e36fdfd173 P fcfc3281929645969ecedbb0c0af759d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.364353 30972 tablet_replica.cc:333] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.365168 30972 raft_consensus.cc:2243] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:16:17.366240 30972 raft_consensus.cc:2272] T 4124d037f0614ab8969bf0e130edd483 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.368743 30972 tablet_replica.cc:333] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.369485 30972 raft_consensus.cc:2243] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.370131 30972 raft_consensus.cc:2272] T 28b50ebff7ac4d9cbf8fc12c43ace31e P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.382207  7475 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:17.382740  7475 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:17.384871  7475 leader_election.cc:290] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:17.386144 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:17.386482 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10940646da924abea9f371781da8acee" candidate_uuid: "fcfc3281929645969ecedbb0c0af759d" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:17.389079 30972 tablet_replica.cc:333] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.389981 30972 raft_consensus.cc:2243] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:16:17.391074 30972 raft_consensus.cc:2272] T 3bdc1594189c43f49251261c5d073447 P fcfc3281929645969ecedbb0c0af759d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.394456 30972 tablet_replica.cc:333] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.395303 30972 raft_consensus.cc:2243] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:16:17.396339 30972 raft_consensus.cc:2272] T 33cee01befe74212ba61fb0673034f4c P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.399173 30972 tablet_replica.cc:333] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.399963 30972 raft_consensus.cc:2243] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:16:17.401068 30972 raft_consensus.cc:2272] T bdc0f3bc03be45ec89dc54321b977dd5 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.389999 32089 leader_election.cc:304] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcfc3281929645969ecedbb0c0af759d; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:17.402066  7475 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:17.412487  7518 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:17.413137  7518 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:17.415220  7518 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:17.418263 30972 tablet_replica.cc:333] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.422838 30972 raft_consensus.cc:2243] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.424836 30972 raft_consensus.cc:2272] T d002861120de41408d48712b6bd491e1 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.427747 30972 tablet_replica.cc:333] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.428508 30972 raft_consensus.cc:2243] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.429174 30972 raft_consensus.cc:2272] T afb482e4812e47d0a501b142e64cb73b P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.431612 30972 tablet_replica.cc:333] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.432349 30972 raft_consensus.cc:2243] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.432917 30972 raft_consensus.cc:2272] T c0324508029249e0a1ff9d3eb1936981 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.435901 30972 tablet_replica.cc:333] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.438748 32273 raft_consensus.cc:1275] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:16:17.441531 32165 leader_election.cc:336] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:17.424690 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:17.442945 32267 raft_consensus.cc:2393] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 113b5461952d47e0944d463ea4e32801 in current term 21: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:16:17.444883 30972 raft_consensus.cc:2243] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.445791 30972 raft_consensus.cc:2272] T 19e09eecc9b2466db338be646fedba5f P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.446920  7491 consensus_queue.cc:1048] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:16:17.449923 32165 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:17.451932 30972 tablet_replica.cc:333] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.453064 30972 raft_consensus.cc:2243] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:16:17.453287  7491 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:17.454386 30972 raft_consensus.cc:2272] T 6565a440fcf14a499c191f2835d21508 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.458338 30972 tablet_replica.cc:333] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.459438 30972 raft_consensus.cc:2243] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:16:17.460625 30972 raft_consensus.cc:2272] T 0fee96a531e44b88bbae1d896f392bdd P fcfc3281929645969ecedbb0c0af759d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.464692 30972 tablet_replica.cc:333] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.465660 30972 raft_consensus.cc:2243] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.466421 30972 raft_consensus.cc:2272] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P fcfc3281929645969ecedbb0c0af759d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.469549 30972 tablet_replica.cc:333] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.472247 30972 raft_consensus.cc:2243] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.474906 30972 raft_consensus.cc:2272] T a933d5409ea04be9bd937643b14efae4 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.511780   395 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:17.525636   395 raft_consensus.cc:1275] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:16:17.528411  7404 consensus_queue.cc:1048] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:16:17.537840 30972 tablet_replica.cc:333] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.541618 30972 raft_consensus.cc:2243] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.553364 30972 raft_consensus.cc:2272] T 980228c6820f4e3aab0ccf2eace31a25 P fcfc3281929645969ecedbb0c0af759d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.471992  7491 raft_consensus.cc:2749] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:17.567210 30972 tablet_replica.cc:333] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.570420 30972 raft_consensus.cc:2243] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.576156 30972 raft_consensus.cc:2272] T 7594a5601f24445092c404115861232c P fcfc3281929645969ecedbb0c0af759d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.589258 30972 tablet_replica.cc:333] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.590284 30972 raft_consensus.cc:2243] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.593600 30972 raft_consensus.cc:2272] T 6021998dccdb415f9b8203cebee0292c P fcfc3281929645969ecedbb0c0af759d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.596736 30972 tablet_replica.cc:333] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.598062 30972 raft_consensus.cc:2243] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.598686 30972 raft_consensus.cc:2272] T 5f28f3141aec48eb9ada8a4f63ca7e32 P fcfc3281929645969ecedbb0c0af759d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.601435 30972 tablet_replica.cc:333] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.604254 30972 raft_consensus.cc:2243] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.626504 30972 raft_consensus.cc:2272] T d5e9c133ed6a41a3ae8f20d028374729 P fcfc3281929645969ecedbb0c0af759d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.666030  7392 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.666678  7392 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:17.668375 30972 tablet_replica.cc:333] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.669237  7392 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:17.669425 30972 raft_consensus.cc:2243] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.670370 30972 raft_consensus.cc:2272] T 314924e72a7f4efa9cbae136ba7cd259 P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.674994 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:17.675804 32194 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:16:17.677563 32238 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:17.678862 30972 tablet_replica.cc:333] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.679677 30972 raft_consensus.cc:2243] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.679809  7392 raft_consensus.cc:2804] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:17.682085  7392 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.679342   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:17.680325 30972 raft_consensus.cc:2272] T 0a452e0dc995431dac6d83c19fd00a32 P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.696926  7392 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:17.697283   398 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:16:17.699769 30972 tablet_replica.cc:333] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.714284 30972 raft_consensus.cc:2243] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.715133 30972 raft_consensus.cc:2272] T 7beffc7d75824f0085f2b522bab2bc79 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.717805 30972 tablet_replica.cc:333] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.718590 30972 raft_consensus.cc:2243] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.719177 30972 raft_consensus.cc:2272] T 002126350f9348faac039e490fafb4d7 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.723045  7392 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:17.726188 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:17.726778 32194 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:17.726824 30972 tablet_replica.cc:333] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.727807 30972 raft_consensus.cc:2243] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.728459 30972 raft_consensus.cc:2272] T acd9953c536c4b5fa2ebab1015a61b53 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.736838 32194 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 18.
I20260709 13:16:17.740077 32238 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:17.741371  7447 raft_consensus.cc:2804] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:17.741909  7447 raft_consensus.cc:697] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:16:17.742596 30972 tablet_replica.cc:333] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.742832  7447 consensus_queue.cc:237] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:17.746411 30972 raft_consensus.cc:2243] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.750394   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05806ba48f814549969547f21c7101c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:16:17.751221   398 raft_consensus.cc:3060] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:17.756960 30972 raft_consensus.cc:2272] T afc0578da01e4736bf535c5df1439723 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.760274 30972 tablet_replica.cc:333] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.748081  7392 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:17.773161 30972 raft_consensus.cc:2243] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.781104 30972 raft_consensus.cc:2272] T 11511d6fc4864afe9cef218fd4e0c0dc P fcfc3281929645969ecedbb0c0af759d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.793279 30972 tablet_replica.cc:333] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.794111 30972 raft_consensus.cc:2243] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.794724 30972 raft_consensus.cc:2272] T 80b1d1e505fa4808b5b8fabb554df626 P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.810321 30972 tablet_replica.cc:333] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.811048 30972 raft_consensus.cc:2243] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.811832 30972 raft_consensus.cc:2272] T 10940646da924abea9f371781da8acee P fcfc3281929645969ecedbb0c0af759d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.826571 30972 tablet_replica.cc:333] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.828042 30972 raft_consensus.cc:2243] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.835186   398 raft_consensus.cc:2468] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 18.
I20260709 13:16:17.836833 30972 raft_consensus.cc:2272] T ddd7dfc158794e3ab7427d0b86b46c8d P fcfc3281929645969ecedbb0c0af759d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.836977 32019 catalog_manager.cc:5697] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:17.839252 30972 tablet_replica.cc:333] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.839929 30972 raft_consensus.cc:2243] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.840461 30972 raft_consensus.cc:2272] T 7db983b299754e0eba1ba5726c892858 P fcfc3281929645969ecedbb0c0af759d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.843122 30972 tablet_replica.cc:333] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d: stopping tablet replica
I20260709 13:16:17.843811 30972 raft_consensus.cc:2243] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.844544 30972 raft_consensus.cc:2272] T 0265ef82085f409c9de498f37135c550 P fcfc3281929645969ecedbb0c0af759d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.027915  7392 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.028522  7392 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:18.031646  7392 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:18.031771   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:18.032612   398 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:16:18.033968 32236 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:16:18.035178  7447 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:18.035612  7447 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.035975  7447 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:18.054270  7447 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:16:18.061347 32239 leader_election.cc:336] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:18.071333 32239 leader_election.cc:336] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:18.073941   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75997deb5a741f998b671928aad3637" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:16:18.074693   398 raft_consensus.cc:3060] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:18.079685  7447 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:18.083966   398 raft_consensus.cc:2468] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 18.
I20260709 13:16:18.095923 32236 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:18.097149  7447 raft_consensus.cc:2804] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:18.097718  7447 raft_consensus.cc:697] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:16:18.098699  7447 consensus_queue.cc:237] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:16:18.196863 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 72054.4us
I20260709 13:16:18.202695 32019 catalog_manager.cc:5697] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 17 to 18, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 18 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:18.242424 32194 raft_consensus.cc:1275] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:16:18.245184   395 raft_consensus.cc:1275] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:16:18.247972  7531 consensus_queue.cc:1048] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:16:18.249212  7524 consensus_queue.cc:1048] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:16:18.299594  7531 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.300185  7531 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:18.302448  7531 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:18.304729 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:16:18.306962 32239 leader_election.cc:336] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:18.307379 32239 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:18.309170  7524 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:18.322379  7524 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.322954  7524 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:18.325170  7524 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:18.326467   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:18.327116   395 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 16.
I20260709 13:16:18.328521 32236 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:16:18.330891  7524 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:18.334154  7524 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.334614  7524 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:16:18.339388 32239 leader_election.cc:336] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:18.350247  7493 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.351004  7493 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:18.353099  7493 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:18.355552 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:16:18.365612 32165 leader_election.cc:336] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:18.366160 32165 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:18.374642 32009 catalog_manager.cc:4755] TS fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7beffc7d75824f0085f2b522bab2bc79: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:18.375355  7493 raft_consensus.cc:2749] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:18.376367  7447 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.379006  7447 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:18.384491  7447 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:16:18.387825 32239 leader_election.cc:336] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:18.394937 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:18.395771 32194 raft_consensus.cc:2468] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 11.
I20260709 13:16:18.397378 32238 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:18.399340  7447 raft_consensus.cc:2804] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:18.400343  7447 raft_consensus.cc:493] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.400775  7447 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:18.421890  7524 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:18.439865   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb6ba4c5418c4645a86d8c0dd19e918b" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:16:18.440541   395 raft_consensus.cc:3060] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:16:18.446547 32239 leader_election.cc:336] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:18.442605  7524 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:16:18.458082 32239 consensus_peers.cc:597] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:18.467252   369 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111) [suppressed 234 similar messages]
W20260709 13:16:18.473133   369 consensus_peers.cc:597] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:18.476181   395 raft_consensus.cc:2468] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 17.
I20260709 13:16:18.477424 32236 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:18.478510  7415 raft_consensus.cc:2804] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:18.479046  7415 raft_consensus.cc:697] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:16:18.479926  7415 consensus_queue.cc:237] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:18.495496  7524 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.496122  7524 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:18.500459  7530 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.501091  7530 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:18.503386  7530 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:18.504976 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:18.498307  7524 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:16:18.509829 32239 leader_election.cc:336] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:18.515012 32239 leader_election.cc:336] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:18.515452 32239 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:18.518400  7524 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:18.519917   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:18.530885 32019 catalog_manager.cc:5697] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 16 to 17, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 17 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:18.533443  7524 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.536192  7524 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:18.537221  7447 raft_consensus.cc:515] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:18.539685 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:18.540282 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab526b36e2374499ab98f72175e85ec3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:18.540746  7524 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:18.540853 32198 raft_consensus.cc:3060] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:18.546152 32236 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:18.547286  7524 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:18.552167 32198 raft_consensus.cc:2468] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 12.
I20260709 13:16:18.553455 32238 leader_election.cc:304] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:18.541936  7447 leader_election.cc:290] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:18.554523  7447 raft_consensus.cc:2804] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:18.555742  7447 raft_consensus.cc:697] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:16:18.556617  7415 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.557281  7415 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:18.559296  7415 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:18.556710  7447 consensus_queue.cc:237] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:18.561983 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:16:18.584178 32239 leader_election.cc:336] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:18.584684 32239 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:18.586284  7415 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:18.588514  7415 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.589138  7415 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:18.598683 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:18.599028  7415 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:16:18.585685 32239 leader_election.cc:336] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:18.604621 32239 leader_election.cc:336] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:18.605116 32239 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:18.606084  7415 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:18.623450 32016 catalog_manager.cc:5697] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 11 to 12, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 12 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:18.637212 32239 consensus_peers.cc:597] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:18.638671 32239 leader_election.cc:336] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:18.639087 32239 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:18.639807  7447 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.640324  7447 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:18.640703  7524 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:18.642509  7447 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:16:18.646705   369 consensus_peers.cc:597] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:18.647760 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:16:18.648356 32239 consensus_peers.cc:597] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:18.648846 32239 consensus_peers.cc:597] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:18.649228 32239 consensus_peers.cc:597] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:18.651577 32239 leader_election.cc:336] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:18.655108 32238 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:18.655877  7415 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:18.658959  7447 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.659473  7447 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:18.661581  7447 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:18.662917 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
W20260709 13:16:18.678941 32239 leader_election.cc:336] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:18.679378 32239 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:18.680090  7447 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:16:18.681082 32239 consensus_peers.cc:597] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:18.686534  7404 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.687150  7404 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:18.689239  7404 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:18.691095  7491 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.691593  7491 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:18.693015  7493 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.693547  7491 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:18.693501  7493 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:18.694121  7491 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.694613  7491 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:18.695441  7493 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:18.696228 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:18.696811 32273 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 16.
I20260709 13:16:18.696797  7491 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:18.701767 32165 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:18.702867 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:18.707636 32273 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 18.
W20260709 13:16:18.707827 32165 leader_election.cc:336] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:18.702996  7464 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.703408 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:18.703603 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:18.708505  7464 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:18.709144 32267 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 19.
I20260709 13:16:18.709247   395 raft_consensus.cc:1275] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:16:18.708863  7404 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:18.703418  7517 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.709928  7404 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.710352  7404 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:18.710063  7517 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:18.710589  7464 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:18.711115  7447 consensus_queue.cc:1048] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:16:18.712153  7517 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:18.714670 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:18.723645 32165 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:18.724444  7491 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:18.724905  7491 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.725310  7491 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:18.733258 32165 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:18.735862 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:18.736562 32267 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 17.
I20260709 13:16:18.747460  7404 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:18.748821  7493 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:16:18.748893   369 leader_election.cc:336] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:18.749295  7493 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
W20260709 13:16:18.749603   369 leader_election.cc:336] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:18.749742  7493 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:18.750031   369 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:18.750912  7545 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:16:18.775836 32239 consensus_peers.cc:597] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:18.785136 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 51933.1us
W20260709 13:16:18.785851 32165 leader_election.cc:336] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:18.786511 32165 leader_election.cc:336] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:18.788570 32239 consensus_peers.cc:597] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:18.751009   369 consensus_peers.cc:597] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:18.790321   369 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:18.790719  7491 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:18.793008  7491 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:18.793443  7517 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:18.793581  7491 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.793990  7517 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.794461  7517 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:18.794188  7491 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:18.795287  7493 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:18.802856  7517 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:18.806713  7404 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:18.808099  7549 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.808691  7549 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:18.810703  7549 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:18.796291  7491 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:18.807595  7493 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:18.806898  7517 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:18.820788 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:18.822755  7547 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.824203 32272 raft_consensus.cc:3060] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:18.824262  7547 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:16:18.827663   369 leader_election.cc:336] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:18.828027   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
W20260709 13:16:18.803242 32165 leader_election.cc:336] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:18.828641   395 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 13.
I20260709 13:16:18.828857 32165 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 113b5461952d47e0944d463ea4e32801; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:18.830000 32162 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:16:18.835480 32272 raft_consensus.cc:2468] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 18.
I20260709 13:16:18.839237 32265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868446e9dc747d9b702abc7c2888f8a" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:18.832445  7493 raft_consensus.cc:2749] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:18.839808 32265 raft_consensus.cc:3060] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:18.835999  7549 raft_consensus.cc:2804] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:18.836258  7547 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:18.837023 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4124d037f0614ab8969bf0e130edd483" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:18.842422 32267 raft_consensus.cc:3060] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:18.843488 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:18.844087 32269 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 26.
I20260709 13:16:18.845192   369 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:18.846406 32165 consensus_peers.cc:597] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:18.846997  7545 raft_consensus.cc:2804] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:18.847498  7545 raft_consensus.cc:697] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEADER]: Becoming Leader. State: Replica: 94085cf341634eb686a95983b6b7f7e6, State: Running, Role: LEADER
I20260709 13:16:18.848363  7545 consensus_queue.cc:237] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:18.837724 32273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:18.838887 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fee96a531e44b88bbae1d896f392bdd" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:18.850248 32271 raft_consensus.cc:3060] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:18.856264 32265 raft_consensus.cc:2468] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 20.
I20260709 13:16:18.857237 32271 raft_consensus.cc:2468] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 17.
I20260709 13:16:18.850229 32273 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 21.
I20260709 13:16:18.873247 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:18.873580  7493 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.874195  7493 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:18.876310  7493 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:18.877429  7404 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:16:18.874197 32165 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:18.878569 32165 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:18.879971  7493 raft_consensus.cc:2804] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:16:18.877838  7404 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 26 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.881282  7404 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:16:18.887461 32239 consensus_peers.cc:597] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:18.890763  7552 raft_consensus.cc:2804] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:18.902518 32267 raft_consensus.cc:2468] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 19.
I20260709 13:16:18.841856  7549 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.906165  7530 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.906782  7530 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:16:18.914155 32239 leader_election.cc:336] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:18.914469 32165 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:18.915354  7530 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:18.915566  7547 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:18.915962  7547 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.916319  7547 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:18.892110  7404 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:18.917070 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:18.917699 32198 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:16:18.918957  7404 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 27 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:18.918970 32238 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:18.920401 32165 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:18.919961  7493 raft_consensus.cc:697] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 20 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:16:18.923100  7493 consensus_queue.cc:237] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:18.920145  7549 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:18.926487  7530 raft_consensus.cc:2804] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:18.937029 32016 catalog_manager.cc:5697] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 reported cstate change: term changed from 17 to 18, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4). New cstate: current_term: 18 leader_uuid: "94085cf341634eb686a95983b6b7f7e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:18.950314 32165 leader_election.cc:336] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:18.951488 32165 leader_election.cc:336] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:18.952358 32165 leader_election.cc:336] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:18.953243 32165 leader_election.cc:336] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:18.954167 32165 leader_election.cc:336] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:18.955094 32165 consensus_peers.cc:597] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:18.955651 32165 leader_election.cc:336] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:18.932467  7553 raft_consensus.cc:2804] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:16:18.959774  7553 raft_consensus.cc:697] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 19 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:16:18.961184  7553 consensus_queue.cc:237] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:18.937806  7530 raft_consensus.cc:493] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:18.972071  7530 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:18.980607  7524 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.991608  7524 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:18.993872  7524 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:16:18.995404   369 consensus_peers.cc:597] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:18.996331 32239 consensus_peers.cc:597] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:18.996933 32239 consensus_peers.cc:597] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:18.996989 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801" is_pre_election: true
I20260709 13:16:18.997655 32198 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 21.
I20260709 13:16:18.999389 32238 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
W20260709 13:16:19.001032 32239 leader_election.cc:336] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:19.002315 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:19.002983 32272 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 20.
I20260709 13:16:19.005249 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c477d57775f149408ec3429ac3fd28f4" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
W20260709 13:16:19.005568   369 consensus_peers.cc:597] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:19.005867 32267 raft_consensus.cc:3060] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:19.012511 32267 raft_consensus.cc:2468] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 27.
I20260709 13:16:19.013705  7530 raft_consensus.cc:515] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:18.933917  7552 raft_consensus.cc:697] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 17 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:16:18.992129  7547 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:19.018272  7551 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:19.020437  7551 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:19.022475  7551 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:19.023439  7547 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:19.016098  7524 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:19.026660  7524 raft_consensus.cc:493] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.027034  7524 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:19.027118   395 raft_consensus.cc:1275] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:16:19.030004  7415 consensus_queue.cc:1048] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:16:19.039857   369 consensus_peers.cc:597] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:19.041460  7552 consensus_queue.cc:237] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:19.043460 32016 catalog_manager.cc:5697] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 19 to 20, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 20 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:19.047560 32165 consensus_peers.cc:597] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:19.048262  7549 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:19.052265  7549 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:19.054148 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:19.062407 32267 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 21.
I20260709 13:16:19.054436   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0717a2686ee346b7a5a183e36fdfd173" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:16:19.063285   398 raft_consensus.cc:3060] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:19.055917 32198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdc1594189c43f49251261c5d073447" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:19.068972 32198 raft_consensus.cc:3060] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:19.056514 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cee01befe74212ba61fb0673034f4c" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:19.072877 32272 raft_consensus.cc:3060] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:16:19.084883   369 consensus_peers.cc:597] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:19.087906 32198 raft_consensus.cc:2468] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:16:19.089036   398 raft_consensus.cc:2468] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 14.
I20260709 13:16:19.061038  7524 raft_consensus.cc:515] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:19.090441 32162 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:16:19.088454 32272 raft_consensus.cc:2468] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 22.
I20260709 13:16:19.091274  7524 leader_election.cc:290] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:19.061743  7530 leader_election.cc:290] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:16:19.097216 32239 leader_election.cc:336] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:19.116662  7549 raft_consensus.cc:2804] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:19.117208  7549 raft_consensus.cc:697] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:16:19.117924 32194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d001b18973b4cbf86649781d9445577" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "113b5461952d47e0944d463ea4e32801"
I20260709 13:16:19.118106  7549 consensus_queue.cc:237] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:19.118566 32194 raft_consensus.cc:3060] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:19.120994 32165 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:19.122931  7547 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:19.123297  7547 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:19.123632  7547 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:19.125257 32165 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:19.128072 32194 raft_consensus.cc:2468] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 22.
I20260709 13:16:19.141563 32194 raft_consensus.cc:1275] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:16:19.141630 32238 leader_election.cc:304] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:19.141846  7551 raft_consensus.cc:2804] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:16:19.142647  7551 raft_consensus.cc:697] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 27 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:16:19.143671  7551 consensus_queue.cc:237] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:19.143947 32238 leader_election.cc:304] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:19.142693  7559 raft_consensus.cc:2804] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:19.147432  7415 raft_consensus.cc:2804] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:19.147744  7530 consensus_queue.cc:1048] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:19.148308  7559 raft_consensus.cc:697] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:16:19.149261  7559 consensus_queue.cc:237] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:19.148041  7415 raft_consensus.cc:697] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:16:19.152347  7415 consensus_queue.cc:237] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:19.166466 32165 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:19.168289  7551 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:19.167804 32016 catalog_manager.cc:5697] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 16 to 17, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 17 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:19.168730  7551 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting leader election (detected failure of leader fcfc3281929645969ecedbb0c0af759d)
I20260709 13:16:19.169167  7551 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:19.169755 32016 catalog_manager.cc:5697] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 18 to 19, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 19 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:19.172883 32165 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:19.173640  7549 raft_consensus.cc:2804] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:19.174105  7549 raft_consensus.cc:697] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 22 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
W20260709 13:16:19.174319 32165 leader_election.cc:336] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:19.175113 32165 consensus_peers.cc:597] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:19.174932  7549 consensus_queue.cc:237] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:16:19.175572 32165 consensus_peers.cc:597] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:19.176004 32165 leader_election.cc:336] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:19.176386 30972 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 32145)
W20260709 13:16:19.182564   369 consensus_peers.cc:597] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:19.189265 32239 consensus_peers.cc:597] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:19.189872 32239 consensus_peers.cc:597] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:19.190315 32239 leader_election.cc:336] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:19.132411  7547 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:19.201198 32016 catalog_manager.cc:5697] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 14 to 15, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 15 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:19.203652  7547 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:19.203437 32016 catalog_manager.cc:5697] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 20 to 22, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 22 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:19.215795  7551 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:19.217609  7551 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 election: Requested vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:16:19.218081 32239 consensus_peers.cc:597] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:19.222632 32019 catalog_manager.cc:5697] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 13 to 14, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 14 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:19.224696 32019 catalog_manager.cc:5697] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 26 to 27, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 27 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:19.228263 32239 consensus_peers.cc:597] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:19.228928 32239 consensus_peers.cc:597] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:19.229547 32019 catalog_manager.cc:5697] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 21 to 22, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 22 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:19.234953 32272 raft_consensus.cc:1275] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Refusing update from remote peer 94085cf341634eb686a95983b6b7f7e6: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:16:19.237735  7545 consensus_queue.cc:1048] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:16:19.239841 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 63852.8us
I20260709 13:16:19.259783 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6565a440fcf14a499c191f2835d21508" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:19.260449 32272 raft_consensus.cc:3060] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:16:19.269251   369 consensus_peers.cc:597] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:19.286461 32272 raft_consensus.cc:2468] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 21.
I20260709 13:16:19.299326 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0f3bc03be45ec89dc54321b977dd5" candidate_uuid: "113b5461952d47e0944d463ea4e32801" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06"
I20260709 13:16:19.300420 32272 raft_consensus.cc:3060] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:16:19.323726   369 consensus_peers.cc:597] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:19.334630 32165 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: 
I20260709 13:16:19.339938  7547 raft_consensus.cc:2804] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:16:19.340514  7547 raft_consensus.cc:697] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 21 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:16:19.341478  7547 consensus_queue.cc:237] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:19.355062 32272 raft_consensus.cc:2468] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 113b5461952d47e0944d463ea4e32801 in term 22.
W20260709 13:16:19.361819 32165 leader_election.cc:336] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:19.362644 32165 consensus_peers.cc:597] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:19.363071 32165 consensus_peers.cc:597] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:19.363548 32165 consensus_peers.cc:597] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:19.363941 32165 consensus_peers.cc:597] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:19.364313 32165 leader_election.cc:336] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:19.364954 32165 leader_election.cc:336] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:19.365744 32165 consensus_peers.cc:597] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:19.366374 32165 leader_election.cc:336] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:19.367108 32165 leader_election.cc:336] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:19.367762 32165 consensus_peers.cc:597] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:19.381203 32022 catalog_manager.cc:5697] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 20 to 21, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 21 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:19.389885 32165 consensus_peers.cc:597] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:19.399479 32165 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06; no voters: fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:19.400262  7547 raft_consensus.cc:2804] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:19.400799  7547 raft_consensus.cc:697] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 22 LEADER]: Becoming Leader. State: Replica: 113b5461952d47e0944d463ea4e32801, State: Running, Role: LEADER
I20260709 13:16:19.401695  7547 consensus_queue.cc:237] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:19.437865 32022 catalog_manager.cc:5697] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 reported cstate change: term changed from 21 to 22, leader changed from fcfc3281929645969ecedbb0c0af759d (127.30.63.1) to 113b5461952d47e0944d463ea4e32801 (127.30.63.2). New cstate: current_term: 22 leader_uuid: "113b5461952d47e0944d463ea4e32801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:19.501588 32271 raft_consensus.cc:1275] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:16:19.525207 32009 catalog_manager.cc:4755] TS fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7beffc7d75824f0085f2b522bab2bc79: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:19.529359  7553 consensus_queue.cc:1048] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:16:19.542059 32165 consensus_peers.cc:597] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:19.555678 32165 consensus_peers.cc:597] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:19.687996   395 raft_consensus.cc:1275] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:16:19.691355  7552 consensus_queue.cc:1048] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:19.710664 32271 raft_consensus.cc:1275] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:16:19.713649 32271 raft_consensus.cc:1275] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:16:19.717159   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:36651, user_credentials={real_user=slave}} blocked reactor thread for 76490.5us
I20260709 13:16:19.719637 32198 raft_consensus.cc:1275] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:16:19.721619  7530 consensus_queue.cc:1048] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:19.742300 32269 raft_consensus.cc:1275] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:16:19.743223 32165 consensus_peers.cc:597] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:19.744131 32165 consensus_peers.cc:597] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:19.745368 32165 consensus_peers.cc:597] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:19.764420 32165 consensus_peers.cc:597] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:19.775550 32165 consensus_peers.cc:597] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:19.796444 32267 raft_consensus.cc:1275] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 27 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
W20260709 13:16:19.802980 32239 consensus_peers.cc:597] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:19.805328  7549 consensus_queue.cc:1048] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:19.809250  7547 consensus_queue.cc:1048] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:19.816687  7547 consensus_queue.cc:1048] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:16:19.817570  7579 log.cc:927] Time spent T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:16:19.850618  7553 consensus_queue.cc:1048] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:16:19.861665 32239 consensus_peers.cc:597] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:19.890312 32194 raft_consensus.cc:1275] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:16:19.892262  7559 consensus_queue.cc:1048] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:19.949155 32273 raft_consensus.cc:1275] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:16:19.953424 32269 raft_consensus.cc:1275] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Refusing update from remote peer 113b5461952d47e0944d463ea4e32801: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:16:19.983989 32165 consensus_peers.cc:597] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:20.090243  7549 consensus_queue.cc:1048] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:20.092710  7549 consensus_queue.cc:1048] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:16:20.254556 32239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 69652.1us
W20260709 13:16:20.259829 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 85518.2us
W20260709 13:16:20.383690 32165 consensus_peers.cc:597] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:20.914671   369 consensus_peers.cc:597] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:20.921744 32239 consensus_peers.cc:597] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:20.927891 32239 consensus_peers.cc:597] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:20.980967 32239 consensus_peers.cc:597] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:21.110898 32165 consensus_peers.cc:597] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:21.140820   369 consensus_peers.cc:597] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:21.186847   369 consensus_peers.cc:597] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:21.230472 32239 consensus_peers.cc:597] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:21.257022 32239 consensus_peers.cc:597] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:21.268620 32239 consensus_peers.cc:597] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:21.292420 32239 consensus_peers.cc:597] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:21.382180 32165 consensus_peers.cc:597] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:21.382968 32239 consensus_peers.cc:597] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:21.382326   369 consensus_peers.cc:597] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:21.405817   369 consensus_peers.cc:597] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:21.426369 32239 consensus_peers.cc:597] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:21.429397 32239 consensus_peers.cc:597] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:21.433773 32165 consensus_peers.cc:597] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:21.498332 32165 consensus_peers.cc:597] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:21.507069   369 consensus_peers.cc:597] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:21.524797 32165 consensus_peers.cc:597] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:21.547348 32165 consensus_peers.cc:597] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:21.547631   369 consensus_peers.cc:597] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:21.618507   369 consensus_peers.cc:597] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:21.625581 32165 consensus_peers.cc:597] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:21.635267 32009 catalog_manager.cc:4755] TS fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7beffc7d75824f0085f2b522bab2bc79: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:21.636031 32165 consensus_peers.cc:597] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:21.651645   369 consensus_peers.cc:597] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:21.666077 32239 consensus_peers.cc:597] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:21.718565 32239 consensus_peers.cc:597] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:21.759733 32165 consensus_peers.cc:597] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:21.766741 32165 consensus_peers.cc:597] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:21.791900 32239 consensus_peers.cc:597] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:21.848178 32165 consensus_peers.cc:597] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:21.908110 32165 consensus_peers.cc:597] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:21.964480 32239 consensus_peers.cc:597] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:21.987659 32239 consensus_peers.cc:597] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:21.993052 32239 consensus_peers.cc:597] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:21.999523   369 consensus_peers.cc:597] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:22.101263 32165 consensus_peers.cc:597] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:22.113593 32165 consensus_peers.cc:597] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:22.195286 32165 consensus_peers.cc:597] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:22.253041 32239 consensus_peers.cc:597] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:22.282302 32165 consensus_peers.cc:597] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:22.373554 32239 consensus_peers.cc:597] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:22.375617 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 47366.6us
W20260709 13:16:22.462337 32165 consensus_peers.cc:597] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:22.477732 32165 consensus_peers.cc:597] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:22.732151 32165 consensus_peers.cc:597] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:22.743752 32165 consensus_peers.cc:597] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:22.786585 30972 tablet_server.cc:196] TabletServer@127.30.63.1:0 shutdown complete.
W20260709 13:16:22.790859 32165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 46588us
W20260709 13:16:23.016752 32165 consensus_peers.cc:597] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:23.034206 30972 tablet_server.cc:179] TabletServer@127.30.63.2:0 shutting down...
W20260709 13:16:23.046717   369 consensus_peers.cc:597] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:23.075501 32238 consensus_peers.cc:597] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:23.091800   368 consensus_peers.cc:597] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:23.111835 32238 consensus_peers.cc:597] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:23.135896   368 consensus_peers.cc:597] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:23.137873 32238 consensus_peers.cc:597] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:23.150065 32238 consensus_peers.cc:597] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:23.171535   368 consensus_peers.cc:597] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:23.197293 32238 consensus_peers.cc:597] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:23.209218 30972 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:23.212476 30972 tablet_replica.cc:333] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.213630 30972 raft_consensus.cc:2243] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:23.214398 30972 raft_consensus.cc:2272] T 9d001b18973b4cbf86649781d9445577 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.218688 30972 tablet_replica.cc:333] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.219509 30972 raft_consensus.cc:2243] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:23.220228 30972 raft_consensus.cc:2272] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.223451 30972 tablet_replica.cc:333] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.224323 30972 raft_consensus.cc:2243] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:16:23.225365 30972 raft_consensus.cc:2272] T 359bcc57ad77431cae0df4de7bf9b026 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.229364 30972 tablet_replica.cc:333] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.230325 30972 raft_consensus.cc:2243] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:23.231559 30972 raft_consensus.cc:2272] T 7049b5c289c247ea8dda13c92984c95d P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:23.236038 32238 consensus_peers.cc:597] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:23.237380 30972 tablet_replica.cc:333] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
W20260709 13:16:23.241886   368 consensus_peers.cc:597] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:23.240628 30972 raft_consensus.cc:2243] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:23.243554 30972 raft_consensus.cc:2272] T ab526b36e2374499ab98f72175e85ec3 P 113b5461952d47e0944d463ea4e32801 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:23.249140 32238 consensus_peers.cc:597] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:23.253433 32238 consensus_peers.cc:597] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:23.254586 32238 consensus_peers.cc:597] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:23.257889 32238 consensus_peers.cc:597] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:23.268989 32239 consensus_peers.cc:597] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:23.271847   368 consensus_peers.cc:597] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:23.272531 30972 tablet_replica.cc:333] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
W20260709 13:16:23.284061 32238 consensus_peers.cc:597] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:23.279703 30972 raft_consensus.cc:2243] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:23.286494 30972 raft_consensus.cc:2272] T 0a452e0dc995431dac6d83c19fd00a32 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.295202 30972 tablet_replica.cc:333] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.296311 30972 raft_consensus.cc:2243] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:16:23.299693 30972 raft_consensus.cc:2272] T c477d57775f149408ec3429ac3fd28f4 P 113b5461952d47e0944d463ea4e32801 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.309329 30972 tablet_replica.cc:333] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.311004 30972 raft_consensus.cc:2243] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:16:23.312186 30972 raft_consensus.cc:2272] T a08fb71ae3e84c459773fd53510d6e04 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:23.312227 32238 consensus_peers.cc:597] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:23.314839 30972 tablet_replica.cc:333] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.315713 30972 raft_consensus.cc:2243] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 19 LEADER]: Raft consensus shutting down.
W20260709 13:16:23.329128 32238 consensus_peers.cc:597] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:23.329713 30972 raft_consensus.cc:2272] T 95f5e8022e3d4b9e9f240b21076de4c3 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.339452 30972 tablet_replica.cc:333] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.343005 30972 raft_consensus.cc:2243] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:23.343822 30972 raft_consensus.cc:2272] T dea547a3502e4ffeacd79e160d8f60e6 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.346930 30972 tablet_replica.cc:333] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.348038 30972 raft_consensus.cc:2243] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 13:16:23.348268   368 consensus_peers.cc:597] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:23.349423 30972 raft_consensus.cc:2272] T 06fe55ed2a71411c95a6ffde95f58270 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.368563 30972 tablet_replica.cc:333] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.369472 30972 raft_consensus.cc:2243] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:16:23.370726 30972 raft_consensus.cc:2272] T 375545897daf43fa925e7b181b2a634b P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.373378 30972 tablet_replica.cc:333] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.374222 30972 raft_consensus.cc:2243] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:16:23.375583 30972 raft_consensus.cc:2272] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 113b5461952d47e0944d463ea4e32801 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.378486 30972 tablet_replica.cc:333] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.379666 30972 raft_consensus.cc:2243] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:16:23.380776 30972 raft_consensus.cc:2272] T 3868446e9dc747d9b702abc7c2888f8a P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.383605 30972 tablet_replica.cc:333] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.384372 30972 raft_consensus.cc:2243] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:16:23.385504 30972 raft_consensus.cc:2272] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.388186 30972 tablet_replica.cc:333] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.391680 30972 raft_consensus.cc:2243] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 13:16:23.394752   368 consensus_peers.cc:597] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:23.392560 30972 raft_consensus.cc:2272] T d63bb58dbda1427191933eb8353d8d75 P 113b5461952d47e0944d463ea4e32801 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:23.414472 32238 consensus_peers.cc:597] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:23.416682 30972 tablet_replica.cc:333] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.434587 30972 raft_consensus.cc:2243] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Raft consensus shutting down.
W20260709 13:16:23.440848   368 consensus_peers.cc:597] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:23.441787 30972 raft_consensus.cc:2272] T 547f929c96244ef9a23b3eec5126aa3e P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.444833 30972 tablet_replica.cc:333] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.445843 30972 raft_consensus.cc:2243] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:23.446568 30972 raft_consensus.cc:2272] T 0aaeda9c539745d5b9b44fb7acb8b438 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.470222 30972 tablet_replica.cc:333] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.471056 30972 raft_consensus.cc:2243] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Raft consensus shutting down.
W20260709 13:16:23.471071 32238 consensus_peers.cc:597] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:23.477639 30972 raft_consensus.cc:2272] T 0717a2686ee346b7a5a183e36fdfd173 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:23.480134 32165 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111) [suppressed 518 similar messages]
W20260709 13:16:23.488446   368 consensus_peers.cc:597] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:23.488876 30972 tablet_replica.cc:333] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.491053 30972 raft_consensus.cc:2243] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 19 LEADER]: Raft consensus shutting down.
W20260709 13:16:23.503970 32239 consensus_peers.cc:597] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:23.505637 30972 raft_consensus.cc:2272] T 4124d037f0614ab8969bf0e130edd483 P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:23.508296   368 consensus_peers.cc:597] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:23.508466 30972 tablet_replica.cc:333] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.512861 30972 raft_consensus.cc:2243] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:23.513556 30972 raft_consensus.cc:2272] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 113b5461952d47e0944d463ea4e32801 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.516434 30972 tablet_replica.cc:333] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.517289 30972 raft_consensus.cc:2243] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:23.517920 30972 raft_consensus.cc:2272] T 3bdc1594189c43f49251261c5d073447 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.520483 30972 tablet_replica.cc:333] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.521845 30972 raft_consensus.cc:2243] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:23.522694 30972 raft_consensus.cc:2272] T 5708596452c34a319a19ae8a5b24b2df P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.526041 30972 tablet_replica.cc:333] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.526904 30972 raft_consensus.cc:2243] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:23.527781 30972 raft_consensus.cc:2272] T d002861120de41408d48712b6bd491e1 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.530534 30972 tablet_replica.cc:333] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.531350 30972 raft_consensus.cc:2243] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:16:23.532486 30972 raft_consensus.cc:2272] T bdc0f3bc03be45ec89dc54321b977dd5 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.539981 30972 tablet_replica.cc:333] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.540768 30972 raft_consensus.cc:2243] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:16:23.542101 30972 raft_consensus.cc:2272] T 33cee01befe74212ba61fb0673034f4c P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.544890 30972 tablet_replica.cc:333] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.545764 30972 raft_consensus.cc:2243] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:23.546413 30972 raft_consensus.cc:2272] T 05806ba48f814549969547f21c7101c3 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.549084 30972 tablet_replica.cc:333] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.549904 30972 raft_consensus.cc:2243] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:23.553505 30972 raft_consensus.cc:2272] T ee05beb4092f41ddb391480547d90df0 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.558296 30972 tablet_replica.cc:333] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.559152 30972 raft_consensus.cc:2243] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:23.560120 30972 raft_consensus.cc:2272] T 19e09eecc9b2466db338be646fedba5f P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.563256 30972 tablet_replica.cc:333] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.564543 30972 raft_consensus.cc:2243] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:16:23.570188 30972 raft_consensus.cc:2272] T 6565a440fcf14a499c191f2835d21508 P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:23.576190   368 consensus_peers.cc:597] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:23.577998 30972 tablet_replica.cc:333] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.578912 30972 raft_consensus.cc:2243] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:16:23.580029 30972 raft_consensus.cc:2272] T 0fee96a531e44b88bbae1d896f392bdd P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.582808 30972 tablet_replica.cc:333] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.583776 30972 raft_consensus.cc:2243] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:23.584438 30972 raft_consensus.cc:2272] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.587018 30972 tablet_replica.cc:333] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.588943 30972 raft_consensus.cc:2243] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:16:23.594123 30972 raft_consensus.cc:2272] T a933d5409ea04be9bd937643b14efae4 P 113b5461952d47e0944d463ea4e32801 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.598636 30972 tablet_replica.cc:333] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.599472 30972 raft_consensus.cc:2243] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:16:23.600781 30972 raft_consensus.cc:2272] T 2ec7a9cf151948fdaa078aba5fb1df43 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.603439 30972 tablet_replica.cc:333] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.604604 30972 raft_consensus.cc:2243] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:16:23.605660 30972 raft_consensus.cc:2272] T 980228c6820f4e3aab0ccf2eace31a25 P 113b5461952d47e0944d463ea4e32801 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:23.608016 32239 consensus_peers.cc:597] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:23.609205 30972 tablet_replica.cc:333] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.610023 30972 raft_consensus.cc:2243] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:23.610595 30972 raft_consensus.cc:2272] T 7db983b299754e0eba1ba5726c892858 P 113b5461952d47e0944d463ea4e32801 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.613462 30972 tablet_replica.cc:333] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.614223 30972 raft_consensus.cc:2243] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:23.614811 30972 raft_consensus.cc:2272] T 7594a5601f24445092c404115861232c P 113b5461952d47e0944d463ea4e32801 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.617465 30972 tablet_replica.cc:333] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.621578 30972 raft_consensus.cc:2243] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:23.622542 30972 raft_consensus.cc:2272] T f089b75ada024eb9bbf7e4b953063dd4 P 113b5461952d47e0944d463ea4e32801 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:23.624780   369 consensus_peers.cc:597] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:23.628957 30972 tablet_replica.cc:333] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.630671 30972 raft_consensus.cc:2243] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:16:23.631623 30972 raft_consensus.cc:2272] T 0265ef82085f409c9de498f37135c550 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.636408 30972 tablet_replica.cc:333] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.637210 30972 raft_consensus.cc:2243] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:23.638062 30972 raft_consensus.cc:2272] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 113b5461952d47e0944d463ea4e32801 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.643539 30972 tablet_replica.cc:333] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.644412 30972 raft_consensus.cc:2243] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:16:23.652688 30972 raft_consensus.cc:2272] T afc0578da01e4736bf535c5df1439723 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.655371 30972 tablet_replica.cc:333] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.656193 30972 raft_consensus.cc:2243] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:23.656828 30972 raft_consensus.cc:2272] T 11511d6fc4864afe9cef218fd4e0c0dc P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.660434 30972 tablet_replica.cc:333] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.661300 30972 raft_consensus.cc:2243] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:23.661960 30972 raft_consensus.cc:2272] T d5e9c133ed6a41a3ae8f20d028374729 P 113b5461952d47e0944d463ea4e32801 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.664609 30972 tablet_replica.cc:333] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.665688 30972 raft_consensus.cc:2243] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:16:23.666886 30972 raft_consensus.cc:2272] T 314924e72a7f4efa9cbae136ba7cd259 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.669710 30972 tablet_replica.cc:333] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.670403 30972 raft_consensus.cc:2243] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:23.671393 30972 raft_consensus.cc:2272] T 7beffc7d75824f0085f2b522bab2bc79 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.673874 30972 tablet_replica.cc:333] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.674568 30972 raft_consensus.cc:2243] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:16:23.675645 30972 raft_consensus.cc:2272] T 002126350f9348faac039e490fafb4d7 P 113b5461952d47e0944d463ea4e32801 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.678398 30972 tablet_replica.cc:333] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.680140 30972 raft_consensus.cc:2243] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:23.680735 30972 raft_consensus.cc:2272] T acd9953c536c4b5fa2ebab1015a61b53 P 113b5461952d47e0944d463ea4e32801 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:23.682096   369 consensus_peers.cc:597] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:23.684480 30972 tablet_replica.cc:333] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.685299 30972 raft_consensus.cc:2243] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:16:23.686378 30972 raft_consensus.cc:2272] T ddd7dfc158794e3ab7427d0b86b46c8d P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.689213 30972 tablet_replica.cc:333] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.689878 30972 raft_consensus.cc:2243] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:23.690469 30972 raft_consensus.cc:2272] T 80b1d1e505fa4808b5b8fabb554df626 P 113b5461952d47e0944d463ea4e32801 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:23.693029 30972 tablet_replica.cc:333] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801: stopping tablet replica
I20260709 13:16:23.693660 30972 raft_consensus.cc:2243] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:16:23.694809 30972 raft_consensus.cc:2272] T 10940646da924abea9f371781da8acee P 113b5461952d47e0944d463ea4e32801 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:23.767302 32239 consensus_peers.cc:597] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:23.769994   369 consensus_peers.cc:597] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:23.779377 32239 consensus_peers.cc:597] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:23.798601   369 consensus_peers.cc:597] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:23.824476   369 consensus_peers.cc:597] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:23.845137 32239 consensus_peers.cc:597] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:23.883711 32239 consensus_peers.cc:597] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:23.903541   369 consensus_peers.cc:597] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:23.921960 32239 consensus_peers.cc:597] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:23.959441 32239 consensus_peers.cc:597] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:24.003264 32239 consensus_peers.cc:597] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:24.110843 32239 consensus_peers.cc:597] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:24.129292 32239 consensus_peers.cc:597] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:24.894320 30972 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 32220)
I20260709 13:16:25.032162  7613 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:25.032956  7613 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:25.035257  7613 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:25.049233  7612 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:25.087527  7612 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:25.092270  7608 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:25.095568  7608 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:25.096066  7623 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:25.096638  7623 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:25.097941  7608 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:25.098477  7608 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:25.098629  7623 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:25.099176  7623 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:25.098919  7608 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:25.099592  7623 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:25.101161  7608 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:25.092947  7616 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:25.092978  7610 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:25.091581  7622 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:25.102221  7616 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:25.119652  7609 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:25.120352  7609 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:25.122527  7609 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:25.122972  7609 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:25.123389  7609 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:25.101541  7623 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:25.138626  7612 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:25.112813  7610 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:25.142674  7617 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:25.125141  7622 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:25.149180  7622 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:25.150305  7619 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:25.151455  7610 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:25.152045  7616 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:25.152688  7606 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:25.143229  7613 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:16:25.154465   369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:42339, user_credentials={real_user=slave}} blocked reactor thread for 100974us
I20260709 13:16:25.158563  7610 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:25.159070  7610 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:25.161119  7610 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:25.170356  7621 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:25.171609  7609 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:25.157208  7606 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:25.177685  7606 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:25.153316  7617 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:25.180478  7617 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:25.165972  7613 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:25.183184  7613 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:25.184125  7621 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:25.198851  7621 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:25.157843  7619 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:25.201454  7622 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:25.202275  7619 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:25.202044  7622 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:25.204281  7614 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:25.204833  7614 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:25.206774  7614 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:25.207417  7622 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:25.213652  7616 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:25.214407  7616 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:25.218125  7616 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:25.218601  7627 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:25.220950  7618 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:25.221053  7627 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:25.225642  7617 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:25.226014  7627 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:25.223335  7626 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:25.224062  7623 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:25.226269  7617 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:25.226842  7623 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:25.231237  7626 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:25.221688  7618 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:25.233542  7626 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:25.235728  7623 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:25.235918  7617 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:25.246973   401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:25.247617   401 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 20.
I20260709 13:16:25.247818  7606 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:25.248508  7606 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:25.251278  7606 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:25.236819  7618 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:25.236907   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:25.239634   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:25.243072  7619 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:25.252555   400 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 19.
I20260709 13:16:25.252626  7619 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:25.244845   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
I20260709 13:16:25.253878   398 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 14.
I20260709 13:16:25.254135   395 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 18.
I20260709 13:16:25.258013  7619 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:25.259275  7626 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:25.259795  7626 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:25.261870  7626 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:16:25.264297   369 leader_election.cc:336] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:25.269169 32236 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:16:25.270170  7618 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:25.270613  7618 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:25.271050  7618 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:16:25.275095   368 leader_election.cc:336] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:25.275573   368 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:25.276362  7630 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:25.276950 32236 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:16:25.277896 32236 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:16:25.278918  7624 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:25.279287  7624 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:25.279630  7624 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:16:25.279767   369 consensus_peers.cc:597] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:25.280838  7623 raft_consensus.cc:2804] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:25.281241  7623 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:25.281597  7623 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:25.292663  7626 raft_consensus.cc:493] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 94085cf341634eb686a95983b6b7f7e6)
I20260709 13:16:25.293274  7626 raft_consensus.cc:515] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:25.295265  7626 leader_election.cc:290] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:25.299353   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6867d296184651b908c8f457d74e4a" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6" is_pre_election: true
W20260709 13:16:25.300158   369 leader_election.cc:336] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:25.300911   369 leader_election.cc:336] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:25.301414   369 consensus_peers.cc:597] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:25.304215   369 leader_election.cc:336] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:25.305087   368 leader_election.cc:336] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:25.305606  7624 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:25.307832  7624 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
W20260709 13:16:25.308643   368 leader_election.cc:336] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
W20260709 13:16:25.311245   368 leader_election.cc:336] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:25.311714   368 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:25.312563  7630 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:25.312397  7618 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:16:25.313544   368 leader_election.cc:336] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:25.313968   368 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:25.314647  7630 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:25.308377  7623 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:16:25.315694   368 leader_election.cc:336] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:25.316124 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
W20260709 13:16:25.316514   368 leader_election.cc:336] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
W20260709 13:16:25.310695   369 consensus_peers.cc:597] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:25.317380 32271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:25.318086   368 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:25.318682 32271 raft_consensus.cc:2393] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 19: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:16:25.318815  7630 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:25.319307 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beffc7d75824f0085f2b522bab2bc79" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:25.320690 32272 raft_consensus.cc:2393] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 21: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
W20260709 13:16:25.320794   368 leader_election.cc:336] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:25.321226 32267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:25.322489 32269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:25.322533 32267 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 19.
I20260709 13:16:25.323676   398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547f929c96244ef9a23b3eec5126aa3e" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:16:25.324229   398 raft_consensus.cc:3060] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:25.332039  7618 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:25.345033  7623 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Requested vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 94085cf341634eb686a95983b6b7f7e6 (127.30.63.4:40025)
I20260709 13:16:25.333683 32269 raft_consensus.cc:2393] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94085cf341634eb686a95983b6b7f7e6 in current term 15: Already voted for candidate 6b3ed521ce8947db80c4b4828b355c06 in this term.
I20260709 13:16:25.336010   400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a933d5409ea04be9bd937643b14efae4" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:16:25.356894   400 raft_consensus.cc:3060] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:25.332170   395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec7a9cf151948fdaa078aba5fb1df43" candidate_uuid: "6b3ed521ce8947db80c4b4828b355c06" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "94085cf341634eb686a95983b6b7f7e6"
I20260709 13:16:25.332245   398 raft_consensus.cc:2468] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 19.
I20260709 13:16:25.364843 32236 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:16:25.365710  7623 raft_consensus.cc:2804] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:16:25.366219  7623 raft_consensus.cc:697] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 19 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:16:25.367163  7623 consensus_queue.cc:237] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:25.369108   369 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:25.369920  7630 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:25.371150   395 raft_consensus.cc:3060] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:25.371788   369 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:25.373059  7630 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:25.376693   369 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:25.382768   369 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:25.384081  7618 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:16:25.386008 32239 consensus_peers.cc:597] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:25.384649  7618 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:25.388777  7618 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:16:25.386725 32238 leader_election.cc:336] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
W20260709 13:16:25.390913 32239 leader_election.cc:336] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:25.391440 32239 leader_election.cc:336] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:25.391918 32239 leader_election.cc:336] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:25.397776 32239 leader_election.cc:336] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:25.400287 32022 catalog_manager.cc:5697] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 18 to 19, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 19 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:25.401858   400 raft_consensus.cc:2468] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 15.
I20260709 13:16:25.402374  7617 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:25.403059 32236 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:16:25.394443   395 raft_consensus.cc:2468] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3ed521ce8947db80c4b4828b355c06 in term 21.
I20260709 13:16:25.404692 32236 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 
I20260709 13:16:25.407711  7630 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:25.407753  7618 raft_consensus.cc:2804] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:25.409799  7618 raft_consensus.cc:697] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:16:25.409917  7624 raft_consensus.cc:2804] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:16:25.410599  7624 raft_consensus.cc:697] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 LEADER]: Becoming Leader. State: Replica: 6b3ed521ce8947db80c4b4828b355c06, State: Running, Role: LEADER
I20260709 13:16:25.410928  7618 consensus_queue.cc:237] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:25.411547  7624 consensus_queue.cc:237] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:25.398391 32239 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:25.421262  7626 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:16:25.428772 32239 consensus_peers.cc:597] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:25.397264 32238 leader_election.cc:336] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
W20260709 13:16:25.429749 32238 leader_election.cc:336] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
W20260709 13:16:25.430382 32238 leader_election.cc:336] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
W20260709 13:16:25.431032 32238 leader_election.cc:336] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
W20260709 13:16:25.431541 32238 leader_election.cc:336] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
W20260709 13:16:25.432039 32238 leader_election.cc:336] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
W20260709 13:16:25.432847 32238 leader_election.cc:336] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
W20260709 13:16:25.433314 32238 leader_election.cc:336] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
W20260709 13:16:25.433876 32238 leader_election.cc:336] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
W20260709 13:16:25.435112 32238 leader_election.cc:336] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
W20260709 13:16:25.435897 32238 leader_election.cc:336] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
W20260709 13:16:25.434523 32239 consensus_peers.cc:597] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:25.436828 32239 leader_election.cc:336] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:25.437352 32239 leader_election.cc:336] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:25.437896 32239 leader_election.cc:336] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:25.438788 32239 consensus_peers.cc:597] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:25.439319 32239 leader_election.cc:336] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:25.439839 32239 leader_election.cc:336] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:25.436328 32238 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:25.441205  7618 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:16:25.442391 32238 leader_election.cc:336] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:25.442829 32238 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:25.443596  7618 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:16:25.444697 32239 leader_election.cc:336] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:25.445709 32239 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:25.445277 32238 leader_election.cc:336] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:25.446529 32238 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:25.447113  7618 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:25.448693  7618 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:16:25.447683 32239 leader_election.cc:336] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:25.450920 32239 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:25.451674  7618 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:16:25.452731 32239 leader_election.cc:336] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:25.457811 32239 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:25.458632  7618 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:16:25.459731 32239 leader_election.cc:336] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:25.460220 32239 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:25.460999  7618 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:16:25.461961 32239 leader_election.cc:336] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:25.462425 32239 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:25.457260 32238 leader_election.cc:336] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
W20260709 13:16:25.463280 32238 leader_election.cc:336] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:25.463752  7618 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:16:25.465700 32238 leader_election.cc:336] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
W20260709 13:16:25.466424 32238 leader_election.cc:336] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
W20260709 13:16:25.467562 32238 leader_election.cc:336] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
W20260709 13:16:25.464609 32239 leader_election.cc:336] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:25.468858 32239 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:25.469707  7618 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:16:25.470815 32239 leader_election.cc:336] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:25.471302 32239 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:25.472096  7618 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:16:25.473347 32239 leader_election.cc:336] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:25.474102 32239 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06, 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:25.468422 32238 leader_election.cc:336] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:25.474990 32238 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:25.475777  7618 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:25.476707  7618 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:16:25.477694 32238 leader_election.cc:336] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:25.480489 32238 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:25.481346  7618 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:16:25.482424 32238 leader_election.cc:336] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:25.482898 32238 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:25.485417 32239 leader_election.cc:336] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:25.485999  7618 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:25.494366 32239 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:25.493287 32238 leader_election.cc:336] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:25.495293 32238 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:25.496191  7618 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:16:25.496376 32239 leader_election.cc:336] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:25.496874 32239 leader_election.cc:304] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 94085cf341634eb686a95983b6b7f7e6, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:25.497612  7618 raft_consensus.cc:2749] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:25.504148  7618 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:16:25.505380 32238 leader_election.cc:336] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:25.505889 32238 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:25.507236  7618 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:25.527294 32022 catalog_manager.cc:5697] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 14 to 15, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 15 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:25.529081 32022 catalog_manager.cc:5697] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 reported cstate change: term changed from 20 to 21, leader changed from 113b5461952d47e0944d463ea4e32801 (127.30.63.2) to 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3). New cstate: current_term: 21 leader_uuid: "6b3ed521ce8947db80c4b4828b355c06" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:25.651479 32239 consensus_peers.cc:597] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:25.651984 32239 consensus_peers.cc:597] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:25.799955 32009 catalog_manager.cc:4755] TS fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7beffc7d75824f0085f2b522bab2bc79: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:25.806171 32238 consensus_peers.cc:597] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:25.815179 32238 consensus_peers.cc:597] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:25.849061   400 raft_consensus.cc:1275] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:16:25.852384  7624 consensus_queue.cc:1048] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:16:25.890750   395 raft_consensus.cc:1275] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:16:25.892629  7623 consensus_queue.cc:1048] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:16:25.894943 30972 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 32220)
W20260709 13:16:25.909973 32238 consensus_peers.cc:597] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:26.011247   395 raft_consensus.cc:1275] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Refusing update from remote peer 6b3ed521ce8947db80c4b4828b355c06: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:16:26.014777  7624 consensus_queue.cc:1048] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:16:26.061457   424 debug-util.cc:398] Leaking SignalData structure 0x7b0800246780 after lost signal to thread 30975
W20260709 13:16:26.062650   424 debug-util.cc:398] Leaking SignalData structure 0x7b080024aee0 after lost signal to thread 32056
W20260709 13:16:26.064065   424 debug-util.cc:398] Leaking SignalData structure 0x7b08002e6220 after lost signal to thread 32297
W20260709 13:16:26.065387   424 debug-util.cc:398] Leaking SignalData structure 0x7b08002e57a0 after lost signal to thread 427
W20260709 13:16:26.135156   368 consensus_peers.cc:597] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:26.202185 32238 consensus_peers.cc:597] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:26.216382   369 consensus_peers.cc:597] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:26.238791   368 consensus_peers.cc:597] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:26.239109 32238 consensus_peers.cc:597] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:26.292598   368 consensus_peers.cc:597] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:26.302186 32238 consensus_peers.cc:597] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:26.395274 32239 consensus_peers.cc:597] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:26.428710 32239 consensus_peers.cc:597] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:26.498426 32238 consensus_peers.cc:597] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:26.514554 32238 consensus_peers.cc:597] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:26.542910   368 consensus_peers.cc:597] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:26.571285   368 consensus_peers.cc:597] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:26.591063 32238 consensus_peers.cc:597] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:26.641952 32238 consensus_peers.cc:597] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:26.646438 32238 consensus_peers.cc:597] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:26.646471   368 consensus_peers.cc:597] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:26.668170 32238 consensus_peers.cc:597] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:26.679785   368 consensus_peers.cc:597] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:26.685026 32238 consensus_peers.cc:597] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:26.708114   368 consensus_peers.cc:597] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:26.724839   368 consensus_peers.cc:597] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:26.728354 32238 consensus_peers.cc:597] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:26.753887 32238 consensus_peers.cc:597] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:26.760809 32238 consensus_peers.cc:597] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:26.768496 32238 consensus_peers.cc:597] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:26.772637   368 consensus_peers.cc:597] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:26.800525  7621 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:26.801239  7621 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:16:26.814575   369 leader_election.cc:336] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:26.815557   368 leader_election.cc:336] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:26.816048   368 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:26.816888  7617 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:26.817844  7621 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:16:26.895485 30972 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 32220)
W20260709 13:16:26.900552 32239 consensus_peers.cc:597] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:26.905447 32238 consensus_peers.cc:597] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:26.933357   369 consensus_peers.cc:597] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:16:26.946237  7626 raft_consensus.cc:493] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:26.946925  7626 raft_consensus.cc:515] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:26.956205  7626 leader_election.cc:290] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:16:26.963479 32239 leader_election.cc:336] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:26.973641 32238 leader_election.cc:336] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:26.975282 32238 leader_election.cc:304] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:26.976711  7609 raft_consensus.cc:2749] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:16:26.979137 32239 consensus_peers.cc:597] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:26.981902 32239 consensus_peers.cc:597] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:16:27.006302  7609 raft_consensus.cc:493] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:27.006870  7609 raft_consensus.cc:515] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:16:27.019023 32238 leader_election.cc:336] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:27.023236  7609 leader_election.cc:290] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:16:27.025471 32239 leader_election.cc:336] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:27.026151 32239 leader_election.cc:304] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:27.027595  7609 raft_consensus.cc:2749] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:16:27.071192 32239 consensus_peers.cc:597] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:27.083639   369 consensus_peers.cc:597] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:16:27.085248  7626 raft_consensus.cc:493] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:27.085875  7626 raft_consensus.cc:515] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:27.088153  7626 leader_election.cc:290] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:16:27.099465 32238 leader_election.cc:336] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
W20260709 13:16:27.100397 32239 leader_election.cc:336] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:27.101015 32239 leader_election.cc:304] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:27.102437  7609 raft_consensus.cc:2749] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:16:27.120702 32239 consensus_peers.cc:597] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:27.125526  7609 raft_consensus.cc:493] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:27.126116  7609 raft_consensus.cc:515] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:27.130239  7609 leader_election.cc:290] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:27.147722  7626 raft_consensus.cc:493] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:27.148335  7626 raft_consensus.cc:515] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:27.150585  7626 leader_election.cc:290] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:16:27.157517 32238 leader_election.cc:336] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:27.167867  7626 raft_consensus.cc:493] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:27.168473  7626 raft_consensus.cc:515] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:27.174562  7609 raft_consensus.cc:493] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:27.175228  7609 raft_consensus.cc:515] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:27.177358  7609 leader_election.cc:290] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:16:27.170074 32239 leader_election.cc:336] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:27.178066 32239 leader_election.cc:304] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:27.184151   368 consensus_peers.cc:597] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:27.186256  7626 leader_election.cc:290] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:27.186926  7624 raft_consensus.cc:2749] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:27.188479  7609 raft_consensus.cc:493] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:27.188977  7609 raft_consensus.cc:515] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:27.191274  7609 leader_election.cc:290] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:16:27.207882   369 consensus_peers.cc:597] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:27.208473   369 consensus_peers.cc:597] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:27.212536 32239 leader_election.cc:336] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:27.230293 32238 leader_election.cc:336] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:27.233803 32238 leader_election.cc:304] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:27.235651 32239 leader_election.cc:336] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:27.236481  7626 raft_consensus.cc:2749] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:16:27.239151 32239 leader_election.cc:336] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:27.242563 32239 leader_election.cc:336] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:27.243294   369 consensus_peers.cc:597] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:16:27.250851  7626 raft_consensus.cc:493] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:27.252517  7626 raft_consensus.cc:515] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:27.254951  7626 leader_election.cc:290] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:16:27.256896 32238 leader_election.cc:336] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:27.257817 32238 leader_election.cc:304] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
W20260709 13:16:27.257382 32239 consensus_peers.cc:597] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:27.265473   369 consensus_peers.cc:597] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:16:27.268574  7626 raft_consensus.cc:2749] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:16:27.269630 32238 leader_election.cc:336] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:27.270097 32238 leader_election.cc:304] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:27.275108  7626 raft_consensus.cc:2749] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:16:27.276188 32238 leader_election.cc:336] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:27.276677 32238 leader_election.cc:304] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:27.284746  7609 raft_consensus.cc:2749] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:16:27.295017 32239 leader_election.cc:336] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:27.306941 32238 leader_election.cc:336] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:27.311671 32238 leader_election.cc:304] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:27.313856  7626 raft_consensus.cc:493] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:27.314504  7626 raft_consensus.cc:515] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:27.321552  7626 leader_election.cc:290] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:27.331255  7649 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:27.331844  7649 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:27.339282  7649 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:16:27.439353   369 leader_election.cc:336] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:27.439900   368 leader_election.cc:336] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:27.440326   368 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:27.441056  7626 raft_consensus.cc:2749] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:27.443746  7617 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:27.457854  7617 raft_consensus.cc:493] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:27.458546  7617 raft_consensus.cc:515] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:27.494599  7617 leader_election.cc:290] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:16:27.501784   368 leader_election.cc:336] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
W20260709 13:16:27.588213 32238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:44517, user_credentials={real_user=slave}} blocked reactor thread for 281275us
W20260709 13:16:27.595072 32239 consensus_peers.cc:597] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:16:27.597165  7617 raft_consensus.cc:493] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:27.601294  7617 raft_consensus.cc:515] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } attrs { replace: true } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:27.604058  7617 leader_election.cc:290] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:27.606767  7626 raft_consensus.cc:493] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:27.607213  7624 raft_consensus.cc:493] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:27.609280  7651 raft_consensus.cc:493] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:27.624946  7624 raft_consensus.cc:515] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:27.625020  7651 raft_consensus.cc:515] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:27.627146  7624 leader_election.cc:290] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:27.627426  7651 leader_election.cc:290] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
I20260709 13:16:27.624334  7626 raft_consensus.cc:515] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:27.630575  7626 leader_election.cc:290] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:16:27.633200   369 leader_election.cc:336] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:27.638140   369 leader_election.cc:304] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:27.640159  7621 raft_consensus.cc:2749] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:27.645177  7656 raft_consensus.cc:493] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:27.645774  7656 raft_consensus.cc:515] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:16:27.646742 32239 consensus_peers.cc:597] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:27.647225 32239 consensus_peers.cc:597] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:27.647768   368 leader_election.cc:336] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:27.647837  7656 leader_election.cc:290] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:16:27.651674   369 consensus_peers.cc:597] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:27.652096   369 leader_election.cc:336] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:27.652434   369 leader_election.cc:304] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:27.659264  7656 raft_consensus.cc:493] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:27.660364 32272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f5e8022e3d4b9e9f240b21076de4c3" candidate_uuid: "94085cf341634eb686a95983b6b7f7e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6b3ed521ce8947db80c4b4828b355c06" is_pre_election: true
I20260709 13:16:27.660421  7656 raft_consensus.cc:515] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:27.660950  7617 raft_consensus.cc:2749] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:27.661058 32272 raft_consensus.cc:2468] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94085cf341634eb686a95983b6b7f7e6 in term 19.
I20260709 13:16:27.662685  7656 leader_election.cc:290] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:16:27.653388 32239 leader_election.cc:336] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:27.665967 32239 consensus_peers.cc:597] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:16:27.683290  7656 raft_consensus.cc:493] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
W20260709 13:16:27.683486 32239 consensus_peers.cc:597] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:27.683962 32239 consensus_peers.cc:597] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:27.683838  7656 raft_consensus.cc:515] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
W20260709 13:16:27.684376 32239 leader_election.cc:336] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:27.684837 32239 leader_election.cc:336] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:27.685339 32239 leader_election.cc:336] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:27.685992  7656 leader_election.cc:290] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:16:27.688172   369 consensus_peers.cc:597] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:27.697125 32238 leader_election.cc:336] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:27.697744 32238 leader_election.cc:304] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:27.698529  7656 raft_consensus.cc:2749] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:16:27.686050 32239 consensus_peers.cc:597] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:27.705111 32239 leader_election.cc:336] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:27.707677  7656 raft_consensus.cc:493] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:27.708158  7656 raft_consensus.cc:515] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } }
I20260709 13:16:27.710071  7656 leader_election.cc:290] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:16:27.712226 32239 leader_election.cc:336] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:27.718583 32238 leader_election.cc:336] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:27.719031 32238 leader_election.cc:304] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:27.719684  7654 raft_consensus.cc:2749] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:16:27.719856 32238 leader_election.cc:336] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:27.720274 32238 leader_election.cc:304] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:27.725052  7654 raft_consensus.cc:2749] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:16:27.726680 32238 leader_election.cc:336] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:27.727165 32238 leader_election.cc:304] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:27.727907  7654 raft_consensus.cc:2749] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:16:27.729061 32238 leader_election.cc:336] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:27.729504 32238 leader_election.cc:304] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:27.730276  7654 raft_consensus.cc:2749] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:16:27.731408 32238 leader_election.cc:336] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:27.731823 32238 leader_election.cc:304] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:27.732525  7654 raft_consensus.cc:2749] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:16:27.733332 32239 leader_election.cc:336] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:27.734972 32239 leader_election.cc:336] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:27.746536   369 consensus_peers.cc:597] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:27.759140 32238 leader_election.cc:336] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:27.759752 32238 leader_election.cc:304] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:27.760732  7656 raft_consensus.cc:2749] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:16:27.774317 32238 leader_election.cc:336] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:27.774803 32238 leader_election.cc:304] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3ed521ce8947db80c4b4828b355c06; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:27.782545  7656 raft_consensus.cc:2749] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:16:27.795380 32239 consensus_peers.cc:597] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:28.163182 32239 consensus_peers.cc:597] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:28.221918 30972 tablet_server.cc:196] TabletServer@127.30.63.2:0 shutdown complete.
W20260709 13:16:28.238166 32238 consensus_peers.cc:597] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:28.253410 32238 consensus_peers.cc:597] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:28.324529 32239 consensus_peers.cc:597] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:28.346576 32053 debug-util.cc:398] Leaking SignalData structure 0x7b0800172a60 after lost signal to thread 30975
W20260709 13:16:28.347810 32053 debug-util.cc:398] Leaking SignalData structure 0x7b08002ee880 after lost signal to thread 32056
W20260709 13:16:28.349594 32053 debug-util.cc:398] Leaking SignalData structure 0x7b0800342020 after lost signal to thread 32297
W20260709 13:16:28.350860 32053 debug-util.cc:398] Leaking SignalData structure 0x7b08000fa840 after lost signal to thread 427
I20260709 13:16:28.368202 30972 tablet_server.cc:179] TabletServer@127.30.63.3:0 shutting down...
W20260709 13:16:28.397723   369 consensus_peers.cc:597] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Couldn't send request to peer 6b3ed521ce8947db80c4b4828b355c06. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:28.401877   369 consensus_peers.cc:597] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 -> Peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Couldn't send request to peer 6b3ed521ce8947db80c4b4828b355c06. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:28.418792   369 consensus_peers.cc:597] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 -> Peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Couldn't send request to peer 6b3ed521ce8947db80c4b4828b355c06. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:28.478372 30972 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:28.479565 30972 tablet_replica.cc:333] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.480643 30972 raft_consensus.cc:2243] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.481421 30972 raft_consensus.cc:2272] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.484398 30972 tablet_replica.cc:333] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.485323 30972 raft_consensus.cc:2243] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.486523 30972 raft_consensus.cc:2272] T 9d001b18973b4cbf86649781d9445577 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.489416 30972 tablet_replica.cc:333] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.490319 30972 raft_consensus.cc:2243] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.490944 30972 raft_consensus.cc:2272] T 359bcc57ad77431cae0df4de7bf9b026 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.493690 30972 tablet_replica.cc:333] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.494596 30972 raft_consensus.cc:2243] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.495798 30972 raft_consensus.cc:2272] T cb6ba4c5418c4645a86d8c0dd19e918b P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.498620 30972 tablet_replica.cc:333] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.499507 30972 raft_consensus.cc:2243] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.501178 30972 raft_consensus.cc:2272] T a75997deb5a741f998b671928aad3637 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.504206 30972 tablet_replica.cc:333] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.505213 30972 raft_consensus.cc:2243] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.506361 30972 raft_consensus.cc:2272] T f89f60951b564577beff269254a33cde P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.509173 30972 tablet_replica.cc:333] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.510102 30972 raft_consensus.cc:2243] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.511338 30972 raft_consensus.cc:2272] T ab526b36e2374499ab98f72175e85ec3 P 6b3ed521ce8947db80c4b4828b355c06 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.514055 30972 tablet_replica.cc:333] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.514976 30972 raft_consensus.cc:2243] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 19 LEADER]: Raft consensus shutting down.
W20260709 13:16:28.515939 32239 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111) [suppressed 562 similar messages]
I20260709 13:16:28.516218 30972 raft_consensus.cc:2272] T 7049b5c289c247ea8dda13c92984c95d P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.518877 30972 tablet_replica.cc:333] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.519815 30972 raft_consensus.cc:2243] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.520998 30972 raft_consensus.cc:2272] T 0a452e0dc995431dac6d83c19fd00a32 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.523743 30972 tablet_replica.cc:333] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.524681 30972 raft_consensus.cc:2243] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.525307 30972 raft_consensus.cc:2272] T c477d57775f149408ec3429ac3fd28f4 P 6b3ed521ce8947db80c4b4828b355c06 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.527878 30972 tablet_replica.cc:333] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.530135 30972 raft_consensus.cc:2243] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.530786 30972 raft_consensus.cc:2272] T a08fb71ae3e84c459773fd53510d6e04 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.533597 30972 tablet_replica.cc:333] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.534511 30972 raft_consensus.cc:2243] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.535498 30972 raft_consensus.cc:2272] T 95f5e8022e3d4b9e9f240b21076de4c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.538235 30972 tablet_replica.cc:333] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.539171 30972 raft_consensus.cc:2243] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.540324 30972 raft_consensus.cc:2272] T dea547a3502e4ffeacd79e160d8f60e6 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.543181 30972 tablet_replica.cc:333] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.544163 30972 raft_consensus.cc:2243] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.545766 30972 raft_consensus.cc:2272] T 06fe55ed2a71411c95a6ffde95f58270 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.548664 30972 tablet_replica.cc:333] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.549505 30972 raft_consensus.cc:2243] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.550153 30972 raft_consensus.cc:2272] T 1f415b574b5d492a8f6bbb83d1c0b0f6 P 6b3ed521ce8947db80c4b4828b355c06 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.552865 30972 tablet_replica.cc:333] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.553725 30972 raft_consensus.cc:2243] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.554401 30972 raft_consensus.cc:2272] T 375545897daf43fa925e7b181b2a634b P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.557093 30972 tablet_replica.cc:333] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.557915 30972 raft_consensus.cc:2243] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.558501 30972 raft_consensus.cc:2272] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.561249 30972 tablet_replica.cc:333] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.562089 30972 raft_consensus.cc:2243] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.562773 30972 raft_consensus.cc:2272] T 3868446e9dc747d9b702abc7c2888f8a P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.565354 30972 tablet_replica.cc:333] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.566243 30972 raft_consensus.cc:2243] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.567384 30972 raft_consensus.cc:2272] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.570161 30972 tablet_replica.cc:333] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.570976 30972 raft_consensus.cc:2243] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.571609 30972 raft_consensus.cc:2272] T e3aaa20c2aed4029bc6031c8bf5b7c71 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.574004 30972 tablet_replica.cc:333] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.574828 30972 raft_consensus.cc:2243] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.575870 30972 raft_consensus.cc:2272] T d63bb58dbda1427191933eb8353d8d75 P 6b3ed521ce8947db80c4b4828b355c06 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.578529 30972 tablet_replica.cc:333] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.579345 30972 raft_consensus.cc:2243] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.579978 30972 raft_consensus.cc:2272] T 7f6867d296184651b908c8f457d74e4a P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.582468 30972 tablet_replica.cc:333] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.583307 30972 raft_consensus.cc:2243] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.584244 30972 raft_consensus.cc:2272] T 547f929c96244ef9a23b3eec5126aa3e P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.586683 30972 tablet_replica.cc:333] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.587450 30972 raft_consensus.cc:2243] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.588084 30972 raft_consensus.cc:2272] T 4124d037f0614ab8969bf0e130edd483 P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.590497 30972 tablet_replica.cc:333] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.591341 30972 raft_consensus.cc:2243] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.592365 30972 raft_consensus.cc:2272] T 28b50ebff7ac4d9cbf8fc12c43ace31e P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.594858 30972 tablet_replica.cc:333] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.595662 30972 raft_consensus.cc:2243] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.596879 30972 raft_consensus.cc:2272] T 3bdc1594189c43f49251261c5d073447 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.599570 30972 tablet_replica.cc:333] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.600536 30972 raft_consensus.cc:2243] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.601598 30972 raft_consensus.cc:2272] T 05806ba48f814549969547f21c7101c3 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.604177 30972 tablet_replica.cc:333] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.605021 30972 raft_consensus.cc:2243] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:16:28.605563   369 consensus_peers.cc:597] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Couldn't send request to peer 6b3ed521ce8947db80c4b4828b355c06. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:28.606267 30972 raft_consensus.cc:2272] T c0324508029249e0a1ff9d3eb1936981 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.611107 30972 tablet_replica.cc:333] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.611898 30972 raft_consensus.cc:2243] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.612808 30972 raft_consensus.cc:2272] T afb482e4812e47d0a501b142e64cb73b P 6b3ed521ce8947db80c4b4828b355c06 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.615393 30972 tablet_replica.cc:333] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.616211 30972 raft_consensus.cc:2243] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.617312 30972 raft_consensus.cc:2272] T d002861120de41408d48712b6bd491e1 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.621251 30972 tablet_replica.cc:333] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.622133 30972 raft_consensus.cc:2243] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.622864 30972 raft_consensus.cc:2272] T ee05beb4092f41ddb391480547d90df0 P 6b3ed521ce8947db80c4b4828b355c06 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.626195 30972 tablet_replica.cc:333] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.627017 30972 raft_consensus.cc:2243] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.627658 30972 raft_consensus.cc:2272] T 5708596452c34a319a19ae8a5b24b2df P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.630412 30972 tablet_replica.cc:333] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.631273 30972 raft_consensus.cc:2243] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:16:28.631716   369 consensus_peers.cc:597] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Couldn't send request to peer 6b3ed521ce8947db80c4b4828b355c06. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:28.631932 30972 raft_consensus.cc:2272] T 980228c6820f4e3aab0ccf2eace31a25 P 6b3ed521ce8947db80c4b4828b355c06 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.634609 30972 tablet_replica.cc:333] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.635378 30972 raft_consensus.cc:2243] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.636623 30972 raft_consensus.cc:2272] T a933d5409ea04be9bd937643b14efae4 P 6b3ed521ce8947db80c4b4828b355c06 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.639132 30972 tablet_replica.cc:333] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.639886 30972 raft_consensus.cc:2243] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.640956 30972 raft_consensus.cc:2272] T 2ec7a9cf151948fdaa078aba5fb1df43 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.643618 30972 tablet_replica.cc:333] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.644531 30972 raft_consensus.cc:2243] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.645810 30972 raft_consensus.cc:2272] T 5f28f3141aec48eb9ada8a4f63ca7e32 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.648356 30972 tablet_replica.cc:333] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.649200 30972 raft_consensus.cc:2243] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.650300 30972 raft_consensus.cc:2272] T 7594a5601f24445092c404115861232c P 6b3ed521ce8947db80c4b4828b355c06 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.652915 30972 tablet_replica.cc:333] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.653743 30972 raft_consensus.cc:2243] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.654462 30972 raft_consensus.cc:2272] T 6021998dccdb415f9b8203cebee0292c P 6b3ed521ce8947db80c4b4828b355c06 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.657204 30972 tablet_replica.cc:333] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.658012 30972 raft_consensus.cc:2243] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.658926 30972 raft_consensus.cc:2272] T f089b75ada024eb9bbf7e4b953063dd4 P 6b3ed521ce8947db80c4b4828b355c06 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.661665 30972 tablet_replica.cc:333] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.662418 30972 raft_consensus.cc:2243] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.663434 30972 raft_consensus.cc:2272] T d5e9c133ed6a41a3ae8f20d028374729 P 6b3ed521ce8947db80c4b4828b355c06 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.666028 30972 tablet_replica.cc:333] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.666846 30972 raft_consensus.cc:2243] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.667459 30972 raft_consensus.cc:2272] T afc0578da01e4736bf535c5df1439723 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.669905 30972 tablet_replica.cc:333] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.670571 30972 raft_consensus.cc:2243] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.671360 30972 raft_consensus.cc:2272] T 11511d6fc4864afe9cef218fd4e0c0dc P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.673578 30972 tablet_replica.cc:333] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.674404 30972 raft_consensus.cc:2243] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.675483 30972 raft_consensus.cc:2272] T 7beffc7d75824f0085f2b522bab2bc79 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.678053 30972 tablet_replica.cc:333] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.678855 30972 raft_consensus.cc:2243] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.679486 30972 raft_consensus.cc:2272] T 002126350f9348faac039e490fafb4d7 P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.682269 30972 tablet_replica.cc:333] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.683084 30972 raft_consensus.cc:2243] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.683707 30972 raft_consensus.cc:2272] T 6565a440fcf14a499c191f2835d21508 P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.686390 30972 tablet_replica.cc:333] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.687196 30972 raft_consensus.cc:2243] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.687868 30972 raft_consensus.cc:2272] T 0fee96a531e44b88bbae1d896f392bdd P 6b3ed521ce8947db80c4b4828b355c06 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.690512 30972 tablet_replica.cc:333] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.691310 30972 raft_consensus.cc:2243] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.692005 30972 raft_consensus.cc:2272] T 33cee01befe74212ba61fb0673034f4c P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.694553 30972 tablet_replica.cc:333] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.695287 30972 raft_consensus.cc:2243] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.695912 30972 raft_consensus.cc:2272] T bdc0f3bc03be45ec89dc54321b977dd5 P 6b3ed521ce8947db80c4b4828b355c06 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.698537 30972 tablet_replica.cc:333] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.699306 30972 raft_consensus.cc:2243] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.699975 30972 raft_consensus.cc:2272] T 10940646da924abea9f371781da8acee P 6b3ed521ce8947db80c4b4828b355c06 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.702848 30972 tablet_replica.cc:333] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06: stopping tablet replica
I20260709 13:16:28.703560 30972 raft_consensus.cc:2243] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.704142 30972 raft_consensus.cc:2272] T 0265ef82085f409c9de498f37135c550 P 6b3ed521ce8947db80c4b4828b355c06 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:28.736260   368 consensus_peers.cc:597] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:28.777705   369 consensus_peers.cc:597] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Couldn't send request to peer 6b3ed521ce8947db80c4b4828b355c06. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:28.788997   369 consensus_peers.cc:597] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 -> Peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Couldn't send request to peer 6b3ed521ce8947db80c4b4828b355c06. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:28.789842   368 consensus_peers.cc:597] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:28.837684   369 consensus_peers.cc:597] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Couldn't send request to peer 6b3ed521ce8947db80c4b4828b355c06. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.3:36651: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:28.856331   369 consensus_peers.cc:597] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:16:28.895192   369 consensus_peers.cc:597] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 -> Peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Couldn't send request to peer 6b3ed521ce8947db80c4b4828b355c06. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.3:36651: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:28.961257  7617 raft_consensus.cc:493] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:28.961853  7617 raft_consensus.cc:515] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:28.964247  7617 leader_election.cc:290] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:16:28.975221   369 leader_election.cc:336] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:28.976419   368 leader_election.cc:336] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:28.976928   368 leader_election.cc:304] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:28.978343  7617 raft_consensus.cc:2749] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:16:29.096302   368 consensus_peers.cc:597] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:29.149782   368 consensus_peers.cc:597] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:29.226946   368 consensus_peers.cc:597] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:29.270921   368 consensus_peers.cc:597] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:29.273780   368 consensus_peers.cc:597] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:29.287566   368 consensus_peers.cc:597] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:29.374557   368 consensus_peers.cc:597] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:29.399207   368 consensus_peers.cc:597] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:29.463115   369 consensus_peers.cc:597] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:16:29.513473   369 consensus_peers.cc:597] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:16:29.524511  7621 raft_consensus.cc:493] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:29.525112  7621 raft_consensus.cc:515] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:29.527105  7621 leader_election.cc:290] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:16:29.539845   369 leader_election.cc:336] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:29.540560   369 leader_election.cc:336] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Network error: Client connection negotiation failed: client connection to 127.30.63.3:36651: connect: Connection refused (error 111)
I20260709 13:16:29.541074   369 leader_election.cc:304] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:29.541846  7621 raft_consensus.cc:2749] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:29.574573  7621 raft_consensus.cc:493] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:29.575100  7621 raft_consensus.cc:515] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:29.577059  7621 leader_election.cc:290] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:16:29.586001   369 leader_election.cc:336] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:29.586724   369 leader_election.cc:336] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Network error: Client connection negotiation failed: client connection to 127.30.63.3:36651: connect: Connection refused (error 111)
I20260709 13:16:29.587119   369 leader_election.cc:304] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:29.587918  7621 raft_consensus.cc:2749] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:29.608513  7621 raft_consensus.cc:493] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:29.609055  7621 raft_consensus.cc:515] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:29.610919  7621 leader_election.cc:290] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:16:29.615816   369 consensus_peers.cc:597] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:16:29.620604   369 leader_election.cc:336] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:29.621259   369 leader_election.cc:336] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Network error: Client connection negotiation failed: client connection to 127.30.63.3:36651: connect: Connection refused (error 111)
I20260709 13:16:29.621886   369 leader_election.cc:304] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:29.622644  7621 raft_consensus.cc:2749] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:29.627797  7621 raft_consensus.cc:493] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:29.628276  7621 raft_consensus.cc:515] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:29.630205  7621 leader_election.cc:290] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:16:29.641194   369 leader_election.cc:336] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Network error: Client connection negotiation failed: client connection to 127.30.63.3:36651: connect: Connection refused (error 111)
W20260709 13:16:29.642987   369 leader_election.cc:336] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:29.643648   369 leader_election.cc:304] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:29.646011  7621 raft_consensus.cc:2749] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:16:29.649139   369 consensus_peers.cc:597] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:16:29.709084  7621 raft_consensus.cc:493] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:29.709628  7621 raft_consensus.cc:515] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:29.711643  7621 leader_election.cc:290] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:29.713251 30972 tablet_server.cc:196] TabletServer@127.30.63.3:0 shutdown complete.
I20260709 13:16:29.715375  7621 raft_consensus.cc:493] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:29.716390  7621 raft_consensus.cc:515] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
W20260709 13:16:29.717368   368 leader_election.cc:336] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
W20260709 13:16:29.723750   368 leader_election.cc:336] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:29.727375  7621 leader_election.cc:290] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:29.772943  7617 raft_consensus.cc:493] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:29.775049  7617 raft_consensus.cc:515] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:29.780436  7617 leader_election.cc:290] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:16:29.791199   369 leader_election.cc:336] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Network error: Client connection negotiation failed: client connection to 127.30.63.3:36651: connect: Connection refused (error 111)
I20260709 13:16:29.792059   369 leader_election.cc:304] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:29.793658  7659 raft_consensus.cc:2749] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:16:29.794404   369 leader_election.cc:336] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Network error: Client connection negotiation failed: client connection to 127.30.63.3:36651: connect: Connection refused (error 111)
I20260709 13:16:29.795148   369 leader_election.cc:304] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:29.796597  7659 raft_consensus.cc:2749] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:16:29.802821   368 leader_election.cc:336] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
W20260709 13:16:29.806183   369 leader_election.cc:336] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Network error: Client connection negotiation failed: client connection to 127.30.63.3:36651: connect: Connection refused (error 111)
I20260709 13:16:29.806573   369 leader_election.cc:304] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:29.809898  7659 raft_consensus.cc:2749] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:16:29.815344   369 consensus_peers.cc:597] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:16:29.822494   369 consensus_peers.cc:597] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:16:29.831310   368 consensus_peers.cc:597] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 -> Peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Couldn't send request to peer 113b5461952d47e0944d463ea4e32801. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:29.846786  7659 raft_consensus.cc:493] T 7049b5c289c247ea8dda13c92984c95d P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:29.848196  7659 raft_consensus.cc:515] T 7049b5c289c247ea8dda13c92984c95d P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } attrs { replace: true } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:29.852417  7659 leader_election.cc:290] T 7049b5c289c247ea8dda13c92984c95d P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:16:29.865381   369 leader_election.cc:336] T 7049b5c289c247ea8dda13c92984c95d P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:29.867311   369 leader_election.cc:336] T 7049b5c289c247ea8dda13c92984c95d P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Network error: Client connection negotiation failed: client connection to 127.30.63.3:36651: connect: Connection refused (error 111)
I20260709 13:16:29.870546   369 leader_election.cc:304] T 7049b5c289c247ea8dda13c92984c95d P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:29.875241  7659 raft_consensus.cc:2749] T 7049b5c289c247ea8dda13c92984c95d P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:16:29.876662   368 leader_election.cc:336] T 7049b5c289c247ea8dda13c92984c95d P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:29.916392  7659 raft_consensus.cc:493] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:29.917407  7659 raft_consensus.cc:515] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:29.920245  7659 leader_election.cc:290] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
W20260709 13:16:29.928994   368 leader_election.cc:336] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
W20260709 13:16:29.936525   369 leader_election.cc:336] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Network error: Client connection negotiation failed: client connection to 127.30.63.3:36651: connect: Connection refused (error 111)
I20260709 13:16:29.937142   369 leader_election.cc:304] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:29.937971  7659 raft_consensus.cc:2749] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:30.040921 30972 tablet_server.cc:179] TabletServer@127.30.63.4:0 shutting down...
W20260709 13:16:30.072892   369 consensus_peers.cc:597] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:16:30.080689  7621 raft_consensus.cc:493] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 113b5461952d47e0944d463ea4e32801)
I20260709 13:16:30.081521  7621 raft_consensus.cc:515] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:30.084774  7621 leader_election.cc:290] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517)
W20260709 13:16:30.093380   368 leader_election.cc:336] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
W20260709 13:16:30.098709   369 leader_election.cc:336] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:30.100461   369 leader_election.cc:304] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:30.102725  7621 raft_consensus.cc:2749] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:30.112268  7621 raft_consensus.cc:493] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:30.113121  7621 raft_consensus.cc:515] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "113b5461952d47e0944d463ea4e32801" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 44517 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:30.115685  7621 leader_election.cc:290] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:30.116460 30972 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:30.117445  7621 raft_consensus.cc:493] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b3ed521ce8947db80c4b4828b355c06)
I20260709 13:16:30.117868 30972 tablet_replica.cc:333] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6: stopping tablet replica
I20260709 13:16:30.118386  7621 raft_consensus.cc:515] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "fcfc3281929645969ecedbb0c0af759d" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42339 } } peers { permanent_uuid: "6b3ed521ce8947db80c4b4828b355c06" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 36651 } } peers { permanent_uuid: "94085cf341634eb686a95983b6b7f7e6" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 40025 } attrs { promote: false } }
I20260709 13:16:30.119670 30972 raft_consensus.cc:2243] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.121562 30972 raft_consensus.cc:2272] T a933d5409ea04be9bd937643b14efae4 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:30.125559   368 leader_election.cc:336] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 113b5461952d47e0944d463ea4e32801 (127.30.63.2:44517): Network error: Client connection negotiation failed: client connection to 127.30.63.2:44517: connect: Connection refused (error 111)
I20260709 13:16:30.126353 30972 tablet_replica.cc:333] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6: stopping tablet replica
I20260709 13:16:30.127187  7621 leader_election.cc:290] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339), 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651)
I20260709 13:16:30.127377 30972 raft_consensus.cc:2243] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.128611 30972 raft_consensus.cc:2272] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.132684 30972 tablet_replica.cc:333] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6: stopping tablet replica
I20260709 13:16:30.133876 30972 raft_consensus.cc:2243] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.135766 30972 raft_consensus.cc:2272] T d3a2e596cd6e4340bfea0e5a0e0609d7 P 94085cf341634eb686a95983b6b7f7e6 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:30.139441   369 leader_election.cc:336] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
W20260709 13:16:30.140275   369 leader_election.cc:336] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Network error: Client connection negotiation failed: client connection to 127.30.63.3:36651: connect: Connection refused (error 111)
I20260709 13:16:30.140892   369 leader_election.cc:304] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 113b5461952d47e0944d463ea4e32801, 6b3ed521ce8947db80c4b4828b355c06
I20260709 13:16:30.141392 30972 tablet_replica.cc:333] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6: stopping tablet replica
I20260709 13:16:30.141793  7621 raft_consensus.cc:2749] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:16:30.141942   369 leader_election.cc:336] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6b3ed521ce8947db80c4b4828b355c06 (127.30.63.3:36651): Network error: Client connection negotiation failed: client connection to 127.30.63.3:36651: connect: Connection refused (error 111)
I20260709 13:16:30.143460 30972 raft_consensus.cc:2243] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.143821   369 leader_election.cc:304] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94085cf341634eb686a95983b6b7f7e6; no voters: 6b3ed521ce8947db80c4b4828b355c06, fcfc3281929645969ecedbb0c0af759d
I20260709 13:16:30.144459 30972 raft_consensus.cc:2272] T 05806ba48f814549969547f21c7101c3 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:30.144811   369 raft_consensus.cc:2686] T afb482e4812e47d0a501b142e64cb73b P 94085cf341634eb686a95983b6b7f7e6: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:16:30.148324 30972 tablet_replica.cc:333] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6: stopping tablet replica
I20260709 13:16:30.149359 30972 raft_consensus.cc:2243] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.150292 30972 raft_consensus.cc:2272] T c0324508029249e0a1ff9d3eb1936981 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:30.152182   369 consensus_peers.cc:597] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:16:30.154320 30972 tablet_replica.cc:333] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6: stopping tablet replica
I20260709 13:16:30.155581 30972 raft_consensus.cc:2243] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.157138 30972 raft_consensus.cc:2272] T 547f929c96244ef9a23b3eec5126aa3e P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.161082 30972 tablet_replica.cc:333] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6: stopping tablet replica
W20260709 13:16:30.161067   369 consensus_peers.cc:597] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 -> Peer fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): Couldn't send request to peer fcfc3281929645969ecedbb0c0af759d. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:16:30.162374 30972 raft_consensus.cc:2243] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.163816 30972 raft_consensus.cc:2272] T 4a6ce5ae89cb4ad08c24a3a10d6fc0c2 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.166810 30972 tablet_replica.cc:333] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6: stopping tablet replica
I20260709 13:16:30.167717 30972 raft_consensus.cc:2243] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.168452 30972 raft_consensus.cc:2272] T 2ec7a9cf151948fdaa078aba5fb1df43 P 94085cf341634eb686a95983b6b7f7e6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.172372 30972 tablet_replica.cc:333] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6: stopping tablet replica
I20260709 13:16:30.173300 30972 raft_consensus.cc:2243] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.174813 30972 raft_consensus.cc:2272] T 0cf85dc23ac44824a3668eb1b1f3aa42 P 94085cf341634eb686a95983b6b7f7e6 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.178673 30972 tablet_replica.cc:333] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6: stopping tablet replica
I20260709 13:16:30.179546 30972 raft_consensus.cc:2243] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.181051 30972 raft_consensus.cc:2272] T ee05beb4092f41ddb391480547d90df0 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.183977 30972 tablet_replica.cc:333] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6: stopping tablet replica
I20260709 13:16:30.184787 30972 raft_consensus.cc:2243] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.186308 30972 raft_consensus.cc:2272] T 19e09eecc9b2466db338be646fedba5f P 94085cf341634eb686a95983b6b7f7e6 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.190245 30972 tablet_replica.cc:333] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6: stopping tablet replica
I20260709 13:16:30.191143 30972 raft_consensus.cc:2243] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.192729 30972 raft_consensus.cc:2272] T 0aaeda9c539745d5b9b44fb7acb8b438 P 94085cf341634eb686a95983b6b7f7e6 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.196795 30972 tablet_replica.cc:333] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6: stopping tablet replica
I20260709 13:16:30.197690 30972 raft_consensus.cc:2243] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.199249 30972 raft_consensus.cc:2272] T 0717a2686ee346b7a5a183e36fdfd173 P 94085cf341634eb686a95983b6b7f7e6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.203384 30972 tablet_replica.cc:333] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6: stopping tablet replica
I20260709 13:16:30.204386 30972 raft_consensus.cc:2243] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.206059 30972 raft_consensus.cc:2272] T d63bb58dbda1427191933eb8353d8d75 P 94085cf341634eb686a95983b6b7f7e6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.209769 30972 tablet_replica.cc:333] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6: stopping tablet replica
I20260709 13:16:30.210961 30972 raft_consensus.cc:2243] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.211860 30972 raft_consensus.cc:2272] T a75997deb5a741f998b671928aad3637 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.215940 30972 tablet_replica.cc:333] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6: stopping tablet replica
I20260709 13:16:30.216810 30972 raft_consensus.cc:2243] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.217628 30972 raft_consensus.cc:2272] T 314924e72a7f4efa9cbae136ba7cd259 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.221082 30972 tablet_replica.cc:333] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6: stopping tablet replica
I20260709 13:16:30.221993 30972 raft_consensus.cc:2243] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.222867 30972 raft_consensus.cc:2272] T 64767c8d367b4cc1b7e2ffbcbf73ce29 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.226469 30972 tablet_replica.cc:333] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6: stopping tablet replica
I20260709 13:16:30.227370 30972 raft_consensus.cc:2243] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.228796 30972 raft_consensus.cc:2272] T 7beffc7d75824f0085f2b522bab2bc79 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.232455 30972 tablet_replica.cc:333] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6: stopping tablet replica
I20260709 13:16:30.233294 30972 raft_consensus.cc:2243] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.234865 30972 raft_consensus.cc:2272] T acd9953c536c4b5fa2ebab1015a61b53 P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.238636 30972 tablet_replica.cc:333] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6: stopping tablet replica
I20260709 13:16:30.239488 30972 raft_consensus.cc:2243] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.240780 30972 raft_consensus.cc:2272] T ddd7dfc158794e3ab7427d0b86b46c8d P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.244462 30972 tablet_replica.cc:333] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6: stopping tablet replica
I20260709 13:16:30.245289 30972 raft_consensus.cc:2243] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.246709 30972 raft_consensus.cc:2272] T 80b1d1e505fa4808b5b8fabb554df626 P 94085cf341634eb686a95983b6b7f7e6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.250214 30972 tablet_replica.cc:333] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6: stopping tablet replica
I20260709 13:16:30.250978 30972 raft_consensus.cc:2243] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.252395 30972 raft_consensus.cc:2272] T f89f60951b564577beff269254a33cde P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.255952 30972 tablet_replica.cc:333] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6: stopping tablet replica
I20260709 13:16:30.256768 30972 raft_consensus.cc:2243] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.258240 30972 raft_consensus.cc:2272] T 5708596452c34a319a19ae8a5b24b2df P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.261590 30972 tablet_replica.cc:333] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6: stopping tablet replica
I20260709 13:16:30.262305 30972 raft_consensus.cc:2243] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.263691 30972 raft_consensus.cc:2272] T 6021998dccdb415f9b8203cebee0292c P 94085cf341634eb686a95983b6b7f7e6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.266930 30972 tablet_replica.cc:333] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6: stopping tablet replica
I20260709 13:16:30.267680 30972 raft_consensus.cc:2243] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.268976 30972 raft_consensus.cc:2272] T f089b75ada024eb9bbf7e4b953063dd4 P 94085cf341634eb686a95983b6b7f7e6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.272001 30972 tablet_replica.cc:333] T 7049b5c289c247ea8dda13c92984c95d P 94085cf341634eb686a95983b6b7f7e6: stopping tablet replica
I20260709 13:16:30.272756 30972 raft_consensus.cc:2243] T 7049b5c289c247ea8dda13c92984c95d P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.273655 30972 raft_consensus.cc:2272] T 7049b5c289c247ea8dda13c92984c95d P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.277052 30972 tablet_replica.cc:333] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6: stopping tablet replica
I20260709 13:16:30.277824 30972 raft_consensus.cc:2243] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.279361 30972 raft_consensus.cc:2272] T 7f6867d296184651b908c8f457d74e4a P 94085cf341634eb686a95983b6b7f7e6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.281920 30972 tablet_replica.cc:333] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6: stopping tablet replica
I20260709 13:16:30.282554 30972 raft_consensus.cc:2243] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:16:30.283864 30972 raft_consensus.cc:2272] T 7db983b299754e0eba1ba5726c892858 P 94085cf341634eb686a95983b6b7f7e6 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.287796 30972 tablet_replica.cc:333] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6: stopping tablet replica
I20260709 13:16:30.288535 30972 raft_consensus.cc:2243] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.289700 30972 raft_consensus.cc:2272] T 95f5e8022e3d4b9e9f240b21076de4c3 P 94085cf341634eb686a95983b6b7f7e6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.293453 30972 tablet_replica.cc:333] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6: stopping tablet replica
I20260709 13:16:30.294071 30972 raft_consensus.cc:2243] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:30.294770 30972 raft_consensus.cc:2272] T cb6ba4c5418c4645a86d8c0dd19e918b P 94085cf341634eb686a95983b6b7f7e6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:30.576561 30972 tablet_server.cc:196] TabletServer@127.30.63.4:0 shutdown complete.
I20260709 13:16:30.646719 30972 master.cc:562] Master@127.30.63.62:38793 shutting down...
W20260709 13:16:30.700125 32070 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:16:30.700388 32070 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:16:30.700553 32070 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:16:34.045187 32009 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111) [suppressed 137 similar messages]
W20260709 13:16:34.050781 32009 catalog_manager.cc:4755] TS fcfc3281929645969ecedbb0c0af759d (127.30.63.1:42339): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7beffc7d75824f0085f2b522bab2bc79: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42339: connect: Connection refused (error 111)
I20260709 13:16:34.297616 30972 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:34.298467 30972 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:34.298871 30972 tablet_replica.cc:333] T 00000000000000000000000000000000 P ffbfb630fccf464dbfd0bffd795262f7: stopping tablet replica
I20260709 13:16:34.496340 30972 master.cc:584] Master@127.30.63.62:38793 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (238509 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:16:34.612708 30972 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.30.63.62:45347
I20260709 13:16:34.613947 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:34.621145  7665 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:34.621170  7666 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:34.621647  7668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:34.622761 30972 server_base.cc:1061] running on GCE node
I20260709 13:16:34.625717 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:34.625916 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:34.626030 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783602994626019 us; error 0 us; skew 500 ppm
I20260709 13:16:34.626500 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:34.629594 30972 webserver.cc:533] Webserver started at http://127.30.63.62:43413/ using document root <none> and password file <none>
I20260709 13:16:34.630061 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:34.630213 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:34.630434 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:34.631640 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602730526113-30972-0/minicluster-data/master-0-root/instance:
uuid: "cf4ae385c4e84919bd77fd3e88afe143"
format_stamp: "Formatted at 2026-07-09 13:16:34 on dist-test-slave-c08m"
I20260709 13:16:34.636058 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:16:34.639513  7673 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:34.640300 30972 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:16:34.640673 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602730526113-30972-0/minicluster-data/master-0-root
uuid: "cf4ae385c4e84919bd77fd3e88afe143"
format_stamp: "Formatted at 2026-07-09 13:16:34 on dist-test-slave-c08m"
I20260709 13:16:34.640940 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602730526113-30972-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602730526113-30972-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602730526113-30972-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:34.650923 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:34.652202 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:34.694345 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.62:45347
I20260709 13:16:34.694486  7724 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.62:45347 every 8 connection(s)
I20260709 13:16:34.698556  7725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:34.710080  7725 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf4ae385c4e84919bd77fd3e88afe143: Bootstrap starting.
I20260709 13:16:34.715088  7725 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cf4ae385c4e84919bd77fd3e88afe143: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:34.719774  7725 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf4ae385c4e84919bd77fd3e88afe143: No bootstrap required, opened a new log
I20260709 13:16:34.722137  7725 raft_consensus.cc:359] T 00000000000000000000000000000000 P cf4ae385c4e84919bd77fd3e88afe143 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf4ae385c4e84919bd77fd3e88afe143" member_type: VOTER }
I20260709 13:16:34.722560  7725 raft_consensus.cc:385] T 00000000000000000000000000000000 P cf4ae385c4e84919bd77fd3e88afe143 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:34.723160  7725 raft_consensus.cc:740] T 00000000000000000000000000000000 P cf4ae385c4e84919bd77fd3e88afe143 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf4ae385c4e84919bd77fd3e88afe143, State: Initialized, Role: FOLLOWER
I20260709 13:16:34.723928  7725 consensus_queue.cc:260] T 00000000000000000000000000000000 P cf4ae385c4e84919bd77fd3e88afe143 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf4ae385c4e84919bd77fd3e88afe143" member_type: VOTER }
I20260709 13:16:34.724434  7725 raft_consensus.cc:399] T 00000000000000000000000000000000 P cf4ae385c4e84919bd77fd3e88afe143 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:16:34.724726  7725 raft_consensus.cc:493] T 00000000000000000000000000000000 P cf4ae385c4e84919bd77fd3e88afe143 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:16:34.725028  7725 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cf4ae385c4e84919bd77fd3e88afe143 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:34.730530  7725 raft_consensus.cc:515] T 00000000000000000000000000000000 P cf4ae385c4e84919bd77fd3e88afe143 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf4ae385c4e84919bd77fd3e88afe143" member_type: VOTER }
I20260709 13:16:34.731065  7725 leader_election.cc:304] T 00000000000000000000000000000000 P cf4ae385c4e84919bd77fd3e88afe143 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cf4ae385c4e84919bd77fd3e88afe143; no voters: 
I20260709 13:16:34.732419  7725 leader_election.cc:290] T 00000000000000000000000000000000 P cf4ae385c4e84919bd77fd3e88afe143 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:16:34.732851  7728 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cf4ae385c4e84919bd77fd3e88afe143 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:34.734489  7728 raft_consensus.cc:697] T 00000000000000000000000000000000 P cf4ae385c4e84919bd77fd3e88afe143 [term 1 LEADER]: Becoming Leader. State: Replica: cf4ae385c4e84919bd77fd3e88afe143, State: Running, Role: LEADER
I20260709 13:16:34.735335  7728 consensus_queue.cc:237] T 00000000000000000000000000000000 P cf4ae385c4e84919bd77fd3e88afe143 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf4ae385c4e84919bd77fd3e88afe143" member_type: VOTER }
I20260709 13:16:34.736315  7725 sys_catalog.cc:565] T 00000000000000000000000000000000 P cf4ae385c4e84919bd77fd3e88afe143 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:16:34.745426  7730 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf4ae385c4e84919bd77fd3e88afe143 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cf4ae385c4e84919bd77fd3e88afe143. Latest consensus state: current_term: 1 leader_uuid: "cf4ae385c4e84919bd77fd3e88afe143" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf4ae385c4e84919bd77fd3e88afe143" member_type: VOTER } }
I20260709 13:16:34.746024  7730 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf4ae385c4e84919bd77fd3e88afe143 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:34.747740  7729 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf4ae385c4e84919bd77fd3e88afe143 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cf4ae385c4e84919bd77fd3e88afe143" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf4ae385c4e84919bd77fd3e88afe143" member_type: VOTER } }
I20260709 13:16:34.748004  7738 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:16:34.748255  7729 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf4ae385c4e84919bd77fd3e88afe143 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:34.757076  7738 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:16:34.758358 30972 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:16:34.767612  7738 catalog_manager.cc:1383] Generated new cluster ID: c3211ff8698f45f080d4f39fd25d0c44
I20260709 13:16:34.767936  7738 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:16:34.787844  7738 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:16:34.789158  7738 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:16:34.807024  7738 catalog_manager.cc:6070] T 00000000000000000000000000000000 P cf4ae385c4e84919bd77fd3e88afe143: Generated new TSK 0
I20260709 13:16:34.807663  7738 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:16:34.825299 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:34.832173  7746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:34.833833  7747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:34.841193  7749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:34.841214 30972 server_base.cc:1061] running on GCE node
I20260709 13:16:34.844837 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:34.845112 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:34.845283 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783602994845260 us; error 0 us; skew 500 ppm
I20260709 13:16:34.845815 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:34.848296 30972 webserver.cc:533] Webserver started at http://127.30.63.1:43761/ using document root <none> and password file <none>
I20260709 13:16:34.848845 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:34.849047 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:34.849320 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:34.850545 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602730526113-30972-0/minicluster-data/ts-0-root/instance:
uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
format_stamp: "Formatted at 2026-07-09 13:16:34 on dist-test-slave-c08m"
I20260709 13:16:34.855413 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:16:34.859081  7754 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:34.860009 30972 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:16:34.860357 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602730526113-30972-0/minicluster-data/ts-0-root
uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
format_stamp: "Formatted at 2026-07-09 13:16:34 on dist-test-slave-c08m"
I20260709 13:16:34.860750 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602730526113-30972-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602730526113-30972-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602730526113-30972-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:34.879257 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:34.880635 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:34.882266 30972 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:34.884773 30972 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:34.885026 30972 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:34.885272 30972 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:34.885460 30972 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:34.927471 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.1:35503
I20260709 13:16:34.927604  7816 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.1:35503 every 8 connection(s)
I20260709 13:16:34.932783 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:34.939983  7821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:34.942219  7822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:34.944561  7824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:34.944682 30972 server_base.cc:1061] running on GCE node
I20260709 13:16:34.947594 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:34.947818 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:34.948020 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783602994948004 us; error 0 us; skew 500 ppm
I20260709 13:16:34.948781 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:34.952123 30972 webserver.cc:533] Webserver started at http://127.30.63.2:41773/ using document root <none> and password file <none>
I20260709 13:16:34.952672  7817 heartbeater.cc:344] Connected to a master server at 127.30.63.62:45347
I20260709 13:16:34.952714 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:34.953120 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:34.953148  7817 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:34.953455 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:34.954042  7817 heartbeater.cc:507] Master 127.30.63.62:45347 requested a full tablet report, sending...
I20260709 13:16:34.954842 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602730526113-30972-0/minicluster-data/ts-1-root/instance:
uuid: "1c5936948a84476fb0dcc1fa2d895740"
format_stamp: "Formatted at 2026-07-09 13:16:34 on dist-test-slave-c08m"
I20260709 13:16:34.956311  7690 ts_manager.cc:194] Registered new tserver with Master: 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:34.958277  7690 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49710
I20260709 13:16:34.959946 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:16:34.964170  7829 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:34.965056 30972 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:16:34.965413 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602730526113-30972-0/minicluster-data/ts-1-root
uuid: "1c5936948a84476fb0dcc1fa2d895740"
format_stamp: "Formatted at 2026-07-09 13:16:34 on dist-test-slave-c08m"
I20260709 13:16:34.965790 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602730526113-30972-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602730526113-30972-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602730526113-30972-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:34.986136 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:34.987485 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:34.989267 30972 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:34.992049 30972 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:34.992262 30972 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:34.992472 30972 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:34.992678 30972 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.001s
I20260709 13:16:35.039302 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.2:45491
I20260709 13:16:35.039415  7891 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.2:45491 every 8 connection(s)
I20260709 13:16:35.045084 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:35.053053  7895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:35.055661  7892 heartbeater.cc:344] Connected to a master server at 127.30.63.62:45347
W20260709 13:16:35.055872  7896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:35.056210  7892 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:35.057641  7892 heartbeater.cc:507] Master 127.30.63.62:45347 requested a full tablet report, sending...
W20260709 13:16:35.059576  7898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:35.060240 30972 server_base.cc:1061] running on GCE node
I20260709 13:16:35.060559  7690 ts_manager.cc:194] Registered new tserver with Master: 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:35.061218 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:35.061559 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:35.061764 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783602995061745 us; error 0 us; skew 500 ppm
I20260709 13:16:35.062394 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:35.062340  7690 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49716
I20260709 13:16:35.065361 30972 webserver.cc:533] Webserver started at http://127.30.63.3:41565/ using document root <none> and password file <none>
I20260709 13:16:35.065888 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:35.066104 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:35.066373 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:35.068115 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602730526113-30972-0/minicluster-data/ts-2-root/instance:
uuid: "7de07e50a1714f5d9055bb4b86655200"
format_stamp: "Formatted at 2026-07-09 13:16:35 on dist-test-slave-c08m"
I20260709 13:16:35.072876 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:16:35.076747  7903 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:35.077667 30972 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:16:35.078007 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602730526113-30972-0/minicluster-data/ts-2-root
uuid: "7de07e50a1714f5d9055bb4b86655200"
format_stamp: "Formatted at 2026-07-09 13:16:35 on dist-test-slave-c08m"
I20260709 13:16:35.078395 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602730526113-30972-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602730526113-30972-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602730526113-30972-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:35.095992 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:35.097780 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:35.099500 30972 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:35.102015 30972 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:35.102272 30972 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:35.102567 30972 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:35.102773 30972 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:35.147918 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.3:44141
I20260709 13:16:35.148047  7965 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.3:44141 every 8 connection(s)
I20260709 13:16:35.153298 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:35.161051  7969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:35.161882  7970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:35.165817  7966 heartbeater.cc:344] Connected to a master server at 127.30.63.62:45347
W20260709 13:16:35.166236  7972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:35.166370  7966 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:35.167656  7966 heartbeater.cc:507] Master 127.30.63.62:45347 requested a full tablet report, sending...
I20260709 13:16:35.169343 30972 server_base.cc:1061] running on GCE node
I20260709 13:16:35.170205  7690 ts_manager.cc:194] Registered new tserver with Master: 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:35.170305 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:35.170656 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:35.170852 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783602995170829 us; error 0 us; skew 500 ppm
I20260709 13:16:35.171429 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:35.171859  7690 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49722
I20260709 13:16:35.174558 30972 webserver.cc:533] Webserver started at http://127.30.63.4:44677/ using document root <none> and password file <none>
I20260709 13:16:35.175120 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:35.175308 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:35.175587 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:35.176888 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602730526113-30972-0/minicluster-data/ts-3-root/instance:
uuid: "c9a569f7d1ad42359002386a73702690"
format_stamp: "Formatted at 2026-07-09 13:16:35 on dist-test-slave-c08m"
I20260709 13:16:35.182144 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:16:35.185920  7977 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:35.186884 30972 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:16:35.187163 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602730526113-30972-0/minicluster-data/ts-3-root
uuid: "c9a569f7d1ad42359002386a73702690"
format_stamp: "Formatted at 2026-07-09 13:16:35 on dist-test-slave-c08m"
I20260709 13:16:35.187415 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602730526113-30972-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602730526113-30972-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602730526113-30972-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:35.206262 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:35.207533 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:35.209121 30972 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:35.211576 30972 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:35.211776 30972 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:35.212088 30972 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:35.212296 30972 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:35.258635 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.4:46031
I20260709 13:16:35.258738  8039 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.4:46031 every 8 connection(s)
I20260709 13:16:35.276439  8040 heartbeater.cc:344] Connected to a master server at 127.30.63.62:45347
I20260709 13:16:35.276947  8040 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:35.277801  8040 heartbeater.cc:507] Master 127.30.63.62:45347 requested a full tablet report, sending...
I20260709 13:16:35.280125  7690 ts_manager.cc:194] Registered new tserver with Master: c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:35.280751 30972 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.016788137s
I20260709 13:16:35.282032  7690 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49738
I20260709 13:16:35.311873  7690 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49752:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:16:35.595132  7782 tablet_service.cc:1511] Processing CreateTablet for tablet b72bd809944d47a395c4bc1b0fc18c19 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:16:35.596787  7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b72bd809944d47a395c4bc1b0fc18c19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.596410  7780 tablet_service.cc:1511] Processing CreateTablet for tablet 3462b69ce46f4d49b5c5f1a6872a03e4 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:16:35.597998  7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3462b69ce46f4d49b5c5f1a6872a03e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.597741  7855 tablet_service.cc:1511] Processing CreateTablet for tablet 7806fa697a044140850e326d8e5889d1 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:16:35.599195  7855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7806fa697a044140850e326d8e5889d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.598991  7857 tablet_service.cc:1511] Processing CreateTablet for tablet b66f54819dda4cca9214096155a16694 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:16:35.600400  7857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b66f54819dda4cca9214096155a16694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.603451  7854 tablet_service.cc:1511] Processing CreateTablet for tablet ee4af0a88c7f43bcaa15fc11bdfaf591 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:16:35.603152  7781 tablet_service.cc:1511] Processing CreateTablet for tablet 7806fa697a044140850e326d8e5889d1 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:16:35.605691  7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7806fa697a044140850e326d8e5889d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.605928  7852 tablet_service.cc:1511] Processing CreateTablet for tablet 0d8e359e2c264806bd048cd1baed4db4 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:16:35.606544  7850 tablet_service.cc:1511] Processing CreateTablet for tablet de92af0966804027bbe4ec91b14382d4 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:16:35.607342  7852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d8e359e2c264806bd048cd1baed4db4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.608019  7850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de92af0966804027bbe4ec91b14382d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.601562  7853 tablet_service.cc:1511] Processing CreateTablet for tablet af8981a911484760ab96a4d042148094 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:16:35.609475  7853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af8981a911484760ab96a4d042148094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.601809  7856 tablet_service.cc:1511] Processing CreateTablet for tablet b72bd809944d47a395c4bc1b0fc18c19 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:16:35.612504  7856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b72bd809944d47a395c4bc1b0fc18c19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.601850  7779 tablet_service.cc:1511] Processing CreateTablet for tablet ee4af0a88c7f43bcaa15fc11bdfaf591 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:16:35.598997  7851 tablet_service.cc:1511] Processing CreateTablet for tablet 0eb35ec786da4450bcf232cf85ba857b (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:16:35.614367  7779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee4af0a88c7f43bcaa15fc11bdfaf591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.614730  7851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eb35ec786da4450bcf232cf85ba857b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.615299  7777 tablet_service.cc:1511] Processing CreateTablet for tablet 87d445d744434f90baaf040e708b1e98 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:16:35.616338  7854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee4af0a88c7f43bcaa15fc11bdfaf591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.612824  7778 tablet_service.cc:1511] Processing CreateTablet for tablet af8981a911484760ab96a4d042148094 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:16:35.616768  7777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87d445d744434f90baaf040e708b1e98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.617581  7778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af8981a911484760ab96a4d042148094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.630532  7776 tablet_service.cc:1511] Processing CreateTablet for tablet 0eb35ec786da4450bcf232cf85ba857b (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:16:35.632082  7776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eb35ec786da4450bcf232cf85ba857b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.635768  7849 tablet_service.cc:1511] Processing CreateTablet for tablet aa3b3005e3634f858a7e68a789b5f827 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:16:35.637409  7849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa3b3005e3634f858a7e68a789b5f827. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.638468  7775 tablet_service.cc:1511] Processing CreateTablet for tablet de92af0966804027bbe4ec91b14382d4 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:16:35.640072  7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de92af0966804027bbe4ec91b14382d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.646592  7774 tablet_service.cc:1511] Processing CreateTablet for tablet 9c126cef127140f48a31bbd723a86051 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:16:35.648237  7774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c126cef127140f48a31bbd723a86051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.657272  7848 tablet_service.cc:1511] Processing CreateTablet for tablet deeaf93ab6424e9c8013e6c9fbccb724 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:16:35.658357  7773 tablet_service.cc:1511] Processing CreateTablet for tablet deeaf93ab6424e9c8013e6c9fbccb724 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:16:35.658841  7848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deeaf93ab6424e9c8013e6c9fbccb724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.663357  7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deeaf93ab6424e9c8013e6c9fbccb724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.708688  7775 tablet_service.cc:1511] Processing CreateTablet for tablet 5391ca2d8a8747bebb865e71268e06ad (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:16:35.710151  7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5391ca2d8a8747bebb865e71268e06ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.715040  8059 tablet_bootstrap.cc:492] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:35.725133  8060 tablet_bootstrap.cc:492] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:35.726318  7855 tablet_service.cc:1511] Processing CreateTablet for tablet 5391ca2d8a8747bebb865e71268e06ad (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:16:35.733134  7855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5391ca2d8a8747bebb865e71268e06ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.734019  7930 tablet_service.cc:1511] Processing CreateTablet for tablet b72bd809944d47a395c4bc1b0fc18c19 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:16:35.735558  7930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b72bd809944d47a395c4bc1b0fc18c19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.737962  7929 tablet_service.cc:1511] Processing CreateTablet for tablet 3462b69ce46f4d49b5c5f1a6872a03e4 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:16:35.739187  8059 tablet_bootstrap.cc:654] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:35.739797  7929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3462b69ce46f4d49b5c5f1a6872a03e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.739710  8005 tablet_service.cc:1511] Processing CreateTablet for tablet b66f54819dda4cca9214096155a16694 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:16:35.741982  8004 tablet_service.cc:1511] Processing CreateTablet for tablet 7806fa697a044140850e326d8e5889d1 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:16:35.743577  8004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7806fa697a044140850e326d8e5889d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.743242  7927 tablet_service.cc:1511] Processing CreateTablet for tablet 87d445d744434f90baaf040e708b1e98 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:16:35.745915  8003 tablet_service.cc:1511] Processing CreateTablet for tablet 3462b69ce46f4d49b5c5f1a6872a03e4 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:16:35.747888  7926 tablet_service.cc:1511] Processing CreateTablet for tablet 0d8e359e2c264806bd048cd1baed4db4 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:16:35.749909  8001 tablet_service.cc:1511] Processing CreateTablet for tablet 87d445d744434f90baaf040e708b1e98 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:16:35.749909  7925 tablet_service.cc:1511] Processing CreateTablet for tablet 0eb35ec786da4450bcf232cf85ba857b (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:16:35.751717  7924 tablet_service.cc:1511] Processing CreateTablet for tablet 9c126cef127140f48a31bbd723a86051 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:16:35.745915  7931 tablet_service.cc:1511] Processing CreateTablet for tablet b66f54819dda4cca9214096155a16694 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:16:35.741982  7928 tablet_service.cc:1511] Processing CreateTablet for tablet ee4af0a88c7f43bcaa15fc11bdfaf591 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:16:35.765909  7927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87d445d744434f90baaf040e708b1e98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.766870  7928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee4af0a88c7f43bcaa15fc11bdfaf591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.758633  8003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3462b69ce46f4d49b5c5f1a6872a03e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.767602  7924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c126cef127140f48a31bbd723a86051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.758129  7998 tablet_service.cc:1511] Processing CreateTablet for tablet 9c126cef127140f48a31bbd723a86051 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:16:35.758363  7922 tablet_service.cc:1511] Processing CreateTablet for tablet deeaf93ab6424e9c8013e6c9fbccb724 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:16:35.769474  7998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c126cef127140f48a31bbd723a86051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.772984  7931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b66f54819dda4cca9214096155a16694. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:35.749305  7737 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:35.751185  8000 tablet_service.cc:1511] Processing CreateTablet for tablet 0d8e359e2c264806bd048cd1baed4db4 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:16:35.753281  7999 tablet_service.cc:1511] Processing CreateTablet for tablet de92af0966804027bbe4ec91b14382d4 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:16:35.760488  7997 tablet_service.cc:1511] Processing CreateTablet for tablet aa3b3005e3634f858a7e68a789b5f827 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:16:35.760854  7996 tablet_service.cc:1511] Processing CreateTablet for tablet 5391ca2d8a8747bebb865e71268e06ad (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:16:35.748507  8002 tablet_service.cc:1511] Processing CreateTablet for tablet af8981a911484760ab96a4d042148094 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:16:35.753556  7923 tablet_service.cc:1511] Processing CreateTablet for tablet aa3b3005e3634f858a7e68a789b5f827 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:16:35.774468  8001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87d445d744434f90baaf040e708b1e98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.780393  7997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa3b3005e3634f858a7e68a789b5f827. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.776470  7925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eb35ec786da4450bcf232cf85ba857b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.787933  7922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deeaf93ab6424e9c8013e6c9fbccb724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.789512  7926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d8e359e2c264806bd048cd1baed4db4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.790524  7923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa3b3005e3634f858a7e68a789b5f827. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.795327  8005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b66f54819dda4cca9214096155a16694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.796392  8000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d8e359e2c264806bd048cd1baed4db4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.797336  8002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af8981a911484760ab96a4d042148094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.798910  7996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5391ca2d8a8747bebb865e71268e06ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.814273  7856 tablet_service.cc:1511] Processing CreateTablet for tablet b750f6e7ca2b48ef942ad988e6c4dd8d (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:16:35.816241  7856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b750f6e7ca2b48ef942ad988e6c4dd8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.817389  7999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de92af0966804027bbe4ec91b14382d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.799889  7776 tablet_service.cc:1511] Processing CreateTablet for tablet da682789343c4852b052f5fa4483c715 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:16:35.819579  7776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da682789343c4852b052f5fa4483c715. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.827611  8060 tablet_bootstrap.cc:654] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:35.836229  7774 tablet_service.cc:1511] Processing CreateTablet for tablet 985b6cf5ffe74ecfabc7ba74e262a88f (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:16:35.838274  7774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985b6cf5ffe74ecfabc7ba74e262a88f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.874125  7848 tablet_service.cc:1511] Processing CreateTablet for tablet 985b6cf5ffe74ecfabc7ba74e262a88f (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:16:35.876184  7848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985b6cf5ffe74ecfabc7ba74e262a88f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.922298  7855 tablet_service.cc:1511] Processing CreateTablet for tablet 7141f7bef8234a56bdbb17df0b302a75 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:16:35.922811  7857 tablet_service.cc:1511] Processing CreateTablet for tablet d28b4b42078f421f85ebc87a2481aa87 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:16:35.923940  7855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7141f7bef8234a56bdbb17df0b302a75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.924700  7857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d28b4b42078f421f85ebc87a2481aa87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.926862  8059 tablet_bootstrap.cc:492] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:35.927611  8059 ts_tablet_manager.cc:1403] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.213s	user 0.027s	sys 0.053s
I20260709 13:16:35.933413  7775 tablet_service.cc:1511] Processing CreateTablet for tablet 242ac51169564e5e9b95c521387a853b (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:16:35.937883  8059 raft_consensus.cc:359] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:35.943035  8059 raft_consensus.cc:385] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:35.943710  8059 raft_consensus.cc:740] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:35.944535  7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242ac51169564e5e9b95c521387a853b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.947528  7777 tablet_service.cc:1511] Processing CreateTablet for tablet 7141f7bef8234a56bdbb17df0b302a75 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:16:35.961642  7817 heartbeater.cc:499] Master 127.30.63.62:45347 was elected leader, sending a full tablet report...
I20260709 13:16:35.948457  7996 tablet_service.cc:1511] Processing CreateTablet for tablet da682789343c4852b052f5fa4483c715 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:16:35.990799  7996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da682789343c4852b052f5fa4483c715. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:35.951251  8060 tablet_bootstrap.cc:492] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:35.998106  8060 ts_tablet_manager.cc:1403] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.273s	user 0.005s	sys 0.024s
I20260709 13:16:35.984169  8004 tablet_service.cc:1511] Processing CreateTablet for tablet b750f6e7ca2b48ef942ad988e6c4dd8d (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:16:35.949880  8059 consensus_queue.cc:260] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:36.013284  7777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7141f7bef8234a56bdbb17df0b302a75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.014191  7923 tablet_service.cc:1511] Processing CreateTablet for tablet b750f6e7ca2b48ef942ad988e6c4dd8d (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:16:36.015012  7781 tablet_service.cc:1511] Processing CreateTablet for tablet 878f83ec036345f69ff96a6b46613485 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:16:36.014976  8000 tablet_service.cc:1511] Processing CreateTablet for tablet d28b4b42078f421f85ebc87a2481aa87 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:16:36.018277  7854 tablet_service.cc:1511] Processing CreateTablet for tablet 878f83ec036345f69ff96a6b46613485 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:16:36.021288  7922 tablet_service.cc:1511] Processing CreateTablet for tablet 985b6cf5ffe74ecfabc7ba74e262a88f (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:16:36.027444  8063 tablet_bootstrap.cc:492] T aa3b3005e3634f858a7e68a789b5f827 P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:36.027179  7996 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba560db35494ad2b64a9b728d510c1a (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:16:36.029032  8064 tablet_bootstrap.cc:492] T 0d8e359e2c264806bd048cd1baed4db4 P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:36.030479  7998 tablet_service.cc:1511] Processing CreateTablet for tablet 7141f7bef8234a56bdbb17df0b302a75 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:16:36.036900  7855 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba560db35494ad2b64a9b728d510c1a (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:16:36.036902  7776 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba560db35494ad2b64a9b728d510c1a (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:16:36.051501  7926 tablet_service.cc:1511] Processing CreateTablet for tablet d28b4b42078f421f85ebc87a2481aa87 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:16:36.053287  7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 878f83ec036345f69ff96a6b46613485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.054070  7776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba560db35494ad2b64a9b728d510c1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.057181  8004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b750f6e7ca2b48ef942ad988e6c4dd8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.046015  7854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 878f83ec036345f69ff96a6b46613485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.059499  8060 raft_consensus.cc:359] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:36.061014  7855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba560db35494ad2b64a9b728d510c1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.061769  7998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7141f7bef8234a56bdbb17df0b302a75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.063874  7922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985b6cf5ffe74ecfabc7ba74e262a88f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.076879  7923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b750f6e7ca2b48ef942ad988e6c4dd8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.077347  8003 tablet_service.cc:1511] Processing CreateTablet for tablet 242ac51169564e5e9b95c521387a853b (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:16:36.064487  7774 tablet_service.cc:1511] Processing CreateTablet for tablet 4877bb8fb91844ddab1c717b7dec231d (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:16:36.079278  7774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4877bb8fb91844ddab1c717b7dec231d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.079591  7926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d28b4b42078f421f85ebc87a2481aa87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.080034  7925 tablet_service.cc:1511] Processing CreateTablet for tablet 8b505df72528474496f1a81ffa9ad0a6 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:16:36.065575  8001 tablet_service.cc:1511] Processing CreateTablet for tablet 4877bb8fb91844ddab1c717b7dec231d (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:16:36.066336  7892 heartbeater.cc:499] Master 127.30.63.62:45347 was elected leader, sending a full tablet report...
I20260709 13:16:36.072260  7848 tablet_service.cc:1511] Processing CreateTablet for tablet 8b505df72528474496f1a81ffa9ad0a6 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:16:36.082614  8003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242ac51169564e5e9b95c521387a853b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.083285  8001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4877bb8fb91844ddab1c717b7dec231d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.084005  7924 tablet_service.cc:1511] Processing CreateTablet for tablet da682789343c4852b052f5fa4483c715 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:16:36.085561  7924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da682789343c4852b052f5fa4483c715. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.085728  7927 tablet_service.cc:1511] Processing CreateTablet for tablet 242ac51169564e5e9b95c521387a853b (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:16:36.089372  7925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b505df72528474496f1a81ffa9ad0a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.089666  7930 tablet_service.cc:1511] Processing CreateTablet for tablet 878f83ec036345f69ff96a6b46613485 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:16:36.091105  7930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 878f83ec036345f69ff96a6b46613485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.091519  7848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b505df72528474496f1a81ffa9ad0a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.104298  8000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d28b4b42078f421f85ebc87a2481aa87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.110273  8063 tablet_bootstrap.cc:654] T aa3b3005e3634f858a7e68a789b5f827 P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.114408  7996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba560db35494ad2b64a9b728d510c1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.099673  8060 raft_consensus.cc:385] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.128990  8060 raft_consensus.cc:740] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.129945  8060 consensus_queue.cc:260] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:36.133970  8059 ts_tablet_manager.cc:1434] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.206s	user 0.021s	sys 0.013s
I20260709 13:16:36.135121  7927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242ac51169564e5e9b95c521387a853b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.135160  8059 tablet_bootstrap.cc:492] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:36.130511  7931 tablet_service.cc:1511] Processing CreateTablet for tablet 4877bb8fb91844ddab1c717b7dec231d (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:16:36.135547  8064 tablet_bootstrap.cc:654] T 0d8e359e2c264806bd048cd1baed4db4 P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:36.135848  7677 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.30.63.2:45491, user_credentials={real_user=slave}} blocked reactor thread for 53407.6us
I20260709 13:16:36.174563  7966 heartbeater.cc:499] Master 127.30.63.62:45347 was elected leader, sending a full tablet report...
W20260709 13:16:36.182713  7818 tablet.cc:2406] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:16:36.197062  7931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4877bb8fb91844ddab1c717b7dec231d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.206734  7775 tablet_service.cc:1511] Processing CreateTablet for tablet 9eeed88ecdc244a98599a38459ae66b8 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:16:36.208190  7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eeed88ecdc244a98599a38459ae66b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.210662  7857 tablet_service.cc:1511] Processing CreateTablet for tablet 9eeed88ecdc244a98599a38459ae66b8 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:16:36.212244  7857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eeed88ecdc244a98599a38459ae66b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.225334  7998 tablet_service.cc:1511] Processing CreateTablet for tablet 8b505df72528474496f1a81ffa9ad0a6 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:16:36.226840  7998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b505df72528474496f1a81ffa9ad0a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.236694  8059 tablet_bootstrap.cc:654] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.239141  7923 tablet_service.cc:1511] Processing CreateTablet for tablet 9eeed88ecdc244a98599a38459ae66b8 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:16:36.240907  7923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eeed88ecdc244a98599a38459ae66b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.245402  8000 tablet_service.cc:1511] Processing CreateTablet for tablet ceaecfbd6ac84206af71ba2b5fe22259 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:16:36.246912  8000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceaecfbd6ac84206af71ba2b5fe22259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.260236  8063 tablet_bootstrap.cc:492] T aa3b3005e3634f858a7e68a789b5f827 P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:36.260954  8063 ts_tablet_manager.cc:1403] T aa3b3005e3634f858a7e68a789b5f827 P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.234s	user 0.014s	sys 0.010s
I20260709 13:16:36.261344  7777 tablet_service.cc:1511] Processing CreateTablet for tablet ceaecfbd6ac84206af71ba2b5fe22259 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:16:36.262777  7777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceaecfbd6ac84206af71ba2b5fe22259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.264212  8063 raft_consensus.cc:359] T aa3b3005e3634f858a7e68a789b5f827 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:36.265100  8063 raft_consensus.cc:385] T aa3b3005e3634f858a7e68a789b5f827 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.265416  8063 raft_consensus.cc:740] T aa3b3005e3634f858a7e68a789b5f827 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.266366  8063 consensus_queue.cc:260] T aa3b3005e3634f858a7e68a789b5f827 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:36.285138  8040 heartbeater.cc:499] Master 127.30.63.62:45347 was elected leader, sending a full tablet report...
I20260709 13:16:36.286155  7854 tablet_service.cc:1511] Processing CreateTablet for tablet ceaecfbd6ac84206af71ba2b5fe22259 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:16:36.286638  8065 raft_consensus.cc:493] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.287137  8065 raft_consensus.cc:515] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:36.287673  7854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceaecfbd6ac84206af71ba2b5fe22259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.286177  7924 tablet_service.cc:1511] Processing CreateTablet for tablet e8725967bab0469eb6a5ed9c6bddf3cb (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:16:36.294298  7924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8725967bab0469eb6a5ed9c6bddf3cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.298719  8065 leader_election.cc:290] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:36.304761  8060 ts_tablet_manager.cc:1434] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.264s	user 0.025s	sys 0.075s
I20260709 13:16:36.323130  8066 raft_consensus.cc:493] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.323778  8066 raft_consensus.cc:515] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:36.325625  7998 tablet_service.cc:1511] Processing CreateTablet for tablet e8725967bab0469eb6a5ed9c6bddf3cb (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:16:36.309321  8060 tablet_bootstrap.cc:492] T de92af0966804027bbe4ec91b14382d4 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:36.334283  8070 raft_consensus.cc:493] T aa3b3005e3634f858a7e68a789b5f827 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.334868  8070 raft_consensus.cc:515] T aa3b3005e3634f858a7e68a789b5f827 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:36.346014  7777 tablet_service.cc:1511] Processing CreateTablet for tablet e8725967bab0469eb6a5ed9c6bddf3cb (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:16:36.329150  8066 leader_election.cc:290] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:36.350564  8063 ts_tablet_manager.cc:1434] T aa3b3005e3634f858a7e68a789b5f827 P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.089s	user 0.016s	sys 0.012s
I20260709 13:16:36.351802  8063 tablet_bootstrap.cc:492] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:36.361865  7998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8725967bab0469eb6a5ed9c6bddf3cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.376984  7777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8725967bab0469eb6a5ed9c6bddf3cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.382386  7857 tablet_service.cc:1511] Processing CreateTablet for tablet a8fe051592e64e39905b33d218b96822 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:16:36.384208  7857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8fe051592e64e39905b33d218b96822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.386548  7922 tablet_service.cc:1511] Processing CreateTablet for tablet a8fe051592e64e39905b33d218b96822 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:16:36.387904  7922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8fe051592e64e39905b33d218b96822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.389067  8064 tablet_bootstrap.cc:492] T 0d8e359e2c264806bd048cd1baed4db4 P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:36.389853  8064 ts_tablet_manager.cc:1403] T 0d8e359e2c264806bd048cd1baed4db4 P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.385s	user 0.013s	sys 0.023s
I20260709 13:16:36.391386  8060 tablet_bootstrap.cc:654] T de92af0966804027bbe4ec91b14382d4 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.368261  8070 leader_election.cc:290] T aa3b3005e3634f858a7e68a789b5f827 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:36.378507  8059 tablet_bootstrap.cc:492] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:36.443101  8064 raft_consensus.cc:359] T 0d8e359e2c264806bd048cd1baed4db4 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:36.444558  8064 raft_consensus.cc:385] T 0d8e359e2c264806bd048cd1baed4db4 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.444972  8064 raft_consensus.cc:740] T 0d8e359e2c264806bd048cd1baed4db4 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.446007  8064 consensus_queue.cc:260] T 0d8e359e2c264806bd048cd1baed4db4 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:36.420228  8059 ts_tablet_manager.cc:1403] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.285s	user 0.018s	sys 0.014s
I20260709 13:16:36.454528  8059 raft_consensus.cc:359] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:36.455538  8059 raft_consensus.cc:385] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.455899  8059 raft_consensus.cc:740] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.470890  8064 ts_tablet_manager.cc:1434] T 0d8e359e2c264806bd048cd1baed4db4 P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.081s	user 0.003s	sys 0.015s
I20260709 13:16:36.472069  8064 tablet_bootstrap.cc:492] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:36.471781  7781 tablet_service.cc:1511] Processing CreateTablet for tablet d99b23f5044644c1b270bc5afcaf2119 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:16:36.473248  7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d99b23f5044644c1b270bc5afcaf2119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.475255  8063 tablet_bootstrap.cc:654] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.466646  8059 consensus_queue.cc:260] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:36.481516  7855 tablet_service.cc:1511] Processing CreateTablet for tablet d99b23f5044644c1b270bc5afcaf2119 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:16:36.483098  7855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d99b23f5044644c1b270bc5afcaf2119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.483712  8059 ts_tablet_manager.cc:1434] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:16:36.484992  8059 tablet_bootstrap.cc:492] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:36.492888  7775 tablet_service.cc:1511] Processing CreateTablet for tablet 6ed88d7e51364cb28224875b51de8f8e (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:16:36.493830  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4af0a88c7f43bcaa15fc11bdfaf591" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:36.497988  8001 tablet_service.cc:1511] Processing CreateTablet for tablet a8fe051592e64e39905b33d218b96822 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:16:36.498481  7996 tablet_service.cc:1511] Processing CreateTablet for tablet 6ed88d7e51364cb28224875b51de8f8e (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:16:36.499866  8001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8fe051592e64e39905b33d218b96822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.500984  7996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed88d7e51364cb28224875b51de8f8e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:36.501085  7830 leader_election.cc:343] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:36.502471  7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed88d7e51364cb28224875b51de8f8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.509327  8059 tablet_bootstrap.cc:654] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.515352  8064 tablet_bootstrap.cc:654] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.515761  7867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3b3005e3634f858a7e68a789b5f827" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
W20260709 13:16:36.518041  7907 leader_election.cc:343] T aa3b3005e3634f858a7e68a789b5f827 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:36.542403  7931 tablet_service.cc:1511] Processing CreateTablet for tablet d99b23f5044644c1b270bc5afcaf2119 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:16:36.565371  7848 tablet_service.cc:1511] Processing CreateTablet for tablet 6ed88d7e51364cb28224875b51de8f8e (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:16:36.566800  7848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed88d7e51364cb28224875b51de8f8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.580653  7931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d99b23f5044644c1b270bc5afcaf2119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.580531  7927 tablet_service.cc:1511] Processing CreateTablet for tablet 32f607aa832749eeb8e3b97bab01b9f3 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:16:36.582342  7927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32f607aa832749eeb8e3b97bab01b9f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.588912  7774 tablet_service.cc:1511] Processing CreateTablet for tablet 32f607aa832749eeb8e3b97bab01b9f3 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:16:36.594007  7774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32f607aa832749eeb8e3b97bab01b9f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.599936  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3b3005e3634f858a7e68a789b5f827" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
W20260709 13:16:36.601775  7906 leader_election.cc:343] T aa3b3005e3634f858a7e68a789b5f827 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:36.600152  8064 tablet_bootstrap.cc:492] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:36.602273  7906 leader_election.cc:304] T aa3b3005e3634f858a7e68a789b5f827 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200; no voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690
I20260709 13:16:36.602614  8064 ts_tablet_manager.cc:1403] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.131s	user 0.014s	sys 0.016s
I20260709 13:16:36.603169  8070 raft_consensus.cc:2749] T aa3b3005e3634f858a7e68a789b5f827 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:36.606113  8059 tablet_bootstrap.cc:492] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:36.606666  8064 raft_consensus.cc:359] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:36.615542  7924 tablet_service.cc:1511] Processing CreateTablet for tablet ea27688f1e2442e18da64b6f636beaf4 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:16:36.617070  7924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea27688f1e2442e18da64b6f636beaf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.618569  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3462b69ce46f4d49b5c5f1a6872a03e4" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:36.606649  8059 ts_tablet_manager.cc:1403] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.122s	user 0.015s	sys 0.004s
I20260709 13:16:36.611075  7854 tablet_service.cc:1511] Processing CreateTablet for tablet ea27688f1e2442e18da64b6f636beaf4 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:16:36.621084  7854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea27688f1e2442e18da64b6f636beaf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.620950  7781 tablet_service.cc:1511] Processing CreateTablet for tablet afc39d65d52c48e3a959c8876930ab07 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
W20260709 13:16:36.621393  7757 leader_election.cc:343] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:36.622331  7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afc39d65d52c48e3a959c8876930ab07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.625208  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4af0a88c7f43bcaa15fc11bdfaf591" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
W20260709 13:16:36.627094  7832 leader_election.cc:343] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:36.627593  7832 leader_election.cc:304] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:36.618130  8084 raft_consensus.cc:493] T 0d8e359e2c264806bd048cd1baed4db4 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.628747  8066 raft_consensus.cc:2749] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:36.629144  8084 raft_consensus.cc:515] T 0d8e359e2c264806bd048cd1baed4db4 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:36.630681  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3462b69ce46f4d49b5c5f1a6872a03e4" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
W20260709 13:16:36.632194  7757 leader_election.cc:343] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:36.632710  7757 leader_election.cc:304] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690
I20260709 13:16:36.615532  8064 raft_consensus.cc:385] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.633608  8064 raft_consensus.cc:740] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.633950  8065 raft_consensus.cc:2749] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:36.619609  7998 tablet_service.cc:1511] Processing CreateTablet for tablet 32f607aa832749eeb8e3b97bab01b9f3 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:16:36.638847  7856 tablet_service.cc:1511] Processing CreateTablet for tablet afc39d65d52c48e3a959c8876930ab07 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:16:36.645339  7856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afc39d65d52c48e3a959c8876930ab07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.646021  8063 tablet_bootstrap.cc:492] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:36.646596  8063 ts_tablet_manager.cc:1403] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.295s	user 0.033s	sys 0.020s
I20260709 13:16:36.648234  7998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32f607aa832749eeb8e3b97bab01b9f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.643157  7922 tablet_service.cc:1511] Processing CreateTablet for tablet afc39d65d52c48e3a959c8876930ab07 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:16:36.648439  7776 tablet_service.cc:1511] Processing CreateTablet for tablet 06dd732d5f194c5f8bacb0d12d551212 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:16:36.653546  7922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afc39d65d52c48e3a959c8876930ab07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.653600  7776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06dd732d5f194c5f8bacb0d12d551212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.657037  8001 tablet_service.cc:1511] Processing CreateTablet for tablet ea27688f1e2442e18da64b6f636beaf4 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:16:36.658433  8001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea27688f1e2442e18da64b6f636beaf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.652128  7996 tablet_service.cc:1511] Processing CreateTablet for tablet 06dd732d5f194c5f8bacb0d12d551212 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:16:36.662067  7996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06dd732d5f194c5f8bacb0d12d551212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.665529  8063 raft_consensus.cc:359] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:36.666395  8063 raft_consensus.cc:385] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.666723  8063 raft_consensus.cc:740] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.661641  8064 consensus_queue.cc:260] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:36.667670  7853 tablet_service.cc:1511] Processing CreateTablet for tablet 06dd732d5f194c5f8bacb0d12d551212 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:16:36.669251  7853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06dd732d5f194c5f8bacb0d12d551212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.669380  8064 ts_tablet_manager.cc:1434] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.001s
I20260709 13:16:36.670428  8064 tablet_bootstrap.cc:492] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:36.631927  8059 raft_consensus.cc:359] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:36.676983  8059 raft_consensus.cc:385] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.677160  8064 tablet_bootstrap.cc:654] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.677449  8059 raft_consensus.cc:740] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.678062  8084 leader_election.cc:290] T 0d8e359e2c264806bd048cd1baed4db4 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:36.678526  8059 consensus_queue.cc:260] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:36.640002  8060 tablet_bootstrap.cc:492] T de92af0966804027bbe4ec91b14382d4 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:36.686174  8060 ts_tablet_manager.cc:1403] T de92af0966804027bbe4ec91b14382d4 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.380s	user 0.029s	sys 0.006s
I20260709 13:16:36.688261  8059 ts_tablet_manager.cc:1434] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.062s	user 0.004s	sys 0.003s
I20260709 13:16:36.689909  7931 tablet_service.cc:1511] Processing CreateTablet for tablet 48ee265806af41dfb77624fadfa04e6b (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:16:36.689836  8059 tablet_bootstrap.cc:492] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:36.690797  8060 raft_consensus.cc:359] T de92af0966804027bbe4ec91b14382d4 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:36.691603  8060 raft_consensus.cc:385] T de92af0966804027bbe4ec91b14382d4 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.691905  8060 raft_consensus.cc:740] T de92af0966804027bbe4ec91b14382d4 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.692849  8060 consensus_queue.cc:260] T de92af0966804027bbe4ec91b14382d4 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:36.697407  7931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48ee265806af41dfb77624fadfa04e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.697777  8060 ts_tablet_manager.cc:1434] T de92af0966804027bbe4ec91b14382d4 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:16:36.698844  8060 tablet_bootstrap.cc:492] T 7806fa697a044140850e326d8e5889d1 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:36.704965  8000 tablet_service.cc:1511] Processing CreateTablet for tablet 48ee265806af41dfb77624fadfa04e6b (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:16:36.667604  8063 consensus_queue.cc:260] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:36.707628  8063 ts_tablet_manager.cc:1434] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.000s
I20260709 13:16:36.713132  8000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48ee265806af41dfb77624fadfa04e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.713903  8063 tablet_bootstrap.cc:492] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:36.720633  8063 tablet_bootstrap.cc:654] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.728767  8059 tablet_bootstrap.cc:654] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.729022  7774 tablet_service.cc:1511] Processing CreateTablet for tablet 48ee265806af41dfb77624fadfa04e6b (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:16:36.730463  7774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48ee265806af41dfb77624fadfa04e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.735520  8065 raft_consensus.cc:493] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.759374  7853 tablet_service.cc:1511] Processing CreateTablet for tablet 45dba482a30c44a58bf79b2a8a890aee (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:16:36.759631  8065 raft_consensus.cc:515] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:36.763074  8065 leader_election.cc:290] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:36.764287  7853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45dba482a30c44a58bf79b2a8a890aee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.764971  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de92af0966804027bbe4ec91b14382d4" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
W20260709 13:16:36.767491  7757 leader_election.cc:343] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:36.779865  7737 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:36.789786  7922 tablet_service.cc:1511] Processing CreateTablet for tablet 940bca2247d04fb495fba36734ace153 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:16:36.790650  8003 tablet_service.cc:1511] Processing CreateTablet for tablet 45dba482a30c44a58bf79b2a8a890aee (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:16:36.790870  8004 tablet_service.cc:1511] Processing CreateTablet for tablet 2e6d18ad10a340e2aa1fba5831e6db57 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:16:36.791270  7922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 940bca2247d04fb495fba36734ace153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.792022  8003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45dba482a30c44a58bf79b2a8a890aee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.792373  7867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8e359e2c264806bd048cd1baed4db4" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
W20260709 13:16:36.794088  7981 leader_election.cc:343] T 0d8e359e2c264806bd048cd1baed4db4 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:36.794951  8004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e6d18ad10a340e2aa1fba5831e6db57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.810223  7926 tablet_service.cc:1511] Processing CreateTablet for tablet 191eb110a7ae4009a2184d4c3af4f439 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:16:36.811672  7926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 191eb110a7ae4009a2184d4c3af4f439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.817376  7775 tablet_service.cc:1511] Processing CreateTablet for tablet 2e6d18ad10a340e2aa1fba5831e6db57 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:16:36.832419  7999 tablet_service.cc:1511] Processing CreateTablet for tablet 191eb110a7ae4009a2184d4c3af4f439 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:16:36.834074  7999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 191eb110a7ae4009a2184d4c3af4f439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.846119  8059 tablet_bootstrap.cc:492] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:36.846051  7781 tablet_service.cc:1511] Processing CreateTablet for tablet 191eb110a7ae4009a2184d4c3af4f439 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:16:36.846841  8059 ts_tablet_manager.cc:1403] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.157s	user 0.019s	sys 0.023s
I20260709 13:16:36.848050  7924 tablet_service.cc:1511] Processing CreateTablet for tablet 45dba482a30c44a58bf79b2a8a890aee (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:16:36.849524  7924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45dba482a30c44a58bf79b2a8a890aee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.840751  7776 tablet_service.cc:1511] Processing CreateTablet for tablet 940bca2247d04fb495fba36734ace153 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:16:36.844128  7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e6d18ad10a340e2aa1fba5831e6db57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.857280  8063 tablet_bootstrap.cc:492] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:36.857844  8063 ts_tablet_manager.cc:1403] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.144s	user 0.013s	sys 0.003s
I20260709 13:16:36.859889  7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 191eb110a7ae4009a2184d4c3af4f439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.861063  8063 raft_consensus.cc:359] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:36.861865  8063 raft_consensus.cc:385] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.862169  8063 raft_consensus.cc:740] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.862586  8064 tablet_bootstrap.cc:492] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:36.863147  8064 ts_tablet_manager.cc:1403] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.193s	user 0.021s	sys 0.028s
I20260709 13:16:36.863025  8063 consensus_queue.cc:260] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:36.864092  7854 tablet_service.cc:1511] Processing CreateTablet for tablet c265324643494522a597d6dab81e7893 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:16:36.865454  7854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c265324643494522a597d6dab81e7893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.866427  8060 tablet_bootstrap.cc:654] T 7806fa697a044140850e326d8e5889d1 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.867201  8064 raft_consensus.cc:359] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:36.868080  8064 raft_consensus.cc:385] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.868378  8064 raft_consensus.cc:740] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.868964  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8e359e2c264806bd048cd1baed4db4" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:36.869735  7776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 940bca2247d04fb495fba36734ace153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.869303  8064 consensus_queue.cc:260] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
W20260709 13:16:36.871444  7980 leader_election.cc:343] T 0d8e359e2c264806bd048cd1baed4db4 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:36.871976  7980 leader_election.cc:304] T 0d8e359e2c264806bd048cd1baed4db4 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:36.873185  8084 raft_consensus.cc:2749] T 0d8e359e2c264806bd048cd1baed4db4 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:36.874843  8064 ts_tablet_manager.cc:1434] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:16:36.875909  8064 tablet_bootstrap.cc:492] T 9c126cef127140f48a31bbd723a86051 P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:36.877663  7848 tablet_service.cc:1511] Processing CreateTablet for tablet 2e6d18ad10a340e2aa1fba5831e6db57 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:16:36.879103  7848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e6d18ad10a340e2aa1fba5831e6db57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.879033  7867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de92af0966804027bbe4ec91b14382d4" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:36.879765  7867 raft_consensus.cc:2468] T de92af0966804027bbe4ec91b14382d4 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 0.
I20260709 13:16:36.881282  7758 leader_election.cc:304] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: c9a569f7d1ad42359002386a73702690
I20260709 13:16:36.882481  8065 raft_consensus.cc:2804] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:36.882850  8065 raft_consensus.cc:493] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.883190  8065 raft_consensus.cc:3060] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:36.853348  8059 raft_consensus.cc:359] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:36.883865  8059 raft_consensus.cc:385] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.884182  8059 raft_consensus.cc:740] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.884536  8063 ts_tablet_manager.cc:1434] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.005s
I20260709 13:16:36.884989  8059 consensus_queue.cc:260] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:36.887209  7853 tablet_service.cc:1511] Processing CreateTablet for tablet 940bca2247d04fb495fba36734ace153 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:16:36.888509  7853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 940bca2247d04fb495fba36734ace153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.893447  8063 tablet_bootstrap.cc:492] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:36.894207  8065 raft_consensus.cc:515] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:36.897323  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de92af0966804027bbe4ec91b14382d4" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:36.898658  8084 raft_consensus.cc:493] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.899175  8084 raft_consensus.cc:515] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:36.900079  8063 tablet_bootstrap.cc:654] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.909245  8084 leader_election.cc:290] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:36.910970  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3462b69ce46f4d49b5c5f1a6872a03e4" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
W20260709 13:16:36.912456  7980 leader_election.cc:343] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:36.906927  7757 leader_election.cc:343] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:36.913678  8001 tablet_service.cc:1511] Processing CreateTablet for tablet c265324643494522a597d6dab81e7893 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:16:36.915066  8001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c265324643494522a597d6dab81e7893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.915499  8060 tablet_bootstrap.cc:492] T 7806fa697a044140850e326d8e5889d1 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:36.916005  8060 ts_tablet_manager.cc:1403] T 7806fa697a044140850e326d8e5889d1 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.217s	user 0.010s	sys 0.004s
I20260709 13:16:36.919149  8060 raft_consensus.cc:359] T 7806fa697a044140850e326d8e5889d1 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:36.919605  8064 tablet_bootstrap.cc:654] T 9c126cef127140f48a31bbd723a86051 P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.919942  8060 raft_consensus.cc:385] T 7806fa697a044140850e326d8e5889d1 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:36.920684  8065 leader_election.cc:290] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:36.921844  7867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de92af0966804027bbe4ec91b14382d4" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:36.922078  8059 ts_tablet_manager.cc:1434] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.075s	user 0.014s	sys 0.003s
I20260709 13:16:36.922994  8060 raft_consensus.cc:740] T 7806fa697a044140850e326d8e5889d1 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:36.924124  7774 tablet_service.cc:1511] Processing CreateTablet for tablet ffeb7520452b4edcb0421cee5ab0e516 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:16:36.924381  8060 consensus_queue.cc:260] T 7806fa697a044140850e326d8e5889d1 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:36.925287  7867 raft_consensus.cc:3060] T de92af0966804027bbe4ec91b14382d4 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:36.926970  8060 ts_tablet_manager.cc:1434] T 7806fa697a044140850e326d8e5889d1 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:16:36.928160  8060 tablet_bootstrap.cc:492] T aa3b3005e3634f858a7e68a789b5f827 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:36.932411  8084 raft_consensus.cc:493] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.932983  8084 raft_consensus.cc:515] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:36.935848  7774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffeb7520452b4edcb0421cee5ab0e516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.936498  7866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5391ca2d8a8747bebb865e71268e06ad" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
W20260709 13:16:36.938129  7981 leader_election.cc:343] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:36.938753  8084 leader_election.cc:290] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:36.943161  7854 tablet_service.cc:1511] Processing CreateTablet for tablet ffeb7520452b4edcb0421cee5ab0e516 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:16:36.947451  8065 raft_consensus.cc:493] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.947382  7922 tablet_service.cc:1511] Processing CreateTablet for tablet c265324643494522a597d6dab81e7893 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:16:36.948134  8065 raft_consensus.cc:515] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:36.948944  7922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c265324643494522a597d6dab81e7893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.950062  8059 tablet_bootstrap.cc:492] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:36.951645  8065 leader_election.cc:290] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:36.952404  7854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffeb7520452b4edcb0421cee5ab0e516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.952946  7866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8981a911484760ab96a4d042148094" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:36.951642  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8981a911484760ab96a4d042148094" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:36.954481  7867 raft_consensus.cc:2468] T de92af0966804027bbe4ec91b14382d4 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 1.
W20260709 13:16:36.957005  7757 leader_election.cc:343] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:36.958564  7758 leader_election.cc:343] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:36.959270  7758 leader_election.cc:304] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690
I20260709 13:16:36.959291  7926 tablet_service.cc:1511] Processing CreateTablet for tablet ffeb7520452b4edcb0421cee5ab0e516 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:16:36.960083  8060 tablet_bootstrap.cc:654] T aa3b3005e3634f858a7e68a789b5f827 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:36.960577  8097 raft_consensus.cc:2749] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:36.960892  7926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffeb7520452b4edcb0421cee5ab0e516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.963014  7758 leader_election.cc:304] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: c9a569f7d1ad42359002386a73702690
I20260709 13:16:36.963498  8000 tablet_service.cc:1511] Processing CreateTablet for tablet f35a05f13eee42d4bdd19ff8b2b98212 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:16:36.965013  8000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f35a05f13eee42d4bdd19ff8b2b98212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.965420  8097 raft_consensus.cc:2804] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:36.967890  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3462b69ce46f4d49b5c5f1a6872a03e4" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:36.968626  7792 raft_consensus.cc:2468] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 0.
I20260709 13:16:36.958127  7781 tablet_service.cc:1511] Processing CreateTablet for tablet f35a05f13eee42d4bdd19ff8b2b98212 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:16:36.969153  7791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5391ca2d8a8747bebb865e71268e06ad" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:36.969909  7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f35a05f13eee42d4bdd19ff8b2b98212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.970418  7978 leader_election.cc:304] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:36.972673  8084 raft_consensus.cc:2804] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:36.973068  8084 raft_consensus.cc:493] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.973423  8084 raft_consensus.cc:3060] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:36.975329  7856 tablet_service.cc:1511] Processing CreateTablet for tablet f35a05f13eee42d4bdd19ff8b2b98212 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:16:36.968420  8097 raft_consensus.cc:697] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:16:36.977160  7856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f35a05f13eee42d4bdd19ff8b2b98212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.977456  8097 consensus_queue.cc:237] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:36.993100  7777 tablet_service.cc:1511] Processing CreateTablet for tablet 93cca694a49b44ba8eda19c91491696e (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:16:36.993482  7927 tablet_service.cc:1511] Processing CreateTablet for tablet 93cca694a49b44ba8eda19c91491696e (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:16:36.994597  7777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93cca694a49b44ba8eda19c91491696e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:36.995352  7927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93cca694a49b44ba8eda19c91491696e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.004462  8070 raft_consensus.cc:493] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.004261  7855 tablet_service.cc:1511] Processing CreateTablet for tablet 932dad2d4cee49e296e9359aa665ef9d (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:16:37.004992  8070 raft_consensus.cc:515] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:37.005621  7855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 932dad2d4cee49e296e9359aa665ef9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.007351  8070 leader_election.cc:290] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:37.011252  7867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deeaf93ab6424e9c8013e6c9fbccb724" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
W20260709 13:16:37.012959  7907 leader_election.cc:343] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:36.999064  7978 leader_election.cc:343] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:37.020153  7931 tablet_service.cc:1511] Processing CreateTablet for tablet 932dad2d4cee49e296e9359aa665ef9d (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:16:37.021574  7931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 932dad2d4cee49e296e9359aa665ef9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.031447  7773 tablet_service.cc:1511] Processing CreateTablet for tablet d1b12aa42b0f49a49b24d2433fdca7a8 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:16:37.032960  7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1b12aa42b0f49a49b24d2433fdca7a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.025753  8084 raft_consensus.cc:515] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:37.036427  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3462b69ce46f4d49b5c5f1a6872a03e4" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
W20260709 13:16:37.037961  7980 leader_election.cc:343] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:37.038604  8084 leader_election.cc:290] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 election: Requested vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:37.049139  7855 tablet_service.cc:1511] Processing CreateTablet for tablet d1b12aa42b0f49a49b24d2433fdca7a8 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:16:37.051999  7855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1b12aa42b0f49a49b24d2433fdca7a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.052662  7925 tablet_service.cc:1511] Processing CreateTablet for tablet d1b12aa42b0f49a49b24d2433fdca7a8 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:16:37.054649  8063 tablet_bootstrap.cc:492] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:37.061288  7857 tablet_service.cc:1511] Processing CreateTablet for tablet 5cc8636f68ae4121ac05d99e24866633 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:16:37.064428  7791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deeaf93ab6424e9c8013e6c9fbccb724" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:37.067651  7925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1b12aa42b0f49a49b24d2433fdca7a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.067937  7922 tablet_service.cc:1511] Processing CreateTablet for tablet 9cc9c8ab28ac4825a9ddbc9a7ef56f12 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:16:37.069231  7922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cc9c8ab28ac4825a9ddbc9a7ef56f12. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:37.069656  7904 leader_election.cc:343] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:37.070367  7904 leader_election.cc:304] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200; no voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:37.071933  8070 raft_consensus.cc:2749] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:37.062994  7978 leader_election.cc:304] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:37.076072  8084 raft_consensus.cc:2749] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:16:37.076262  7978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:35503, user_credentials={real_user=slave}} blocked reactor thread for 77882.4us
I20260709 13:16:37.077088  8060 tablet_bootstrap.cc:492] T aa3b3005e3634f858a7e68a789b5f827 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:37.077603  8060 ts_tablet_manager.cc:1403] T aa3b3005e3634f858a7e68a789b5f827 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.150s	user 0.012s	sys 0.003s
I20260709 13:16:37.079103  8001 tablet_service.cc:1511] Processing CreateTablet for tablet 93cca694a49b44ba8eda19c91491696e (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:16:37.080001  8063 ts_tablet_manager.cc:1403] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.187s	user 0.020s	sys 0.009s
I20260709 13:16:37.080808  8001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93cca694a49b44ba8eda19c91491696e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.081369  7999 tablet_service.cc:1511] Processing CreateTablet for tablet 932dad2d4cee49e296e9359aa665ef9d (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:16:37.082744  7999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 932dad2d4cee49e296e9359aa665ef9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.082600  8004 tablet_service.cc:1511] Processing CreateTablet for tablet 9cc9c8ab28ac4825a9ddbc9a7ef56f12 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:16:37.079759  8003 tablet_service.cc:1511] Processing CreateTablet for tablet 5cc8636f68ae4121ac05d99e24866633 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:16:37.083891  8004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cc9c8ab28ac4825a9ddbc9a7ef56f12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.083532  8063 raft_consensus.cc:359] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:37.084295  8063 raft_consensus.cc:385] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.085943  8066 raft_consensus.cc:493] T 7806fa697a044140850e326d8e5889d1 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.086438  8066 raft_consensus.cc:515] T 7806fa697a044140850e326d8e5889d1 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:37.088358  7773 tablet_service.cc:1511] Processing CreateTablet for tablet 9cc9c8ab28ac4825a9ddbc9a7ef56f12 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:16:37.089994  7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cc9c8ab28ac4825a9ddbc9a7ef56f12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.090078  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7806fa697a044140850e326d8e5889d1" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
W20260709 13:16:37.091686  7830 leader_election.cc:343] T 7806fa697a044140850e326d8e5889d1 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:37.092247  8003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cc8636f68ae4121ac05d99e24866633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.079617  7791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3462b69ce46f4d49b5c5f1a6872a03e4" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:37.093005  7791 raft_consensus.cc:3060] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.096925  8066 leader_election.cc:290] T 7806fa697a044140850e326d8e5889d1 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:37.098676  8060 raft_consensus.cc:359] T aa3b3005e3634f858a7e68a789b5f827 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:37.099422  8060 raft_consensus.cc:385] T aa3b3005e3634f858a7e68a789b5f827 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.099720  8060 raft_consensus.cc:740] T aa3b3005e3634f858a7e68a789b5f827 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.100418  8060 consensus_queue.cc:260] T aa3b3005e3634f858a7e68a789b5f827 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:37.102739  8060 ts_tablet_manager.cc:1434] T aa3b3005e3634f858a7e68a789b5f827 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:16:37.103746  8060 tablet_bootstrap.cc:492] T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:37.104409  7857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cc8636f68ae4121ac05d99e24866633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.105229  8063 raft_consensus.cc:740] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.104462  7926 tablet_service.cc:1511] Processing CreateTablet for tablet 3fa297fedf4549fd89f9a179ef9147a8 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:16:37.119678  7775 tablet_service.cc:1511] Processing CreateTablet for tablet 66c64de12c904e15892de849a597eeae (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:16:37.122906  7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66c64de12c904e15892de849a597eeae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.126402  7791 raft_consensus.cc:2468] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 1.
I20260709 13:16:37.128152  7978 leader_election.cc:304] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:37.128861  8063 consensus_queue.cc:260] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:37.131557  8063 ts_tablet_manager.cc:1434] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.051s	user 0.003s	sys 0.004s
I20260709 13:16:37.132654  8063 tablet_bootstrap.cc:492] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:37.138777  8064 tablet_bootstrap.cc:492] T 9c126cef127140f48a31bbd723a86051 P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:37.129359  8084 raft_consensus.cc:2804] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:37.117452  8059 tablet_bootstrap.cc:654] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.139348  8064 ts_tablet_manager.cc:1403] T 9c126cef127140f48a31bbd723a86051 P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.264s	user 0.013s	sys 0.013s
I20260709 13:16:37.142261  8084 raft_consensus.cc:697] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690 [term 1 LEADER]: Becoming Leader. State: Replica: c9a569f7d1ad42359002386a73702690, State: Running, Role: LEADER
I20260709 13:16:37.149158  8084 consensus_queue.cc:237] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:37.150810  8063 tablet_bootstrap.cc:654] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.157104  7776 tablet_service.cc:1511] Processing CreateTablet for tablet c04b5a061ff84745af17197de774ac96 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:16:37.158512  7776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c04b5a061ff84745af17197de774ac96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.162731  7923 tablet_service.cc:1511] Processing CreateTablet for tablet 66c64de12c904e15892de849a597eeae (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:16:37.163131  7930 tablet_service.cc:1511] Processing CreateTablet for tablet 272dd059968c4493bb875e3bf32a3183 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:16:37.165861  7996 tablet_service.cc:1511] Processing CreateTablet for tablet 272dd059968c4493bb875e3bf32a3183 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:16:37.166787  7782 tablet_service.cc:1511] Processing CreateTablet for tablet b5e46a5b31234af492e77dbf435ead58 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:16:37.167382  7996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272dd059968c4493bb875e3bf32a3183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.168035  7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e46a5b31234af492e77dbf435ead58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.171047  7690 catalog_manager.cc:5697] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:37.171782  7781 tablet_service.cc:1511] Processing CreateTablet for tablet 272dd059968c4493bb875e3bf32a3183 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:16:37.173754  8000 tablet_service.cc:1511] Processing CreateTablet for tablet 3fa297fedf4549fd89f9a179ef9147a8 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:16:37.173864  7779 tablet_service.cc:1511] Processing CreateTablet for tablet 1f5409294f3e4162a75137e616968afb (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:16:37.186329  7779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5409294f3e4162a75137e616968afb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.188161  8002 tablet_service.cc:1511] Processing CreateTablet for tablet f584d75fb3ee4c80958b7b9e5322cf2b (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:16:37.189945  7780 tablet_service.cc:1511] Processing CreateTablet for tablet 044eb7b4196a4ac595bec86f29fca1bf (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:16:37.191424  7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 044eb7b4196a4ac595bec86f29fca1bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.176800  7928 tablet_service.cc:1511] Processing CreateTablet for tablet 569ddc7f4d23481a852ea6ef24d38e31 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:16:37.195297  8003 tablet_service.cc:1511] Processing CreateTablet for tablet c04b5a061ff84745af17197de774ac96 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:16:37.178498  7998 tablet_service.cc:1511] Processing CreateTablet for tablet 569ddc7f4d23481a852ea6ef24d38e31 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:16:37.179329  7997 tablet_service.cc:1511] Processing CreateTablet for tablet ea7f3171e8b84ac48e0abd056c43f778 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:16:37.202502  7853 tablet_service.cc:1511] Processing CreateTablet for tablet 66c64de12c904e15892de849a597eeae (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:16:37.202983  7849 tablet_service.cc:1511] Processing CreateTablet for tablet c04b5a061ff84745af17197de774ac96 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:16:37.204022  7853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66c64de12c904e15892de849a597eeae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.204738  7849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c04b5a061ff84745af17197de774ac96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.205834  7852 tablet_service.cc:1511] Processing CreateTablet for tablet 569ddc7f4d23481a852ea6ef24d38e31 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:16:37.206265  8070 raft_consensus.cc:493] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.207273  7852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 569ddc7f4d23481a852ea6ef24d38e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.206787  8070 raft_consensus.cc:515] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:37.181227  7929 tablet_service.cc:1511] Processing CreateTablet for tablet b5e46a5b31234af492e77dbf435ead58 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:16:37.183436  7778 tablet_service.cc:1511] Processing CreateTablet for tablet ea7f3171e8b84ac48e0abd056c43f778 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:16:37.209342  8066 raft_consensus.cc:493] T aa3b3005e3634f858a7e68a789b5f827 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.210114  7778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea7f3171e8b84ac48e0abd056c43f778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.209937  8066 raft_consensus.cc:515] T aa3b3005e3634f858a7e68a789b5f827 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:37.178725  8005 tablet_service.cc:1511] Processing CreateTablet for tablet 1f5409294f3e4162a75137e616968afb (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:16:37.206749  7850 tablet_service.cc:1511] Processing CreateTablet for tablet 1f5409294f3e4162a75137e616968afb (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:16:37.214048  7850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5409294f3e4162a75137e616968afb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.217236  8066 leader_election.cc:290] T aa3b3005e3634f858a7e68a789b5f827 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:37.217492  8070 leader_election.cc:290] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:37.218438  7924 tablet_service.cc:1511] Processing CreateTablet for tablet ea7f3171e8b84ac48e0abd056c43f778 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:16:37.219707  7926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fa297fedf4549fd89f9a179ef9147a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.219475  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c126cef127140f48a31bbd723a86051" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:37.220634  8097 raft_consensus.cc:493] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.220956  7851 tablet_service.cc:1511] Processing CreateTablet for tablet b5e46a5b31234af492e77dbf435ead58 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:16:37.221174  8097 raft_consensus.cc:515] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:37.222226  7851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e46a5b31234af492e77dbf435ead58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.223562  8097 leader_election.cc:290] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:37.224809  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c126cef127140f48a31bbd723a86051" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:37.225068  7929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e46a5b31234af492e77dbf435ead58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.225528  7941 raft_consensus.cc:2468] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 0.
I20260709 13:16:37.227404  8014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c126cef127140f48a31bbd723a86051" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:37.229754  7757 leader_election.cc:304] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: c9a569f7d1ad42359002386a73702690
I20260709 13:16:37.219475  7791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c126cef127140f48a31bbd723a86051" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:37.230790  7791 raft_consensus.cc:2468] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 0.
I20260709 13:16:37.231307  8097 raft_consensus.cc:2804] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:37.231662  8097 raft_consensus.cc:493] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.231992  8097 raft_consensus.cc:3060] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.232106  7904 leader_election.cc:304] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:16:37.181039  7774 tablet_service.cc:1511] Processing CreateTablet for tablet 5cc8636f68ae4121ac05d99e24866633 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:16:37.195356  8000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fa297fedf4549fd89f9a179ef9147a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.253254  7856 tablet_service.cc:1511] Processing CreateTablet for tablet 3fa297fedf4549fd89f9a179ef9147a8 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:16:37.254642  7856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fa297fedf4549fd89f9a179ef9147a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.261101  8002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f584d75fb3ee4c80958b7b9e5322cf2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.265894  7997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea7f3171e8b84ac48e0abd056c43f778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.237689  8070 raft_consensus.cc:2804] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:37.281562  8070 raft_consensus.cc:493] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.282004  8070 raft_consensus.cc:3060] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.273151  7774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cc8636f68ae4121ac05d99e24866633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.273515  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3b3005e3634f858a7e68a789b5f827" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:37.285073  7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272dd059968c4493bb875e3bf32a3183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.285010  7941 raft_consensus.cc:2468] T aa3b3005e3634f858a7e68a789b5f827 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 0.
I20260709 13:16:37.293182  7832 leader_election.cc:304] T aa3b3005e3634f858a7e68a789b5f827 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:16:37.294256  8066 raft_consensus.cc:2804] T aa3b3005e3634f858a7e68a789b5f827 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:37.294679  8066 raft_consensus.cc:493] T aa3b3005e3634f858a7e68a789b5f827 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.295022  8066 raft_consensus.cc:3060] T aa3b3005e3634f858a7e68a789b5f827 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.297840  7848 tablet_service.cc:1511] Processing CreateTablet for tablet 2e84fab0d4fc43359b4219baa6171aa5 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:16:37.276571  8005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5409294f3e4162a75137e616968afb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.275039  7854 tablet_service.cc:1511] Processing CreateTablet for tablet f584d75fb3ee4c80958b7b9e5322cf2b (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:16:37.269317  7923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66c64de12c904e15892de849a597eeae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.307669  8060 tablet_bootstrap.cc:654] T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.282132  7687 catalog_manager.cc:5697] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a569f7d1ad42359002386a73702690 (127.30.63.4). New cstate: current_term: 1 leader_uuid: "c9a569f7d1ad42359002386a73702690" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:37.311004  7777 tablet_service.cc:1511] Processing CreateTablet for tablet 2e84fab0d4fc43359b4219baa6171aa5 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:16:37.312781  7931 tablet_service.cc:1511] Processing CreateTablet for tablet 044eb7b4196a4ac595bec86f29fca1bf (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:16:37.313479  7852 tablet_service.cc:1511] Processing CreateTablet for tablet 044eb7b4196a4ac595bec86f29fca1bf (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:16:37.315498  7927 tablet_service.cc:1511] Processing CreateTablet for tablet e74f9555b1f64bc080273bc35b9ef15b (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:16:37.181294  8064 raft_consensus.cc:359] T 9c126cef127140f48a31bbd723a86051 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:37.321635  7996 tablet_service.cc:1511] Processing CreateTablet for tablet 2e84fab0d4fc43359b4219baa6171aa5 (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:16:37.327809  7998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 569ddc7f4d23481a852ea6ef24d38e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.332723  7930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272dd059968c4493bb875e3bf32a3183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.344024  8001 tablet_service.cc:1511] Processing CreateTablet for tablet e74f9555b1f64bc080273bc35b9ef15b (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:16:37.333047  7777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e84fab0d4fc43359b4219baa6171aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.345510  7996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e84fab0d4fc43359b4219baa6171aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.353730  7854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f584d75fb3ee4c80958b7b9e5322cf2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.354892  8014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7806fa697a044140850e326d8e5889d1" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:37.356065  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3b3005e3634f858a7e68a789b5f827" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:37.357069  8064 raft_consensus.cc:385] T 9c126cef127140f48a31bbd723a86051 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.332497  7925 tablet_service.cc:1511] Processing CreateTablet for tablet f584d75fb3ee4c80958b7b9e5322cf2b (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:16:37.373780  7924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea7f3171e8b84ac48e0abd056c43f778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.327847  7775 tablet_service.cc:1511] Processing CreateTablet for tablet e74f9555b1f64bc080273bc35b9ef15b (DEFAULT_TABLE table=test-workload [id=1da40913210244548e4f6fb61a1bb570]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:16:37.331188  8066 raft_consensus.cc:515] T aa3b3005e3634f858a7e68a789b5f827 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:37.384788  7852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 044eb7b4196a4ac595bec86f29fca1bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.377807  8003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c04b5a061ff84745af17197de774ac96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.371765  8064 raft_consensus.cc:740] T 9c126cef127140f48a31bbd723a86051 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
W20260709 13:16:37.400025  7832 leader_election.cc:343] T 7806fa697a044140850e326d8e5889d1 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:37.405761  7832 leader_election.cc:304] T 7806fa697a044140850e326d8e5889d1 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690
I20260709 13:16:37.401280  7928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 569ddc7f4d23481a852ea6ef24d38e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.401765  7848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e84fab0d4fc43359b4219baa6171aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.402997  8063 tablet_bootstrap.cc:492] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:37.388887  8070 raft_consensus.cc:515] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:37.426935  8059 tablet_bootstrap.cc:492] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:37.427309  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c126cef127140f48a31bbd723a86051" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:37.427567  8059 ts_tablet_manager.cc:1403] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.478s	user 0.021s	sys 0.017s
I20260709 13:16:37.427724  8063 ts_tablet_manager.cc:1403] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.295s	user 0.017s	sys 0.009s
I20260709 13:16:37.433390  7931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 044eb7b4196a4ac595bec86f29fca1bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.432154  8059 raft_consensus.cc:359] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:37.414521  8064 consensus_queue.cc:260] T 9c126cef127140f48a31bbd723a86051 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:37.439476  8015 raft_consensus.cc:2468] T 9c126cef127140f48a31bbd723a86051 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 0.
W20260709 13:16:37.440296  7832 leader_election.cc:343] T aa3b3005e3634f858a7e68a789b5f827 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:37.442500  8065 consensus_queue.cc:1048] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:37.444276  8064 ts_tablet_manager.cc:1434] T 9c126cef127140f48a31bbd723a86051 P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.298s	user 0.007s	sys 0.003s
I20260709 13:16:37.447495  8064 tablet_bootstrap.cc:492] T 7806fa697a044140850e326d8e5889d1 P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:37.452695  7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e74f9555b1f64bc080273bc35b9ef15b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.417373  8001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e74f9555b1f64bc080273bc35b9ef15b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.470323  8060 tablet_bootstrap.cc:492] T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:37.470922  8060 ts_tablet_manager.cc:1403] T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.367s	user 0.014s	sys 0.015s
W20260709 13:16:37.471521  7757 consensus_peers.cc:597] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7 -> Peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Couldn't send request to peer c9a569f7d1ad42359002386a73702690. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:37.474892  8060 raft_consensus.cc:359] T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:37.475764  8060 raft_consensus.cc:385] T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.476115  8060 raft_consensus.cc:740] T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.461967  8059 raft_consensus.cc:385] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.476979  8060 consensus_queue.cc:260] T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:37.476763  8059 raft_consensus.cc:740] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.484498  7791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c126cef127140f48a31bbd723a86051" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:37.502177  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3b3005e3634f858a7e68a789b5f827" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:37.504460  8059 consensus_queue.cc:260] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:37.505527  8108 raft_consensus.cc:2749] T 7806fa697a044140850e326d8e5889d1 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:37.507192  8059 ts_tablet_manager.cc:1434] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.000s
I20260709 13:16:37.485042  8070 leader_election.cc:290] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
W20260709 13:16:37.509301  7832 leader_election.cc:343] T aa3b3005e3634f858a7e68a789b5f827 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:37.511013  8097 raft_consensus.cc:515] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:37.497555  8066 leader_election.cc:290] T aa3b3005e3634f858a7e68a789b5f827 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Requested vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:37.498953  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3b3005e3634f858a7e68a789b5f827" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:37.512777  8060 ts_tablet_manager.cc:1434] T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:16:37.513087  7941 raft_consensus.cc:3060] T aa3b3005e3634f858a7e68a789b5f827 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.513876  8060 tablet_bootstrap.cc:492] T 0d8e359e2c264806bd048cd1baed4db4 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:37.500703  7927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e74f9555b1f64bc080273bc35b9ef15b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.509642  8059 tablet_bootstrap.cc:492] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:37.496623  8063 raft_consensus.cc:359] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:37.512646  7791 raft_consensus.cc:2393] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7de07e50a1714f5d9055bb4b86655200 in current term 1: Already voted for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in this term.
I20260709 13:16:37.527122  7904 leader_election.cc:304] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690
I20260709 13:16:37.528992  8070 raft_consensus.cc:2749] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:37.543684  7941 raft_consensus.cc:2468] T aa3b3005e3634f858a7e68a789b5f827 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 1.
I20260709 13:16:37.545202  7832 leader_election.cc:304] T aa3b3005e3634f858a7e68a789b5f827 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: c9a569f7d1ad42359002386a73702690
I20260709 13:16:37.546984  8109 raft_consensus.cc:2804] T aa3b3005e3634f858a7e68a789b5f827 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:37.547631  8109 raft_consensus.cc:697] T aa3b3005e3634f858a7e68a789b5f827 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Becoming Leader. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:16:37.548784  8109 consensus_queue.cc:237] T aa3b3005e3634f858a7e68a789b5f827 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:37.518253  8063 raft_consensus.cc:385] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.551965  8063 raft_consensus.cc:740] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.554225  8097 leader_election.cc:290] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Requested vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:37.555310  8063 consensus_queue.cc:260] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:37.557426  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c126cef127140f48a31bbd723a86051" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:37.558064  8015 raft_consensus.cc:3060] T 9c126cef127140f48a31bbd723a86051 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.558982  8063 ts_tablet_manager.cc:1434] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.108s	user 0.005s	sys 0.001s
I20260709 13:16:37.555356  7925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f584d75fb3ee4c80958b7b9e5322cf2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.564323  8063 tablet_bootstrap.cc:492] T 87d445d744434f90baaf040e708b1e98 P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:37.565622  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c126cef127140f48a31bbd723a86051" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:37.568100  7941 raft_consensus.cc:2393] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in current term 1: Already voted for candidate 7de07e50a1714f5d9055bb4b86655200 in this term.
I20260709 13:16:37.583557  8060 tablet_bootstrap.cc:654] T 0d8e359e2c264806bd048cd1baed4db4 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.586443  8064 tablet_bootstrap.cc:654] T 7806fa697a044140850e326d8e5889d1 P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.603324  8070 raft_consensus.cc:493] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.604127  8070 raft_consensus.cc:515] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:37.607050  8070 leader_election.cc:290] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:37.607792  7791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72bd809944d47a395c4bc1b0fc18c19" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:37.608098  7866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72bd809944d47a395c4bc1b0fc18c19" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
W20260709 13:16:37.609426  7904 leader_election.cc:343] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:37.610087  7907 leader_election.cc:343] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:37.610528  7907 leader_election.cc:304] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200; no voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:37.611126  8063 tablet_bootstrap.cc:654] T 87d445d744434f90baaf040e708b1e98 P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.611711  8070 raft_consensus.cc:2749] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:37.616793  8015 raft_consensus.cc:2468] T 9c126cef127140f48a31bbd723a86051 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 1.
I20260709 13:16:37.618199  7757 leader_election.cc:304] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:37.619874  8097 raft_consensus.cc:2804] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:37.624264  8059 tablet_bootstrap.cc:654] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.631786  8064 tablet_bootstrap.cc:492] T 7806fa697a044140850e326d8e5889d1 P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:37.637142  8064 ts_tablet_manager.cc:1403] T 7806fa697a044140850e326d8e5889d1 P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.190s	user 0.011s	sys 0.005s
I20260709 13:16:37.637907  8063 tablet_bootstrap.cc:492] T 87d445d744434f90baaf040e708b1e98 P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:37.638497  8063 ts_tablet_manager.cc:1403] T 87d445d744434f90baaf040e708b1e98 P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.074s	user 0.008s	sys 0.008s
I20260709 13:16:37.638859  8097 raft_consensus.cc:697] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:16:37.639910  8097 consensus_queue.cc:237] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:37.634330  8060 tablet_bootstrap.cc:492] T 0d8e359e2c264806bd048cd1baed4db4 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:37.641685  8063 raft_consensus.cc:359] T 87d445d744434f90baaf040e708b1e98 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:37.642385  8060 ts_tablet_manager.cc:1403] T 0d8e359e2c264806bd048cd1baed4db4 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.129s	user 0.016s	sys 0.022s
I20260709 13:16:37.642683  8063 raft_consensus.cc:385] T 87d445d744434f90baaf040e708b1e98 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.643080  8063 raft_consensus.cc:740] T 87d445d744434f90baaf040e708b1e98 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.643913  8063 consensus_queue.cc:260] T 87d445d744434f90baaf040e708b1e98 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:37.646090  8060 raft_consensus.cc:359] T 0d8e359e2c264806bd048cd1baed4db4 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:37.646855  8060 raft_consensus.cc:385] T 0d8e359e2c264806bd048cd1baed4db4 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.647156  8060 raft_consensus.cc:740] T 0d8e359e2c264806bd048cd1baed4db4 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.649667  8084 consensus_queue.cc:1048] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:37.641674  8064 raft_consensus.cc:359] T 7806fa697a044140850e326d8e5889d1 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:37.650599  8064 raft_consensus.cc:385] T 7806fa697a044140850e326d8e5889d1 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.650918  8064 raft_consensus.cc:740] T 7806fa697a044140850e326d8e5889d1 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.651203  8063 ts_tablet_manager.cc:1434] T 87d445d744434f90baaf040e708b1e98 P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:16:37.651671  8064 consensus_queue.cc:260] T 7806fa697a044140850e326d8e5889d1 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:37.654341  8064 ts_tablet_manager.cc:1434] T 7806fa697a044140850e326d8e5889d1 P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:16:37.654763  8109 raft_consensus.cc:493] T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.655591  8109 raft_consensus.cc:515] T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:37.657655  8120 raft_consensus.cc:493] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.658396  8120 raft_consensus.cc:515] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:37.654920  8063 tablet_bootstrap.cc:492] T b66f54819dda4cca9214096155a16694 P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:37.663012  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4af0a88c7f43bcaa15fc11bdfaf591" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:37.657006  8064 tablet_bootstrap.cc:492] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
W20260709 13:16:37.665256  7757 leader_election.cc:343] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:37.667590  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eb35ec786da4450bcf232cf85ba857b" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
W20260709 13:16:37.673197  7830 leader_election.cc:343] T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:37.674224  7867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4af0a88c7f43bcaa15fc11bdfaf591" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:37.675863  7867 raft_consensus.cc:2468] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 0.
I20260709 13:16:37.681025  7758 leader_election.cc:304] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:37.676858  8063 tablet_bootstrap.cc:654] T b66f54819dda4cca9214096155a16694 P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.647887  8060 consensus_queue.cc:260] T 0d8e359e2c264806bd048cd1baed4db4 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:37.678315  8109 leader_election.cc:290] T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:37.678313  8120 leader_election.cc:290] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:37.685354  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eb35ec786da4450bcf232cf85ba857b" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:37.681883  8097 raft_consensus.cc:2804] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:16:37.689648  7832 leader_election.cc:343] T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:37.689826  7980 consensus_peers.cc:597] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690 -> Peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Couldn't send request to peer 7de07e50a1714f5d9055bb4b86655200. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:37.696259  7832 leader_election.cc:304] T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:37.690402  8064 tablet_bootstrap.cc:654] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.703788  8109 raft_consensus.cc:2749] T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:37.704942  7690 catalog_manager.cc:5697] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:37.691362  8097 raft_consensus.cc:493] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.713951  8097 raft_consensus.cc:3060] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.721221  8070 raft_consensus.cc:493] T 87d445d744434f90baaf040e708b1e98 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.721801  8070 raft_consensus.cc:515] T 87d445d744434f90baaf040e708b1e98 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:37.723913  8070 leader_election.cc:290] T 87d445d744434f90baaf040e708b1e98 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:37.727177  7791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d445d744434f90baaf040e708b1e98" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:37.730862  8097 raft_consensus.cc:515] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
W20260709 13:16:37.731209  7904 leader_election.cc:343] T 87d445d744434f90baaf040e708b1e98 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:37.732035  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d445d744434f90baaf040e708b1e98" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:37.742620  8060 ts_tablet_manager.cc:1434] T 0d8e359e2c264806bd048cd1baed4db4 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.100s	user 0.007s	sys 0.000s
I20260709 13:16:37.743854  8060 tablet_bootstrap.cc:492] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:37.731235  7689 catalog_manager.cc:5697] T aa3b3005e3634f858a7e68a789b5f827 P 1c5936948a84476fb0dcc1fa2d895740 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "1c5936948a84476fb0dcc1fa2d895740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:37.748850  7906 leader_election.cc:343] T 87d445d744434f90baaf040e708b1e98 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:37.749459  7906 leader_election.cc:304] T 87d445d744434f90baaf040e708b1e98 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690
I20260709 13:16:37.753543  8070 raft_consensus.cc:2749] T 87d445d744434f90baaf040e708b1e98 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:37.760718  7867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4af0a88c7f43bcaa15fc11bdfaf591" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:37.761415  7867 raft_consensus.cc:3060] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.762313  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4af0a88c7f43bcaa15fc11bdfaf591" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
W20260709 13:16:37.763936  7757 leader_election.cc:343] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:37.764956  8097 leader_election.cc:290] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Requested vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:37.766166  8060 tablet_bootstrap.cc:654] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.770563  8064 tablet_bootstrap.cc:492] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:37.771247  8064 ts_tablet_manager.cc:1403] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.114s	user 0.014s	sys 0.007s
I20260709 13:16:37.774421  8059 tablet_bootstrap.cc:492] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:37.775123  8059 ts_tablet_manager.cc:1403] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.266s	user 0.011s	sys 0.019s
I20260709 13:16:37.775144  7867 raft_consensus.cc:2468] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 1.
I20260709 13:16:37.775799  8063 tablet_bootstrap.cc:492] T b66f54819dda4cca9214096155a16694 P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:37.776520  8063 ts_tablet_manager.cc:1403] T b66f54819dda4cca9214096155a16694 P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.124s	user 0.017s	sys 0.033s
I20260709 13:16:37.776959  7758 leader_election.cc:304] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:37.777920  8097 raft_consensus.cc:2804] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:37.778424  8097 raft_consensus.cc:697] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:16:37.778853  8059 raft_consensus.cc:359] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:37.779256  8097 consensus_queue.cc:237] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:37.784196  8059 raft_consensus.cc:385] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.784565  8059 raft_consensus.cc:740] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.779942  8063 raft_consensus.cc:359] T b66f54819dda4cca9214096155a16694 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:37.785223  8064 raft_consensus.cc:359] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:37.785406  8059 consensus_queue.cc:260] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:37.786551  8064 raft_consensus.cc:385] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.786976  8064 raft_consensus.cc:740] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.785337  8063 raft_consensus.cc:385] T b66f54819dda4cca9214096155a16694 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.788118  8063 raft_consensus.cc:740] T b66f54819dda4cca9214096155a16694 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.788416  8059 ts_tablet_manager.cc:1434] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 13:16:37.787933  8064 consensus_queue.cc:260] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
W20260709 13:16:37.783211  7737 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:37.789008  8063 consensus_queue.cc:260] T b66f54819dda4cca9214096155a16694 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:37.789609  8059 tablet_bootstrap.cc:492] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:37.783864  8060 tablet_bootstrap.cc:492] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:37.791371  8060 ts_tablet_manager.cc:1403] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.003s
I20260709 13:16:37.791394  8064 ts_tablet_manager.cc:1434] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:16:37.792753  8064 tablet_bootstrap.cc:492] T 87d445d744434f90baaf040e708b1e98 P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:37.796027  8063 ts_tablet_manager.cc:1434] T b66f54819dda4cca9214096155a16694 P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:16:37.796754  8059 tablet_bootstrap.cc:654] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.796279  8060 raft_consensus.cc:359] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:37.797250  8060 raft_consensus.cc:385] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.797626  8060 raft_consensus.cc:740] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.798549  8060 consensus_queue.cc:260] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:37.797210  8063 tablet_bootstrap.cc:492] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:37.803121  8060 ts_tablet_manager.cc:1434] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:16:37.806275  8060 tablet_bootstrap.cc:492] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:37.808454  8063 tablet_bootstrap.cc:654] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.809670  7690 catalog_manager.cc:5697] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:37.807601  8059 tablet_bootstrap.cc:492] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:37.813161  8059 ts_tablet_manager.cc:1403] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.004s
I20260709 13:16:37.824617  8064 tablet_bootstrap.cc:654] T 87d445d744434f90baaf040e708b1e98 P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.826390  8070 raft_consensus.cc:493] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.829156  8070 raft_consensus.cc:515] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:37.831050  8059 raft_consensus.cc:359] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:37.831600  8070 leader_election.cc:290] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:37.832026  8059 raft_consensus.cc:385] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.832374  8059 raft_consensus.cc:740] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.833298  8059 consensus_queue.cc:260] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:37.833703  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8e359e2c264806bd048cd1baed4db4" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:37.833307  7867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8e359e2c264806bd048cd1baed4db4" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:37.834460  8015 raft_consensus.cc:2468] T 0d8e359e2c264806bd048cd1baed4db4 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 0.
I20260709 13:16:37.833343  8060 tablet_bootstrap.cc:654] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.834805  7867 raft_consensus.cc:2468] T 0d8e359e2c264806bd048cd1baed4db4 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 0.
I20260709 13:16:37.835901  7906 leader_election.cc:304] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:37.837092  8070 raft_consensus.cc:2804] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:37.837492  8070 raft_consensus.cc:493] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.837852  8070 raft_consensus.cc:3060] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.834875  8063 tablet_bootstrap.cc:492] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:37.838672  8063 ts_tablet_manager.cc:1403] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.016s
I20260709 13:16:37.840814  8059 ts_tablet_manager.cc:1434] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:16:37.841475  8063 raft_consensus.cc:359] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:37.841925  8059 tablet_bootstrap.cc:492] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:37.844681  8070 raft_consensus.cc:515] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:37.842175  8063 raft_consensus.cc:385] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.847350  8063 raft_consensus.cc:740] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.847373  7867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8e359e2c264806bd048cd1baed4db4" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:37.847625  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8e359e2c264806bd048cd1baed4db4" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:37.844350  8060 tablet_bootstrap.cc:492] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:37.848264  8015 raft_consensus.cc:3060] T 0d8e359e2c264806bd048cd1baed4db4 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.848131  7867 raft_consensus.cc:3060] T 0d8e359e2c264806bd048cd1baed4db4 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.850430  8070 leader_election.cc:290] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Requested vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:37.848503  8060 ts_tablet_manager.cc:1403] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.003s
I20260709 13:16:37.853844  8060 raft_consensus.cc:359] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:37.856740  8060 raft_consensus.cc:385] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.857113  8060 raft_consensus.cc:740] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.858064  8015 raft_consensus.cc:2468] T 0d8e359e2c264806bd048cd1baed4db4 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 1.
I20260709 13:16:37.858129  7867 raft_consensus.cc:2468] T 0d8e359e2c264806bd048cd1baed4db4 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 1.
I20260709 13:16:37.859606  7906 leader_election.cc:304] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:37.860065  8060 consensus_queue.cc:260] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:37.848145  8063 consensus_queue.cc:260] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:37.862131  8059 tablet_bootstrap.cc:654] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.864841  8070 raft_consensus.cc:2804] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:37.863106  8060 ts_tablet_manager.cc:1434] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:16:37.866312  8063 ts_tablet_manager.cc:1434] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.004s
I20260709 13:16:37.867202  8060 tablet_bootstrap.cc:492] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:37.874002  8060 tablet_bootstrap.cc:654] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.875921  8063 tablet_bootstrap.cc:492] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:37.876096  8059 tablet_bootstrap.cc:492] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:37.876475  8070 raft_consensus.cc:697] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Becoming Leader. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Running, Role: LEADER
I20260709 13:16:37.876271  8124 raft_consensus.cc:493] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.876974  8059 ts_tablet_manager.cc:1403] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.000s
I20260709 13:16:37.877352  8124 raft_consensus.cc:515] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:37.879474  8124 leader_election.cc:290] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:37.880988  8059 raft_consensus.cc:359] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:37.881575  7791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da682789343c4852b052f5fa4483c715" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:37.881980  8059 raft_consensus.cc:385] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.882454  8059 raft_consensus.cc:740] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.883062  8063 tablet_bootstrap.cc:654] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.883320  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da682789343c4852b052f5fa4483c715" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:37.883224  8059 consensus_queue.cc:260] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
W20260709 13:16:37.883733  7978 leader_election.cc:343] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:37.884860  7980 leader_election.cc:343] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:37.884922  8070 consensus_queue.cc:237] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:37.885476  7980 leader_election.cc:304] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:37.889241  8059 ts_tablet_manager.cc:1434] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:16:37.889657  8124 raft_consensus.cc:2749] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:37.890257  8059 tablet_bootstrap.cc:492] T 87d445d744434f90baaf040e708b1e98 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:37.890694  8060 tablet_bootstrap.cc:492] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:37.891206  8060 ts_tablet_manager.cc:1403] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.000s
I20260709 13:16:37.893953  8060 raft_consensus.cc:359] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:37.894816  8060 raft_consensus.cc:385] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.895164  8060 raft_consensus.cc:740] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.895851  8064 tablet_bootstrap.cc:492] T 87d445d744434f90baaf040e708b1e98 P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:37.895977  8060 consensus_queue.cc:260] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:37.898178  8064 ts_tablet_manager.cc:1403] T 87d445d744434f90baaf040e708b1e98 P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.106s	user 0.013s	sys 0.009s
I20260709 13:16:37.899520  8060 ts_tablet_manager.cc:1434] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:16:37.899716  8063 tablet_bootstrap.cc:492] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:37.897150  8059 tablet_bootstrap.cc:654] T 87d445d744434f90baaf040e708b1e98 P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.900259  8063 ts_tablet_manager.cc:1403] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.000s
I20260709 13:16:37.900959  8060 tablet_bootstrap.cc:492] T deeaf93ab6424e9c8013e6c9fbccb724 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:37.903106  8063 raft_consensus.cc:359] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:37.903976  8063 raft_consensus.cc:385] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.904290  8063 raft_consensus.cc:740] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.905047  8063 consensus_queue.cc:260] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:37.907086  8060 tablet_bootstrap.cc:654] T deeaf93ab6424e9c8013e6c9fbccb724 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.907235  8063 ts_tablet_manager.cc:1434] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:16:37.908250  8063 tablet_bootstrap.cc:492] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:37.912137  8059 tablet_bootstrap.cc:492] T 87d445d744434f90baaf040e708b1e98 P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:37.902963  8064 raft_consensus.cc:359] T 87d445d744434f90baaf040e708b1e98 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:37.912842  8059 ts_tablet_manager.cc:1403] T 87d445d744434f90baaf040e708b1e98 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.003s
I20260709 13:16:37.914783  8063 tablet_bootstrap.cc:654] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.912793  8064 raft_consensus.cc:385] T 87d445d744434f90baaf040e708b1e98 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.915227  8064 raft_consensus.cc:740] T 87d445d744434f90baaf040e708b1e98 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.916141  8064 consensus_queue.cc:260] T 87d445d744434f90baaf040e708b1e98 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:37.916215  7690 catalog_manager.cc:5697] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "7de07e50a1714f5d9055bb4b86655200" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:37.919697  8059 raft_consensus.cc:359] T 87d445d744434f90baaf040e708b1e98 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:37.923559  8059 raft_consensus.cc:385] T 87d445d744434f90baaf040e708b1e98 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.923913  8059 raft_consensus.cc:740] T 87d445d744434f90baaf040e708b1e98 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.924711  8059 consensus_queue.cc:260] T 87d445d744434f90baaf040e708b1e98 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:37.926759  8059 ts_tablet_manager.cc:1434] T 87d445d744434f90baaf040e708b1e98 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:16:37.927927  8059 tablet_bootstrap.cc:492] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:37.934580  8059 tablet_bootstrap.cc:654] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.937469  8063 tablet_bootstrap.cc:492] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:37.937738  8060 tablet_bootstrap.cc:492] T deeaf93ab6424e9c8013e6c9fbccb724 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:37.938060  8063 ts_tablet_manager.cc:1403] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.012s
I20260709 13:16:37.938321  8060 ts_tablet_manager.cc:1403] T deeaf93ab6424e9c8013e6c9fbccb724 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.000s
I20260709 13:16:37.941006  8063 raft_consensus.cc:359] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:37.941239  8060 raft_consensus.cc:359] T deeaf93ab6424e9c8013e6c9fbccb724 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:37.921183  8109 raft_consensus.cc:493] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.941751  8063 raft_consensus.cc:385] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.942204  8063 raft_consensus.cc:740] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.942289  8109 raft_consensus.cc:515] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:37.943344  8063 consensus_queue.cc:260] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:37.944626  8109 leader_election.cc:290] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:37.945807  8063 ts_tablet_manager.cc:1434] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:16:37.947000  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f54819dda4cca9214096155a16694" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:37.947608  8063 tablet_bootstrap.cc:492] T 878f83ec036345f69ff96a6b46613485 P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:37.948621  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f54819dda4cca9214096155a16694" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:37.949354  7941 raft_consensus.cc:2468] T b66f54819dda4cca9214096155a16694 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 0.
W20260709 13:16:37.951167  7832 leader_election.cc:343] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:37.951933  7832 leader_election.cc:304] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: c9a569f7d1ad42359002386a73702690
I20260709 13:16:37.953855  8063 tablet_bootstrap.cc:654] T 878f83ec036345f69ff96a6b46613485 P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.957152  8109 raft_consensus.cc:2804] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:37.957823  8109 raft_consensus.cc:493] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.965116  8109 raft_consensus.cc:3060] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.920444  8064 ts_tablet_manager.cc:1434] T 87d445d744434f90baaf040e708b1e98 P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.002s
I20260709 13:16:37.980533  8060 raft_consensus.cc:385] T deeaf93ab6424e9c8013e6c9fbccb724 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.981274  8060 raft_consensus.cc:740] T deeaf93ab6424e9c8013e6c9fbccb724 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.982784  8060 consensus_queue.cc:260] T deeaf93ab6424e9c8013e6c9fbccb724 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:37.986809  8060 ts_tablet_manager.cc:1434] T deeaf93ab6424e9c8013e6c9fbccb724 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 13:16:37.989688  8060 tablet_bootstrap.cc:492] T 5391ca2d8a8747bebb865e71268e06ad P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:37.989867  8064 tablet_bootstrap.cc:492] T af8981a911484760ab96a4d042148094 P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:37.990789  8109 raft_consensus.cc:515] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:37.997891  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f54819dda4cca9214096155a16694" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
W20260709 13:16:37.999451  7832 leader_election.cc:343] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:38.000113  8064 tablet_bootstrap.cc:654] T af8981a911484760ab96a4d042148094 P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.001751  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f54819dda4cca9214096155a16694" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:38.002585  7941 raft_consensus.cc:3060] T b66f54819dda4cca9214096155a16694 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.004572  8059 tablet_bootstrap.cc:492] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:38.005175  8059 ts_tablet_manager.cc:1403] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.077s	user 0.029s	sys 0.042s
I20260709 13:16:38.006525  8064 tablet_bootstrap.cc:492] T af8981a911484760ab96a4d042148094 P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:38.007009  8064 ts_tablet_manager.cc:1403] T af8981a911484760ab96a4d042148094 P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:16:38.007973  8059 raft_consensus.cc:359] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:38.008687  8059 raft_consensus.cc:385] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.008953  8059 raft_consensus.cc:740] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.009727  8059 consensus_queue.cc:260] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:38.009754  8064 raft_consensus.cc:359] T af8981a911484760ab96a4d042148094 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:38.012888  8064 raft_consensus.cc:385] T af8981a911484760ab96a4d042148094 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.013165  8064 raft_consensus.cc:740] T af8981a911484760ab96a4d042148094 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.013842  8064 consensus_queue.cc:260] T af8981a911484760ab96a4d042148094 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:38.014420  8060 tablet_bootstrap.cc:654] T 5391ca2d8a8747bebb865e71268e06ad P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.014006  7941 raft_consensus.cc:2468] T b66f54819dda4cca9214096155a16694 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 1.
I20260709 13:16:38.015898  8064 ts_tablet_manager.cc:1434] T af8981a911484760ab96a4d042148094 P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:16:38.026861  8064 tablet_bootstrap.cc:492] T aa3b3005e3634f858a7e68a789b5f827 P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:38.027667  8063 tablet_bootstrap.cc:492] T 878f83ec036345f69ff96a6b46613485 P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:38.028189  8063 ts_tablet_manager.cc:1403] T 878f83ec036345f69ff96a6b46613485 P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.081s	user 0.025s	sys 0.036s
I20260709 13:16:38.017637  8059 ts_tablet_manager.cc:1434] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:16:38.028621  8070 raft_consensus.cc:493] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:38.028980  7832 consensus_peers.cc:597] T aa3b3005e3634f858a7e68a789b5f827 P 1c5936948a84476fb0dcc1fa2d895740 -> Peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Couldn't send request to peer c9a569f7d1ad42359002386a73702690. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:38.029536  8059 tablet_bootstrap.cc:492] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:38.029212  8070 raft_consensus.cc:515] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:38.032066  8070 leader_election.cc:290] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:38.023952  8109 leader_election.cc:290] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:38.032469  7791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4af0a88c7f43bcaa15fc11bdfaf591" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:38.034516  7867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4af0a88c7f43bcaa15fc11bdfaf591" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:38.035390  7867 raft_consensus.cc:2393] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7de07e50a1714f5d9055bb4b86655200 in current term 1: Already voted for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in this term.
I20260709 13:16:38.035669  8063 raft_consensus.cc:359] T 878f83ec036345f69ff96a6b46613485 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:38.037635  7907 leader_election.cc:304] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200; no voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:38.038213  8063 raft_consensus.cc:385] T 878f83ec036345f69ff96a6b46613485 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.038555  8063 raft_consensus.cc:740] T 878f83ec036345f69ff96a6b46613485 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.039112  8070 raft_consensus.cc:3060] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.039340  8063 consensus_queue.cc:260] T 878f83ec036345f69ff96a6b46613485 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:38.043529  8064 tablet_bootstrap.cc:654] T aa3b3005e3634f858a7e68a789b5f827 P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.045881  8097 raft_consensus.cc:493] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.039317  8059 tablet_bootstrap.cc:654] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.046448  8097 raft_consensus.cc:515] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:38.049784  7867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deeaf93ab6424e9c8013e6c9fbccb724" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:38.050101  7940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deeaf93ab6424e9c8013e6c9fbccb724" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:38.050530  7867 raft_consensus.cc:2468] T deeaf93ab6424e9c8013e6c9fbccb724 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 0.
I20260709 13:16:38.050814  7940 raft_consensus.cc:2468] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 0.
I20260709 13:16:38.052102  7758 leader_election.cc:304] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 
I20260709 13:16:38.052543  8097 leader_election.cc:290] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:38.053128  8120 raft_consensus.cc:2804] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:38.053543  8120 raft_consensus.cc:493] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.054023  8063 ts_tablet_manager.cc:1434] T 878f83ec036345f69ff96a6b46613485 P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.002s
I20260709 13:16:38.053893  8120 raft_consensus.cc:3060] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.055891  8059 tablet_bootstrap.cc:492] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:38.056561  8059 ts_tablet_manager.cc:1403] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.002s
I20260709 13:16:38.060822  8059 raft_consensus.cc:359] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:38.061808  8059 raft_consensus.cc:385] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.062148  8059 raft_consensus.cc:740] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.063035  8059 consensus_queue.cc:260] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:38.066954  8109 consensus_queue.cc:1048] T aa3b3005e3634f858a7e68a789b5f827 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:38.069427  7832 leader_election.cc:304] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: c9a569f7d1ad42359002386a73702690
I20260709 13:16:38.069799  8059 ts_tablet_manager.cc:1434] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:16:38.070762  8109 raft_consensus.cc:2804] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:38.070922  8059 tablet_bootstrap.cc:492] T 7806fa697a044140850e326d8e5889d1 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:38.071370  8109 raft_consensus.cc:697] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Becoming Leader. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:16:38.072343  8109 consensus_queue.cc:237] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:38.077049  8059 tablet_bootstrap.cc:654] T 7806fa697a044140850e326d8e5889d1 P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.077271  8064 tablet_bootstrap.cc:492] T aa3b3005e3634f858a7e68a789b5f827 P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:38.077744  8064 ts_tablet_manager.cc:1403] T aa3b3005e3634f858a7e68a789b5f827 P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.051s	user 0.019s	sys 0.000s
I20260709 13:16:38.081663  7940 raft_consensus.cc:3060] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.083997  8066 raft_consensus.cc:493] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.084730  8066 raft_consensus.cc:515] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:38.086047  8063 tablet_bootstrap.cc:492] T 985b6cf5ffe74ecfabc7ba74e262a88f P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:38.087208  8066 leader_election.cc:290] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:38.088373  8097 raft_consensus.cc:493] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.088904  7791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8981a911484760ab96a4d042148094" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:38.089455  8097 raft_consensus.cc:515] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:38.089974  7791 raft_consensus.cc:2468] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 0.
I20260709 13:16:38.083168  8120 raft_consensus.cc:515] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:38.092515  7830 leader_election.cc:304] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 
I20260709 13:16:38.093662  7939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72bd809944d47a395c4bc1b0fc18c19" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:38.093861  8066 raft_consensus.cc:2804] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:38.094554  7939 raft_consensus.cc:2468] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 0.
I20260709 13:16:38.094589  8066 raft_consensus.cc:493] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.094861  8065 raft_consensus.cc:493] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.095597  8065 raft_consensus.cc:515] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:38.096021  8066 raft_consensus.cc:3060] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.096148  7757 leader_election.cc:304] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:16:38.097509  8120 leader_election.cc:290] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Requested vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:38.097764  8065 leader_election.cc:290] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:38.098127  8120 raft_consensus.cc:2804] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:38.098516  8120 raft_consensus.cc:493] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.098876  8120 raft_consensus.cc:3060] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.098887  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5391ca2d8a8747bebb865e71268e06ad" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:38.099655  8015 raft_consensus.cc:2468] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 0.
I20260709 13:16:38.102108  8059 tablet_bootstrap.cc:492] T 7806fa697a044140850e326d8e5889d1 P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:38.103204  8059 ts_tablet_manager.cc:1403] T 7806fa697a044140850e326d8e5889d1 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.009s
I20260709 13:16:38.102308  7938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deeaf93ab6424e9c8013e6c9fbccb724" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:38.103880  7938 raft_consensus.cc:3060] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.104568  8124 raft_consensus.cc:493] T 87d445d744434f90baaf040e708b1e98 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.105438  8060 tablet_bootstrap.cc:492] T 5391ca2d8a8747bebb865e71268e06ad P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:38.105939  8060 ts_tablet_manager.cc:1403] T 5391ca2d8a8747bebb865e71268e06ad P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.116s	user 0.033s	sys 0.019s
I20260709 13:16:38.106761  7757 leader_election.cc:304] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:38.107580  8065 consensus_queue.cc:1048] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:38.108955  8065 raft_consensus.cc:2804] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:38.108894  8060 raft_consensus.cc:359] T 5391ca2d8a8747bebb865e71268e06ad P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:38.109464  8065 raft_consensus.cc:493] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.109750  8060 raft_consensus.cc:385] T 5391ca2d8a8747bebb865e71268e06ad P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.109863  8065 raft_consensus.cc:3060] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.110080  8060 raft_consensus.cc:740] T 5391ca2d8a8747bebb865e71268e06ad P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.066993  8070 raft_consensus.cc:2749] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:38.105077  8124 raft_consensus.cc:515] T 87d445d744434f90baaf040e708b1e98 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:38.112872  8060 consensus_queue.cc:260] T 5391ca2d8a8747bebb865e71268e06ad P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:38.102958  8066 raft_consensus.cc:515] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:38.116604  7791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d445d744434f90baaf040e708b1e98" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:38.118809  7791 raft_consensus.cc:2468] T 87d445d744434f90baaf040e708b1e98 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 0.
I20260709 13:16:38.119712  8066 leader_election.cc:290] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:38.120141  7978 leader_election.cc:304] T 87d445d744434f90baaf040e708b1e98 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:38.120499  8066 raft_consensus.cc:493] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.121048  8084 raft_consensus.cc:2804] T 87d445d744434f90baaf040e708b1e98 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:38.117107  8064 raft_consensus.cc:359] T aa3b3005e3634f858a7e68a789b5f827 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:38.123659  8064 raft_consensus.cc:385] T aa3b3005e3634f858a7e68a789b5f827 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.125204  8063 tablet_bootstrap.cc:654] T 985b6cf5ffe74ecfabc7ba74e262a88f P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.121042  8066 raft_consensus.cc:515] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:38.124231  8064 raft_consensus.cc:740] T aa3b3005e3634f858a7e68a789b5f827 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.128034  8064 consensus_queue.cc:260] T aa3b3005e3634f858a7e68a789b5f827 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:38.123420  8084 raft_consensus.cc:493] T 87d445d744434f90baaf040e708b1e98 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.130405  8084 raft_consensus.cc:3060] T 87d445d744434f90baaf040e708b1e98 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.131788  8059 raft_consensus.cc:359] T 7806fa697a044140850e326d8e5889d1 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:38.132488  8059 raft_consensus.cc:385] T 7806fa697a044140850e326d8e5889d1 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.132802  8059 raft_consensus.cc:740] T 7806fa697a044140850e326d8e5889d1 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.121954  8097 leader_election.cc:290] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:38.121060  7939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d445d744434f90baaf040e708b1e98" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:38.117496  8124 leader_election.cc:290] T 87d445d744434f90baaf040e708b1e98 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:38.135068  8059 consensus_queue.cc:260] T 7806fa697a044140850e326d8e5889d1 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:38.137693  7791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8981a911484760ab96a4d042148094" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:38.141114  7939 raft_consensus.cc:2468] T 87d445d744434f90baaf040e708b1e98 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 0.
I20260709 13:16:38.145304  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8981a911484760ab96a4d042148094" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:38.145936  8013 raft_consensus.cc:3060] T af8981a911484760ab96a4d042148094 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.148250  8119 raft_consensus.cc:493] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.150022  8119 raft_consensus.cc:515] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:38.150518  8084 raft_consensus.cc:515] T 87d445d744434f90baaf040e708b1e98 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:38.153328  8119 leader_election.cc:290] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:38.154280  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d445d744434f90baaf040e708b1e98" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:38.154908  7941 raft_consensus.cc:3060] T 87d445d744434f90baaf040e708b1e98 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.148869  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8981a911484760ab96a4d042148094" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:38.155072  7939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eb35ec786da4450bcf232cf85ba857b" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:38.144019  7791 raft_consensus.cc:3060] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.157449  8013 raft_consensus.cc:2468] T af8981a911484760ab96a4d042148094 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 1.
I20260709 13:16:38.155763  7939 raft_consensus.cc:2468] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 0.
I20260709 13:16:38.148908  8064 ts_tablet_manager.cc:1434] T aa3b3005e3634f858a7e68a789b5f827 P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.002s
I20260709 13:16:38.141163  8124 raft_consensus.cc:493] T 7806fa697a044140850e326d8e5889d1 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.166486  8064 tablet_bootstrap.cc:492] T b66f54819dda4cca9214096155a16694 P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:38.171072  8059 ts_tablet_manager.cc:1434] T 7806fa697a044140850e326d8e5889d1 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.001s
I20260709 13:16:38.172513  8059 tablet_bootstrap.cc:492] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:38.174885  7867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72bd809944d47a395c4bc1b0fc18c19" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:38.175631  7867 raft_consensus.cc:2468] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 0.
I20260709 13:16:38.176014  7865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5391ca2d8a8747bebb865e71268e06ad" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:38.177038  7866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deeaf93ab6424e9c8013e6c9fbccb724" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:38.177136  7865 raft_consensus.cc:2468] T 5391ca2d8a8747bebb865e71268e06ad P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 0.
I20260709 13:16:38.178063  7866 raft_consensus.cc:3060] T deeaf93ab6424e9c8013e6c9fbccb724 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.178983  7864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eb35ec786da4450bcf232cf85ba857b" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:38.179904  7864 raft_consensus.cc:2468] T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 0.
I20260709 13:16:38.181051  7757 leader_election.cc:304] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:16:38.182142  8119 raft_consensus.cc:2804] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:38.182503  8119 raft_consensus.cc:493] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.182861  8119 raft_consensus.cc:3060] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.187481  8059 tablet_bootstrap.cc:654] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.189754  7832 leader_election.cc:304] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:38.190881  8153 raft_consensus.cc:2804] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:38.190760  8119 raft_consensus.cc:515] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:38.191642  8153 raft_consensus.cc:697] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Becoming Leader. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:16:38.165356  8124 raft_consensus.cc:515] T 7806fa697a044140850e326d8e5889d1 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:38.192859  8153 consensus_queue.cc:237] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:38.194722  7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eb35ec786da4450bcf232cf85ba857b" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:38.195083  8124 leader_election.cc:290] T 7806fa697a044140850e326d8e5889d1 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:38.195443  7937 raft_consensus.cc:3060] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.205138  7864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7806fa697a044140850e326d8e5889d1" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:38.206140  7864 raft_consensus.cc:2468] T 7806fa697a044140850e326d8e5889d1 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 0.
I20260709 13:16:38.213564  7981 leader_election.cc:304] T 7806fa697a044140850e326d8e5889d1 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:38.161844  8084 leader_election.cc:290] T 87d445d744434f90baaf040e708b1e98 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 election: Requested vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:38.221577  8124 raft_consensus.cc:2804] T 7806fa697a044140850e326d8e5889d1 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:38.222141  8124 raft_consensus.cc:493] T 7806fa697a044140850e326d8e5889d1 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.222540  8124 raft_consensus.cc:3060] T 7806fa697a044140850e326d8e5889d1 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.225389  7864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eb35ec786da4450bcf232cf85ba857b" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:38.226099  7864 raft_consensus.cc:3060] T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.231308  7791 raft_consensus.cc:2468] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 1.
I20260709 13:16:38.234797  8120 raft_consensus.cc:515] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:38.218732  8119 leader_election.cc:290] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Requested vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:38.228363  7941 raft_consensus.cc:2468] T 87d445d744434f90baaf040e708b1e98 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 1.
I20260709 13:16:38.248520  8120 leader_election.cc:290] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Requested vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:38.259631  8060 ts_tablet_manager.cc:1434] T 5391ca2d8a8747bebb865e71268e06ad P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.153s	user 0.010s	sys 0.004s
I20260709 13:16:38.262705  8060 tablet_bootstrap.cc:492] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:38.261706  7690 catalog_manager.cc:5697] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "1c5936948a84476fb0dcc1fa2d895740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:38.270080  7863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72bd809944d47a395c4bc1b0fc18c19" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:38.270828  7863 raft_consensus.cc:3060] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.271505  8124 raft_consensus.cc:515] T 7806fa697a044140850e326d8e5889d1 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:38.274700  8066 leader_election.cc:290] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:38.280072  7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72bd809944d47a395c4bc1b0fc18c19" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:38.280823  7936 raft_consensus.cc:2468] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 0.
I20260709 13:16:38.280854  7980 leader_election.cc:304] T 87d445d744434f90baaf040e708b1e98 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:38.282441  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72bd809944d47a395c4bc1b0fc18c19" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:38.288797  7941 raft_consensus.cc:3060] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.290288  7937 raft_consensus.cc:2468] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 1.
I20260709 13:16:38.293782  7791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72bd809944d47a395c4bc1b0fc18c19" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:38.294696  7791 raft_consensus.cc:2393] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c5936948a84476fb0dcc1fa2d895740 in current term 1: Already voted for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in this term.
I20260709 13:16:38.286442  7832 leader_election.cc:304] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:16:38.296168  8060 tablet_bootstrap.cc:654] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.298779  7791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7806fa697a044140850e326d8e5889d1" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:38.299459  7791 raft_consensus.cc:2468] T 7806fa697a044140850e326d8e5889d1 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 0.
I20260709 13:16:38.299671  7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7806fa697a044140850e326d8e5889d1" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:38.300276  7789 raft_consensus.cc:3060] T 7806fa697a044140850e326d8e5889d1 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.305063  8157 consensus_queue.cc:1048] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:38.305439  7757 leader_election.cc:304] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:16:38.306528  8119 raft_consensus.cc:2804] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:38.307015  8119 raft_consensus.cc:697] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:16:38.307855  7789 raft_consensus.cc:2468] T 7806fa697a044140850e326d8e5889d1 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 1.
I20260709 13:16:38.305519  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d445d744434f90baaf040e708b1e98" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:38.309866  7792 raft_consensus.cc:3060] T 87d445d744434f90baaf040e708b1e98 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.312233  7978 leader_election.cc:304] T 7806fa697a044140850e326d8e5889d1 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:38.277366  7938 raft_consensus.cc:2468] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 1.
I20260709 13:16:38.320840  8156 raft_consensus.cc:2804] T 7806fa697a044140850e326d8e5889d1 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:38.321429  8156 raft_consensus.cc:697] T 7806fa697a044140850e326d8e5889d1 P c9a569f7d1ad42359002386a73702690 [term 1 LEADER]: Becoming Leader. State: Replica: c9a569f7d1ad42359002386a73702690, State: Running, Role: LEADER
I20260709 13:16:38.322307  8156 consensus_queue.cc:237] T 7806fa697a044140850e326d8e5889d1 P c9a569f7d1ad42359002386a73702690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:38.307936  8119 consensus_queue.cc:237] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:38.307957  8065 raft_consensus.cc:515] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:38.329573  8065 leader_election.cc:290] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:38.284677  8084 raft_consensus.cc:2804] T 87d445d744434f90baaf040e708b1e98 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:38.336468  7865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5391ca2d8a8747bebb865e71268e06ad" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:38.337194  7865 raft_consensus.cc:3060] T 5391ca2d8a8747bebb865e71268e06ad P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.338482  7690 catalog_manager.cc:5697] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "1c5936948a84476fb0dcc1fa2d895740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:38.340189  8155 raft_consensus.cc:493] T aa3b3005e3634f858a7e68a789b5f827 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.340746  8155 raft_consensus.cc:515] T aa3b3005e3634f858a7e68a789b5f827 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:38.347831  8155 leader_election.cc:290] T aa3b3005e3634f858a7e68a789b5f827 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:38.350885  7867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7806fa697a044140850e326d8e5889d1" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:38.351569  7867 raft_consensus.cc:3060] T 7806fa697a044140850e326d8e5889d1 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.352967  7757 leader_election.cc:304] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:16:38.356235  7941 raft_consensus.cc:2468] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 1.
I20260709 13:16:38.356707  8065 raft_consensus.cc:2804] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:38.357162  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3b3005e3634f858a7e68a789b5f827" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:38.357430  8065 raft_consensus.cc:697] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:16:38.357577  7757 leader_election.cc:304] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:16:38.358696  8157 raft_consensus.cc:2804] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:38.359355  8157 raft_consensus.cc:697] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:16:38.358736  8065 consensus_queue.cc:237] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:38.360176  8157 consensus_queue.cc:237] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:38.344208  8124 leader_election.cc:290] T 7806fa697a044140850e326d8e5889d1 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 election: Requested vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:38.365660  7938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3b3005e3634f858a7e68a789b5f827" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:38.367275  7980 leader_election.cc:304] T aa3b3005e3634f858a7e68a789b5f827 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:38.368405  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5391ca2d8a8747bebb865e71268e06ad" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:38.368806  8124 raft_consensus.cc:2749] T aa3b3005e3634f858a7e68a789b5f827 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:38.369076  8015 raft_consensus.cc:3060] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.370193  8064 tablet_bootstrap.cc:654] T b66f54819dda4cca9214096155a16694 P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.374433  7867 raft_consensus.cc:2468] T 7806fa697a044140850e326d8e5889d1 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 1.
I20260709 13:16:38.318694  7864 raft_consensus.cc:2468] T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 1.
I20260709 13:16:38.383653  8070 consensus_queue.cc:1048] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:38.388170  7865 raft_consensus.cc:2468] T 5391ca2d8a8747bebb865e71268e06ad P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 1.
I20260709 13:16:38.380048  8015 raft_consensus.cc:2468] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 1.
I20260709 13:16:38.431265  8063 tablet_bootstrap.cc:492] T 985b6cf5ffe74ecfabc7ba74e262a88f P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:38.432034  8063 ts_tablet_manager.cc:1403] T 985b6cf5ffe74ecfabc7ba74e262a88f P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.346s	user 0.013s	sys 0.015s
I20260709 13:16:38.439626  8136 raft_consensus.cc:493] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a569f7d1ad42359002386a73702690)
I20260709 13:16:38.440384  8136 raft_consensus.cc:515] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:38.449589  7863 raft_consensus.cc:2468] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 1.
I20260709 13:16:38.450769  8066 raft_consensus.cc:2764] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:16:38.454811  7757 leader_election.cc:304] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:38.437790  8070 consensus_queue.cc:1048] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:16:38.458305  8097 raft_consensus.cc:2804] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:38.458959  8097 raft_consensus.cc:697] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:16:38.438998  7792 raft_consensus.cc:2468] T 87d445d744434f90baaf040e708b1e98 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 1.
I20260709 13:16:38.466523  8120 consensus_queue.cc:1048] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:38.468005  8063 raft_consensus.cc:359] T 985b6cf5ffe74ecfabc7ba74e262a88f P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:38.468762  8063 raft_consensus.cc:385] T 985b6cf5ffe74ecfabc7ba74e262a88f P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.469018  8063 raft_consensus.cc:740] T 985b6cf5ffe74ecfabc7ba74e262a88f P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.469702  8063 consensus_queue.cc:260] T 985b6cf5ffe74ecfabc7ba74e262a88f P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:38.470788  8136 leader_election.cc:290] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:38.472893  8014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3462b69ce46f4d49b5c5f1a6872a03e4" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:38.474762  8063 ts_tablet_manager.cc:1434] T 985b6cf5ffe74ecfabc7ba74e262a88f P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.001s
I20260709 13:16:38.476064  8063 tablet_bootstrap.cc:492] T da682789343c4852b052f5fa4483c715 P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:38.476958  8120 consensus_queue.cc:1048] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:38.483681  8063 tablet_bootstrap.cc:654] T da682789343c4852b052f5fa4483c715 P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.489691  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3462b69ce46f4d49b5c5f1a6872a03e4" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:38.460086  8097 consensus_queue.cc:237] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:38.492532  7904 leader_election.cc:304] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690
I20260709 13:16:38.494053  8136 raft_consensus.cc:2749] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:38.494711  8136 raft_consensus.cc:493] T 878f83ec036345f69ff96a6b46613485 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.495179  8136 raft_consensus.cc:515] T 878f83ec036345f69ff96a6b46613485 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:38.453466  7866 raft_consensus.cc:2468] T deeaf93ab6424e9c8013e6c9fbccb724 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 1.
I20260709 13:16:38.498668  7865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878f83ec036345f69ff96a6b46613485" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:38.499797  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878f83ec036345f69ff96a6b46613485" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
W20260709 13:16:38.500332  7907 leader_election.cc:343] T 878f83ec036345f69ff96a6b46613485 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:38.501080  8120 raft_consensus.cc:493] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.501654  8120 raft_consensus.cc:515] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
W20260709 13:16:38.502187  7904 leader_election.cc:343] T 878f83ec036345f69ff96a6b46613485 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:38.502808  7904 leader_election.cc:304] T 878f83ec036345f69ff96a6b46613485 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200; no voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:38.503342  8136 leader_election.cc:290] T 878f83ec036345f69ff96a6b46613485 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:38.504365  8070 raft_consensus.cc:2749] T 878f83ec036345f69ff96a6b46613485 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:38.505159  7938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985b6cf5ffe74ecfabc7ba74e262a88f" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:38.508226  8060 tablet_bootstrap.cc:492] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:38.505839  7938 raft_consensus.cc:2468] T 985b6cf5ffe74ecfabc7ba74e262a88f P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 0.
I20260709 13:16:38.508814  8060 ts_tablet_manager.cc:1403] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.247s	user 0.048s	sys 0.028s
I20260709 13:16:38.509693  7757 leader_election.cc:304] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:16:38.509316  7690 catalog_manager.cc:5697] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:38.511646  7866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985b6cf5ffe74ecfabc7ba74e262a88f" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:38.511879  8060 raft_consensus.cc:359] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:38.512331  8120 leader_election.cc:290] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:38.512846  8084 raft_consensus.cc:697] T 87d445d744434f90baaf040e708b1e98 P c9a569f7d1ad42359002386a73702690 [term 1 LEADER]: Becoming Leader. State: Replica: c9a569f7d1ad42359002386a73702690, State: Running, Role: LEADER
I20260709 13:16:38.514127  8084 consensus_queue.cc:237] T 87d445d744434f90baaf040e708b1e98 P c9a569f7d1ad42359002386a73702690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:38.512952  8120 raft_consensus.cc:2804] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:38.516350  8120 raft_consensus.cc:493] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.516873  8120 raft_consensus.cc:3060] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.525583  8060 raft_consensus.cc:385] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.526698  8060 raft_consensus.cc:740] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.528681  8059 tablet_bootstrap.cc:492] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:38.529207  8059 ts_tablet_manager.cc:1403] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.357s	user 0.029s	sys 0.023s
I20260709 13:16:38.529279  8060 consensus_queue.cc:260] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:38.528898  8064 tablet_bootstrap.cc:492] T b66f54819dda4cca9214096155a16694 P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:38.531653  8064 ts_tablet_manager.cc:1403] T b66f54819dda4cca9214096155a16694 P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.368s	user 0.013s	sys 0.007s
I20260709 13:16:38.532016  7866 raft_consensus.cc:2468] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 0.
I20260709 13:16:38.532737  8163 raft_consensus.cc:493] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.533371  8163 raft_consensus.cc:515] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:38.540380  8163 leader_election.cc:290] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:38.545931  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985b6cf5ffe74ecfabc7ba74e262a88f" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:38.546254  7938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985b6cf5ffe74ecfabc7ba74e262a88f" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:38.550948  7938 raft_consensus.cc:2468] T 985b6cf5ffe74ecfabc7ba74e262a88f P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 0.
I20260709 13:16:38.538367  8059 raft_consensus.cc:359] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:38.552420  7832 leader_election.cc:304] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:16:38.552865  8059 raft_consensus.cc:385] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.553431  8059 raft_consensus.cc:740] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.553647  8163 raft_consensus.cc:2804] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:38.554126  8163 raft_consensus.cc:493] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.554515  8163 raft_consensus.cc:3060] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.555042  8059 consensus_queue.cc:260] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:38.539937  8120 raft_consensus.cc:515] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:38.557274  7792 raft_consensus.cc:2393] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c5936948a84476fb0dcc1fa2d895740 in current term 1: Already voted for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in this term.
I20260709 13:16:38.560603  8120 leader_election.cc:290] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Requested vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:38.561831  7863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985b6cf5ffe74ecfabc7ba74e262a88f" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:38.564317  8064 raft_consensus.cc:359] T b66f54819dda4cca9214096155a16694 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:38.576308  8064 raft_consensus.cc:385] T b66f54819dda4cca9214096155a16694 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.570021  7940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985b6cf5ffe74ecfabc7ba74e262a88f" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:38.577111  7940 raft_consensus.cc:3060] T 985b6cf5ffe74ecfabc7ba74e262a88f P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.578835  8063 tablet_bootstrap.cc:492] T da682789343c4852b052f5fa4483c715 P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:38.579356  8063 ts_tablet_manager.cc:1403] T da682789343c4852b052f5fa4483c715 P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.104s	user 0.012s	sys 0.000s
I20260709 13:16:38.578114  7689 catalog_manager.cc:5697] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:38.580816  7689 catalog_manager.cc:5697] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:38.573241  8163 raft_consensus.cc:515] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:38.544327  8060 ts_tablet_manager.cc:1434] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:16:38.589890  8163 leader_election.cc:290] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Requested vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:38.590232  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985b6cf5ffe74ecfabc7ba74e262a88f" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:38.590713  7863 raft_consensus.cc:2393] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in current term 1: Already voted for candidate 1c5936948a84476fb0dcc1fa2d895740 in this term.
I20260709 13:16:38.591095  7792 raft_consensus.cc:2393] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c5936948a84476fb0dcc1fa2d895740 in current term 1: Already voted for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in this term.
I20260709 13:16:38.588372  7689 catalog_manager.cc:5697] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:38.582257  8063 raft_consensus.cc:359] T da682789343c4852b052f5fa4483c715 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:38.593626  8063 raft_consensus.cc:385] T da682789343c4852b052f5fa4483c715 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.593966  8063 raft_consensus.cc:740] T da682789343c4852b052f5fa4483c715 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.594780  8063 consensus_queue.cc:260] T da682789343c4852b052f5fa4483c715 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:38.584545  7940 raft_consensus.cc:2468] T 985b6cf5ffe74ecfabc7ba74e262a88f P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 1.
I20260709 13:16:38.596028  8060 tablet_bootstrap.cc:492] T 7141f7bef8234a56bdbb17df0b302a75 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:38.597337  7757 leader_election.cc:304] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: 1c5936948a84476fb0dcc1fa2d895740
I20260709 13:16:38.598001  8063 ts_tablet_manager.cc:1434] T da682789343c4852b052f5fa4483c715 P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:16:38.598979  8063 tablet_bootstrap.cc:492] T b750f6e7ca2b48ef942ad988e6c4dd8d P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:38.602181  8060 tablet_bootstrap.cc:654] T 7141f7bef8234a56bdbb17df0b302a75 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.603010  8097 raft_consensus.cc:2804] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:38.603696  8097 raft_consensus.cc:697] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:16:38.606314  8097 consensus_queue.cc:237] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:38.584959  8064 raft_consensus.cc:740] T b66f54819dda4cca9214096155a16694 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.586346  7690 catalog_manager.cc:5697] T 7806fa697a044140850e326d8e5889d1 P c9a569f7d1ad42359002386a73702690 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a569f7d1ad42359002386a73702690 (127.30.63.4). New cstate: current_term: 1 leader_uuid: "c9a569f7d1ad42359002386a73702690" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:38.610993  7690 catalog_manager.cc:5697] T 87d445d744434f90baaf040e708b1e98 P c9a569f7d1ad42359002386a73702690 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a569f7d1ad42359002386a73702690 (127.30.63.4). New cstate: current_term: 1 leader_uuid: "c9a569f7d1ad42359002386a73702690" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:38.593102  7938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985b6cf5ffe74ecfabc7ba74e262a88f" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:38.613950  7938 raft_consensus.cc:2393] T 985b6cf5ffe74ecfabc7ba74e262a88f P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c5936948a84476fb0dcc1fa2d895740 in current term 1: Already voted for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in this term.
I20260709 13:16:38.615329  7832 leader_election.cc:304] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:38.616194  8060 tablet_bootstrap.cc:492] T 7141f7bef8234a56bdbb17df0b302a75 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:38.616736  8060 ts_tablet_manager.cc:1403] T 7141f7bef8234a56bdbb17df0b302a75 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.006s
I20260709 13:16:38.616727  8109 raft_consensus.cc:2749] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:38.619560  8060 raft_consensus.cc:359] T 7141f7bef8234a56bdbb17df0b302a75 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:38.620249  8060 raft_consensus.cc:385] T 7141f7bef8234a56bdbb17df0b302a75 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.620527  8060 raft_consensus.cc:740] T 7141f7bef8234a56bdbb17df0b302a75 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.621214  8060 consensus_queue.cc:260] T 7141f7bef8234a56bdbb17df0b302a75 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:38.622808  8060 ts_tablet_manager.cc:1434] T 7141f7bef8234a56bdbb17df0b302a75 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:38.623780  8060 tablet_bootstrap.cc:492] T b750f6e7ca2b48ef942ad988e6c4dd8d P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:38.621230  8109 consensus_queue.cc:1048] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:16:38.625775  8064 consensus_queue.cc:260] T b66f54819dda4cca9214096155a16694 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:38.628060  8064 ts_tablet_manager.cc:1434] T b66f54819dda4cca9214096155a16694 P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.096s	user 0.005s	sys 0.000s
I20260709 13:16:38.573153  8059 ts_tablet_manager.cc:1434] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:16:38.623535  8015 raft_consensus.cc:3060] T aa3b3005e3634f858a7e68a789b5f827 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.630438  8060 tablet_bootstrap.cc:654] T b750f6e7ca2b48ef942ad988e6c4dd8d P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.604787  8157 raft_consensus.cc:493] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.632920  8157 raft_consensus.cc:515] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:38.635372  8013 raft_consensus.cc:3060] T b66f54819dda4cca9214096155a16694 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.635878  8157 leader_election.cc:290] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:38.637975  7940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da682789343c4852b052f5fa4483c715" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:38.638695  7940 raft_consensus.cc:2468] T da682789343c4852b052f5fa4483c715 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 0.
I20260709 13:16:38.639195  8014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da682789343c4852b052f5fa4483c715" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:38.639909  8014 raft_consensus.cc:2468] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 0.
I20260709 13:16:38.641714  7757 leader_election.cc:304] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:38.643656  8157 raft_consensus.cc:2804] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:38.644347  8157 raft_consensus.cc:493] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.644837  8157 raft_consensus.cc:3060] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.653757  8059 tablet_bootstrap.cc:492] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:38.604874  8063 tablet_bootstrap.cc:654] T b750f6e7ca2b48ef942ad988e6c4dd8d P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.662578  8157 raft_consensus.cc:515] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:38.667232  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da682789343c4852b052f5fa4483c715" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:38.668165  7941 raft_consensus.cc:3060] T da682789343c4852b052f5fa4483c715 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.677203  8064 tablet_bootstrap.cc:492] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:38.681782  8014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da682789343c4852b052f5fa4483c715" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:38.682497  8014 raft_consensus.cc:3060] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.686800  8109 consensus_queue.cc:1048] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:38.690897  8014 raft_consensus.cc:2468] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 1.
I20260709 13:16:38.691334  8163 consensus_queue.cc:1048] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:38.691466  8157 leader_election.cc:290] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Requested vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:38.692881  7757 leader_election.cc:304] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:38.693953  8157 raft_consensus.cc:2804] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:38.693734  7687 catalog_manager.cc:5697] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:38.695372  8157 raft_consensus.cc:697] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:16:38.703207  8059 tablet_bootstrap.cc:654] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.705899  7941 raft_consensus.cc:2468] T da682789343c4852b052f5fa4483c715 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 1.
I20260709 13:16:38.706553  8063 tablet_bootstrap.cc:492] T b750f6e7ca2b48ef942ad988e6c4dd8d P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:38.707034  8063 ts_tablet_manager.cc:1403] T b750f6e7ca2b48ef942ad988e6c4dd8d P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.108s	user 0.006s	sys 0.004s
I20260709 13:16:38.696352  8157 consensus_queue.cc:237] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:38.709846  8063 raft_consensus.cc:359] T b750f6e7ca2b48ef942ad988e6c4dd8d P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:38.710741  8063 raft_consensus.cc:385] T b750f6e7ca2b48ef942ad988e6c4dd8d P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.711088  8063 raft_consensus.cc:740] T b750f6e7ca2b48ef942ad988e6c4dd8d P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.711953  8063 consensus_queue.cc:260] T b750f6e7ca2b48ef942ad988e6c4dd8d P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:38.714800  8064 tablet_bootstrap.cc:654] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.723114  8063 ts_tablet_manager.cc:1434] T b750f6e7ca2b48ef942ad988e6c4dd8d P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 13:16:38.724252  8063 tablet_bootstrap.cc:492] T 9eeed88ecdc244a98599a38459ae66b8 P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:38.725342  8060 tablet_bootstrap.cc:492] T b750f6e7ca2b48ef942ad988e6c4dd8d P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:38.725873  8060 ts_tablet_manager.cc:1403] T b750f6e7ca2b48ef942ad988e6c4dd8d P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.102s	user 0.030s	sys 0.027s
I20260709 13:16:38.730737  8063 tablet_bootstrap.cc:654] T 9eeed88ecdc244a98599a38459ae66b8 P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.731077  8060 raft_consensus.cc:359] T b750f6e7ca2b48ef942ad988e6c4dd8d P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:38.732718  8060 raft_consensus.cc:385] T b750f6e7ca2b48ef942ad988e6c4dd8d P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.733073  8060 raft_consensus.cc:740] T b750f6e7ca2b48ef942ad988e6c4dd8d P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.733952  8060 consensus_queue.cc:260] T b750f6e7ca2b48ef942ad988e6c4dd8d P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:38.735430  8136 raft_consensus.cc:493] T b750f6e7ca2b48ef942ad988e6c4dd8d P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.735952  8136 raft_consensus.cc:515] T b750f6e7ca2b48ef942ad988e6c4dd8d P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:38.736698  8059 tablet_bootstrap.cc:492] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:38.737176  8059 ts_tablet_manager.cc:1403] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.003s
I20260709 13:16:38.738094  8136 leader_election.cc:290] T b750f6e7ca2b48ef942ad988e6c4dd8d P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:38.739019  8060 ts_tablet_manager.cc:1434] T b750f6e7ca2b48ef942ad988e6c4dd8d P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:16:38.740128  8059 raft_consensus.cc:359] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:38.740836  8059 raft_consensus.cc:385] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.741119  8059 raft_consensus.cc:740] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.741164  8012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b750f6e7ca2b48ef942ad988e6c4dd8d" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:38.741853  8060 tablet_bootstrap.cc:492] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:38.742285  7863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b750f6e7ca2b48ef942ad988e6c4dd8d" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:38.744675  7863 raft_consensus.cc:2468] T b750f6e7ca2b48ef942ad988e6c4dd8d P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 0.
W20260709 13:16:38.742800  7906 leader_election.cc:343] T b750f6e7ca2b48ef942ad988e6c4dd8d P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:38.746284  7907 leader_election.cc:304] T b750f6e7ca2b48ef942ad988e6c4dd8d P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: c9a569f7d1ad42359002386a73702690
I20260709 13:16:38.747522  8136 raft_consensus.cc:2804] T b750f6e7ca2b48ef942ad988e6c4dd8d P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:38.747908  8136 raft_consensus.cc:493] T b750f6e7ca2b48ef942ad988e6c4dd8d P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.748248  8136 raft_consensus.cc:3060] T b750f6e7ca2b48ef942ad988e6c4dd8d P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.748206  8156 consensus_queue.cc:1048] T 7806fa697a044140850e326d8e5889d1 P c9a569f7d1ad42359002386a73702690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:38.756274  8060 tablet_bootstrap.cc:654] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.758266  8119 consensus_queue.cc:1048] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:38.741899  8059 consensus_queue.cc:260] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:38.769665  8059 ts_tablet_manager.cc:1434] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:16:38.772548  8059 tablet_bootstrap.cc:492] T 5ba560db35494ad2b64a9b728d510c1a P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:38.766582  8136 raft_consensus.cc:515] T b750f6e7ca2b48ef942ad988e6c4dd8d P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:38.779186  8136 leader_election.cc:290] T b750f6e7ca2b48ef942ad988e6c4dd8d P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Requested vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:38.780382  7866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b750f6e7ca2b48ef942ad988e6c4dd8d" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:38.787914  7866 raft_consensus.cc:3060] T b750f6e7ca2b48ef942ad988e6c4dd8d P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.791790  8084 consensus_queue.cc:1048] T 7806fa697a044140850e326d8e5889d1 P c9a569f7d1ad42359002386a73702690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:38.799659  8012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b750f6e7ca2b48ef942ad988e6c4dd8d" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
W20260709 13:16:38.801259  7906 leader_election.cc:343] T b750f6e7ca2b48ef942ad988e6c4dd8d P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:38.820823  8063 tablet_bootstrap.cc:492] T 9eeed88ecdc244a98599a38459ae66b8 P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:38.821408  8063 ts_tablet_manager.cc:1403] T 9eeed88ecdc244a98599a38459ae66b8 P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.097s	user 0.019s	sys 0.004s
I20260709 13:16:38.822592  8060 tablet_bootstrap.cc:492] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:38.823171  8060 ts_tablet_manager.cc:1403] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.082s	user 0.012s	sys 0.034s
I20260709 13:16:38.823289  8163 consensus_queue.cc:1048] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:38.825846  8063 raft_consensus.cc:359] T 9eeed88ecdc244a98599a38459ae66b8 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:38.826092  8157 consensus_queue.cc:1048] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:38.826604  8063 raft_consensus.cc:385] T 9eeed88ecdc244a98599a38459ae66b8 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.826247  8060 raft_consensus.cc:359] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:38.826913  8063 raft_consensus.cc:740] T 9eeed88ecdc244a98599a38459ae66b8 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.827010  8060 raft_consensus.cc:385] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.827332  8060 raft_consensus.cc:740] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.827759  8063 consensus_queue.cc:260] T 9eeed88ecdc244a98599a38459ae66b8 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:38.828087  8060 consensus_queue.cc:260] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:38.830096  8063 ts_tablet_manager.cc:1434] T 9eeed88ecdc244a98599a38459ae66b8 P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:16:38.830225  8060 ts_tablet_manager.cc:1434] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:16:38.831418  8060 tablet_bootstrap.cc:492] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:38.831842  8063 tablet_bootstrap.cc:492] T 8b505df72528474496f1a81ffa9ad0a6 P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:38.833065  8064 tablet_bootstrap.cc:492] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:38.833552  8064 ts_tablet_manager.cc:1403] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.157s	user 0.018s	sys 0.005s
I20260709 13:16:38.838310  8063 tablet_bootstrap.cc:654] T 8b505df72528474496f1a81ffa9ad0a6 P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.838310  8060 tablet_bootstrap.cc:654] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.836344  8064 raft_consensus.cc:359] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:38.843173  8064 raft_consensus.cc:385] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.836259  7687 catalog_manager.cc:5697] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:38.843571  8064 raft_consensus.cc:740] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.851111  8059 tablet_bootstrap.cc:654] T 5ba560db35494ad2b64a9b728d510c1a P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.853080  8064 consensus_queue.cc:260] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:38.855360  8064 ts_tablet_manager.cc:1434] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:16:38.859561  8064 tablet_bootstrap.cc:492] T b750f6e7ca2b48ef942ad988e6c4dd8d P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:38.864993  8119 consensus_queue.cc:1048] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:16:38.882685  7866 raft_consensus.cc:2468] T b750f6e7ca2b48ef942ad988e6c4dd8d P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 1.
I20260709 13:16:38.891356  7907 leader_election.cc:304] T b750f6e7ca2b48ef942ad988e6c4dd8d P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: c9a569f7d1ad42359002386a73702690
I20260709 13:16:38.892639  8136 raft_consensus.cc:2804] T b750f6e7ca2b48ef942ad988e6c4dd8d P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:38.893118  8136 raft_consensus.cc:697] T b750f6e7ca2b48ef942ad988e6c4dd8d P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Becoming Leader. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Running, Role: LEADER
I20260709 13:16:38.894037  8136 consensus_queue.cc:237] T b750f6e7ca2b48ef942ad988e6c4dd8d P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:38.896898  8153 raft_consensus.cc:493] T 7141f7bef8234a56bdbb17df0b302a75 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.897652  8153 raft_consensus.cc:515] T 7141f7bef8234a56bdbb17df0b302a75 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:38.898694  8119 consensus_queue.cc:1048] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:38.936919  7737 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:38.940641  8153 leader_election.cc:290] T 7141f7bef8234a56bdbb17df0b302a75 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:38.942453  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7141f7bef8234a56bdbb17df0b302a75" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
W20260709 13:16:38.945108  7830 leader_election.cc:343] T 7141f7bef8234a56bdbb17df0b302a75 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:38.946801  8171 consensus_queue.cc:1048] T 87d445d744434f90baaf040e708b1e98 P c9a569f7d1ad42359002386a73702690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:38.965934  8060 tablet_bootstrap.cc:492] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:38.966442  8060 ts_tablet_manager.cc:1403] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.136s	user 0.008s	sys 0.011s
I20260709 13:16:38.958249  8065 consensus_queue.cc:1048] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:16:38.968981  8060 raft_consensus.cc:359] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:38.969712  8060 raft_consensus.cc:385] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.969966  8060 raft_consensus.cc:740] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.970665  8060 consensus_queue.cc:260] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:38.971805  8064 tablet_bootstrap.cc:654] T b750f6e7ca2b48ef942ad988e6c4dd8d P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.972880  8060 ts_tablet_manager.cc:1434] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:16:38.973855  8060 tablet_bootstrap.cc:492] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:38.989972  8012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7141f7bef8234a56bdbb17df0b302a75" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:38.992120  8097 consensus_queue.cc:1048] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:38.993086  8059 tablet_bootstrap.cc:492] T 5ba560db35494ad2b64a9b728d510c1a P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:38.993769  8059 ts_tablet_manager.cc:1403] T 5ba560db35494ad2b64a9b728d510c1a P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.221s	user 0.040s	sys 0.048s
I20260709 13:16:38.996661  8066 raft_consensus.cc:493] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.997620  8066 raft_consensus.cc:515] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:39.000658  8066 leader_election.cc:290] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:39.003018  8084 consensus_queue.cc:1048] T 87d445d744434f90baaf040e708b1e98 P c9a569f7d1ad42359002386a73702690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:16:39.013542  8060 tablet_bootstrap.cc:654] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.023087  8063 tablet_bootstrap.cc:492] T 8b505df72528474496f1a81ffa9ad0a6 P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:39.023598  8063 ts_tablet_manager.cc:1403] T 8b505df72528474496f1a81ffa9ad0a6 P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.192s	user 0.040s	sys 0.028s
W20260709 13:16:38.992477  7832 leader_election.cc:343] T 7141f7bef8234a56bdbb17df0b302a75 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.031637  8059 raft_consensus.cc:359] T 5ba560db35494ad2b64a9b728d510c1a P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:39.032526  8059 raft_consensus.cc:385] T 5ba560db35494ad2b64a9b728d510c1a P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.032856  8059 raft_consensus.cc:740] T 5ba560db35494ad2b64a9b728d510c1a P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.038980  8059 consensus_queue.cc:260] T 5ba560db35494ad2b64a9b728d510c1a P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:39.040624  8063 raft_consensus.cc:359] T 8b505df72528474496f1a81ffa9ad0a6 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:39.041632  8063 raft_consensus.cc:385] T 8b505df72528474496f1a81ffa9ad0a6 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.041988  8063 raft_consensus.cc:740] T 8b505df72528474496f1a81ffa9ad0a6 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.033690  7832 leader_election.cc:304] T 7141f7bef8234a56bdbb17df0b302a75 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690
I20260709 13:16:39.043818  8063 consensus_queue.cc:260] T 8b505df72528474496f1a81ffa9ad0a6 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:39.043365  7689 catalog_manager.cc:5697] T b750f6e7ca2b48ef942ad988e6c4dd8d P 7de07e50a1714f5d9055bb4b86655200 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "7de07e50a1714f5d9055bb4b86655200" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:39.046746  8063 ts_tablet_manager.cc:1434] T 8b505df72528474496f1a81ffa9ad0a6 P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:16:39.046296  8060 tablet_bootstrap.cc:492] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:39.048985  8060 ts_tablet_manager.cc:1403] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.075s	user 0.007s	sys 0.010s
I20260709 13:16:39.047734  8063 tablet_bootstrap.cc:492] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:39.048202  8070 raft_consensus.cc:493] T 9eeed88ecdc244a98599a38459ae66b8 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.049347  8066 raft_consensus.cc:2749] T 7141f7bef8234a56bdbb17df0b302a75 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:39.049692  8070 raft_consensus.cc:515] T 9eeed88ecdc244a98599a38459ae66b8 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:39.052033  8060 raft_consensus.cc:359] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:39.052775  8060 raft_consensus.cc:385] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.053094  8060 raft_consensus.cc:740] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.052932  7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eeed88ecdc244a98599a38459ae66b8" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:39.054311  7863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eeed88ecdc244a98599a38459ae66b8" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
W20260709 13:16:39.056018  7907 leader_election.cc:343] T 9eeed88ecdc244a98599a38459ae66b8 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:39.057271  7904 leader_election.cc:343] T 9eeed88ecdc244a98599a38459ae66b8 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.057725  7904 leader_election.cc:304] T 9eeed88ecdc244a98599a38459ae66b8 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200; no voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:39.058526  8136 raft_consensus.cc:2749] T 9eeed88ecdc244a98599a38459ae66b8 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:39.059291  8070 leader_election.cc:290] T 9eeed88ecdc244a98599a38459ae66b8 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:39.049036  8059 ts_tablet_manager.cc:1434] T 5ba560db35494ad2b64a9b728d510c1a P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.000s
I20260709 13:16:39.061024  8059 tablet_bootstrap.cc:492] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
W20260709 13:16:39.059288  7832 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:46031, user_credentials={real_user=slave}} blocked reactor thread for 66849.6us
I20260709 13:16:39.065176  8060 consensus_queue.cc:260] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:39.067770  8097 consensus_queue.cc:1048] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:39.068550  8064 tablet_bootstrap.cc:492] T b750f6e7ca2b48ef942ad988e6c4dd8d P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:39.069113  8064 ts_tablet_manager.cc:1403] T b750f6e7ca2b48ef942ad988e6c4dd8d P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.213s	user 0.010s	sys 0.011s
I20260709 13:16:39.071291  8012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28b4b42078f421f85ebc87a2481aa87" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:39.073287  7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28b4b42078f421f85ebc87a2481aa87" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:39.076565  8059 tablet_bootstrap.cc:654] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.080698  8060 ts_tablet_manager.cc:1434] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 13:16:39.086127  8063 tablet_bootstrap.cc:654] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.086560  8060 tablet_bootstrap.cc:492] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:39.088804  8059 tablet_bootstrap.cc:492] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:39.089915  8059 ts_tablet_manager.cc:1403] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.001s
I20260709 13:16:39.093071  8059 raft_consensus.cc:359] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:39.093931  8059 raft_consensus.cc:385] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.094141  8119 raft_consensus.cc:493] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.094702  8119 raft_consensus.cc:515] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:39.098779  8119 leader_election.cc:290] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:39.098737  7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4877bb8fb91844ddab1c717b7dec231d" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:39.100224  8059 raft_consensus.cc:740] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.099939  8120 consensus_queue.cc:1048] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:16:39.100963  7757 leader_election.cc:343] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.101130  8059 consensus_queue.cc:260] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:39.101606  8064 raft_consensus.cc:359] T b750f6e7ca2b48ef942ad988e6c4dd8d P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:39.102293  8064 raft_consensus.cc:385] T b750f6e7ca2b48ef942ad988e6c4dd8d P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.102581  8064 raft_consensus.cc:740] T b750f6e7ca2b48ef942ad988e6c4dd8d P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.103282  8064 consensus_queue.cc:260] T b750f6e7ca2b48ef942ad988e6c4dd8d P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:39.103736  8059 ts_tablet_manager.cc:1434] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:16:39.105470  8064 ts_tablet_manager.cc:1434] T b750f6e7ca2b48ef942ad988e6c4dd8d P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:16:39.105398  8012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4877bb8fb91844ddab1c717b7dec231d" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:39.107391  8063 tablet_bootstrap.cc:492] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:39.108507  8063 ts_tablet_manager.cc:1403] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.061s	user 0.016s	sys 0.007s
I20260709 13:16:39.108399  8065 consensus_queue.cc:1048] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:39.107949  8059 tablet_bootstrap.cc:492] T 7141f7bef8234a56bdbb17df0b302a75 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
W20260709 13:16:39.107383  7757 leader_election.cc:343] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.113193  7757 leader_election.cc:304] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690
I20260709 13:16:39.113997  8065 raft_consensus.cc:2749] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:39.116214  8063 raft_consensus.cc:359] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:39.116990  8063 raft_consensus.cc:385] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.117269  8063 raft_consensus.cc:740] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.118139  8063 consensus_queue.cc:260] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:39.120250  8063 ts_tablet_manager.cc:1434] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:16:39.121224  8063 tablet_bootstrap.cc:492] T d28b4b42078f421f85ebc87a2481aa87 P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:39.123842  8060 tablet_bootstrap.cc:654] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.126963  8063 tablet_bootstrap.cc:654] T d28b4b42078f421f85ebc87a2481aa87 P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.126219  8059 tablet_bootstrap.cc:654] T 7141f7bef8234a56bdbb17df0b302a75 P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.130530  8013 raft_consensus.cc:3060] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:39.130892  7832 leader_election.cc:343] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:39.131775  7832 leader_election.cc:343] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.132326  7832 leader_election.cc:304] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740; no voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690
I20260709 13:16:39.136113  8066 raft_consensus.cc:2749] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:39.153218  8064 tablet_bootstrap.cc:492] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:39.177341  8070 raft_consensus.cc:493] T 8b505df72528474496f1a81ffa9ad0a6 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.177968  8070 raft_consensus.cc:515] T 8b505df72528474496f1a81ffa9ad0a6 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:39.180135  8070 leader_election.cc:290] T 8b505df72528474496f1a81ffa9ad0a6 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:39.182328  7866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b505df72528474496f1a81ffa9ad0a6" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:39.185137  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b505df72528474496f1a81ffa9ad0a6" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
W20260709 13:16:39.187248  7907 leader_election.cc:343] T 8b505df72528474496f1a81ffa9ad0a6 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:39.189118  7906 leader_election.cc:343] T 8b505df72528474496f1a81ffa9ad0a6 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.189584  7906 leader_election.cc:304] T 8b505df72528474496f1a81ffa9ad0a6 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200; no voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690
I20260709 13:16:39.191248  8070 raft_consensus.cc:2749] T 8b505df72528474496f1a81ffa9ad0a6 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:39.209336  8059 tablet_bootstrap.cc:492] T 7141f7bef8234a56bdbb17df0b302a75 P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:39.210134  8059 ts_tablet_manager.cc:1403] T 7141f7bef8234a56bdbb17df0b302a75 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.104s	user 0.017s	sys 0.009s
I20260709 13:16:39.211306  8065 consensus_queue.cc:1048] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:39.213055  8059 raft_consensus.cc:359] T 7141f7bef8234a56bdbb17df0b302a75 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:39.214040  8059 raft_consensus.cc:385] T 7141f7bef8234a56bdbb17df0b302a75 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.214361  8059 raft_consensus.cc:740] T 7141f7bef8234a56bdbb17df0b302a75 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.215572  8065 consensus_queue.cc:1048] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:39.215322  8059 consensus_queue.cc:260] T 7141f7bef8234a56bdbb17df0b302a75 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:39.218508  8059 ts_tablet_manager.cc:1434] T 7141f7bef8234a56bdbb17df0b302a75 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:16:39.219633  8060 tablet_bootstrap.cc:492] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:39.220325  8060 ts_tablet_manager.cc:1403] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.134s	user 0.020s	sys 0.041s
I20260709 13:16:39.224043  8060 raft_consensus.cc:359] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:39.225003  8060 raft_consensus.cc:385] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.225288  8060 raft_consensus.cc:740] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.225940  8060 consensus_queue.cc:260] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:39.229341  8064 tablet_bootstrap.cc:654] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.230469  8059 tablet_bootstrap.cc:492] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:39.233448  8060 ts_tablet_manager.cc:1434] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:16:39.243049  8084 raft_consensus.cc:493] T b750f6e7ca2b48ef942ad988e6c4dd8d P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.243637  8084 raft_consensus.cc:515] T b750f6e7ca2b48ef942ad988e6c4dd8d P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:39.248138  8060 tablet_bootstrap.cc:492] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:39.248317  8059 tablet_bootstrap.cc:654] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.251287  8084 leader_election.cc:290] T b750f6e7ca2b48ef942ad988e6c4dd8d P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
W20260709 13:16:39.252578  8216 log.cc:927] Time spent T 985b6cf5ffe74ecfabc7ba74e262a88f P 7de07e50a1714f5d9055bb4b86655200: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:16:39.259848  8063 tablet_bootstrap.cc:492] T d28b4b42078f421f85ebc87a2481aa87 P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:39.265236  8063 ts_tablet_manager.cc:1403] T d28b4b42078f421f85ebc87a2481aa87 P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.144s	user 0.042s	sys 0.068s
I20260709 13:16:39.257259  8060 tablet_bootstrap.cc:654] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.254103  7940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b750f6e7ca2b48ef942ad988e6c4dd8d" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:39.251325  7863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b750f6e7ca2b48ef942ad988e6c4dd8d" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:39.270390  7863 raft_consensus.cc:2393] T b750f6e7ca2b48ef942ad988e6c4dd8d P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a569f7d1ad42359002386a73702690 in current term 1: Already voted for candidate 7de07e50a1714f5d9055bb4b86655200 in this term.
I20260709 13:16:39.276896  8063 raft_consensus.cc:359] T d28b4b42078f421f85ebc87a2481aa87 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:39.277788  8063 raft_consensus.cc:385] T d28b4b42078f421f85ebc87a2481aa87 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.278224  8063 raft_consensus.cc:740] T d28b4b42078f421f85ebc87a2481aa87 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.284174  7980 leader_election.cc:304] T b750f6e7ca2b48ef942ad988e6c4dd8d P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:39.285835  8156 raft_consensus.cc:3060] T b750f6e7ca2b48ef942ad988e6c4dd8d P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.287479  8063 consensus_queue.cc:260] T d28b4b42078f421f85ebc87a2481aa87 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:39.295065  8063 ts_tablet_manager.cc:1434] T d28b4b42078f421f85ebc87a2481aa87 P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.002s
I20260709 13:16:39.296137  8063 tablet_bootstrap.cc:492] T a8fe051592e64e39905b33d218b96822 P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:39.298633  8064 tablet_bootstrap.cc:492] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:39.299120  8064 ts_tablet_manager.cc:1403] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.183s	user 0.015s	sys 0.008s
I20260709 13:16:39.300246  8153 raft_consensus.cc:493] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.300752  8153 raft_consensus.cc:515] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:39.302466  8064 raft_consensus.cc:359] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:39.302860  8153 leader_election.cc:290] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:39.303174  8064 raft_consensus.cc:385] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.303468  8064 raft_consensus.cc:740] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.304358  8119 raft_consensus.cc:493] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.304554  7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878f83ec036345f69ff96a6b46613485" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:39.304229  8064 consensus_queue.cc:260] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:39.304903  8119 raft_consensus.cc:515] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:39.304605  8065 consensus_queue.cc:1048] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:39.306516  7940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878f83ec036345f69ff96a6b46613485" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:39.307299  8119 leader_election.cc:290] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:39.307356  7940 raft_consensus.cc:2468] T 878f83ec036345f69ff96a6b46613485 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 0.
I20260709 13:16:39.308961  7832 leader_election.cc:304] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:16:39.309881  8153 raft_consensus.cc:2804] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:39.310510  7940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242ac51169564e5e9b95c521387a853b" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:39.318775  8153 raft_consensus.cc:493] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.313676  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242ac51169564e5e9b95c521387a853b" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:39.319207  8153 raft_consensus.cc:3060] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:39.315176  7830 leader_election.cc:343] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.320158  8064 ts_tablet_manager.cc:1434] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:16:39.320626  8163 raft_consensus.cc:493] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:39.321549  7757 leader_election.cc:343] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.321623  8163 raft_consensus.cc:515] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:39.323233  8064 tablet_bootstrap.cc:492] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:39.335104  7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba560db35494ad2b64a9b728d510c1a" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:39.335908  7789 raft_consensus.cc:2468] T 5ba560db35494ad2b64a9b728d510c1a P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 0.
I20260709 13:16:39.337311  8063 tablet_bootstrap.cc:654] T a8fe051592e64e39905b33d218b96822 P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.337965  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba560db35494ad2b64a9b728d510c1a" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
W20260709 13:16:39.337981  7757 leader_election.cc:343] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.341285  7757 leader_election.cc:304] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690
I20260709 13:16:39.337481  8163 leader_election.cc:290] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:39.339113  8156 raft_consensus.cc:2749] T b750f6e7ca2b48ef942ad988e6c4dd8d P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:39.343573  8065 raft_consensus.cc:2749] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:39.338969  8064 tablet_bootstrap.cc:654] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.337270  7830 leader_election.cc:304] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 
W20260709 13:16:39.345491  7832 leader_election.cc:343] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.351450  8163 raft_consensus.cc:2804] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:39.352243  8163 raft_consensus.cc:493] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.352831  8163 raft_consensus.cc:3060] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.362558  8059 tablet_bootstrap.cc:492] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:39.363067  8059 ts_tablet_manager.cc:1403] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.133s	user 0.010s	sys 0.008s
I20260709 13:16:39.376981  8060 tablet_bootstrap.cc:492] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:39.376951  8156 raft_consensus.cc:493] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.377681  8060 ts_tablet_manager.cc:1403] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.130s	user 0.015s	sys 0.019s
I20260709 13:16:39.377656  8156 raft_consensus.cc:515] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:39.379580  8064 tablet_bootstrap.cc:492] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:39.380119  8064 ts_tablet_manager.cc:1403] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.012s
I20260709 13:16:39.380769  7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7141f7bef8234a56bdbb17df0b302a75" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:39.384934  7789 raft_consensus.cc:2468] T 7141f7bef8234a56bdbb17df0b302a75 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 0.
I20260709 13:16:39.386334  7978 leader_election.cc:304] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:39.387228  8155 raft_consensus.cc:2804] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:39.387660  8155 raft_consensus.cc:493] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.380836  8060 raft_consensus.cc:359] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:39.381848  8156 leader_election.cc:290] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:39.388023  8155 raft_consensus.cc:3060] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.389631  8153 raft_consensus.cc:515] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:39.390481  8063 tablet_bootstrap.cc:492] T a8fe051592e64e39905b33d218b96822 P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:39.391012  8063 ts_tablet_manager.cc:1403] T a8fe051592e64e39905b33d218b96822 P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.095s	user 0.016s	sys 0.000s
I20260709 13:16:39.391539  8153 leader_election.cc:290] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Requested vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:39.383028  7863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7141f7bef8234a56bdbb17df0b302a75" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:39.392416  7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878f83ec036345f69ff96a6b46613485" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:39.392558  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878f83ec036345f69ff96a6b46613485" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:39.393375  7941 raft_consensus.cc:3060] T 878f83ec036345f69ff96a6b46613485 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.393744  8064 raft_consensus.cc:359] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
W20260709 13:16:39.394246  7830 leader_election.cc:343] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.394443  8064 raft_consensus.cc:385] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.394740  8064 raft_consensus.cc:740] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.395412  8064 consensus_queue.cc:260] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:39.388227  8060 raft_consensus.cc:385] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.392652  7863 raft_consensus.cc:2468] T 7141f7bef8234a56bdbb17df0b302a75 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 0.
I20260709 13:16:39.396941  8060 raft_consensus.cc:740] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.397258  8064 ts_tablet_manager.cc:1434] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.011s	user 0.000s	sys 0.005s
I20260709 13:16:39.397922  8060 consensus_queue.cc:260] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:39.399871  8060 ts_tablet_manager.cc:1434] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:16:39.400869  8060 tablet_bootstrap.cc:492] T 8b505df72528474496f1a81ffa9ad0a6 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:39.383991  8059 raft_consensus.cc:359] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:39.372160  8163 raft_consensus.cc:515] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:39.404733  8059 raft_consensus.cc:385] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.405051  8059 raft_consensus.cc:740] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.403494  8155 raft_consensus.cc:515] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:39.406488  8070 consensus_queue.cc:1048] T b750f6e7ca2b48ef942ad988e6c4dd8d P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:39.412774  8064 tablet_bootstrap.cc:492] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:39.415751  8163 leader_election.cc:290] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:39.417466  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba560db35494ad2b64a9b728d510c1a" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
W20260709 13:16:39.421497  7832 leader_election.cc:343] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.422986  7941 raft_consensus.cc:2468] T 878f83ec036345f69ff96a6b46613485 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 1.
I20260709 13:16:39.421525  7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba560db35494ad2b64a9b728d510c1a" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:39.424167  7789 raft_consensus.cc:3060] T 5ba560db35494ad2b64a9b728d510c1a P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.424314  7832 leader_election.cc:304] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:39.425408  8060 tablet_bootstrap.cc:654] T 8b505df72528474496f1a81ffa9ad0a6 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.425537  8163 raft_consensus.cc:2804] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:39.426047  8063 raft_consensus.cc:359] T a8fe051592e64e39905b33d218b96822 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:39.426591  8163 raft_consensus.cc:697] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Becoming Leader. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:16:39.427461  8163 consensus_queue.cc:237] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:39.430441  8059 consensus_queue.cc:260] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:39.432804  8059 ts_tablet_manager.cc:1434] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.069s	user 0.005s	sys 0.002s
I20260709 13:16:39.433992  8059 tablet_bootstrap.cc:492] T 9eeed88ecdc244a98599a38459ae66b8 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:39.426740  8063 raft_consensus.cc:385] T a8fe051592e64e39905b33d218b96822 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.419390  8064 tablet_bootstrap.cc:654] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.440155  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7141f7bef8234a56bdbb17df0b302a75" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:39.441332  7792 raft_consensus.cc:3060] T 7141f7bef8234a56bdbb17df0b302a75 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.451740  7792 raft_consensus.cc:2468] T 7141f7bef8234a56bdbb17df0b302a75 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 1.
I20260709 13:16:39.451802  8136 consensus_queue.cc:1048] T b750f6e7ca2b48ef942ad988e6c4dd8d P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:39.459263  7866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7141f7bef8234a56bdbb17df0b302a75" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:39.459918  7866 raft_consensus.cc:3060] T 7141f7bef8234a56bdbb17df0b302a75 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.460155  8136 raft_consensus.cc:493] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.460871  8136 raft_consensus.cc:515] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:39.466622  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4877bb8fb91844ddab1c717b7dec231d" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
W20260709 13:16:39.468614  7906 leader_election.cc:343] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.470525  8136 leader_election.cc:290] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:39.437772  8063 raft_consensus.cc:740] T a8fe051592e64e39905b33d218b96822 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.455669  7789 raft_consensus.cc:2468] T 5ba560db35494ad2b64a9b728d510c1a P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 1.
I20260709 13:16:39.472257  8063 consensus_queue.cc:260] T a8fe051592e64e39905b33d218b96822 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:39.456187  8155 leader_election.cc:290] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 election: Requested vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:39.470781  7791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4877bb8fb91844ddab1c717b7dec231d" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:39.472903  7830 leader_election.cc:304] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: c9a569f7d1ad42359002386a73702690
I20260709 13:16:39.473671  7791 raft_consensus.cc:2468] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 0.
I20260709 13:16:39.474356  8153 raft_consensus.cc:2804] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:39.474915  8153 raft_consensus.cc:697] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Becoming Leader. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:16:39.475132  7904 leader_election.cc:304] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: c9a569f7d1ad42359002386a73702690
I20260709 13:16:39.475813  8153 consensus_queue.cc:237] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:39.482391  8070 raft_consensus.cc:2804] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:39.483104  8070 raft_consensus.cc:493] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.483605  8070 raft_consensus.cc:3060] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.493402  8063 ts_tablet_manager.cc:1434] T a8fe051592e64e39905b33d218b96822 P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.102s	user 0.008s	sys 0.000s
I20260709 13:16:39.498293  8063 tablet_bootstrap.cc:492] T 242ac51169564e5e9b95c521387a853b P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:39.496093  7978 leader_election.cc:304] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:39.502269  8171 raft_consensus.cc:2804] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:39.502919  8171 raft_consensus.cc:697] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690 [term 1 LEADER]: Becoming Leader. State: Replica: c9a569f7d1ad42359002386a73702690, State: Running, Role: LEADER
I20260709 13:16:39.504055  8171 consensus_queue.cc:237] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:39.494032  8155 raft_consensus.cc:493] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.509303  8155 raft_consensus.cc:515] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:39.512522  7863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28b4b42078f421f85ebc87a2481aa87" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:39.512650  8070 raft_consensus.cc:515] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:39.513248  7863 raft_consensus.cc:2468] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 0.
I20260709 13:16:39.514395  7981 leader_election.cc:304] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:39.515251  8084 raft_consensus.cc:2804] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:39.512534  8059 tablet_bootstrap.cc:654] T 9eeed88ecdc244a98599a38459ae66b8 P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.515625  8084 raft_consensus.cc:493] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.517745  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4877bb8fb91844ddab1c717b7dec231d" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:39.546082  8084 raft_consensus.cc:3060] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.518345  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28b4b42078f421f85ebc87a2481aa87" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:39.520712  8155 leader_election.cc:290] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:39.521917  7866 raft_consensus.cc:2468] T 7141f7bef8234a56bdbb17df0b302a75 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 1.
I20260709 13:16:39.527022  8153 raft_consensus.cc:493] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.547431  8153 raft_consensus.cc:515] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
W20260709 13:16:39.547742  7906 leader_election.cc:343] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.548198  8064 tablet_bootstrap.cc:492] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:39.548750  8064 ts_tablet_manager.cc:1403] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.136s	user 0.040s	sys 0.048s
I20260709 13:16:39.549654  8153 leader_election.cc:290] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:39.551688  7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eeed88ecdc244a98599a38459ae66b8" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:39.551563  8064 raft_consensus.cc:359] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:39.552294  8064 raft_consensus.cc:385] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.552654  8064 raft_consensus.cc:740] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.530488  8136 raft_consensus.cc:493] T d28b4b42078f421f85ebc87a2481aa87 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.553316  8136 raft_consensus.cc:515] T d28b4b42078f421f85ebc87a2481aa87 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:39.553390  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eeed88ecdc244a98599a38459ae66b8" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:39.541659  8060 tablet_bootstrap.cc:492] T 8b505df72528474496f1a81ffa9ad0a6 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:39.554670  8060 ts_tablet_manager.cc:1403] T 8b505df72528474496f1a81ffa9ad0a6 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.154s	user 0.008s	sys 0.003s
W20260709 13:16:39.555627  7830 leader_election.cc:343] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.556110  7941 raft_consensus.cc:2468] T d28b4b42078f421f85ebc87a2481aa87 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 0.
I20260709 13:16:39.556453  8070 leader_election.cc:290] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:39.557570  8063 tablet_bootstrap.cc:654] T 242ac51169564e5e9b95c521387a853b P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.557757  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4877bb8fb91844ddab1c717b7dec231d" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:39.558449  7792 raft_consensus.cc:3060] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.558753  8060 raft_consensus.cc:359] T 8b505df72528474496f1a81ffa9ad0a6 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:39.559630  8060 raft_consensus.cc:385] T 8b505df72528474496f1a81ffa9ad0a6 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.553370  8084 raft_consensus.cc:515] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:39.559885  7863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28b4b42078f421f85ebc87a2481aa87" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:39.552363  7937 raft_consensus.cc:2468] T 9eeed88ecdc244a98599a38459ae66b8 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 0.
I20260709 13:16:39.559909  8060 raft_consensus.cc:740] T 8b505df72528474496f1a81ffa9ad0a6 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.561781  7832 leader_election.cc:304] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:39.553431  8064 consensus_queue.cc:260] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:39.562492  8084 leader_election.cc:290] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 election: Requested vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:39.564653  8136 leader_election.cc:290] T d28b4b42078f421f85ebc87a2481aa87 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:39.538223  7687 catalog_manager.cc:5697] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a569f7d1ad42359002386a73702690 (127.30.63.4). New cstate: current_term: 1 leader_uuid: "c9a569f7d1ad42359002386a73702690" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:39.563587  7863 raft_consensus.cc:2468] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 0.
I20260709 13:16:39.562740  8060 consensus_queue.cc:260] T 8b505df72528474496f1a81ffa9ad0a6 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:39.566130  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28b4b42078f421f85ebc87a2481aa87" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:39.566484  7907 leader_election.cc:304] T d28b4b42078f421f85ebc87a2481aa87 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:16:39.567067  8013 raft_consensus.cc:2393] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7de07e50a1714f5d9055bb4b86655200 in current term 1: Already voted for candidate c9a569f7d1ad42359002386a73702690 in this term.
I20260709 13:16:39.567440  8066 raft_consensus.cc:2804] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:39.563920  7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28b4b42078f421f85ebc87a2481aa87" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:39.568022  8066 raft_consensus.cc:493] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.568182  8060 ts_tablet_manager.cc:1434] T 8b505df72528474496f1a81ffa9ad0a6 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:16:39.568477  8066 raft_consensus.cc:3060] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.569228  8060 tablet_bootstrap.cc:492] T d99b23f5044644c1b270bc5afcaf2119 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:39.568284  7937 raft_consensus.cc:3060] T d28b4b42078f421f85ebc87a2481aa87 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.563274  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28b4b42078f421f85ebc87a2481aa87" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:39.572067  7862 raft_consensus.cc:3060] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.564509  8064 ts_tablet_manager.cc:1434] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:16:39.564114  8153 raft_consensus.cc:493] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.575040  8064 tablet_bootstrap.cc:492] T 5ba560db35494ad2b64a9b728d510c1a P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:39.574771  8119 raft_consensus.cc:493] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.575853  8119 raft_consensus.cc:515] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:39.578168  8119 leader_election.cc:290] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:39.580412  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceaecfbd6ac84206af71ba2b5fe22259" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
W20260709 13:16:39.582214  7757 leader_election.cc:343] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.579435  7937 raft_consensus.cc:2468] T d28b4b42078f421f85ebc87a2481aa87 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 1.
I20260709 13:16:39.582850  8136 raft_consensus.cc:2764] T d28b4b42078f421f85ebc87a2481aa87 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:16:39.583726  7866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceaecfbd6ac84206af71ba2b5fe22259" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:39.582037  8066 raft_consensus.cc:515] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:39.584515  8060 tablet_bootstrap.cc:654] T d99b23f5044644c1b270bc5afcaf2119 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.585331  8064 tablet_bootstrap.cc:654] T 5ba560db35494ad2b64a9b728d510c1a P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.586354  7980 leader_election.cc:304] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:39.587316  8084 raft_consensus.cc:2804] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:39.587368  7791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eeed88ecdc244a98599a38459ae66b8" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:39.587882  8084 raft_consensus.cc:697] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [term 1 LEADER]: Becoming Leader. State: Replica: c9a569f7d1ad42359002386a73702690, State: Running, Role: LEADER
W20260709 13:16:39.589179  7830 leader_election.cc:343] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.589493  8084 consensus_queue.cc:237] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:39.592469  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eeed88ecdc244a98599a38459ae66b8" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:39.593099  7941 raft_consensus.cc:3060] T 9eeed88ecdc244a98599a38459ae66b8 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.602635  7941 raft_consensus.cc:2468] T 9eeed88ecdc244a98599a38459ae66b8 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 1.
I20260709 13:16:39.603900  7832 leader_election.cc:304] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:39.575263  8153 raft_consensus.cc:515] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:39.607228  8153 leader_election.cc:290] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:39.607739  8153 raft_consensus.cc:2804] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:39.610030  7791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceaecfbd6ac84206af71ba2b5fe22259" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:39.610265  7862 raft_consensus.cc:2468] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 1.
I20260709 13:16:39.608297  8153 raft_consensus.cc:697] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Becoming Leader. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:16:39.610767  7791 raft_consensus.cc:2468] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 0.
I20260709 13:16:39.611609  8153 consensus_queue.cc:237] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:39.613139  7830 leader_election.cc:304] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 
I20260709 13:16:39.571424  7792 raft_consensus.cc:2468] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 1.
I20260709 13:16:39.616009  7866 raft_consensus.cc:2468] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 0.
I20260709 13:16:39.617046  7904 leader_election.cc:304] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: c9a569f7d1ad42359002386a73702690
I20260709 13:16:39.618769  8136 raft_consensus.cc:2804] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:39.619359  8136 raft_consensus.cc:697] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Becoming Leader. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Running, Role: LEADER
I20260709 13:16:39.620206  8243 raft_consensus.cc:2804] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:39.620671  8243 raft_consensus.cc:493] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.621045  8243 raft_consensus.cc:3060] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.620229  8136 consensus_queue.cc:237] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:39.626276  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceaecfbd6ac84206af71ba2b5fe22259" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
W20260709 13:16:39.628455  7832 leader_election.cc:343] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.637733  8070 raft_consensus.cc:493] T a8fe051592e64e39905b33d218b96822 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.638690  8070 raft_consensus.cc:515] T a8fe051592e64e39905b33d218b96822 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:39.641714  7866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fe051592e64e39905b33d218b96822" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
W20260709 13:16:39.643261  7907 leader_election.cc:343] T a8fe051592e64e39905b33d218b96822 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.651316  8243 raft_consensus.cc:515] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:39.652181  7758 leader_election.cc:304] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: c9a569f7d1ad42359002386a73702690
I20260709 13:16:39.653008  8060 tablet_bootstrap.cc:492] T d99b23f5044644c1b270bc5afcaf2119 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:39.653522  8119 raft_consensus.cc:2804] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:39.653726  8243 leader_election.cc:290] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:39.654000  8119 raft_consensus.cc:493] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.654459  8119 raft_consensus.cc:3060] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.653748  8060 ts_tablet_manager.cc:1403] T d99b23f5044644c1b270bc5afcaf2119 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.085s	user 0.021s	sys 0.034s
I20260709 13:16:39.661706  8060 raft_consensus.cc:359] T d99b23f5044644c1b270bc5afcaf2119 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:39.662770  8060 raft_consensus.cc:385] T d99b23f5044644c1b270bc5afcaf2119 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.663163  8060 raft_consensus.cc:740] T d99b23f5044644c1b270bc5afcaf2119 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.664130  8060 consensus_queue.cc:260] T d99b23f5044644c1b270bc5afcaf2119 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:39.674508  8060 ts_tablet_manager.cc:1434] T d99b23f5044644c1b270bc5afcaf2119 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:16:39.675997  8060 tablet_bootstrap.cc:492] T a8fe051592e64e39905b33d218b96822 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:39.678900  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceaecfbd6ac84206af71ba2b5fe22259" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:39.679387  8084 raft_consensus.cc:493] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:39.681299  7832 leader_election.cc:343] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.682497  7689 catalog_manager.cc:5697] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "1c5936948a84476fb0dcc1fa2d895740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:39.683730  8060 tablet_bootstrap.cc:654] T a8fe051592e64e39905b33d218b96822 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.679994  8084 raft_consensus.cc:515] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:39.686038  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fe051592e64e39905b33d218b96822" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
W20260709 13:16:39.687489  7906 leader_election.cc:343] T a8fe051592e64e39905b33d218b96822 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.687831  8084 leader_election.cc:290] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:39.687942  7906 leader_election.cc:304] T a8fe051592e64e39905b33d218b96822 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200; no voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690
I20260709 13:16:39.690454  7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242ac51169564e5e9b95c521387a853b" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:39.690963  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242ac51169564e5e9b95c521387a853b" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:39.691617  7792 raft_consensus.cc:2468] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 0.
W20260709 13:16:39.691951  7980 leader_election.cc:343] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.692811  8070 leader_election.cc:290] T a8fe051592e64e39905b33d218b96822 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:39.692965  7978 leader_election.cc:304] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:39.693624  8070 raft_consensus.cc:2749] T a8fe051592e64e39905b33d218b96822 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:39.694136  8084 raft_consensus.cc:2804] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:39.694475  8066 leader_election.cc:290] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Requested vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:39.694645  8084 raft_consensus.cc:493] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.698385  7687 catalog_manager.cc:5697] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a569f7d1ad42359002386a73702690 (127.30.63.4). New cstate: current_term: 1 leader_uuid: "c9a569f7d1ad42359002386a73702690" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:39.700971  8059 tablet_bootstrap.cc:492] T 9eeed88ecdc244a98599a38459ae66b8 P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:39.701350  8060 tablet_bootstrap.cc:492] T a8fe051592e64e39905b33d218b96822 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:39.701468  8059 ts_tablet_manager.cc:1403] T 9eeed88ecdc244a98599a38459ae66b8 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.268s	user 0.010s	sys 0.004s
I20260709 13:16:39.702049  8060 ts_tablet_manager.cc:1403] T a8fe051592e64e39905b33d218b96822 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.009s
I20260709 13:16:39.695243  8084 raft_consensus.cc:3060] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.710263  8060 raft_consensus.cc:359] T a8fe051592e64e39905b33d218b96822 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:39.711001  8060 raft_consensus.cc:385] T a8fe051592e64e39905b33d218b96822 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.711560  8060 raft_consensus.cc:740] T a8fe051592e64e39905b33d218b96822 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.712378  8060 consensus_queue.cc:260] T a8fe051592e64e39905b33d218b96822 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:39.725528  8060 ts_tablet_manager.cc:1434] T a8fe051592e64e39905b33d218b96822 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.003s
I20260709 13:16:39.726570  8060 tablet_bootstrap.cc:492] T afc39d65d52c48e3a959c8876930ab07 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:39.729580  8063 tablet_bootstrap.cc:492] T 242ac51169564e5e9b95c521387a853b P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:39.730106  8063 ts_tablet_manager.cc:1403] T 242ac51169564e5e9b95c521387a853b P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.232s	user 0.011s	sys 0.007s
I20260709 13:16:39.734606  8119 raft_consensus.cc:515] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:39.739131  8119 leader_election.cc:290] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:39.739046  8064 tablet_bootstrap.cc:492] T 5ba560db35494ad2b64a9b728d510c1a P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:39.739739  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceaecfbd6ac84206af71ba2b5fe22259" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:39.740257  8064 ts_tablet_manager.cc:1403] T 5ba560db35494ad2b64a9b728d510c1a P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.165s	user 0.041s	sys 0.045s
W20260709 13:16:39.741528  7757 leader_election.cc:343] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.743628  8064 raft_consensus.cc:359] T 5ba560db35494ad2b64a9b728d510c1a P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:39.743870  8063 raft_consensus.cc:359] T 242ac51169564e5e9b95c521387a853b P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:39.744457  8064 raft_consensus.cc:385] T 5ba560db35494ad2b64a9b728d510c1a P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.744678  8063 raft_consensus.cc:385] T 242ac51169564e5e9b95c521387a853b P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.744894  8064 raft_consensus.cc:740] T 5ba560db35494ad2b64a9b728d510c1a P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.745033  8063 raft_consensus.cc:740] T 242ac51169564e5e9b95c521387a853b P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.746069  8063 consensus_queue.cc:260] T 242ac51169564e5e9b95c521387a853b P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
W20260709 13:16:39.747527  7830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:35503, user_credentials={real_user=slave}} blocked reactor thread for 134462us
I20260709 13:16:39.741544  7687 catalog_manager.cc:5697] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "7de07e50a1714f5d9055bb4b86655200" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:39.750372  8063 ts_tablet_manager.cc:1434] T 242ac51169564e5e9b95c521387a853b P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:16:39.750680  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceaecfbd6ac84206af71ba2b5fe22259" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:39.745819  8064 consensus_queue.cc:260] T 5ba560db35494ad2b64a9b728d510c1a P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:39.751454  7792 raft_consensus.cc:2393] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c5936948a84476fb0dcc1fa2d895740 in current term 1: Already voted for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in this term.
I20260709 13:16:39.752995  8064 ts_tablet_manager.cc:1434] T 5ba560db35494ad2b64a9b728d510c1a P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:16:39.751475  8063 tablet_bootstrap.cc:492] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:39.754542  7689 catalog_manager.cc:5697] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "1c5936948a84476fb0dcc1fa2d895740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:39.756219  7689 catalog_manager.cc:5697] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "1c5936948a84476fb0dcc1fa2d895740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:39.759929  8059 raft_consensus.cc:359] T 9eeed88ecdc244a98599a38459ae66b8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:39.761441  8059 raft_consensus.cc:385] T 9eeed88ecdc244a98599a38459ae66b8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.761741  8059 raft_consensus.cc:740] T 9eeed88ecdc244a98599a38459ae66b8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.762717  8059 consensus_queue.cc:260] T 9eeed88ecdc244a98599a38459ae66b8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:39.764442  7830 leader_election.cc:304] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690
I20260709 13:16:39.765946  8060 tablet_bootstrap.cc:654] T afc39d65d52c48e3a959c8876930ab07 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.760528  8064 tablet_bootstrap.cc:492] T 8b505df72528474496f1a81ffa9ad0a6 P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:39.771338  8153 raft_consensus.cc:2749] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:39.773622  8059 ts_tablet_manager.cc:1434] T 9eeed88ecdc244a98599a38459ae66b8 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.000s
I20260709 13:16:39.774456  7866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceaecfbd6ac84206af71ba2b5fe22259" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:39.774791  8059 tablet_bootstrap.cc:492] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:39.775286  7866 raft_consensus.cc:2393] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in current term 1: Already voted for candidate 1c5936948a84476fb0dcc1fa2d895740 in this term.
I20260709 13:16:39.775784  8063 tablet_bootstrap.cc:654] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.777163  7758 leader_election.cc:304] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690
I20260709 13:16:39.777967  8157 raft_consensus.cc:2749] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:39.778295  8064 tablet_bootstrap.cc:654] T 8b505df72528474496f1a81ffa9ad0a6 P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.783924  8084 raft_consensus.cc:515] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:39.786375  8084 leader_election.cc:290] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 election: Requested vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:39.787212  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242ac51169564e5e9b95c521387a853b" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:39.787870  7941 raft_consensus.cc:3060] T 242ac51169564e5e9b95c521387a853b P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.790359  8059 tablet_bootstrap.cc:654] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.794436  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242ac51169564e5e9b95c521387a853b" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:39.795070  7792 raft_consensus.cc:3060] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.802189  8060 tablet_bootstrap.cc:492] T afc39d65d52c48e3a959c8876930ab07 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:39.802716  8060 ts_tablet_manager.cc:1403] T afc39d65d52c48e3a959c8876930ab07 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.076s	user 0.014s	sys 0.013s
I20260709 13:16:39.803176  7941 raft_consensus.cc:2468] T 242ac51169564e5e9b95c521387a853b P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 1.
I20260709 13:16:39.806833  7980 leader_election.cc:304] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:39.807617  8084 raft_consensus.cc:2804] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:39.807834  8059 tablet_bootstrap.cc:492] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:39.808146  8084 raft_consensus.cc:697] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690 [term 1 LEADER]: Becoming Leader. State: Replica: c9a569f7d1ad42359002386a73702690, State: Running, Role: LEADER
I20260709 13:16:39.808368  8059 ts_tablet_manager.cc:1403] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.000s
I20260709 13:16:39.809003  8084 consensus_queue.cc:237] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:39.810834  8059 raft_consensus.cc:359] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:39.811367  8059 raft_consensus.cc:385] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.811571  8059 raft_consensus.cc:740] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.812142  8059 consensus_queue.cc:260] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:39.805524  7792 raft_consensus.cc:2468] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 1.
I20260709 13:16:39.805565  8060 raft_consensus.cc:359] T afc39d65d52c48e3a959c8876930ab07 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:39.813329  8060 raft_consensus.cc:385] T afc39d65d52c48e3a959c8876930ab07 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.813601  8060 raft_consensus.cc:740] T afc39d65d52c48e3a959c8876930ab07 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.814282  8060 consensus_queue.cc:260] T afc39d65d52c48e3a959c8876930ab07 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:39.816186  8060 ts_tablet_manager.cc:1434] T afc39d65d52c48e3a959c8876930ab07 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 13:16:39.817957  8059 ts_tablet_manager.cc:1434] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:16:39.818923  8060 tablet_bootstrap.cc:492] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:39.820451  8244 raft_consensus.cc:493] T afc39d65d52c48e3a959c8876930ab07 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.821512  8244 raft_consensus.cc:515] T afc39d65d52c48e3a959c8876930ab07 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:39.823755  8244 leader_election.cc:290] T afc39d65d52c48e3a959c8876930ab07 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:39.825289  8060 tablet_bootstrap.cc:654] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.828718  8059 tablet_bootstrap.cc:492] T d99b23f5044644c1b270bc5afcaf2119 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:39.833256  7687 catalog_manager.cc:5697] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a569f7d1ad42359002386a73702690 (127.30.63.4). New cstate: current_term: 1 leader_uuid: "c9a569f7d1ad42359002386a73702690" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:39.834992  8059 tablet_bootstrap.cc:654] T d99b23f5044644c1b270bc5afcaf2119 P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.844501  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc39d65d52c48e3a959c8876930ab07" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:39.849159  8063 tablet_bootstrap.cc:492] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:39.849908  8063 ts_tablet_manager.cc:1403] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.099s	user 0.008s	sys 0.018s
I20260709 13:16:39.853535  8064 tablet_bootstrap.cc:492] T 8b505df72528474496f1a81ffa9ad0a6 P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:39.850024  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc39d65d52c48e3a959c8876930ab07" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:39.856065  8064 ts_tablet_manager.cc:1403] T 8b505df72528474496f1a81ffa9ad0a6 P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.097s	user 0.024s	sys 0.011s
I20260709 13:16:39.856176  8157 raft_consensus.cc:493] T 9eeed88ecdc244a98599a38459ae66b8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.856417  8153 consensus_queue.cc:1048] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:39.850994  8244 raft_consensus.cc:493] T a8fe051592e64e39905b33d218b96822 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:39.857223  7832 leader_election.cc:343] T afc39d65d52c48e3a959c8876930ab07 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.862529  8064 raft_consensus.cc:359] T 8b505df72528474496f1a81ffa9ad0a6 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:39.864073  8064 raft_consensus.cc:385] T 8b505df72528474496f1a81ffa9ad0a6 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.864500  8064 raft_consensus.cc:740] T 8b505df72528474496f1a81ffa9ad0a6 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.865406  8064 consensus_queue.cc:260] T 8b505df72528474496f1a81ffa9ad0a6 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:39.871069  8064 ts_tablet_manager.cc:1434] T 8b505df72528474496f1a81ffa9ad0a6 P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
W20260709 13:16:39.872717  7830 leader_election.cc:343] T afc39d65d52c48e3a959c8876930ab07 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.873275  7830 leader_election.cc:304] T afc39d65d52c48e3a959c8876930ab07 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:39.858353  8157 raft_consensus.cc:515] T 9eeed88ecdc244a98599a38459ae66b8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:39.875833  8157 leader_election.cc:290] T 9eeed88ecdc244a98599a38459ae66b8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:39.858426  8063 raft_consensus.cc:359] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:39.877764  7866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eeed88ecdc244a98599a38459ae66b8" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:39.878208  8063 raft_consensus.cc:385] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.878525  8063 raft_consensus.cc:740] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.857419  8059 tablet_bootstrap.cc:492] T d99b23f5044644c1b270bc5afcaf2119 P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:39.859352  8244 raft_consensus.cc:515] T a8fe051592e64e39905b33d218b96822 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:39.880220  8059 ts_tablet_manager.cc:1403] T d99b23f5044644c1b270bc5afcaf2119 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.008s
I20260709 13:16:39.881296  8153 raft_consensus.cc:2749] T afc39d65d52c48e3a959c8876930ab07 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:39.881807  8244 leader_election.cc:290] T a8fe051592e64e39905b33d218b96822 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:39.882001  8153 raft_consensus.cc:493] T 8b505df72528474496f1a81ffa9ad0a6 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.882490  8153 raft_consensus.cc:515] T 8b505df72528474496f1a81ffa9ad0a6 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:39.883518  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fe051592e64e39905b33d218b96822" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:39.884169  7941 raft_consensus.cc:2468] T a8fe051592e64e39905b33d218b96822 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 0.
I20260709 13:16:39.884732  8084 raft_consensus.cc:493] T 5ba560db35494ad2b64a9b728d510c1a P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.885221  8084 raft_consensus.cc:515] T 5ba560db35494ad2b64a9b728d510c1a P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:39.886417  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fe051592e64e39905b33d218b96822" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:39.886675  8059 raft_consensus.cc:359] T d99b23f5044644c1b270bc5afcaf2119 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:39.887274  8084 leader_election.cc:290] T 5ba560db35494ad2b64a9b728d510c1a P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:39.879285  8063 consensus_queue.cc:260] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:39.877076  7940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eeed88ecdc244a98599a38459ae66b8" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:39.887640  8059 raft_consensus.cc:385] T d99b23f5044644c1b270bc5afcaf2119 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.888088  8059 raft_consensus.cc:740] T d99b23f5044644c1b270bc5afcaf2119 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.888280  7940 raft_consensus.cc:2393] T 9eeed88ecdc244a98599a38459ae66b8 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in current term 1: Already voted for candidate 1c5936948a84476fb0dcc1fa2d895740 in this term.
I20260709 13:16:39.893754  8153 leader_election.cc:290] T 8b505df72528474496f1a81ffa9ad0a6 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:39.894695  7866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba560db35494ad2b64a9b728d510c1a" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:39.895908  8063 ts_tablet_manager.cc:1434] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.000s
I20260709 13:16:39.896937  8063 tablet_bootstrap.cc:492] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:39.899288  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba560db35494ad2b64a9b728d510c1a" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:39.901072  7792 raft_consensus.cc:2393] T 5ba560db35494ad2b64a9b728d510c1a P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a569f7d1ad42359002386a73702690 in current term 1: Already voted for candidate 1c5936948a84476fb0dcc1fa2d895740 in this term.
I20260709 13:16:39.900956  8059 consensus_queue.cc:260] T d99b23f5044644c1b270bc5afcaf2119 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:39.903465  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b505df72528474496f1a81ffa9ad0a6" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:39.873291  8064 tablet_bootstrap.cc:492] T 4877bb8fb91844ddab1c717b7dec231d P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:39.904757  7978 leader_election.cc:304] T 5ba560db35494ad2b64a9b728d510c1a P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:39.903909  7757 leader_election.cc:304] T 9eeed88ecdc244a98599a38459ae66b8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:39.906510  8120 raft_consensus.cc:3060] T 9eeed88ecdc244a98599a38459ae66b8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.907298  8059 ts_tablet_manager.cc:1434] T d99b23f5044644c1b270bc5afcaf2119 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.003s
I20260709 13:16:39.907604  8013 raft_consensus.cc:2468] T 8b505df72528474496f1a81ffa9ad0a6 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 0.
I20260709 13:16:39.901948  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b505df72528474496f1a81ffa9ad0a6" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:39.908612  8059 tablet_bootstrap.cc:492] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:39.908816  7941 raft_consensus.cc:2468] T 8b505df72528474496f1a81ffa9ad0a6 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 0.
I20260709 13:16:39.910300  8064 tablet_bootstrap.cc:654] T 4877bb8fb91844ddab1c717b7dec231d P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:39.910372  7832 leader_election.cc:343] T a8fe051592e64e39905b33d218b96822 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.911343  7832 leader_election.cc:304] T 8b505df72528474496f1a81ffa9ad0a6 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:39.912184  8153 raft_consensus.cc:2804] T 8b505df72528474496f1a81ffa9ad0a6 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:39.912537  8153 raft_consensus.cc:493] T 8b505df72528474496f1a81ffa9ad0a6 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.912889  8153 raft_consensus.cc:3060] T 8b505df72528474496f1a81ffa9ad0a6 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.913297  8084 raft_consensus.cc:3060] T 5ba560db35494ad2b64a9b728d510c1a P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.916849  8060 tablet_bootstrap.cc:492] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:39.917546  8060 ts_tablet_manager.cc:1403] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.099s	user 0.016s	sys 0.027s
I20260709 13:16:39.920109  8084 raft_consensus.cc:2749] T 5ba560db35494ad2b64a9b728d510c1a P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:39.920926  8153 raft_consensus.cc:515] T 8b505df72528474496f1a81ffa9ad0a6 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:39.921343  8060 raft_consensus.cc:359] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:39.922372  8060 raft_consensus.cc:385] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.922755  8060 raft_consensus.cc:740] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.922657  7832 leader_election.cc:304] T a8fe051592e64e39905b33d218b96822 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: c9a569f7d1ad42359002386a73702690
I20260709 13:16:39.923683  8060 consensus_queue.cc:260] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:39.924858  8153 leader_election.cc:290] T 8b505df72528474496f1a81ffa9ad0a6 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Requested vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:39.925981  8120 raft_consensus.cc:2749] T 9eeed88ecdc244a98599a38459ae66b8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:39.928885  8060 ts_tablet_manager.cc:1434] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.005s
I20260709 13:16:39.931761  8063 tablet_bootstrap.cc:654] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.932602  8060 tablet_bootstrap.cc:492] T ea27688f1e2442e18da64b6f636beaf4 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:39.936952  8247 raft_consensus.cc:493] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.937449  8247 raft_consensus.cc:515] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:39.939571  8247 leader_election.cc:290] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:39.940851  8059 tablet_bootstrap.cc:654] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.941908  8060 tablet_bootstrap.cc:654] T ea27688f1e2442e18da64b6f636beaf4 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.941821  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8725967bab0469eb6a5ed9c6bddf3cb" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
W20260709 13:16:39.944053  7906 leader_election.cc:343] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.945294  8064 tablet_bootstrap.cc:492] T 4877bb8fb91844ddab1c717b7dec231d P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:39.946202  8064 ts_tablet_manager.cc:1403] T 4877bb8fb91844ddab1c717b7dec231d P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.073s	user 0.023s	sys 0.009s
I20260709 13:16:39.950309  8064 raft_consensus.cc:359] T 4877bb8fb91844ddab1c717b7dec231d P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:39.951388  8064 raft_consensus.cc:385] T 4877bb8fb91844ddab1c717b7dec231d P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.952350  8064 raft_consensus.cc:740] T 4877bb8fb91844ddab1c717b7dec231d P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.952426  8063 tablet_bootstrap.cc:492] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:39.953282  8063 ts_tablet_manager.cc:1403] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.057s	user 0.009s	sys 0.009s
I20260709 13:16:39.953183  8064 consensus_queue.cc:260] T 4877bb8fb91844ddab1c717b7dec231d P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:39.954577  8059 tablet_bootstrap.cc:492] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:39.955113  8059 ts_tablet_manager.cc:1403] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.009s
I20260709 13:16:39.955250  8064 ts_tablet_manager.cc:1434] T 4877bb8fb91844ddab1c717b7dec231d P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
W20260709 13:16:39.997366  7832 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:44141, user_credentials={real_user=slave}} blocked reactor thread for 74602.6us
I20260709 13:16:40.002951  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8725967bab0469eb6a5ed9c6bddf3cb" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:40.008213  8064 tablet_bootstrap.cc:492] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:40.009800  8066 raft_consensus.cc:2804] T a8fe051592e64e39905b33d218b96822 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:40.010733  8066 raft_consensus.cc:493] T a8fe051592e64e39905b33d218b96822 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.011268  8066 raft_consensus.cc:3060] T a8fe051592e64e39905b33d218b96822 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:40.011859  7940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b505df72528474496f1a81ffa9ad0a6" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:40.013024  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b505df72528474496f1a81ffa9ad0a6" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:40.014027  8013 raft_consensus.cc:3060] T 8b505df72528474496f1a81ffa9ad0a6 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:40.018170  8120 raft_consensus.cc:493] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.013062  7940 raft_consensus.cc:3060] T 8b505df72528474496f1a81ffa9ad0a6 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:40.019174  8120 raft_consensus.cc:515] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:40.036564  8136 consensus_queue.cc:1048] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:40.041157  8060 tablet_bootstrap.cc:492] T ea27688f1e2442e18da64b6f636beaf4 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:40.050299  8060 ts_tablet_manager.cc:1403] T ea27688f1e2442e18da64b6f636beaf4 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.118s	user 0.018s	sys 0.008s
I20260709 13:16:40.071641  8120 leader_election.cc:290] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:40.073145  8063 raft_consensus.cc:359] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:40.076879  8063 raft_consensus.cc:385] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:40.077272  8063 raft_consensus.cc:740] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:40.078063  8063 consensus_queue.cc:260] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
W20260709 13:16:40.078958  7904 leader_election.cc:343] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:40.079711  7904 leader_election.cc:304] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690
I20260709 13:16:40.086246  8247 raft_consensus.cc:2749] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:40.079737  8059 raft_consensus.cc:359] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:40.088093  8059 raft_consensus.cc:385] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:40.088418  8059 raft_consensus.cc:740] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:40.096498  8059 consensus_queue.cc:260] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:40.106182  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878f83ec036345f69ff96a6b46613485" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:40.109035  8059 ts_tablet_manager.cc:1434] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.154s	user 0.007s	sys 0.004s
I20260709 13:16:40.112181  8153 raft_consensus.cc:493] T d99b23f5044644c1b270bc5afcaf2119 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.113180  8153 raft_consensus.cc:515] T d99b23f5044644c1b270bc5afcaf2119 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:40.116045  8153 leader_election.cc:290] T d99b23f5044644c1b270bc5afcaf2119 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:40.116671  8156 consensus_queue.cc:1048] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:16:40.118512  8156 consensus_queue.cc:1048] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:40.121851  7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99b23f5044644c1b270bc5afcaf2119" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:40.122840  7789 raft_consensus.cc:2468] T d99b23f5044644c1b270bc5afcaf2119 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 0.
I20260709 13:16:40.126103  8066 raft_consensus.cc:515] T a8fe051592e64e39905b33d218b96822 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:40.129530  7790 raft_consensus.cc:3060] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:40.130055  8247 raft_consensus.cc:493] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.130630  8247 raft_consensus.cc:515] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:40.099615  8084 consensus_queue.cc:1048] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.041s
I20260709 13:16:40.137537  8059 tablet_bootstrap.cc:492] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:40.137589  8247 leader_election.cc:290] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:40.144815  8155 consensus_queue.cc:1048] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:40.145562  7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99b23f5044644c1b270bc5afcaf2119" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:40.146327  7789 raft_consensus.cc:2468] T d99b23f5044644c1b270bc5afcaf2119 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 0.
I20260709 13:16:40.147953  7904 leader_election.cc:304] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:16:40.149106  8247 raft_consensus.cc:2804] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:40.149389  7866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99b23f5044644c1b270bc5afcaf2119" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:40.149582  8247 raft_consensus.cc:493] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.150120  8247 raft_consensus.cc:3060] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:40.153403  8060 raft_consensus.cc:359] T ea27688f1e2442e18da64b6f636beaf4 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:40.153682  7830 leader_election.cc:304] T d99b23f5044644c1b270bc5afcaf2119 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 
I20260709 13:16:40.154212  8060 raft_consensus.cc:385] T ea27688f1e2442e18da64b6f636beaf4 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:40.154590  8060 raft_consensus.cc:740] T ea27688f1e2442e18da64b6f636beaf4 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:40.165228  8063 ts_tablet_manager.cc:1434] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.211s	user 0.008s	sys 0.003s
I20260709 13:16:40.167359  8063 tablet_bootstrap.cc:492] T ea27688f1e2442e18da64b6f636beaf4 P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:40.170261  8247 raft_consensus.cc:515] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:40.172995  8244 consensus_queue.cc:1048] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:40.176214  7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99b23f5044644c1b270bc5afcaf2119" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:40.176935  7787 raft_consensus.cc:3060] T d99b23f5044644c1b270bc5afcaf2119 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:40.180989  8084 raft_consensus.cc:493] T 4877bb8fb91844ddab1c717b7dec231d P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.150094  7866 raft_consensus.cc:2468] T d99b23f5044644c1b270bc5afcaf2119 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 0.
I20260709 13:16:40.182329  8084 raft_consensus.cc:515] T 4877bb8fb91844ddab1c717b7dec231d P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:40.184985  8243 raft_consensus.cc:2804] T d99b23f5044644c1b270bc5afcaf2119 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:40.174642  8244 consensus_queue.cc:1048] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:16:40.188248  8243 raft_consensus.cc:493] T d99b23f5044644c1b270bc5afcaf2119 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.188809  8243 raft_consensus.cc:3060] T d99b23f5044644c1b270bc5afcaf2119 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:40.195984  8084 leader_election.cc:290] T 4877bb8fb91844ddab1c717b7dec231d P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:40.197223  7788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4877bb8fb91844ddab1c717b7dec231d" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:40.199209  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4877bb8fb91844ddab1c717b7dec231d" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:40.196133  8013 raft_consensus.cc:2468] T 8b505df72528474496f1a81ffa9ad0a6 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 1.
I20260709 13:16:40.155438  8060 consensus_queue.cc:260] T ea27688f1e2442e18da64b6f636beaf4 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
W20260709 13:16:40.202559  7832 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:44141, user_credentials={real_user=slave}} blocked reactor thread for 116425us
I20260709 13:16:40.229671  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99b23f5044644c1b270bc5afcaf2119" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:40.230561  7941 raft_consensus.cc:2393] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c5936948a84476fb0dcc1fa2d895740 in current term 1: Already voted for candidate 7de07e50a1714f5d9055bb4b86655200 in this term.
I20260709 13:16:40.232805  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fe051592e64e39905b33d218b96822" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:40.233546  7941 raft_consensus.cc:3060] T a8fe051592e64e39905b33d218b96822 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:40.236754  8015 raft_consensus.cc:3060] T 4877bb8fb91844ddab1c717b7dec231d P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:40.253795  8066 leader_election.cc:290] T a8fe051592e64e39905b33d218b96822 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Requested vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:40.260289  7980 leader_election.cc:304] T 4877bb8fb91844ddab1c717b7dec231d P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:40.256249  8064 tablet_bootstrap.cc:654] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:40.288098  8060 ts_tablet_manager.cc:1434] T ea27688f1e2442e18da64b6f636beaf4 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.218s	user 0.004s	sys 0.004s
I20260709 13:16:40.287727  8153 consensus_queue.cc:1048] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:16:40.303098  8247 leader_election.cc:290] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Requested vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:40.320775  7787 raft_consensus.cc:2468] T d99b23f5044644c1b270bc5afcaf2119 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 1.
I20260709 13:16:40.326141  7866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99b23f5044644c1b270bc5afcaf2119" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:40.326232  8063 tablet_bootstrap.cc:654] T ea27688f1e2442e18da64b6f636beaf4 P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:40.312826  7940 raft_consensus.cc:2468] T 8b505df72528474496f1a81ffa9ad0a6 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 1.
I20260709 13:16:40.331776  7863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878f83ec036345f69ff96a6b46613485" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:40.343166  8060 tablet_bootstrap.cc:492] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:40.351787  8059 tablet_bootstrap.cc:654] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:40.361089  7904 leader_election.cc:304] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:16:40.364326  8153 raft_consensus.cc:493] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.365286  8247 raft_consensus.cc:2804] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:16:40.382154  8273 log.cc:927] Time spent T 5ba560db35494ad2b64a9b728d510c1a P 59fcc1f631f642d6a7cf2d772ab1eba7: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
W20260709 13:16:40.385754  7737 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:40.398355  8065 raft_consensus.cc:493] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.398958  8065 raft_consensus.cc:515] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
W20260709 13:16:40.386089  7981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:45491, user_credentials={real_user=slave}} blocked reactor thread for 278154us
I20260709 13:16:40.381454  8243 raft_consensus.cc:515] T d99b23f5044644c1b270bc5afcaf2119 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:40.393673  8247 raft_consensus.cc:697] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Becoming Leader. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Running, Role: LEADER
I20260709 13:16:40.412655  8065 leader_election.cc:290] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:40.412880  8268 consensus_queue.cc:1048] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:40.414255  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8725967bab0469eb6a5ed9c6bddf3cb" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:40.416741  8243 leader_election.cc:290] T d99b23f5044644c1b270bc5afcaf2119 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Requested vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
W20260709 13:16:40.418232  7757 leader_election.cc:343] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:40.419988  8060 tablet_bootstrap.cc:654] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:40.421332  7832 leader_election.cc:304] T 8b505df72528474496f1a81ffa9ad0a6 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:40.422645  7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8725967bab0469eb6a5ed9c6bddf3cb" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:40.424185  8244 consensus_queue.cc:1048] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:40.425788  8244 raft_consensus.cc:2804] T 8b505df72528474496f1a81ffa9ad0a6 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:40.426223  8244 raft_consensus.cc:697] T 8b505df72528474496f1a81ffa9ad0a6 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Becoming Leader. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:16:40.426975  7941 raft_consensus.cc:2468] T a8fe051592e64e39905b33d218b96822 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 1.
I20260709 13:16:40.427340  8244 consensus_queue.cc:237] T 8b505df72528474496f1a81ffa9ad0a6 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:40.428784  7791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99b23f5044644c1b270bc5afcaf2119" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:40.429939  7791 raft_consensus.cc:2393] T d99b23f5044644c1b270bc5afcaf2119 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c5936948a84476fb0dcc1fa2d895740 in current term 1: Already voted for candidate 7de07e50a1714f5d9055bb4b86655200 in this term.
I20260709 13:16:40.431770  8163 consensus_queue.cc:1048] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:40.433053  8084 raft_consensus.cc:2749] T 4877bb8fb91844ddab1c717b7dec231d P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:40.411151  8247 consensus_queue.cc:237] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:40.417443  7866 raft_consensus.cc:2393] T d99b23f5044644c1b270bc5afcaf2119 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7de07e50a1714f5d9055bb4b86655200 in current term 1: Already voted for candidate 1c5936948a84476fb0dcc1fa2d895740 in this term.
I20260709 13:16:40.423619  7937 raft_consensus.cc:2468] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 0.
I20260709 13:16:40.454605  8153 raft_consensus.cc:515] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:40.457908  8153 leader_election.cc:290] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:40.467804  7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06dd732d5f194c5f8bacb0d12d551212" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:40.476428  7757 leader_election.cc:304] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: c9a569f7d1ad42359002386a73702690
W20260709 13:16:40.496760  7830 leader_election.cc:343] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:40.524044  8065 raft_consensus.cc:2804] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:16:40.530030  7832 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:44141, user_credentials={real_user=slave}} blocked reactor thread for 100211us
I20260709 13:16:40.545035  8059 tablet_bootstrap.cc:492] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:40.545642  8059 ts_tablet_manager.cc:1403] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.408s	user 0.023s	sys 0.012s
W20260709 13:16:40.529489  7757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:44141, user_credentials={real_user=slave}} blocked reactor thread for 53167.4us
W20260709 13:16:40.550815  7907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:45491, user_credentials={real_user=slave}} blocked reactor thread for 105613us
I20260709 13:16:40.551509  8064 tablet_bootstrap.cc:492] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:40.552083  8064 ts_tablet_manager.cc:1403] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.545s	user 0.026s	sys 0.001s
I20260709 13:16:40.536878  8065 raft_consensus.cc:493] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.553058  8065 raft_consensus.cc:3060] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:40.573954  8059 raft_consensus.cc:359] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:40.574769  8059 raft_consensus.cc:385] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:40.575047  8059 raft_consensus.cc:740] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:40.575474  8065 raft_consensus.cc:515] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:40.577435  8064 raft_consensus.cc:359] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:40.585103  8064 raft_consensus.cc:385] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:40.585093  8060 tablet_bootstrap.cc:492] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:40.586521  8060 ts_tablet_manager.cc:1403] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.256s	user 0.026s	sys 0.007s
I20260709 13:16:40.579243  8059 consensus_queue.cc:260] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:40.585561  8064 raft_consensus.cc:740] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:40.605005  8063 tablet_bootstrap.cc:492] T ea27688f1e2442e18da64b6f636beaf4 P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:40.605609  8063 ts_tablet_manager.cc:1403] T ea27688f1e2442e18da64b6f636beaf4 P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.439s	user 0.017s	sys 0.019s
I20260709 13:16:40.606998  8064 consensus_queue.cc:260] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:40.613075  8059 ts_tablet_manager.cc:1434] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.067s	user 0.010s	sys 0.000s
I20260709 13:16:40.614651  8059 tablet_bootstrap.cc:492] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:40.620612  8275 consensus_queue.cc:1048] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:16:40.623740  8063 raft_consensus.cc:359] T ea27688f1e2442e18da64b6f636beaf4 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:40.624884  8063 raft_consensus.cc:385] T ea27688f1e2442e18da64b6f636beaf4 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:40.625222  8063 raft_consensus.cc:740] T ea27688f1e2442e18da64b6f636beaf4 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
W20260709 13:16:40.611269  7832 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:44141, user_credentials={real_user=slave}} blocked reactor thread for 44599.6us
I20260709 13:16:40.638669  8012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8725967bab0469eb6a5ed9c6bddf3cb" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:40.639350  8012 raft_consensus.cc:3060] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:40.639698  8060 raft_consensus.cc:359] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:40.640434  8060 raft_consensus.cc:385] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:40.643363  8060 raft_consensus.cc:740] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:40.644208  8060 consensus_queue.cc:260] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:40.630802  7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8725967bab0469eb6a5ed9c6bddf3cb" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:40.644903  8063 consensus_queue.cc:260] T ea27688f1e2442e18da64b6f636beaf4 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:40.647308  8063 ts_tablet_manager.cc:1434] T ea27688f1e2442e18da64b6f636beaf4 P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.002s
I20260709 13:16:40.647517  8059 tablet_bootstrap.cc:654] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:40.637988  7832 leader_election.cc:304] T a8fe051592e64e39905b33d218b96822 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:16:40.632081  8064 ts_tablet_manager.cc:1434] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.080s	user 0.007s	sys 0.004s
W20260709 13:16:40.635409  8286 log.cc:927] Time spent T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7: Append to log took a long time: real 0.062s	user 0.002s	sys 0.000s
I20260709 13:16:40.651489  8060 ts_tablet_manager.cc:1434] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.000s
I20260709 13:16:40.652082  7758 leader_election.cc:304] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:40.652940  8060 tablet_bootstrap.cc:492] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:40.654999  8163 raft_consensus.cc:2804] T a8fe051592e64e39905b33d218b96822 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:40.655534  8163 raft_consensus.cc:697] T a8fe051592e64e39905b33d218b96822 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Becoming Leader. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:16:40.653420  8063 tablet_bootstrap.cc:492] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
W20260709 13:16:40.653690  8287 log.cc:927] Time spent T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200: Append to log took a long time: real 0.082s	user 0.002s	sys 0.000s
I20260709 13:16:40.645381  7936 raft_consensus.cc:3060] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:40.657847  8119 raft_consensus.cc:2749] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:40.664971  8064 tablet_bootstrap.cc:492] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:40.655009  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fe051592e64e39905b33d218b96822" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:40.656468  8163 consensus_queue.cc:237] T a8fe051592e64e39905b33d218b96822 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:40.656477  8282 consensus_queue.cc:1048] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:16:40.675568  8064 tablet_bootstrap.cc:654] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:40.631699  8065 leader_election.cc:290] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Requested vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
W20260709 13:16:40.677014  8285 log.cc:927] Time spent T 7141f7bef8234a56bdbb17df0b302a75 P 1c5936948a84476fb0dcc1fa2d895740: Append to log took a long time: real 0.104s	user 0.002s	sys 0.000s
I20260709 13:16:40.678426  8063 tablet_bootstrap.cc:654] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:40.685391  7936 raft_consensus.cc:2468] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 1.
I20260709 13:16:40.686141  8012 raft_consensus.cc:2468] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 1.
I20260709 13:16:40.700234  7757 leader_election.cc:304] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:40.700506  7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99b23f5044644c1b270bc5afcaf2119" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:40.713876  8065 raft_consensus.cc:2804] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:40.714442  8065 raft_consensus.cc:697] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:16:40.715301  8065 consensus_queue.cc:237] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:40.715754  8244 raft_consensus.cc:493] T ea27688f1e2442e18da64b6f636beaf4 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.716275  8244 raft_consensus.cc:515] T ea27688f1e2442e18da64b6f636beaf4 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:40.718374  8244 leader_election.cc:290] T ea27688f1e2442e18da64b6f636beaf4 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:40.722290  8014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea27688f1e2442e18da64b6f636beaf4" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:40.722970  7832 leader_election.cc:304] T d99b23f5044644c1b270bc5afcaf2119 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:40.724367  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea27688f1e2442e18da64b6f636beaf4" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:40.725147  7941 raft_consensus.cc:2468] T ea27688f1e2442e18da64b6f636beaf4 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 0.
I20260709 13:16:40.725622  8059 tablet_bootstrap.cc:492] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:40.731941  8059 ts_tablet_manager.cc:1403] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.118s	user 0.015s	sys 0.000s
I20260709 13:16:40.740298  8244 raft_consensus.cc:2749] T d99b23f5044644c1b270bc5afcaf2119 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:40.748226  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06dd732d5f194c5f8bacb0d12d551212" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:40.760530  8064 tablet_bootstrap.cc:492] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:40.761389  8064 ts_tablet_manager.cc:1403] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.097s	user 0.018s	sys 0.001s
W20260709 13:16:40.762864  7832 leader_election.cc:343] T a8fe051592e64e39905b33d218b96822 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:40.766105  7832 leader_election.cc:343] T ea27688f1e2442e18da64b6f636beaf4 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:40.771545  7832 leader_election.cc:304] T ea27688f1e2442e18da64b6f636beaf4 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: c9a569f7d1ad42359002386a73702690
I20260709 13:16:40.772449  8243 raft_consensus.cc:2804] T ea27688f1e2442e18da64b6f636beaf4 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:40.772877  8243 raft_consensus.cc:493] T ea27688f1e2442e18da64b6f636beaf4 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.773216  8243 raft_consensus.cc:3060] T ea27688f1e2442e18da64b6f636beaf4 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:40.778846  8060 tablet_bootstrap.cc:654] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:40.788415  8064 raft_consensus.cc:359] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:40.789430  8064 raft_consensus.cc:385] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:40.790494  8063 tablet_bootstrap.cc:492] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:40.791049  8063 ts_tablet_manager.cc:1403] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.143s	user 0.017s	sys 0.013s
I20260709 13:16:40.789649  8064 raft_consensus.cc:740] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:40.791913  8064 consensus_queue.cc:260] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:40.793708  8064 ts_tablet_manager.cc:1434] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:16:40.794737  8064 tablet_bootstrap.cc:492] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:40.794953  8063 raft_consensus.cc:359] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:40.795710  8063 raft_consensus.cc:385] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:40.795981  8063 raft_consensus.cc:740] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:40.797254  8063 consensus_queue.cc:260] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:40.798806  8059 raft_consensus.cc:359] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:40.799573  8059 raft_consensus.cc:385] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:40.799818  8059 raft_consensus.cc:740] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
W20260709 13:16:40.797281  7832 leader_election.cc:343] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:40.803303  8064 tablet_bootstrap.cc:654] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:40.803634  7832 leader_election.cc:304] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690
I20260709 13:16:40.805202  8163 raft_consensus.cc:2749] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:40.805523  8059 consensus_queue.cc:260] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:40.810846  8059 ts_tablet_manager.cc:1434] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.000s
I20260709 13:16:40.813288  8281 raft_consensus.cc:493] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.813592  8063 ts_tablet_manager.cc:1434] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:16:40.813824  8281 raft_consensus.cc:515] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:40.814704  8063 tablet_bootstrap.cc:492] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:40.816237  8281 leader_election.cc:290] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:40.817512  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc39d65d52c48e3a959c8876930ab07" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:40.819887  7862 raft_consensus.cc:2468] T afc39d65d52c48e3a959c8876930ab07 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 0.
I20260709 13:16:40.820886  7687 catalog_manager.cc:5697] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "7de07e50a1714f5d9055bb4b86655200" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:40.811502  8243 raft_consensus.cc:515] T ea27688f1e2442e18da64b6f636beaf4 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:40.822969  7907 leader_election.cc:304] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:16:40.823915  7791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc39d65d52c48e3a959c8876930ab07" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:40.824436  8059 tablet_bootstrap.cc:492] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:40.828148  8063 tablet_bootstrap.cc:654] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:40.828284  7904 leader_election.cc:343] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:40.830117  8243 leader_election.cc:290] T ea27688f1e2442e18da64b6f636beaf4 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Requested vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:40.829393  8281 raft_consensus.cc:2804] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:40.834336  8059 tablet_bootstrap.cc:654] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:40.834714  8281 raft_consensus.cc:493] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.835176  8281 raft_consensus.cc:3060] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:40.840994  7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea27688f1e2442e18da64b6f636beaf4" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:40.842653  7936 raft_consensus.cc:3060] T ea27688f1e2442e18da64b6f636beaf4 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:40.844521  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea27688f1e2442e18da64b6f636beaf4" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
W20260709 13:16:40.849002  7832 leader_election.cc:343] T ea27688f1e2442e18da64b6f636beaf4 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:40.851671  8064 tablet_bootstrap.cc:492] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:40.852438  8064 ts_tablet_manager.cc:1403] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.058s	user 0.006s	sys 0.006s
I20260709 13:16:40.856280  8064 raft_consensus.cc:359] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:40.858412  8064 raft_consensus.cc:385] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:40.858696  8064 raft_consensus.cc:740] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:40.859338  8059 tablet_bootstrap.cc:492] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:40.859838  8059 ts_tablet_manager.cc:1403] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.013s
I20260709 13:16:40.859495  8064 consensus_queue.cc:260] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:40.859983  8060 tablet_bootstrap.cc:492] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:40.860531  8060 ts_tablet_manager.cc:1403] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.208s	user 0.018s	sys 0.005s
I20260709 13:16:40.861996  8064 ts_tablet_manager.cc:1434] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:16:40.862775  8059 raft_consensus.cc:359] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:40.863476  8059 raft_consensus.cc:385] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:40.863780  8059 raft_consensus.cc:740] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:40.864560  8059 consensus_queue.cc:260] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:40.863170  8064 tablet_bootstrap.cc:492] T a8fe051592e64e39905b33d218b96822 P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:40.867517  8060 raft_consensus.cc:359] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:40.868626  8060 raft_consensus.cc:385] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:40.869172  8059 ts_tablet_manager.cc:1434] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:16:40.869815  8243 consensus_queue.cc:1048] T 8b505df72528474496f1a81ffa9ad0a6 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:40.870323  8059 tablet_bootstrap.cc:492] T afc39d65d52c48e3a959c8876930ab07 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:40.869208  8060 raft_consensus.cc:740] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:40.872655  8060 consensus_queue.cc:260] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:40.875820  8060 ts_tablet_manager.cc:1434] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:16:40.877694  8281 raft_consensus.cc:515] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:40.878228  7936 raft_consensus.cc:2468] T ea27688f1e2442e18da64b6f636beaf4 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 1.
I20260709 13:16:40.888568  8281 leader_election.cc:290] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Requested vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:40.892088  8059 tablet_bootstrap.cc:654] T afc39d65d52c48e3a959c8876930ab07 P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:40.893069  8060 tablet_bootstrap.cc:492] T c265324643494522a597d6dab81e7893 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:40.893859  7791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc39d65d52c48e3a959c8876930ab07" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:40.897009  8064 tablet_bootstrap.cc:654] T a8fe051592e64e39905b33d218b96822 P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:40.897773  7904 leader_election.cc:343] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:40.898151  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc39d65d52c48e3a959c8876930ab07" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:40.898711  7832 leader_election.cc:304] T ea27688f1e2442e18da64b6f636beaf4 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: c9a569f7d1ad42359002386a73702690
I20260709 13:16:40.899029  7862 raft_consensus.cc:3060] T afc39d65d52c48e3a959c8876930ab07 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:40.899843  8243 raft_consensus.cc:2804] T ea27688f1e2442e18da64b6f636beaf4 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:40.900341  8243 raft_consensus.cc:697] T ea27688f1e2442e18da64b6f636beaf4 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Becoming Leader. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:16:40.901721  8243 consensus_queue.cc:237] T ea27688f1e2442e18da64b6f636beaf4 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:40.902390  8063 tablet_bootstrap.cc:492] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:40.903021  8063 ts_tablet_manager.cc:1403] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.089s	user 0.015s	sys 0.007s
I20260709 13:16:40.906332  8063 raft_consensus.cc:359] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:40.907241  8063 raft_consensus.cc:385] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:40.907579  8063 raft_consensus.cc:740] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:40.908651  8063 consensus_queue.cc:260] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:40.917286  8063 ts_tablet_manager.cc:1434] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 13:16:40.918480  8063 tablet_bootstrap.cc:492] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:40.921739  8060 tablet_bootstrap.cc:654] T c265324643494522a597d6dab81e7893 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:40.929265  7862 raft_consensus.cc:2468] T afc39d65d52c48e3a959c8876930ab07 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 1.
I20260709 13:16:40.931675  8063 tablet_bootstrap.cc:654] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:40.934126  8059 tablet_bootstrap.cc:492] T afc39d65d52c48e3a959c8876930ab07 P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:40.934640  8059 ts_tablet_manager.cc:1403] T afc39d65d52c48e3a959c8876930ab07 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.065s	user 0.020s	sys 0.001s
I20260709 13:16:40.935475  8163 consensus_queue.cc:1048] T 8b505df72528474496f1a81ffa9ad0a6 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:40.936925  8064 tablet_bootstrap.cc:492] T a8fe051592e64e39905b33d218b96822 P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:40.937538  8064 ts_tablet_manager.cc:1403] T a8fe051592e64e39905b33d218b96822 P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.075s	user 0.014s	sys 0.001s
I20260709 13:16:40.937393  8059 raft_consensus.cc:359] T afc39d65d52c48e3a959c8876930ab07 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:40.938181  8059 raft_consensus.cc:385] T afc39d65d52c48e3a959c8876930ab07 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:40.938460  8059 raft_consensus.cc:740] T afc39d65d52c48e3a959c8876930ab07 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:40.933818  8281 consensus_queue.cc:1048] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:40.942298  8059 consensus_queue.cc:260] T afc39d65d52c48e3a959c8876930ab07 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:40.944927  8064 raft_consensus.cc:359] T a8fe051592e64e39905b33d218b96822 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:40.945683  8064 raft_consensus.cc:385] T a8fe051592e64e39905b33d218b96822 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:40.945475  7907 leader_election.cc:304] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:40.946079  8064 raft_consensus.cc:740] T a8fe051592e64e39905b33d218b96822 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:40.946878  8059 ts_tablet_manager.cc:1434] T afc39d65d52c48e3a959c8876930ab07 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:16:40.947046  8281 raft_consensus.cc:2804] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:40.949733  8059 tablet_bootstrap.cc:492] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:40.950968  7690 catalog_manager.cc:5697] T 8b505df72528474496f1a81ffa9ad0a6 P 1c5936948a84476fb0dcc1fa2d895740 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "1c5936948a84476fb0dcc1fa2d895740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:40.954094  7690 catalog_manager.cc:5697] T a8fe051592e64e39905b33d218b96822 P 1c5936948a84476fb0dcc1fa2d895740 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "1c5936948a84476fb0dcc1fa2d895740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:40.946894  8064 consensus_queue.cc:260] T a8fe051592e64e39905b33d218b96822 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:40.964695  8063 tablet_bootstrap.cc:492] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:40.965448  8063 ts_tablet_manager.cc:1403] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.013s
I20260709 13:16:40.969646  8059 tablet_bootstrap.cc:654] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:40.971436  8060 tablet_bootstrap.cc:492] T c265324643494522a597d6dab81e7893 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:40.972201  8060 ts_tablet_manager.cc:1403] T c265324643494522a597d6dab81e7893 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.079s	user 0.017s	sys 0.009s
I20260709 13:16:40.955535  8281 raft_consensus.cc:697] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Becoming Leader. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Running, Role: LEADER
I20260709 13:16:40.980113  8281 consensus_queue.cc:237] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:40.984018  8064 ts_tablet_manager.cc:1434] T a8fe051592e64e39905b33d218b96822 P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.000s
I20260709 13:16:40.985270  8064 tablet_bootstrap.cc:492] T 32f607aa832749eeb8e3b97bab01b9f3 P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:40.988979  8282 raft_consensus.cc:493] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.989656  8282 raft_consensus.cc:515] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:40.990183  7685 catalog_manager.cc:5697] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:40.991983  8282 leader_election.cc:290] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:40.994303  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f607aa832749eeb8e3b97bab01b9f3" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
W20260709 13:16:40.995903  7906 leader_election.cc:343] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:40.997210  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f607aa832749eeb8e3b97bab01b9f3" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:40.998232  7792 raft_consensus.cc:2468] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 0.
I20260709 13:16:41.002430  7904 leader_election.cc:304] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: c9a569f7d1ad42359002386a73702690
I20260709 13:16:41.002750  8063 raft_consensus.cc:359] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:41.003531  8063 raft_consensus.cc:385] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:41.003881  8063 raft_consensus.cc:740] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:41.005431  8063 consensus_queue.cc:260] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:41.003705  8282 raft_consensus.cc:2804] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:41.009696  8282 raft_consensus.cc:493] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.010195  8282 raft_consensus.cc:3060] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.014262  8064 tablet_bootstrap.cc:654] T 32f607aa832749eeb8e3b97bab01b9f3 P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:41.021354  8063 ts_tablet_manager.cc:1434] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.055s	user 0.004s	sys 0.005s
I20260709 13:16:41.022585  8063 tablet_bootstrap.cc:492] T 191eb110a7ae4009a2184d4c3af4f439 P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:41.038412  8282 raft_consensus.cc:515] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:41.041676  8293 raft_consensus.cc:493] T afc39d65d52c48e3a959c8876930ab07 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.042233  8293 raft_consensus.cc:515] T afc39d65d52c48e3a959c8876930ab07 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:41.042929  8060 raft_consensus.cc:359] T c265324643494522a597d6dab81e7893 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:41.043898  8060 raft_consensus.cc:385] T c265324643494522a597d6dab81e7893 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:41.044165  8060 raft_consensus.cc:740] T c265324643494522a597d6dab81e7893 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:41.043237  8281 consensus_queue.cc:1048] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:16:41.046978  8012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f607aa832749eeb8e3b97bab01b9f3" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
W20260709 13:16:41.049613  7906 leader_election.cc:343] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:41.053180  8293 leader_election.cc:290] T afc39d65d52c48e3a959c8876930ab07 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:41.054841  8060 consensus_queue.cc:260] T c265324643494522a597d6dab81e7893 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:41.044929  8282 leader_election.cc:290] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:41.058624  7690 catalog_manager.cc:5697] T ea27688f1e2442e18da64b6f636beaf4 P 1c5936948a84476fb0dcc1fa2d895740 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "1c5936948a84476fb0dcc1fa2d895740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:41.054478  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc39d65d52c48e3a959c8876930ab07" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:41.056071  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc39d65d52c48e3a959c8876930ab07" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:41.063815  8059 tablet_bootstrap.cc:492] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:41.066125  7862 raft_consensus.cc:2393] T afc39d65d52c48e3a959c8876930ab07 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in current term 1: Already voted for candidate 7de07e50a1714f5d9055bb4b86655200 in this term.
I20260709 13:16:41.066226  8059 ts_tablet_manager.cc:1403] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.117s	user 0.008s	sys 0.006s
I20260709 13:16:41.066605  8063 tablet_bootstrap.cc:654] T 191eb110a7ae4009a2184d4c3af4f439 P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:41.067809  8119 raft_consensus.cc:493] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.068317  8119 raft_consensus.cc:515] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:41.056071  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f607aa832749eeb8e3b97bab01b9f3" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:41.069339  8276 raft_consensus.cc:493] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.075212  8276 raft_consensus.cc:515] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:41.077556  8276 leader_election.cc:290] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:41.069190  8059 raft_consensus.cc:359] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:41.081365  8059 raft_consensus.cc:385] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:41.070881  8060 ts_tablet_manager.cc:1434] T c265324643494522a597d6dab81e7893 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.098s	user 0.006s	sys 0.000s
I20260709 13:16:41.073709  8012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed88d7e51364cb28224875b51de8f8e" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:41.085392  8012 raft_consensus.cc:2468] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 0.
I20260709 13:16:41.069697  7792 raft_consensus.cc:3060] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.086234  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceaecfbd6ac84206af71ba2b5fe22259" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:41.087111  7862 raft_consensus.cc:2393] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a569f7d1ad42359002386a73702690 in current term 1: Already voted for candidate 1c5936948a84476fb0dcc1fa2d895740 in this term.
I20260709 13:16:41.072939  7757 leader_election.cc:304] T afc39d65d52c48e3a959c8876930ab07 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:41.088811  8120 raft_consensus.cc:3060] T afc39d65d52c48e3a959c8876930ab07 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.089056  7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceaecfbd6ac84206af71ba2b5fe22259" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:41.090302  7790 raft_consensus.cc:2393] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a569f7d1ad42359002386a73702690 in current term 1: Already voted for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in this term.
I20260709 13:16:41.091956  7978 leader_election.cc:304] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:41.092837  8244 raft_consensus.cc:493] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.093307  8276 raft_consensus.cc:3060] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.093325  8244 raft_consensus.cc:515] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:41.093850  7757 leader_election.cc:304] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:41.095258  8157 raft_consensus.cc:2804] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:41.095721  8244 leader_election.cc:290] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:41.071028  8119 leader_election.cc:290] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:41.095732  8157 raft_consensus.cc:493] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.097291  8157 raft_consensus.cc:3060] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.099012  8012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed88d7e51364cb28224875b51de8f8e" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:41.099860  8012 raft_consensus.cc:2468] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 0.
I20260709 13:16:41.100044  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed88d7e51364cb28224875b51de8f8e" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:41.081733  8059 raft_consensus.cc:740] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:41.105926  8060 tablet_bootstrap.cc:492] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:41.100728  7862 raft_consensus.cc:2468] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 0.
I20260709 13:16:41.107702  8059 consensus_queue.cc:260] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:41.115568  7832 leader_election.cc:304] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:41.119455  8244 raft_consensus.cc:2804] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:41.124616  8244 raft_consensus.cc:493] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.125196  8244 raft_consensus.cc:3060] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.137858  8243 consensus_queue.cc:1048] T a8fe051592e64e39905b33d218b96822 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:41.143635  7686 catalog_manager.cc:5697] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "7de07e50a1714f5d9055bb4b86655200" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:41.146641  8059 ts_tablet_manager.cc:1434] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.080s	user 0.007s	sys 0.001s
I20260709 13:16:41.146880  8157 raft_consensus.cc:515] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:41.148342  8059 tablet_bootstrap.cc:492] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:41.156703  8015 raft_consensus.cc:3060] T a8fe051592e64e39905b33d218b96822 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.164850  8293 consensus_queue.cc:1048] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:41.167311  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed88d7e51364cb28224875b51de8f8e" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:41.168001  8013 raft_consensus.cc:3060] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.157227  8157 leader_election.cc:290] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:41.172827  8243 raft_consensus.cc:493] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.172781  8276 raft_consensus.cc:2749] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:41.184043  8060 tablet_bootstrap.cc:654] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:41.191812  8282 raft_consensus.cc:493] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.192679  8282 raft_consensus.cc:515] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:41.196281  8282 leader_election.cc:290] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:41.198392  8012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ee265806af41dfb77624fadfa04e6b" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:41.202972  7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ee265806af41dfb77624fadfa04e6b" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
W20260709 13:16:41.203390  7906 leader_election.cc:343] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:41.203733  8013 raft_consensus.cc:2468] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 1.
I20260709 13:16:41.203815  7790 raft_consensus.cc:2468] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 0.
I20260709 13:16:41.205502  7904 leader_election.cc:304] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: c9a569f7d1ad42359002386a73702690
I20260709 13:16:41.206789  8282 raft_consensus.cc:2804] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:41.207250  8282 raft_consensus.cc:493] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.207690  8282 raft_consensus.cc:3060] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.144528  7792 raft_consensus.cc:2468] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 1.
I20260709 13:16:41.173401  8120 raft_consensus.cc:2749] T afc39d65d52c48e3a959c8876930ab07 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:41.178786  8243 raft_consensus.cc:515] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:41.173715  8157 consensus_queue.cc:1048] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20260709 13:16:41.218876  8243 leader_election.cc:290] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:41.219619  7904 leader_election.cc:304] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: c9a569f7d1ad42359002386a73702690
I20260709 13:16:41.220513  8281 raft_consensus.cc:2804] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:41.221062  8281 raft_consensus.cc:697] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Becoming Leader. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Running, Role: LEADER
I20260709 13:16:41.221892  8281 consensus_queue.cc:237] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:41.222947  8012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dba482a30c44a58bf79b2a8a890aee" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:41.223132  7938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dba482a30c44a58bf79b2a8a890aee" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
W20260709 13:16:41.224479  7832 leader_election.cc:343] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:41.227974  8064 tablet_bootstrap.cc:492] T 32f607aa832749eeb8e3b97bab01b9f3 P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:41.228557  8064 ts_tablet_manager.cc:1403] T 32f607aa832749eeb8e3b97bab01b9f3 P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.243s	user 0.023s	sys 0.016s
W20260709 13:16:41.233083  7832 leader_election.cc:343] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:41.233729  7832 leader_election.cc:304] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740; no voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690
I20260709 13:16:41.241318  8157 raft_consensus.cc:493] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.242074  8157 raft_consensus.cc:515] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:41.250213  8243 raft_consensus.cc:2749] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:41.253495  7757 leader_election.cc:304] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:41.254052  8010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06dd732d5f194c5f8bacb0d12d551212" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:41.255263  8120 raft_consensus.cc:2804] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:16:41.255643  7757 leader_election.cc:343] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:41.241065  8064 raft_consensus.cc:359] T 32f607aa832749eeb8e3b97bab01b9f3 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:41.256672  8064 raft_consensus.cc:385] T 32f607aa832749eeb8e3b97bab01b9f3 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:41.257055  8064 raft_consensus.cc:740] T 32f607aa832749eeb8e3b97bab01b9f3 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:41.257942  8059 tablet_bootstrap.cc:654] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:41.256186  8120 raft_consensus.cc:697] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:16:41.265671  8157 leader_election.cc:290] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:41.267889  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed88d7e51364cb28224875b51de8f8e" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:41.269052  8120 consensus_queue.cc:237] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:41.270170  8064 consensus_queue.cc:260] T 32f607aa832749eeb8e3b97bab01b9f3 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:41.282613  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed88d7e51364cb28224875b51de8f8e" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:41.283087  8064 ts_tablet_manager.cc:1434] T 32f607aa832749eeb8e3b97bab01b9f3 P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.054s	user 0.004s	sys 0.002s
I20260709 13:16:41.283299  7866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06dd732d5f194c5f8bacb0d12d551212" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:41.290181  7866 raft_consensus.cc:2468] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 0.
I20260709 13:16:41.300117  8278 raft_consensus.cc:493] T a8fe051592e64e39905b33d218b96822 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.300868  8278 raft_consensus.cc:515] T a8fe051592e64e39905b33d218b96822 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:41.215286  8244 raft_consensus.cc:515] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:41.302901  7862 raft_consensus.cc:2393] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in current term 1: Already voted for candidate 1c5936948a84476fb0dcc1fa2d895740 in this term.
I20260709 13:16:41.308832  8153 consensus_queue.cc:1048] T a8fe051592e64e39905b33d218b96822 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:41.313529  8012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed88d7e51364cb28224875b51de8f8e" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:41.314453  8012 raft_consensus.cc:2393] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c5936948a84476fb0dcc1fa2d895740 in current term 1: Already voted for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in this term.
I20260709 13:16:41.318655  7758 leader_election.cc:304] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: c9a569f7d1ad42359002386a73702690
I20260709 13:16:41.319316  8278 leader_election.cc:290] T a8fe051592e64e39905b33d218b96822 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:41.320154  8327 raft_consensus.cc:2804] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:41.320636  8327 raft_consensus.cc:493] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.321398  8327 raft_consensus.cc:3060] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.326334  7791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed88d7e51364cb28224875b51de8f8e" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:41.328434  8244 leader_election.cc:290] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:41.328961  7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fe051592e64e39905b33d218b96822" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:41.331247  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fe051592e64e39905b33d218b96822" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:41.334177  7981 leader_election.cc:304] T a8fe051592e64e39905b33d218b96822 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:41.335974  8064 tablet_bootstrap.cc:492] T ea27688f1e2442e18da64b6f636beaf4 P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:41.366693  7830 leader_election.cc:304] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690
I20260709 13:16:41.369758  8163 raft_consensus.cc:2749] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:41.391669  8282 raft_consensus.cc:515] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:41.421651  8063 tablet_bootstrap.cc:492] T 191eb110a7ae4009a2184d4c3af4f439 P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:41.422410  8063 ts_tablet_manager.cc:1403] T 191eb110a7ae4009a2184d4c3af4f439 P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.400s	user 0.065s	sys 0.119s
I20260709 13:16:41.427347  8011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ee265806af41dfb77624fadfa04e6b" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
W20260709 13:16:41.429981  7906 leader_election.cc:343] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:41.432260  7791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ee265806af41dfb77624fadfa04e6b" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:41.432945  7791 raft_consensus.cc:3060] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.434938  8060 tablet_bootstrap.cc:492] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:41.435526  8060 ts_tablet_manager.cc:1403] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.334s	user 0.032s	sys 0.067s
I20260709 13:16:41.439230  8063 raft_consensus.cc:359] T 191eb110a7ae4009a2184d4c3af4f439 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:41.439957  8063 raft_consensus.cc:385] T 191eb110a7ae4009a2184d4c3af4f439 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:41.440224  8063 raft_consensus.cc:740] T 191eb110a7ae4009a2184d4c3af4f439 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:41.441840  8327 raft_consensus.cc:515] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:41.443539  8060 raft_consensus.cc:359] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:41.443820  8059 tablet_bootstrap.cc:492] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:41.458920  8059 ts_tablet_manager.cc:1403] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.311s	user 0.031s	sys 0.013s
I20260709 13:16:41.463027  8278 raft_consensus.cc:493] T 32f607aa832749eeb8e3b97bab01b9f3 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.463666  8278 raft_consensus.cc:515] T 32f607aa832749eeb8e3b97bab01b9f3 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:41.467633  7939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f607aa832749eeb8e3b97bab01b9f3" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:41.474366  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f607aa832749eeb8e3b97bab01b9f3" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:41.475303  7792 raft_consensus.cc:2393] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a569f7d1ad42359002386a73702690 in current term 1: Already voted for candidate 7de07e50a1714f5d9055bb4b86655200 in this term.
I20260709 13:16:41.476693  7978 leader_election.cc:304] T 32f607aa832749eeb8e3b97bab01b9f3 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:41.477488  8059 raft_consensus.cc:359] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:41.444866  8011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06dd732d5f194c5f8bacb0d12d551212" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:41.478593  8275 raft_consensus.cc:3060] T 32f607aa832749eeb8e3b97bab01b9f3 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.481547  8278 leader_election.cc:290] T 32f607aa832749eeb8e3b97bab01b9f3 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:41.483891  8276 raft_consensus.cc:2749] T a8fe051592e64e39905b33d218b96822 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:41.488845  8059 raft_consensus.cc:385] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:41.444952  8282 leader_election.cc:290] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
W20260709 13:16:41.489660  7757 leader_election.cc:343] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:41.489256  8059 raft_consensus.cc:740] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:41.445946  8064 tablet_bootstrap.cc:654] T ea27688f1e2442e18da64b6f636beaf4 P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:41.491300  8059 consensus_queue.cc:260] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:41.446434  7791 raft_consensus.cc:2468] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 1.
I20260709 13:16:41.444257  8060 raft_consensus.cc:385] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:41.494349  8060 raft_consensus.cc:740] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:41.495326  8060 consensus_queue.cc:260] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:41.498310  8060 ts_tablet_manager.cc:1434] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.002s
I20260709 13:16:41.500274  8060 tablet_bootstrap.cc:492] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:41.504240  8059 ts_tablet_manager.cc:1434] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 13:16:41.498982  8275 raft_consensus.cc:2749] T 32f607aa832749eeb8e3b97bab01b9f3 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:41.515262  7904 leader_election.cc:304] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: c9a569f7d1ad42359002386a73702690
I20260709 13:16:41.516177  8282 raft_consensus.cc:2804] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:41.516722  8282 raft_consensus.cc:697] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Becoming Leader. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Running, Role: LEADER
I20260709 13:16:41.517613  8282 consensus_queue.cc:237] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:41.449911  8327 leader_election.cc:290] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:41.476261  7689 catalog_manager.cc:5697] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "7de07e50a1714f5d9055bb4b86655200" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:41.454684  8063 consensus_queue.cc:260] T 191eb110a7ae4009a2184d4c3af4f439 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:41.522979  8063 ts_tablet_manager.cc:1434] T 191eb110a7ae4009a2184d4c3af4f439 P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.100s	user 0.007s	sys 0.000s
I20260709 13:16:41.505436  8059 tablet_bootstrap.cc:492] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:41.523476  7866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06dd732d5f194c5f8bacb0d12d551212" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:41.526252  7866 raft_consensus.cc:3060] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.528931  8163 raft_consensus.cc:493] T c265324643494522a597d6dab81e7893 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.529515  8163 raft_consensus.cc:515] T c265324643494522a597d6dab81e7893 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:41.530928  8063 tablet_bootstrap.cc:492] T 940bca2247d04fb495fba36734ace153 P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:41.531697  8163 leader_election.cc:290] T c265324643494522a597d6dab81e7893 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:41.536935  8060 tablet_bootstrap.cc:654] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:41.536935  7866 raft_consensus.cc:2468] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 1.
I20260709 13:16:41.540706  8120 raft_consensus.cc:493] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.541313  8120 raft_consensus.cc:515] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:41.541453  8247 consensus_queue.cc:1048] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:41.543486  8163 consensus_queue.cc:1048] T ea27688f1e2442e18da64b6f636beaf4 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:41.544428  7939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191eb110a7ae4009a2184d4c3af4f439" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:41.545152  7939 raft_consensus.cc:2468] T 191eb110a7ae4009a2184d4c3af4f439 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 0.
I20260709 13:16:41.546599  7757 leader_election.cc:304] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:16:41.548312  8065 raft_consensus.cc:2804] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:41.548797  8065 raft_consensus.cc:493] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.549218  8065 raft_consensus.cc:3060] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.539892  8063 tablet_bootstrap.cc:654] T 940bca2247d04fb495fba36734ace153 P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:41.550540  8247 consensus_queue.cc:1048] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:41.558130  7939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c265324643494522a597d6dab81e7893" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
W20260709 13:16:41.560711  7832 consensus_peers.cc:597] T ea27688f1e2442e18da64b6f636beaf4 P 1c5936948a84476fb0dcc1fa2d895740 -> Peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Couldn't send request to peer c9a569f7d1ad42359002386a73702690. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:41.560572  8059 tablet_bootstrap.cc:654] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:41.570166  7832 leader_election.cc:343] T c265324643494522a597d6dab81e7893 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:41.576396  8064 tablet_bootstrap.cc:492] T ea27688f1e2442e18da64b6f636beaf4 P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:41.577425  8064 ts_tablet_manager.cc:1403] T ea27688f1e2442e18da64b6f636beaf4 P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.293s	user 0.012s	sys 0.004s
I20260709 13:16:41.583650  7686 catalog_manager.cc:5697] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:41.590489  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c265324643494522a597d6dab81e7893" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:41.597780  8064 raft_consensus.cc:359] T ea27688f1e2442e18da64b6f636beaf4 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:41.598551  8064 raft_consensus.cc:385] T ea27688f1e2442e18da64b6f636beaf4 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:41.598830  8064 raft_consensus.cc:740] T ea27688f1e2442e18da64b6f636beaf4 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:41.599499  8064 consensus_queue.cc:260] T ea27688f1e2442e18da64b6f636beaf4 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:41.588238  8120 leader_election.cc:290] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:41.623885  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191eb110a7ae4009a2184d4c3af4f439" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:41.593137  7758 leader_election.cc:304] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: c9a569f7d1ad42359002386a73702690
I20260709 13:16:41.630115  8119 raft_consensus.cc:2804] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:41.630643  8119 raft_consensus.cc:697] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:16:41.631635  8327 raft_consensus.cc:493] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.631467  8119 consensus_queue.cc:237] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:41.632192  8327 raft_consensus.cc:515] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:41.634457  8327 leader_election.cc:290] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
W20260709 13:16:41.634820  7757 leader_election.cc:343] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:41.639549  8063 tablet_bootstrap.cc:492] T 940bca2247d04fb495fba36734ace153 P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:41.641474  8063 ts_tablet_manager.cc:1403] T 940bca2247d04fb495fba36734ace153 P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.111s	user 0.016s	sys 0.016s
I20260709 13:16:41.648041  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceaecfbd6ac84206af71ba2b5fe22259" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:41.648934  8015 raft_consensus.cc:2468] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 1.
I20260709 13:16:41.650100  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceaecfbd6ac84206af71ba2b5fe22259" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:41.650346  7757 leader_election.cc:304] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:41.650833  7862 raft_consensus.cc:2468] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 1.
I20260709 13:16:41.651324  8327 raft_consensus.cc:2804] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:41.651907  8327 raft_consensus.cc:493] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.652357  8327 raft_consensus.cc:3060] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:41.652501  8065 raft_consensus.cc:515] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:41.662761  8065 leader_election.cc:290] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Requested vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:41.664336  7939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191eb110a7ae4009a2184d4c3af4f439" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:41.665259  7939 raft_consensus.cc:3060] T 191eb110a7ae4009a2184d4c3af4f439 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.670943  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191eb110a7ae4009a2184d4c3af4f439" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
W20260709 13:16:41.672294  7757 leader_election.cc:343] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:41.676424  7939 raft_consensus.cc:2468] T 191eb110a7ae4009a2184d4c3af4f439 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 1.
I20260709 13:16:41.677727  8063 raft_consensus.cc:359] T 940bca2247d04fb495fba36734ace153 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:41.677896  7757 leader_election.cc:304] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: c9a569f7d1ad42359002386a73702690
I20260709 13:16:41.678500  8063 raft_consensus.cc:385] T 940bca2247d04fb495fba36734ace153 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:41.678851  8120 raft_consensus.cc:2804] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:41.679389  8120 raft_consensus.cc:697] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:16:41.680357  8282 consensus_queue.cc:1048] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:41.680262  8120 consensus_queue.cc:237] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:41.678876  8063 raft_consensus.cc:740] T 940bca2247d04fb495fba36734ace153 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:41.676542  7689 catalog_manager.cc:5697] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "7de07e50a1714f5d9055bb4b86655200" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:41.697119  8060 tablet_bootstrap.cc:492] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:41.697835  8060 ts_tablet_manager.cc:1403] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.198s	user 0.029s	sys 0.010s
I20260709 13:16:41.698830  8063 consensus_queue.cc:260] T 940bca2247d04fb495fba36734ace153 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
W20260709 13:16:41.705597  7832 leader_election.cc:343] T c265324643494522a597d6dab81e7893 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:41.706139  7832 leader_election.cc:304] T c265324643494522a597d6dab81e7893 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740; no voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690
I20260709 13:16:41.689792  8327 raft_consensus.cc:515] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
W20260709 13:16:41.713423  7737 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:41.715337  8064 ts_tablet_manager.cc:1434] T ea27688f1e2442e18da64b6f636beaf4 P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.137s	user 0.017s	sys 0.016s
I20260709 13:16:41.707536  8244 raft_consensus.cc:2749] T c265324643494522a597d6dab81e7893 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:41.730633  8059 tablet_bootstrap.cc:492] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:41.731117  8059 ts_tablet_manager.cc:1403] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.226s	user 0.018s	sys 0.002s
I20260709 13:16:41.732036  8063 ts_tablet_manager.cc:1434] T 940bca2247d04fb495fba36734ace153 P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.088s	user 0.006s	sys 0.001s
I20260709 13:16:41.733286  8063 tablet_bootstrap.cc:492] T c265324643494522a597d6dab81e7893 P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:41.739779  8064 tablet_bootstrap.cc:492] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:41.747236  8059 raft_consensus.cc:359] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:41.749234  8059 raft_consensus.cc:385] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:41.749248  8244 raft_consensus.cc:493] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.755306  8059 raft_consensus.cc:740] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:41.755522  8244 raft_consensus.cc:515] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:41.755879  7865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceaecfbd6ac84206af71ba2b5fe22259" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:41.756577  7865 raft_consensus.cc:3060] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:41.757745  8244 leader_election.cc:290] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:41.757992  8059 consensus_queue.cc:260] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:41.759687  7939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932dad2d4cee49e296e9359aa665ef9d" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:41.760263  8293 consensus_queue.cc:1048] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:41.761122  7832 leader_election.cc:343] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:41.753016  8060 raft_consensus.cc:359] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:41.762055  8060 raft_consensus.cc:385] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:41.762408  8060 raft_consensus.cc:740] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:41.754721  8327 leader_election.cc:290] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 2 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:41.763737  8060 consensus_queue.cc:260] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:41.765081  8011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceaecfbd6ac84206af71ba2b5fe22259" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:41.765347  8012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932dad2d4cee49e296e9359aa665ef9d" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:41.765827  8011 raft_consensus.cc:3060] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:41.767374  8063 tablet_bootstrap.cc:654] T c265324643494522a597d6dab81e7893 P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:41.760277  8059 ts_tablet_manager.cc:1434] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.001s
I20260709 13:16:41.775388  8059 tablet_bootstrap.cc:492] T 2e6d18ad10a340e2aa1fba5831e6db57 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:41.777725  8011 raft_consensus.cc:2468] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 2.
I20260709 13:16:41.779881  7757 leader_election.cc:304] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:41.780071  7865 raft_consensus.cc:2468] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 2.
I20260709 13:16:41.782225  8281 consensus_queue.cc:1048] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:41.784410  8327 raft_consensus.cc:2804] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:16:41.784556  7832 leader_election.cc:343] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:41.785247  7832 leader_election.cc:304] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740; no voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690
I20260709 13:16:41.786207  8244 raft_consensus.cc:2749] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:41.787106  8327 raft_consensus.cc:697] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:16:41.788383  8327 consensus_queue.cc:237] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:41.790190  8064 tablet_bootstrap.cc:654] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:41.778329  8060 ts_tablet_manager.cc:1434] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.000s
I20260709 13:16:41.792601  8060 tablet_bootstrap.cc:492] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:41.800494  8060 tablet_bootstrap.cc:654] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:41.801041  8063 tablet_bootstrap.cc:492] T c265324643494522a597d6dab81e7893 P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:41.801700  8063 ts_tablet_manager.cc:1403] T c265324643494522a597d6dab81e7893 P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.069s	user 0.009s	sys 0.004s
I20260709 13:16:41.808326  8064 tablet_bootstrap.cc:492] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:41.808949  8064 ts_tablet_manager.cc:1403] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.082s	user 0.018s	sys 0.000s
I20260709 13:16:41.811734  8064 raft_consensus.cc:359] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:41.812675  8064 raft_consensus.cc:385] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:41.812968  8064 raft_consensus.cc:740] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:41.813057  8063 raft_consensus.cc:359] T c265324643494522a597d6dab81e7893 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:41.813751  8063 raft_consensus.cc:385] T c265324643494522a597d6dab81e7893 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:41.814138  8063 raft_consensus.cc:740] T c265324643494522a597d6dab81e7893 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:41.813783  8064 consensus_queue.cc:260] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:41.814891  8063 consensus_queue.cc:260] T c265324643494522a597d6dab81e7893 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:41.816238  8064 ts_tablet_manager.cc:1434] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:41.817041  8281 raft_consensus.cc:493] T c265324643494522a597d6dab81e7893 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.817647  8281 raft_consensus.cc:515] T c265324643494522a597d6dab81e7893 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:41.817899  8064 tablet_bootstrap.cc:492] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:41.819854  8281 leader_election.cc:290] T c265324643494522a597d6dab81e7893 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:41.822085  8012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c265324643494522a597d6dab81e7893" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:41.822264  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c265324643494522a597d6dab81e7893" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:41.823130  7862 raft_consensus.cc:2468] T c265324643494522a597d6dab81e7893 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 0.
W20260709 13:16:41.823675  7906 leader_election.cc:343] T c265324643494522a597d6dab81e7893 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:41.824919  8063 ts_tablet_manager.cc:1434] T c265324643494522a597d6dab81e7893 P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:16:41.824748  7907 leader_election.cc:304] T c265324643494522a597d6dab81e7893 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: c9a569f7d1ad42359002386a73702690
I20260709 13:16:41.826045  8063 tablet_bootstrap.cc:492] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:41.829260  8281 raft_consensus.cc:2804] T c265324643494522a597d6dab81e7893 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:41.836568  8281 raft_consensus.cc:493] T c265324643494522a597d6dab81e7893 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.837011  8281 raft_consensus.cc:3060] T c265324643494522a597d6dab81e7893 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.840471  8059 tablet_bootstrap.cc:654] T 2e6d18ad10a340e2aa1fba5831e6db57 P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:41.845709  8064 tablet_bootstrap.cc:654] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:41.888221  8244 raft_consensus.cc:493] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.888803  8244 raft_consensus.cc:515] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:41.890909  8244 leader_election.cc:290] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:41.892546  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940bca2247d04fb495fba36734ace153" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:41.893075  7939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940bca2247d04fb495fba36734ace153" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:41.893271  7792 raft_consensus.cc:2468] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 0.
I20260709 13:16:41.893711  7939 raft_consensus.cc:2468] T 940bca2247d04fb495fba36734ace153 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 0.
I20260709 13:16:41.894886  7832 leader_election.cc:304] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:16:41.895977  8163 raft_consensus.cc:2804] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:41.824966  8120 consensus_queue.cc:1048] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.054s
I20260709 13:16:41.896414  8163 raft_consensus.cc:493] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.896916  8163 raft_consensus.cc:3060] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.901516  8064 tablet_bootstrap.cc:492] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:41.902022  8064 ts_tablet_manager.cc:1403] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.084s	user 0.011s	sys 0.008s
I20260709 13:16:41.906252  8063 tablet_bootstrap.cc:654] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:41.908092  8281 raft_consensus.cc:515] T c265324643494522a597d6dab81e7893 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:41.914487  8059 tablet_bootstrap.cc:492] T 2e6d18ad10a340e2aa1fba5831e6db57 P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:41.914959  8059 ts_tablet_manager.cc:1403] T 2e6d18ad10a340e2aa1fba5831e6db57 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.140s	user 0.022s	sys 0.011s
I20260709 13:16:41.916442  8064 raft_consensus.cc:359] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:41.917717  8064 raft_consensus.cc:385] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:41.917992  8064 raft_consensus.cc:740] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:41.918674  8064 consensus_queue.cc:260] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:41.921262  8064 ts_tablet_manager.cc:1434] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.001s
I20260709 13:16:41.922278  8064 tablet_bootstrap.cc:492] T 48ee265806af41dfb77624fadfa04e6b P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:41.930274  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c265324643494522a597d6dab81e7893" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:41.930275  8281 leader_election.cc:290] T c265324643494522a597d6dab81e7893 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Requested vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:41.930955  7862 raft_consensus.cc:3060] T c265324643494522a597d6dab81e7893 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.936123  8060 tablet_bootstrap.cc:492] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:41.936638  8060 ts_tablet_manager.cc:1403] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.144s	user 0.029s	sys 0.035s
I20260709 13:16:41.938933  8011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c265324643494522a597d6dab81e7893" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
W20260709 13:16:41.941061  7906 leader_election.cc:343] T c265324643494522a597d6dab81e7893 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:41.942111  8059 raft_consensus.cc:359] T 2e6d18ad10a340e2aa1fba5831e6db57 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:41.942663  8059 raft_consensus.cc:385] T 2e6d18ad10a340e2aa1fba5831e6db57 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:41.942909  8059 raft_consensus.cc:740] T 2e6d18ad10a340e2aa1fba5831e6db57 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:41.943555  8059 consensus_queue.cc:260] T 2e6d18ad10a340e2aa1fba5831e6db57 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:41.943898  7689 catalog_manager.cc:5697] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:41.953075  8060 raft_consensus.cc:359] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:41.953833  8060 raft_consensus.cc:385] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:41.953858  8013 raft_consensus.cc:3060] T ea27688f1e2442e18da64b6f636beaf4 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.954226  8060 raft_consensus.cc:740] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:41.934264  8163 raft_consensus.cc:515] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:41.954974  8060 consensus_queue.cc:260] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:41.950058  7689 catalog_manager.cc:5697] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:41.959671  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940bca2247d04fb495fba36734ace153" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:41.984375  7792 raft_consensus.cc:3060] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.962136  8163 leader_election.cc:290] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Requested vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:41.963585  7939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940bca2247d04fb495fba36734ace153" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:41.989060  7939 raft_consensus.cc:3060] T 940bca2247d04fb495fba36734ace153 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.964155  7862 raft_consensus.cc:2468] T c265324643494522a597d6dab81e7893 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 1.
I20260709 13:16:41.966132  8059 ts_tablet_manager.cc:1434] T 2e6d18ad10a340e2aa1fba5831e6db57 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.003s
I20260709 13:16:41.992408  8059 tablet_bootstrap.cc:492] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:41.967576  8060 ts_tablet_manager.cc:1434] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:16:41.994356  7907 leader_election.cc:304] T c265324643494522a597d6dab81e7893 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: c9a569f7d1ad42359002386a73702690
I20260709 13:16:41.995128  8060 tablet_bootstrap.cc:492] T ffeb7520452b4edcb0421cee5ab0e516 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:41.995666  8281 raft_consensus.cc:2804] T c265324643494522a597d6dab81e7893 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:41.996245  8281 raft_consensus.cc:697] T c265324643494522a597d6dab81e7893 P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Becoming Leader. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Running, Role: LEADER
I20260709 13:16:41.997118  8281 consensus_queue.cc:237] T c265324643494522a597d6dab81e7893 P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:41.999168  8059 tablet_bootstrap.cc:654] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:41.969302  8064 tablet_bootstrap.cc:654] T 48ee265806af41dfb77624fadfa04e6b P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.006078  7939 raft_consensus.cc:2468] T 940bca2247d04fb495fba36734ace153 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 1.
I20260709 13:16:42.008935  7832 leader_election.cc:304] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:16:42.010929  8337 raft_consensus.cc:2804] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:42.011444  8337 raft_consensus.cc:697] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Becoming Leader. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:16:42.012270  8337 consensus_queue.cc:237] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:42.006249  8060 tablet_bootstrap.cc:654] T ffeb7520452b4edcb0421cee5ab0e516 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.025769  7689 catalog_manager.cc:5697] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 0 to 2, leader changed from <none> to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 2 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:42.029605  7906 consensus_peers.cc:597] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 -> Peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Couldn't send request to peer c9a569f7d1ad42359002386a73702690. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:42.036752  7792 raft_consensus.cc:2468] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 1.
I20260709 13:16:42.039604  8060 tablet_bootstrap.cc:492] T ffeb7520452b4edcb0421cee5ab0e516 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:42.044097  8060 ts_tablet_manager.cc:1403] T ffeb7520452b4edcb0421cee5ab0e516 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.000s
I20260709 13:16:42.046139  8059 tablet_bootstrap.cc:492] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:42.046649  8059 ts_tablet_manager.cc:1403] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.055s	user 0.031s	sys 0.011s
I20260709 13:16:42.047169  8060 raft_consensus.cc:359] T ffeb7520452b4edcb0421cee5ab0e516 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:41.983794  8063 tablet_bootstrap.cc:492] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:42.042462  8064 tablet_bootstrap.cc:492] T 48ee265806af41dfb77624fadfa04e6b P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:42.048377  8064 ts_tablet_manager.cc:1403] T 48ee265806af41dfb77624fadfa04e6b P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.126s	user 0.007s	sys 0.021s
I20260709 13:16:42.051147  8063 ts_tablet_manager.cc:1403] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.225s	user 0.019s	sys 0.006s
I20260709 13:16:42.052196  8060 raft_consensus.cc:385] T ffeb7520452b4edcb0421cee5ab0e516 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.052639  8060 raft_consensus.cc:740] T ffeb7520452b4edcb0421cee5ab0e516 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.055255  7686 catalog_manager.cc:5697] T c265324643494522a597d6dab81e7893 P 7de07e50a1714f5d9055bb4b86655200 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "7de07e50a1714f5d9055bb4b86655200" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:42.058107  8064 raft_consensus.cc:359] T 48ee265806af41dfb77624fadfa04e6b P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:42.060822  8064 raft_consensus.cc:385] T 48ee265806af41dfb77624fadfa04e6b P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.061100  8064 raft_consensus.cc:740] T 48ee265806af41dfb77624fadfa04e6b P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.061981  8064 consensus_queue.cc:260] T 48ee265806af41dfb77624fadfa04e6b P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:42.059002  8063 raft_consensus.cc:359] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:42.063014  8063 raft_consensus.cc:385] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.063345  8063 raft_consensus.cc:740] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.064026  8064 ts_tablet_manager.cc:1434] T 48ee265806af41dfb77624fadfa04e6b P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260709 13:16:42.064090  8063 consensus_queue.cc:260] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:42.065287  8064 tablet_bootstrap.cc:492] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:42.066682  8063 ts_tablet_manager.cc:1434] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:16:42.067901  8063 tablet_bootstrap.cc:492] T 45dba482a30c44a58bf79b2a8a890aee P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:42.068442  7690 catalog_manager.cc:5697] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "1c5936948a84476fb0dcc1fa2d895740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:42.060020  8059 raft_consensus.cc:359] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:42.072798  8059 raft_consensus.cc:385] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.073163  8059 raft_consensus.cc:740] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.073904  8059 consensus_queue.cc:260] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:42.053419  8060 consensus_queue.cc:260] T ffeb7520452b4edcb0421cee5ab0e516 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:42.078895  8060 ts_tablet_manager.cc:1434] T ffeb7520452b4edcb0421cee5ab0e516 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:16:42.080188  8060 tablet_bootstrap.cc:492] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:42.083362  8059 ts_tablet_manager.cc:1434] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:16:42.084539  8059 tablet_bootstrap.cc:492] T ffeb7520452b4edcb0421cee5ab0e516 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:42.089509  8060 tablet_bootstrap.cc:654] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.093044  8064 tablet_bootstrap.cc:654] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.098158  8059 tablet_bootstrap.cc:654] T ffeb7520452b4edcb0421cee5ab0e516 P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.102185  8063 tablet_bootstrap.cc:654] T 45dba482a30c44a58bf79b2a8a890aee P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.110277  8349 raft_consensus.cc:493] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.110874  8349 raft_consensus.cc:515] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:42.112334  8337 raft_consensus.cc:493] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.112918  8337 raft_consensus.cc:515] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:42.117820  8349 leader_election.cc:290] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:42.122198  8337 leader_election.cc:290] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:42.118582  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35a05f13eee42d4bdd19ff8b2b98212" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:42.119530  7791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6d18ad10a340e2aa1fba5831e6db57" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:42.123689  7791 raft_consensus.cc:2468] T 2e6d18ad10a340e2aa1fba5831e6db57 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 0.
I20260709 13:16:42.125447  7978 leader_election.cc:304] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:42.126587  8349 raft_consensus.cc:2804] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:42.119642  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35a05f13eee42d4bdd19ff8b2b98212" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:42.127080  8349 raft_consensus.cc:493] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.121403  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6d18ad10a340e2aa1fba5831e6db57" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:42.127660  8349 raft_consensus.cc:3060] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:42.130669  7830 leader_election.cc:343] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:42.130915  7981 leader_election.cc:343] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:42.131675  7832 leader_election.cc:343] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:42.132177  7832 leader_election.cc:304] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690
I20260709 13:16:42.133167  8337 raft_consensus.cc:2749] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:42.127065  8064 tablet_bootstrap.cc:492] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:42.139061  8064 ts_tablet_manager.cc:1403] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.074s	user 0.015s	sys 0.003s
I20260709 13:16:42.141891  8064 raft_consensus.cc:359] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:42.142715  8064 raft_consensus.cc:385] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.143030  8064 raft_consensus.cc:740] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.143810  8064 consensus_queue.cc:260] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:42.145998  8064 ts_tablet_manager.cc:1434] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:42.145570  8349 raft_consensus.cc:515] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:42.147086  8064 tablet_bootstrap.cc:492] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:42.148819  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6d18ad10a340e2aa1fba5831e6db57" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:42.151978  7792 raft_consensus.cc:3060] T 2e6d18ad10a340e2aa1fba5831e6db57 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.150533  8065 consensus_queue.cc:1048] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:42.153725  8064 tablet_bootstrap.cc:654] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.161279  8120 consensus_queue.cc:1048] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:42.163317  8349 leader_election.cc:290] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 election: Requested vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:42.165225  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6d18ad10a340e2aa1fba5831e6db57" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
W20260709 13:16:42.167095  7981 leader_election.cc:343] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:42.174005  8136 raft_consensus.cc:493] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.183877  8136 raft_consensus.cc:515] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:42.187119  8136 leader_election.cc:290] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
W20260709 13:16:42.173496  7757 consensus_peers.cc:597] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7 -> Peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Couldn't send request to peer c9a569f7d1ad42359002386a73702690. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:42.189666  7791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffeb7520452b4edcb0421cee5ab0e516" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:42.189949  8349 raft_consensus.cc:493] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.190969  8349 raft_consensus.cc:515] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
W20260709 13:16:42.191833  7904 leader_election.cc:343] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:42.142781  8281 consensus_queue.cc:1048] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.050s
I20260709 13:16:42.193607  8344 raft_consensus.cc:493] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.194308  8344 raft_consensus.cc:515] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:42.200026  7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06dd732d5f194c5f8bacb0d12d551212" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:42.202860  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffeb7520452b4edcb0421cee5ab0e516" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:42.203665  7862 raft_consensus.cc:2468] T ffeb7520452b4edcb0421cee5ab0e516 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 0.
I20260709 13:16:42.221952  8344 leader_election.cc:290] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:42.224540  8013 raft_consensus.cc:3060] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.226701  8011 raft_consensus.cc:1275] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Refusing update from remote peer 59fcc1f631f642d6a7cf2d772ab1eba7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:16:42.230684  8120 consensus_queue.cc:1048] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:42.227625  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06dd732d5f194c5f8bacb0d12d551212" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:42.247352  7981 leader_election.cc:304] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:42.261807  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dba482a30c44a58bf79b2a8a890aee" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:42.263211  7862 raft_consensus.cc:2468] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 0.
I20260709 13:16:42.264941  7981 leader_election.cc:304] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:42.265830  7866 raft_consensus.cc:1275] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Refusing update from remote peer 59fcc1f631f642d6a7cf2d772ab1eba7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:16:42.266355  8275 raft_consensus.cc:2804] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:42.266918  8275 raft_consensus.cc:493] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.267366  8275 raft_consensus.cc:3060] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.268345  8293 consensus_queue.cc:1048] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:42.166260  7792 raft_consensus.cc:2468] T 2e6d18ad10a340e2aa1fba5831e6db57 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 1.
I20260709 13:16:42.276131  7978 leader_election.cc:304] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 1c5936948a84476fb0dcc1fa2d895740
I20260709 13:16:42.275970  8349 leader_election.cc:290] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
W20260709 13:16:42.321900  7978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:35503, user_credentials={real_user=slave}} blocked reactor thread for 45893.3us
I20260709 13:16:42.316063  8349 raft_consensus.cc:2804] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:42.348097  8349 raft_consensus.cc:697] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690 [term 1 LEADER]: Becoming Leader. State: Replica: c9a569f7d1ad42359002386a73702690, State: Running, Role: LEADER
I20260709 13:16:42.355197  8349 consensus_queue.cc:237] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:42.345613  7938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dba482a30c44a58bf79b2a8a890aee" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:42.372205  8063 tablet_bootstrap.cc:492] T 45dba482a30c44a58bf79b2a8a890aee P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:42.372808  8063 ts_tablet_manager.cc:1403] T 45dba482a30c44a58bf79b2a8a890aee P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.305s	user 0.033s	sys 0.046s
I20260709 13:16:42.373793  8059 tablet_bootstrap.cc:492] T ffeb7520452b4edcb0421cee5ab0e516 P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:42.374271  8059 ts_tablet_manager.cc:1403] T ffeb7520452b4edcb0421cee5ab0e516 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.290s	user 0.041s	sys 0.056s
I20260709 13:16:42.379580  8060 tablet_bootstrap.cc:492] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:42.380095  8060 ts_tablet_manager.cc:1403] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.300s	user 0.033s	sys 0.051s
I20260709 13:16:42.375732  8063 raft_consensus.cc:359] T 45dba482a30c44a58bf79b2a8a890aee P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:42.381408  8063 raft_consensus.cc:385] T 45dba482a30c44a58bf79b2a8a890aee P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.381716  8063 raft_consensus.cc:740] T 45dba482a30c44a58bf79b2a8a890aee P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.383311  8063 consensus_queue.cc:260] T 45dba482a30c44a58bf79b2a8a890aee P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:42.386957  8063 ts_tablet_manager.cc:1434] T 45dba482a30c44a58bf79b2a8a890aee P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:16:42.386850  7907 leader_election.cc:304] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:42.389009  8063 tablet_bootstrap.cc:492] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:42.387298  8379 raft_consensus.cc:493] T 48ee265806af41dfb77624fadfa04e6b P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.389976  8379 raft_consensus.cc:515] T 48ee265806af41dfb77624fadfa04e6b P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:42.391377  8060 raft_consensus.cc:359] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:42.392068  8379 leader_election.cc:290] T 48ee265806af41dfb77624fadfa04e6b P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:42.387424  8344 raft_consensus.cc:2749] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:42.392045  8060 raft_consensus.cc:385] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.393724  8060 raft_consensus.cc:740] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.394547  8247 raft_consensus.cc:2804] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:42.395579  8247 raft_consensus.cc:493] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.395918  8247 raft_consensus.cc:3060] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.392297  8275 raft_consensus.cc:515] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:42.404784  8060 consensus_queue.cc:260] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:42.414299  8060 ts_tablet_manager.cc:1434] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.003s
I20260709 13:16:42.406276  8275 leader_election.cc:290] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 election: Requested vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:42.415937  8059 raft_consensus.cc:359] T ffeb7520452b4edcb0421cee5ab0e516 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:42.417263  8059 raft_consensus.cc:385] T ffeb7520452b4edcb0421cee5ab0e516 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.418634  8059 raft_consensus.cc:740] T ffeb7520452b4edcb0421cee5ab0e516 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.411604  7866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dba482a30c44a58bf79b2a8a890aee" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:42.419616  8059 consensus_queue.cc:260] T ffeb7520452b4edcb0421cee5ab0e516 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:42.423295  8060 tablet_bootstrap.cc:492] T 2e6d18ad10a340e2aa1fba5831e6db57 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:42.427619  8059 ts_tablet_manager.cc:1434] T ffeb7520452b4edcb0421cee5ab0e516 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 13:16:42.429605  8064 tablet_bootstrap.cc:492] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:42.430034  8064 ts_tablet_manager.cc:1403] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.283s	user 0.073s	sys 0.104s
I20260709 13:16:42.426100  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ee265806af41dfb77624fadfa04e6b" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:42.443241  8382 consensus_queue.cc:1048] T c265324643494522a597d6dab81e7893 P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:42.449569  8293 consensus_queue.cc:1048] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:42.428033  7866 raft_consensus.cc:3060] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.457746  7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ee265806af41dfb77624fadfa04e6b" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:42.458485  8247 raft_consensus.cc:515] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:42.460386  7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dba482a30c44a58bf79b2a8a890aee" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:42.461033  7936 raft_consensus.cc:3060] T 45dba482a30c44a58bf79b2a8a890aee P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.466913  8059 tablet_bootstrap.cc:492] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:42.468735  8063 tablet_bootstrap.cc:654] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.470707  7865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffeb7520452b4edcb0421cee5ab0e516" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
W20260709 13:16:42.431006  8376 log.cc:927] Time spent T 191eb110a7ae4009a2184d4c3af4f439 P 7de07e50a1714f5d9055bb4b86655200: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:16:42.481710  7865 raft_consensus.cc:3060] T ffeb7520452b4edcb0421cee5ab0e516 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.482412  7791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffeb7520452b4edcb0421cee5ab0e516" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:42.483042  7791 raft_consensus.cc:3060] T ffeb7520452b4edcb0421cee5ab0e516 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.485301  8064 raft_consensus.cc:359] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:42.486099  8064 raft_consensus.cc:385] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.486359  8064 raft_consensus.cc:740] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.486994  8064 consensus_queue.cc:260] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:42.491674  8064 ts_tablet_manager.cc:1434] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.002s
I20260709 13:16:42.477407  8247 leader_election.cc:290] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Requested vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:42.518946  8064 tablet_bootstrap.cc:492] T c265324643494522a597d6dab81e7893 P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:42.530297  8059 tablet_bootstrap.cc:654] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.533814  8293 raft_consensus.cc:493] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.534406  8293 raft_consensus.cc:515] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:42.538089  7687 catalog_manager.cc:5697] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a569f7d1ad42359002386a73702690 (127.30.63.4). New cstate: current_term: 1 leader_uuid: "c9a569f7d1ad42359002386a73702690" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:42.550293  7863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b12aa42b0f49a49b24d2433fdca7a8" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
W20260709 13:16:42.553674  7758 leader_election.cc:343] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:42.536473  8293 leader_election.cc:290] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
W20260709 13:16:42.558283  7906 consensus_peers.cc:597] T c265324643494522a597d6dab81e7893 P 7de07e50a1714f5d9055bb4b86655200 -> Peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Couldn't send request to peer c9a569f7d1ad42359002386a73702690. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:42.562916  7980 leader_election.cc:343] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:42.564283  7980 leader_election.cc:304] T 48ee265806af41dfb77624fadfa04e6b P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:42.565843  7866 raft_consensus.cc:2468] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 1.
I20260709 13:16:42.567420  7981 leader_election.cc:304] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:42.567691  8381 raft_consensus.cc:2749] T 48ee265806af41dfb77624fadfa04e6b P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:42.568750  8379 raft_consensus.cc:2804] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:42.569247  8379 raft_consensus.cc:697] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [term 1 LEADER]: Becoming Leader. State: Replica: c9a569f7d1ad42359002386a73702690, State: Running, Role: LEADER
I20260709 13:16:42.570048  8379 consensus_queue.cc:237] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:42.557752  8060 tablet_bootstrap.cc:654] T 2e6d18ad10a340e2aa1fba5831e6db57 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.580655  8064 tablet_bootstrap.cc:654] T c265324643494522a597d6dab81e7893 P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.582777  7865 raft_consensus.cc:2468] T ffeb7520452b4edcb0421cee5ab0e516 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 1.
I20260709 13:16:42.584045  7907 leader_election.cc:304] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:16:42.585045  8247 raft_consensus.cc:2804] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:42.585572  8247 raft_consensus.cc:697] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Becoming Leader. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Running, Role: LEADER
I20260709 13:16:42.586580  8247 consensus_queue.cc:237] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:42.595785  7940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b12aa42b0f49a49b24d2433fdca7a8" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:42.596968  7936 raft_consensus.cc:2468] T 45dba482a30c44a58bf79b2a8a890aee P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 1.
W20260709 13:16:42.597440  7757 leader_election.cc:343] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:42.597894  7757 leader_election.cc:304] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:42.603529  8119 raft_consensus.cc:2749] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:42.603714  7690 catalog_manager.cc:5697] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a569f7d1ad42359002386a73702690 (127.30.63.4). New cstate: current_term: 1 leader_uuid: "c9a569f7d1ad42359002386a73702690" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:42.611435  8013 raft_consensus.cc:3060] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.645555  7791 raft_consensus.cc:2468] T ffeb7520452b4edcb0421cee5ab0e516 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 1.
I20260709 13:16:42.646667  8011 raft_consensus.cc:3060] T 48ee265806af41dfb77624fadfa04e6b P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:42.628831  7981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:45491, user_credentials={real_user=slave}} blocked reactor thread for 60506.7us
I20260709 13:16:42.648099  8386 consensus_queue.cc:1048] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:16:42.652210  7690 catalog_manager.cc:5697] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "7de07e50a1714f5d9055bb4b86655200" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:42.669337  8064 tablet_bootstrap.cc:492] T c265324643494522a597d6dab81e7893 P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:42.669889  8064 ts_tablet_manager.cc:1403] T c265324643494522a597d6dab81e7893 P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.159s	user 0.019s	sys 0.006s
I20260709 13:16:42.671012  8385 consensus_queue.cc:1048] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:42.671773  8063 tablet_bootstrap.cc:492] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:42.672348  8063 ts_tablet_manager.cc:1403] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.284s	user 0.014s	sys 0.007s
I20260709 13:16:42.673115  8059 tablet_bootstrap.cc:492] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:42.673655  8059 ts_tablet_manager.cc:1403] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.212s	user 0.019s	sys 0.002s
I20260709 13:16:42.677776  8059 raft_consensus.cc:359] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:42.678498  8059 raft_consensus.cc:385] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.678819  8059 raft_consensus.cc:740] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.679570  8059 consensus_queue.cc:260] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:42.687345  8060 tablet_bootstrap.cc:492] T 2e6d18ad10a340e2aa1fba5831e6db57 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:42.687930  8060 ts_tablet_manager.cc:1403] T 2e6d18ad10a340e2aa1fba5831e6db57 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.267s	user 0.021s	sys 0.011s
I20260709 13:16:42.697995  8063 raft_consensus.cc:359] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:42.698860  8063 raft_consensus.cc:385] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.699211  8063 raft_consensus.cc:740] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.699937  8063 consensus_queue.cc:260] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:42.700637  8386 raft_consensus.cc:493] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.701154  8386 raft_consensus.cc:515] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:42.703053  8059 ts_tablet_manager.cc:1434] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.001s
I20260709 13:16:42.703667  8386 leader_election.cc:290] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:42.704159  8059 tablet_bootstrap.cc:492] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:42.705500  8063 ts_tablet_manager.cc:1434] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:16:42.708837  8012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569ddc7f4d23481a852ea6ef24d38e31" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:42.711978  8064 raft_consensus.cc:359] T c265324643494522a597d6dab81e7893 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:42.712844  8064 raft_consensus.cc:385] T c265324643494522a597d6dab81e7893 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.713161  8064 raft_consensus.cc:740] T c265324643494522a597d6dab81e7893 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
W20260709 13:16:42.715008  7832 leader_election.cc:343] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:42.714640  8064 consensus_queue.cc:260] T c265324643494522a597d6dab81e7893 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:42.719998  7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569ddc7f4d23481a852ea6ef24d38e31" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:42.721122  8064 ts_tablet_manager.cc:1434] T c265324643494522a597d6dab81e7893 P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.051s	user 0.002s	sys 0.005s
W20260709 13:16:42.721787  7832 leader_election.cc:343] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:42.722645  8064 tablet_bootstrap.cc:492] T f35a05f13eee42d4bdd19ff8b2b98212 P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:42.724242  7832 leader_election.cc:304] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740; no voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690
I20260709 13:16:42.727988  8060 raft_consensus.cc:359] T 2e6d18ad10a340e2aa1fba5831e6db57 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:42.728513  8060 raft_consensus.cc:385] T 2e6d18ad10a340e2aa1fba5831e6db57 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.731024  8063 tablet_bootstrap.cc:492] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:42.728863  8060 raft_consensus.cc:740] T 2e6d18ad10a340e2aa1fba5831e6db57 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.732630  8059 tablet_bootstrap.cc:654] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.727072  8386 raft_consensus.cc:2749] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:16:42.741101  8400 log.cc:927] Time spent T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:16:42.733297  8060 consensus_queue.cc:260] T 2e6d18ad10a340e2aa1fba5831e6db57 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:42.762629  8060 ts_tablet_manager.cc:1434] T 2e6d18ad10a340e2aa1fba5831e6db57 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.000s
I20260709 13:16:42.781052  8063 tablet_bootstrap.cc:654] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.795549  8064 tablet_bootstrap.cc:654] T f35a05f13eee42d4bdd19ff8b2b98212 P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.800479  8060 tablet_bootstrap.cc:492] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:42.800982  8381 raft_consensus.cc:493] T c265324643494522a597d6dab81e7893 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.801326  8392 consensus_queue.cc:1048] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:42.808753  8381 raft_consensus.cc:515] T c265324643494522a597d6dab81e7893 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:42.811214  8381 leader_election.cc:290] T c265324643494522a597d6dab81e7893 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:42.813196  7865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c265324643494522a597d6dab81e7893" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:42.814153  7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c265324643494522a597d6dab81e7893" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:42.820420  7980 leader_election.cc:304] T c265324643494522a597d6dab81e7893 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:42.821907  8060 tablet_bootstrap.cc:654] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.824774  8381 raft_consensus.cc:2749] T c265324643494522a597d6dab81e7893 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:42.856453  8064 tablet_bootstrap.cc:492] T f35a05f13eee42d4bdd19ff8b2b98212 P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:42.856525  8059 tablet_bootstrap.cc:492] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:42.857391  8064 ts_tablet_manager.cc:1403] T f35a05f13eee42d4bdd19ff8b2b98212 P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.135s	user 0.010s	sys 0.004s
I20260709 13:16:42.857442  8059 ts_tablet_manager.cc:1403] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.154s	user 0.014s	sys 0.000s
I20260709 13:16:42.862342  8064 raft_consensus.cc:359] T f35a05f13eee42d4bdd19ff8b2b98212 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:42.863224  8064 raft_consensus.cc:385] T f35a05f13eee42d4bdd19ff8b2b98212 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.863590  8064 raft_consensus.cc:740] T f35a05f13eee42d4bdd19ff8b2b98212 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.864382  8064 consensus_queue.cc:260] T f35a05f13eee42d4bdd19ff8b2b98212 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:42.868315  8064 ts_tablet_manager.cc:1434] T f35a05f13eee42d4bdd19ff8b2b98212 P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:16:42.870462  8064 tablet_bootstrap.cc:492] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:42.880350  8059 raft_consensus.cc:359] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:42.881975  8059 raft_consensus.cc:385] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.882386  8059 raft_consensus.cc:740] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.883682  8059 consensus_queue.cc:260] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:42.891289  8247 raft_consensus.cc:493] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.892104  8247 raft_consensus.cc:515] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:42.895587  7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b12aa42b0f49a49b24d2433fdca7a8" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:42.895829  8247 leader_election.cc:290] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:42.896322  7790 raft_consensus.cc:2468] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 0.
I20260709 13:16:42.896420  7865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b12aa42b0f49a49b24d2433fdca7a8" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:42.898280  8064 tablet_bootstrap.cc:654] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:42.898751  7907 leader_election.cc:343] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:42.899471  7904 leader_election.cc:304] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: 1c5936948a84476fb0dcc1fa2d895740
I20260709 13:16:42.900395  8247 raft_consensus.cc:2804] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:42.900897  8247 raft_consensus.cc:493] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.901295  8247 raft_consensus.cc:3060] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.903313  8059 ts_tablet_manager.cc:1434] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.002s
I20260709 13:16:42.904402  8059 tablet_bootstrap.cc:492] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:42.915134  8059 tablet_bootstrap.cc:654] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.916790  7865 raft_consensus.cc:3060] T 2e6d18ad10a340e2aa1fba5831e6db57 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.925376  8063 tablet_bootstrap.cc:492] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:42.925947  8063 ts_tablet_manager.cc:1403] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.195s	user 0.017s	sys 0.022s
I20260709 13:16:42.926398  8344 consensus_queue.cc:1048] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:42.927440  8060 tablet_bootstrap.cc:492] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:42.930102  8060 ts_tablet_manager.cc:1403] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.154s	user 0.042s	sys 0.034s
I20260709 13:16:42.933624  8247 raft_consensus.cc:515] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:42.935415  8063 raft_consensus.cc:359] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:42.936712  7791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b12aa42b0f49a49b24d2433fdca7a8" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:42.937120  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b12aa42b0f49a49b24d2433fdca7a8" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:42.937388  7791 raft_consensus.cc:3060] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.939467  8060 raft_consensus.cc:359] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:42.940187  8060 raft_consensus.cc:385] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.940450  8060 raft_consensus.cc:740] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.941885  8247 leader_election.cc:290] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Requested vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:42.942752  8060 consensus_queue.cc:260] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
W20260709 13:16:42.946549  7737 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:42.947522  8060 ts_tablet_manager.cc:1434] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:16:42.948693  8060 tablet_bootstrap.cc:492] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:42.949756  8064 tablet_bootstrap.cc:492] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:42.950270  8064 ts_tablet_manager.cc:1403] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.080s	user 0.014s	sys 0.007s
I20260709 13:16:42.952968  8064 raft_consensus.cc:359] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:42.953660  8064 raft_consensus.cc:385] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.953922  8064 raft_consensus.cc:740] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
W20260709 13:16:42.943341  7907 leader_election.cc:343] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:42.954552  8064 consensus_queue.cc:260] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:42.960618  8064 ts_tablet_manager.cc:1434] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:16:42.961838  8064 tablet_bootstrap.cc:492] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:42.962314  8060 tablet_bootstrap.cc:654] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.936156  8063 raft_consensus.cc:385] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.964872  8063 raft_consensus.cc:740] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.966018  8063 consensus_queue.cc:260] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:42.968705  8063 ts_tablet_manager.cc:1434] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.001s
I20260709 13:16:42.972055  8059 tablet_bootstrap.cc:492] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:42.972611  8059 ts_tablet_manager.cc:1403] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.068s	user 0.007s	sys 0.004s
I20260709 13:16:42.975333  8059 raft_consensus.cc:359] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:42.978227  8064 tablet_bootstrap.cc:654] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.976035  8059 raft_consensus.cc:385] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.981304  8059 raft_consensus.cc:740] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.982002  8059 consensus_queue.cc:260] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:42.982635  8247 raft_consensus.cc:493] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.983152  8247 raft_consensus.cc:515] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:42.983995  8059 ts_tablet_manager.cc:1434] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:16:42.989933  7866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932dad2d4cee49e296e9359aa665ef9d" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:42.990656  7866 raft_consensus.cc:2468] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 0.
I20260709 13:16:42.992400  7791 raft_consensus.cc:2468] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 1.
I20260709 13:16:42.993376  7907 leader_election.cc:304] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:16:42.994010  8059 tablet_bootstrap.cc:492] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:42.995380  8063 tablet_bootstrap.cc:492] T 93cca694a49b44ba8eda19c91491696e P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:42.996915  8390 raft_consensus.cc:493] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.997409  8390 raft_consensus.cc:515] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:42.999608  8390 leader_election.cc:290] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:43.003440  8063 tablet_bootstrap.cc:654] T 93cca694a49b44ba8eda19c91491696e P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.004626  7904 leader_election.cc:304] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: 1c5936948a84476fb0dcc1fa2d895740
I20260709 13:16:43.003543  8059 tablet_bootstrap.cc:654] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.005981  8281 raft_consensus.cc:2804] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:43.006554  8281 raft_consensus.cc:697] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Becoming Leader. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Running, Role: LEADER
I20260709 13:16:43.007453  8281 consensus_queue.cc:237] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:43.009328  8136 raft_consensus.cc:2804] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:43.009868  8136 raft_consensus.cc:493] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.010290  8136 raft_consensus.cc:3060] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:43.017498  8247 leader_election.cc:290] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:43.019316  8393 consensus_queue.cc:1048] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:43.020300  8060 tablet_bootstrap.cc:492] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:43.020823  8060 ts_tablet_manager.cc:1403] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.072s	user 0.010s	sys 0.003s
I20260709 13:16:43.021365  7866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35a05f13eee42d4bdd19ff8b2b98212" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:43.022022  7866 raft_consensus.cc:2468] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 0.
I20260709 13:16:43.023283  7758 leader_election.cc:304] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 
I20260709 13:16:43.023514  8060 raft_consensus.cc:359] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:43.024170  8120 raft_consensus.cc:2804] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:43.024879  8120 raft_consensus.cc:493] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.025359  8120 raft_consensus.cc:3060] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:43.027014  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932dad2d4cee49e296e9359aa665ef9d" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:43.029004  8063 tablet_bootstrap.cc:492] T 93cca694a49b44ba8eda19c91491696e P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:43.029528  8063 ts_tablet_manager.cc:1403] T 93cca694a49b44ba8eda19c91491696e P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.003s
I20260709 13:16:43.024191  8060 raft_consensus.cc:385] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.032784  8060 raft_consensus.cc:740] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:43.034575  8063 raft_consensus.cc:359] T 93cca694a49b44ba8eda19c91491696e P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:43.037770  8063 raft_consensus.cc:385] T 93cca694a49b44ba8eda19c91491696e P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.038091  8063 raft_consensus.cc:740] T 93cca694a49b44ba8eda19c91491696e P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:43.041201  8063 consensus_queue.cc:260] T 93cca694a49b44ba8eda19c91491696e P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:43.043493  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35a05f13eee42d4bdd19ff8b2b98212" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:43.044051  8063 ts_tablet_manager.cc:1434] T 93cca694a49b44ba8eda19c91491696e P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.002s
I20260709 13:16:43.044248  8013 raft_consensus.cc:2468] T f35a05f13eee42d4bdd19ff8b2b98212 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 0.
I20260709 13:16:43.045143  8063 tablet_bootstrap.cc:492] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:43.037271  8060 consensus_queue.cc:260] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
W20260709 13:16:43.054883  7906 leader_election.cc:343] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:43.061422  8247 consensus_queue.cc:1048] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:43.062770  8011 raft_consensus.cc:3060] T c265324643494522a597d6dab81e7893 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:43.062978  8247 consensus_queue.cc:1048] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:43.065003  8136 raft_consensus.cc:515] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:43.069957  8060 ts_tablet_manager.cc:1434] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.000s
I20260709 13:16:43.071102  8060 tablet_bootstrap.cc:492] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:43.094609  8063 tablet_bootstrap.cc:654] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.099934  8379 consensus_queue.cc:1048] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:43.169914  8059 tablet_bootstrap.cc:492] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:43.170480  8059 ts_tablet_manager.cc:1403] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.177s	user 0.010s	sys 0.016s
I20260709 13:16:43.170956  8244 raft_consensus.cc:493] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.171489  8244 raft_consensus.cc:515] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:43.173363  8059 raft_consensus.cc:359] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:43.174059  8059 raft_consensus.cc:385] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.174336  8059 raft_consensus.cc:740] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:43.175000  8059 consensus_queue.cc:260] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:43.181102  8059 ts_tablet_manager.cc:1434] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:16:43.182297  8059 tablet_bootstrap.cc:492] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:43.185122  8064 tablet_bootstrap.cc:492] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:43.185693  8064 ts_tablet_manager.cc:1403] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.224s	user 0.019s	sys 0.041s
W20260709 13:16:43.197271  8418 log.cc:927] Time spent T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:16:43.212800  8064 raft_consensus.cc:359] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:43.213912  8064 raft_consensus.cc:385] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.215678  7690 catalog_manager.cc:5697] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "7de07e50a1714f5d9055bb4b86655200" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:43.214262  8064 raft_consensus.cc:740] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:43.200029  8120 raft_consensus.cc:515] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:43.246990  8064 consensus_queue.cc:260] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:43.248698  8065 raft_consensus.cc:493] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.258967  8064 ts_tablet_manager.cc:1434] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.073s	user 0.005s	sys 0.002s
I20260709 13:16:43.263490  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc8636f68ae4121ac05d99e24866633" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:43.264300  8013 raft_consensus.cc:2468] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 0.
I20260709 13:16:43.265127  8136 leader_election.cc:290] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Requested vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:43.267148  8059 tablet_bootstrap.cc:654] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.261869  8065 raft_consensus.cc:515] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:43.270373  7832 leader_election.cc:304] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:43.272023  8065 leader_election.cc:290] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:43.272559  8337 raft_consensus.cc:2804] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:43.272990  8337 raft_consensus.cc:493] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.273335  8337 raft_consensus.cc:3060] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:43.275592  8244 leader_election.cc:290] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:43.285161  8064 tablet_bootstrap.cc:492] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:43.285776  8012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93cca694a49b44ba8eda19c91491696e" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
W20260709 13:16:43.261016  8417 log.cc:927] Time spent T ffeb7520452b4edcb0421cee5ab0e516 P 59fcc1f631f642d6a7cf2d772ab1eba7: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:16:43.291502  8063 tablet_bootstrap.cc:492] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:43.292285  8063 ts_tablet_manager.cc:1403] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.247s	user 0.065s	sys 0.061s
W20260709 13:16:43.299185  7757 leader_election.cc:343] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:43.323846  8059 tablet_bootstrap.cc:492] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:43.324405  8059 ts_tablet_manager.cc:1403] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.142s	user 0.020s	sys 0.031s
I20260709 13:16:43.327934  8059 raft_consensus.cc:359] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:43.328799  8059 raft_consensus.cc:385] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.305641  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932dad2d4cee49e296e9359aa665ef9d" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:43.329154  8059 raft_consensus.cc:740] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
W20260709 13:16:43.330461  7906 leader_election.cc:343] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:43.330010  8059 consensus_queue.cc:260] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:43.330897  7866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932dad2d4cee49e296e9359aa665ef9d" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:43.331576  7866 raft_consensus.cc:3060] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:43.328418  8064 tablet_bootstrap.cc:654] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.339327  7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc8636f68ae4121ac05d99e24866633" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:43.340023  7789 raft_consensus.cc:2468] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 0.
I20260709 13:16:43.340492  8391 raft_consensus.cc:493] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.341045  8391 raft_consensus.cc:515] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:43.341634  7863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35a05f13eee42d4bdd19ff8b2b98212" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:43.342278  7863 raft_consensus.cc:3060] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:43.343417  8391 leader_election.cc:290] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:43.347787  8012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc8636f68ae4121ac05d99e24866633" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:43.348626  8012 raft_consensus.cc:2468] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 0.
I20260709 13:16:43.311688  7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93cca694a49b44ba8eda19c91491696e" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:43.351423  7936 raft_consensus.cc:2468] T 93cca694a49b44ba8eda19c91491696e P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 0.
I20260709 13:16:43.352341  7757 leader_election.cc:304] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:43.353858  8390 raft_consensus.cc:2804] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:43.354250  8390 raft_consensus.cc:493] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.337471  8120 leader_election.cc:290] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:43.362742  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35a05f13eee42d4bdd19ff8b2b98212" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:43.371867  8013 raft_consensus.cc:3060] T f35a05f13eee42d4bdd19ff8b2b98212 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:43.357797  8390 raft_consensus.cc:3060] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:43.381414  8060 tablet_bootstrap.cc:654] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.386374  8063 raft_consensus.cc:359] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:43.390974  7757 leader_election.cc:304] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: c9a569f7d1ad42359002386a73702690
I20260709 13:16:43.392154  8065 raft_consensus.cc:2804] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:43.392539  8065 raft_consensus.cc:493] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.392920  8065 raft_consensus.cc:3060] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:43.409655  8065 raft_consensus.cc:515] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:43.409921  8063 raft_consensus.cc:385] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.412629  8059 ts_tablet_manager.cc:1434] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.088s	user 0.007s	sys 0.001s
I20260709 13:16:43.411444  8063 raft_consensus.cc:740] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:43.378185  7863 raft_consensus.cc:2468] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 1.
I20260709 13:16:43.420336  8013 raft_consensus.cc:2468] T f35a05f13eee42d4bdd19ff8b2b98212 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 1.
I20260709 13:16:43.418622  8063 consensus_queue.cc:260] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:43.424995  8059 tablet_bootstrap.cc:492] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:43.428390  8065 leader_election.cc:290] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Requested vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
W20260709 13:16:43.428879  7832 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:46031, user_credentials={real_user=slave}} blocked reactor thread for 43621.4us
I20260709 13:16:43.440114  8390 raft_consensus.cc:515] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:43.442320  8390 leader_election.cc:290] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:43.448383  8063 ts_tablet_manager.cc:1434] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.149s	user 0.003s	sys 0.006s
W20260709 13:16:43.457062  7757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:46031, user_credentials={real_user=slave}} blocked reactor thread for 52269.4us
I20260709 13:16:43.459277  7940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93cca694a49b44ba8eda19c91491696e" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:43.460021  7940 raft_consensus.cc:3060] T 93cca694a49b44ba8eda19c91491696e P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:43.460191  8063 tablet_bootstrap.cc:492] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
W20260709 13:16:43.457188  7758 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:45491, user_credentials={real_user=slave}} blocked reactor thread for 52333.2us
I20260709 13:16:43.460954  8337 raft_consensus.cc:515] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:43.463155  8337 leader_election.cc:290] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:43.466862  8060 tablet_bootstrap.cc:492] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:43.467408  8060 ts_tablet_manager.cc:1403] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.397s	user 0.014s	sys 0.001s
I20260709 13:16:43.469520  8059 tablet_bootstrap.cc:654] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.472802  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93cca694a49b44ba8eda19c91491696e" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:43.473749  8063 tablet_bootstrap.cc:654] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.468540  7758 leader_election.cc:304] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 
I20260709 13:16:43.479631  7940 raft_consensus.cc:2468] T 93cca694a49b44ba8eda19c91491696e P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 1.
W20260709 13:16:43.483438  7757 leader_election.cc:343] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:43.486734  8429 raft_consensus.cc:2804] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:43.489365  8429 raft_consensus.cc:697] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:16:43.487524  8011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc8636f68ae4121ac05d99e24866633" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:43.491591  8012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc8636f68ae4121ac05d99e24866633" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:43.495085  8012 raft_consensus.cc:3060] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:43.495862  7866 raft_consensus.cc:2468] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 1.
I20260709 13:16:43.497516  8429 consensus_queue.cc:237] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:43.483692  8430 raft_consensus.cc:493] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.500423  8430 raft_consensus.cc:515] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:43.505295  7757 leader_election.cc:304] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: c9a569f7d1ad42359002386a73702690
I20260709 13:16:43.503738  8060 raft_consensus.cc:359] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:43.507161  8060 raft_consensus.cc:385] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.507470  8060 raft_consensus.cc:740] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:43.508075  8060 consensus_queue.cc:260] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:43.509963  8430 leader_election.cc:290] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:43.510358  8119 raft_consensus.cc:2804] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:43.510893  8119 raft_consensus.cc:697] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:16:43.511739  8119 consensus_queue.cc:237] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:43.512811  8060 ts_tablet_manager.cc:1434] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 13:16:43.513481  8136 consensus_queue.cc:1048] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:43.513873  7907 leader_election.cc:304] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: c9a569f7d1ad42359002386a73702690
I20260709 13:16:43.513926  8060 tablet_bootstrap.cc:492] T 1f5409294f3e4162a75137e616968afb P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:43.514793  8382 raft_consensus.cc:2804] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:43.515261  8382 raft_consensus.cc:697] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Becoming Leader. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Running, Role: LEADER
I20260709 13:16:43.516036  8382 consensus_queue.cc:237] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:43.516876  8337 raft_consensus.cc:493] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.517427  8337 raft_consensus.cc:515] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:43.519564  8337 leader_election.cc:290] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:43.519577  8064 tablet_bootstrap.cc:492] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:43.521835  8064 ts_tablet_manager.cc:1403] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.237s	user 0.011s	sys 0.006s
I20260709 13:16:43.527114  7939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c64de12c904e15892de849a597eeae" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:43.532809  7940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c64de12c904e15892de849a597eeae" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
W20260709 13:16:43.535575  7832 leader_election.cc:343] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:43.536674  7757 leader_election.cc:343] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:43.539536  8060 tablet_bootstrap.cc:654] T 1f5409294f3e4162a75137e616968afb P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.549563  8012 raft_consensus.cc:2468] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 1.
I20260709 13:16:43.549733  7865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc8636f68ae4121ac05d99e24866633" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:43.552471  7865 raft_consensus.cc:2393] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in current term 1: Already voted for candidate 1c5936948a84476fb0dcc1fa2d895740 in this term.
I20260709 13:16:43.553222  8064 raft_consensus.cc:359] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:43.553937  8064 raft_consensus.cc:385] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.554222  8064 raft_consensus.cc:740] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:43.554896  8064 consensus_queue.cc:260] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:43.556233  8430 raft_consensus.cc:493] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.556806  8430 raft_consensus.cc:515] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:43.557108  7786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc8636f68ae4121ac05d99e24866633" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:43.557948  7786 raft_consensus.cc:2393] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c5936948a84476fb0dcc1fa2d895740 in current term 1: Already voted for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in this term.
I20260709 13:16:43.558053  8064 ts_tablet_manager.cc:1434] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:16:43.561115  7867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e46a5b31234af492e77dbf435ead58" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:43.561211  7786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c64de12c904e15892de849a597eeae" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:43.559412  8064 tablet_bootstrap.cc:492] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:43.545560  7866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc8636f68ae4121ac05d99e24866633" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:43.565429  7865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c64de12c904e15892de849a597eeae" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:43.565987  7866 raft_consensus.cc:2393] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in current term 1: Already voted for candidate 1c5936948a84476fb0dcc1fa2d895740 in this term.
I20260709 13:16:43.559408  8430 leader_election.cc:290] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:43.561973  7786 raft_consensus.cc:2468] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 0.
I20260709 13:16:43.566190  7865 raft_consensus.cc:2468] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 0.
I20260709 13:16:43.560401  7830 leader_election.cc:304] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690
I20260709 13:16:43.573710  8428 raft_consensus.cc:2749] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:43.566903  8381 raft_consensus.cc:493] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.576630  8381 raft_consensus.cc:515] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:43.579078  8381 leader_election.cc:290] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
W20260709 13:16:43.579888  7758 leader_election.cc:343] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:43.582484  7757 leader_election.cc:304] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 1c5936948a84476fb0dcc1fa2d895740
I20260709 13:16:43.582859  7758 leader_election.cc:304] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:43.585489  8391 raft_consensus.cc:2804] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:43.585891  8390 raft_consensus.cc:2804] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:43.586344  8390 raft_consensus.cc:493] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.586457  8391 raft_consensus.cc:697] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:16:43.586771  8390 raft_consensus.cc:3060] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:43.588768  8064 tablet_bootstrap.cc:654] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.590447  7939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272dd059968c4493bb875e3bf32a3183" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:43.590415  8391 consensus_queue.cc:237] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:43.593500  7786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272dd059968c4493bb875e3bf32a3183" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
W20260709 13:16:43.595013  7978 leader_election.cc:343] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:43.633445  8390 raft_consensus.cc:515] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:43.634413  8060 tablet_bootstrap.cc:492] T 1f5409294f3e4162a75137e616968afb P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:43.634934  8060 ts_tablet_manager.cc:1403] T 1f5409294f3e4162a75137e616968afb P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.121s	user 0.018s	sys 0.016s
I20260709 13:16:43.646569  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c64de12c904e15892de849a597eeae" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
W20260709 13:16:43.636729  7980 leader_election.cc:343] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:43.649351  7980 leader_election.cc:304] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:43.653115  8381 raft_consensus.cc:2749] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:43.655148  7939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e46a5b31234af492e77dbf435ead58" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
W20260709 13:16:43.656167  7907 consensus_peers.cc:597] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200 -> Peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Couldn't send request to peer 1c5936948a84476fb0dcc1fa2d895740. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:43.662128  7689 catalog_manager.cc:5697] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "7de07e50a1714f5d9055bb4b86655200" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:43.635507  8390 leader_election.cc:290] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Requested vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:43.668092  8059 tablet_bootstrap.cc:492] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:43.672014  7865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c64de12c904e15892de849a597eeae" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:43.677518  7865 raft_consensus.cc:3060] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:43.669904  7757 leader_election.cc:343] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:43.675443  8059 ts_tablet_manager.cc:1403] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.251s	user 0.012s	sys 0.011s
I20260709 13:16:43.675618  8060 raft_consensus.cc:359] T 1f5409294f3e4162a75137e616968afb P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:43.679486  8060 raft_consensus.cc:385] T 1f5409294f3e4162a75137e616968afb P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.679845  8060 raft_consensus.cc:740] T 1f5409294f3e4162a75137e616968afb P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
W20260709 13:16:43.680002  7757 leader_election.cc:343] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:43.680756  7757 leader_election.cc:304] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:43.680783  8060 consensus_queue.cc:260] T 1f5409294f3e4162a75137e616968afb P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:43.687847  8060 ts_tablet_manager.cc:1434] T 1f5409294f3e4162a75137e616968afb P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 13:16:43.674283  7830 leader_election.cc:304] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:43.690999  8063 tablet_bootstrap.cc:492] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:43.691675  8063 ts_tablet_manager.cc:1403] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.232s	user 0.024s	sys 0.017s
I20260709 13:16:43.682799  8391 raft_consensus.cc:2749] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:43.701112  8064 tablet_bootstrap.cc:492] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:43.701674  8064 ts_tablet_manager.cc:1403] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.142s	user 0.012s	sys 0.013s
W20260709 13:16:43.701774  7830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:35503, user_credentials={real_user=slave}} blocked reactor thread for 64369.6us
I20260709 13:16:43.708043  8059 raft_consensus.cc:359] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:43.708940  8059 raft_consensus.cc:385] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.709219  8059 raft_consensus.cc:740] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:43.710170  8060 tablet_bootstrap.cc:492] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:43.705073  8428 raft_consensus.cc:493] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.713330  8428 raft_consensus.cc:515] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:43.715588  8428 leader_election.cc:290] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:43.716707  8060 tablet_bootstrap.cc:654] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.717289  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b5a061ff84745af17197de774ac96" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:43.705866  8064 raft_consensus.cc:359] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:43.718711  8064 raft_consensus.cc:385] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.718964  8064 raft_consensus.cc:740] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:43.707888  7865 raft_consensus.cc:2468] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 1.
I20260709 13:16:43.724164  8381 raft_consensus.cc:493] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.724658  8064 consensus_queue.cc:260] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:43.724731  8381 raft_consensus.cc:515] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:43.726660  7758 leader_election.cc:304] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:43.727731  8390 raft_consensus.cc:2804] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:43.727955  8381 leader_election.cc:290] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:43.720978  8337 raft_consensus.cc:2764] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:16:43.728302  8390 raft_consensus.cc:697] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:16:43.729326  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93cca694a49b44ba8eda19c91491696e" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:43.722524  8059 consensus_queue.cc:260] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:43.725906  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b5a061ff84745af17197de774ac96" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:43.732352  8059 ts_tablet_manager.cc:1434] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.001s
I20260709 13:16:43.735967  7690 catalog_manager.cc:5697] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:43.750344  8244 raft_consensus.cc:493] T 1f5409294f3e4162a75137e616968afb P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.752856  8059 tablet_bootstrap.cc:492] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:43.753748  8244 raft_consensus.cc:515] T 1f5409294f3e4162a75137e616968afb P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:43.754014  7690 catalog_manager.cc:5697] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:43.755779  8244 leader_election.cc:290] T 1f5409294f3e4162a75137e616968afb P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:43.729952  8390 consensus_queue.cc:237] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:43.752784  8064 ts_tablet_manager.cc:1434] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
W20260709 13:16:43.748813  7830 leader_election.cc:343] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:43.761171  8064 tablet_bootstrap.cc:492] T f584d75fb3ee4c80958b7b9e5322cf2b P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:43.734486  8063 raft_consensus.cc:359] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:43.762643  8063 raft_consensus.cc:385] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.762929  8063 raft_consensus.cc:740] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:43.763583  8063 consensus_queue.cc:260] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:43.765092  8063 ts_tablet_manager.cc:1434] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.073s	user 0.005s	sys 0.000s
I20260709 13:16:43.766147  8063 tablet_bootstrap.cc:492] T b5e46a5b31234af492e77dbf435ead58 P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:43.737442  7940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93cca694a49b44ba8eda19c91491696e" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:43.770071  8064 tablet_bootstrap.cc:654] T f584d75fb3ee4c80958b7b9e5322cf2b P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.770123  7940 raft_consensus.cc:2393] T 93cca694a49b44ba8eda19c91491696e P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a569f7d1ad42359002386a73702690 in current term 1: Already voted for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in this term.
I20260709 13:16:43.772346  7980 leader_election.cc:304] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:43.773478  8381 raft_consensus.cc:3060] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:43.775904  8012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5409294f3e4162a75137e616968afb" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:43.779649  8059 tablet_bootstrap.cc:654] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.779970  8381 raft_consensus.cc:2749] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:43.783459  8064 tablet_bootstrap.cc:492] T f584d75fb3ee4c80958b7b9e5322cf2b P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:43.783947  8064 ts_tablet_manager.cc:1403] T f584d75fb3ee4c80958b7b9e5322cf2b P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.003s
W20260709 13:16:43.784554  7832 leader_election.cc:343] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:43.785041  7832 leader_election.cc:304] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690
I20260709 13:16:43.788226  8060 tablet_bootstrap.cc:492] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:43.788914  8060 ts_tablet_manager.cc:1403] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.092s	user 0.014s	sys 0.008s
I20260709 13:16:43.789146  7786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5409294f3e4162a75137e616968afb" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:43.790696  8244 raft_consensus.cc:2749] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:16:43.791054  7830 leader_election.cc:343] T 1f5409294f3e4162a75137e616968afb P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:43.796641  7832 leader_election.cc:343] T 1f5409294f3e4162a75137e616968afb P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:43.797094  7832 leader_election.cc:304] T 1f5409294f3e4162a75137e616968afb P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690
I20260709 13:16:43.799131  8386 raft_consensus.cc:2749] T 1f5409294f3e4162a75137e616968afb P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:43.807840  8064 raft_consensus.cc:359] T f584d75fb3ee4c80958b7b9e5322cf2b P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:43.808645  8064 raft_consensus.cc:385] T f584d75fb3ee4c80958b7b9e5322cf2b P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.808936  8064 raft_consensus.cc:740] T f584d75fb3ee4c80958b7b9e5322cf2b P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:43.809815  8064 consensus_queue.cc:260] T f584d75fb3ee4c80958b7b9e5322cf2b P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:43.816221  8063 tablet_bootstrap.cc:654] T b5e46a5b31234af492e77dbf435ead58 P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.817937  8060 raft_consensus.cc:359] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:43.818843  8060 raft_consensus.cc:385] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.819181  8060 raft_consensus.cc:740] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:43.820050  8060 consensus_queue.cc:260] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:43.821710  8064 ts_tablet_manager.cc:1434] T f584d75fb3ee4c80958b7b9e5322cf2b P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.004s
I20260709 13:16:43.823666  7690 catalog_manager.cc:5697] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:43.826640  7690 catalog_manager.cc:5697] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:43.831324  8064 tablet_bootstrap.cc:492] T 932dad2d4cee49e296e9359aa665ef9d P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:43.840912  8064 tablet_bootstrap.cc:654] T 932dad2d4cee49e296e9359aa665ef9d P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.846482  8060 ts_tablet_manager.cc:1434] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.057s	user 0.001s	sys 0.020s
I20260709 13:16:43.848568  8244 raft_consensus.cc:493] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.849301  8244 raft_consensus.cc:515] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:43.849779  8136 raft_consensus.cc:493] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.850265  8136 raft_consensus.cc:515] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:43.851444  8244 leader_election.cc:290] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:43.852253  8136 leader_election.cc:290] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:43.853807  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cc9c8ab28ac4825a9ddbc9a7ef56f12" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:43.855436  8059 tablet_bootstrap.cc:492] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:43.856112  8059 ts_tablet_manager.cc:1403] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.104s	user 0.012s	sys 0.000s
I20260709 13:16:43.856323  8012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cc9c8ab28ac4825a9ddbc9a7ef56f12" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:43.857020  8012 raft_consensus.cc:2468] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 0.
W20260709 13:16:43.858246  7904 leader_election.cc:343] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:43.859390  7906 leader_election.cc:304] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:43.861413  8382 raft_consensus.cc:2804] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:43.861835  8382 raft_consensus.cc:493] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.861840  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e46a5b31234af492e77dbf435ead58" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:43.862290  8382 raft_consensus.cc:3060] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:43.862622  7792 raft_consensus.cc:2468] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 0.
I20260709 13:16:43.864010  7830 leader_election.cc:304] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 
I20260709 13:16:43.864959  8244 raft_consensus.cc:2804] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:43.865327  8244 raft_consensus.cc:493] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.865648  8244 raft_consensus.cc:3060] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:43.873975  8244 raft_consensus.cc:515] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:43.875416  8060 tablet_bootstrap.cc:492] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:43.878844  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e46a5b31234af492e77dbf435ead58" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:43.879539  7792 raft_consensus.cc:3060] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:43.880937  8382 raft_consensus.cc:515] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:43.884629  8012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cc9c8ab28ac4825a9ddbc9a7ef56f12" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:43.885367  8012 raft_consensus.cc:3060] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:43.887974  7940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e46a5b31234af492e77dbf435ead58" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:43.891870  8244 leader_election.cc:290] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Requested vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
W20260709 13:16:43.895042  7832 leader_election.cc:343] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:43.896780  8059 raft_consensus.cc:359] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:43.893400  7792 raft_consensus.cc:2468] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 1.
I20260709 13:16:43.897820  8059 raft_consensus.cc:385] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.898252  8059 raft_consensus.cc:740] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:43.898785  7830 leader_election.cc:304] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 
I20260709 13:16:43.899858  8386 raft_consensus.cc:2804] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:43.900385  8386 raft_consensus.cc:697] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Becoming Leader. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:16:43.901358  8386 consensus_queue.cc:237] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:43.906987  8060 tablet_bootstrap.cc:654] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.908797  8382 leader_election.cc:290] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:43.911599  8063 tablet_bootstrap.cc:492] T b5e46a5b31234af492e77dbf435ead58 P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:43.912189  8063 ts_tablet_manager.cc:1403] T b5e46a5b31234af492e77dbf435ead58 P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.146s	user 0.032s	sys 0.011s
I20260709 13:16:43.909668  8012 raft_consensus.cc:2468] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 1.
I20260709 13:16:43.915999  7906 leader_election.cc:304] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:43.918919  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cc9c8ab28ac4825a9ddbc9a7ef56f12" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:43.919610  8064 tablet_bootstrap.cc:492] T 932dad2d4cee49e296e9359aa665ef9d P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:43.920085  8064 ts_tablet_manager.cc:1403] T 932dad2d4cee49e296e9359aa665ef9d P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.089s	user 0.033s	sys 0.047s
W20260709 13:16:43.920264  7904 leader_election.cc:343] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:43.921833  8063 raft_consensus.cc:359] T b5e46a5b31234af492e77dbf435ead58 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:43.922715  8063 raft_consensus.cc:385] T b5e46a5b31234af492e77dbf435ead58 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.923237  8059 consensus_queue.cc:260] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:43.923545  7940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e46a5b31234af492e77dbf435ead58" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:43.923015  8063 raft_consensus.cc:740] T b5e46a5b31234af492e77dbf435ead58 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:43.923036  8064 raft_consensus.cc:359] T 932dad2d4cee49e296e9359aa665ef9d P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:43.925760  8382 raft_consensus.cc:2804] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:43.926067  8064 raft_consensus.cc:385] T 932dad2d4cee49e296e9359aa665ef9d P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.926446  8064 raft_consensus.cc:740] T 932dad2d4cee49e296e9359aa665ef9d P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:43.927275  8382 raft_consensus.cc:697] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Becoming Leader. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Running, Role: LEADER
I20260709 13:16:43.927270  8064 consensus_queue.cc:260] T 932dad2d4cee49e296e9359aa665ef9d P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:43.928535  8382 consensus_queue.cc:237] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:43.929697  8063 consensus_queue.cc:260] T b5e46a5b31234af492e77dbf435ead58 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:43.930778  8059 ts_tablet_manager.cc:1434] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.074s	user 0.010s	sys 0.000s
I20260709 13:16:43.932687  8064 ts_tablet_manager.cc:1434] T 932dad2d4cee49e296e9359aa665ef9d P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.003s
I20260709 13:16:43.935132  8393 raft_consensus.cc:493] T 932dad2d4cee49e296e9359aa665ef9d P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.935600  8393 raft_consensus.cc:515] T 932dad2d4cee49e296e9359aa665ef9d P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:43.933048  7940 raft_consensus.cc:3060] T b5e46a5b31234af492e77dbf435ead58 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:43.939495  8393 leader_election.cc:290] T 932dad2d4cee49e296e9359aa665ef9d P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:43.940407  8064 tablet_bootstrap.cc:492] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:43.941452  7865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932dad2d4cee49e296e9359aa665ef9d" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:43.942327  7865 raft_consensus.cc:2393] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a569f7d1ad42359002386a73702690 in current term 1: Already voted for candidate 7de07e50a1714f5d9055bb4b86655200 in this term.
I20260709 13:16:43.947767  8064 tablet_bootstrap.cc:654] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.932900  8059 tablet_bootstrap.cc:492] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:43.953223  7940 raft_consensus.cc:2468] T b5e46a5b31234af492e77dbf435ead58 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 1.
I20260709 13:16:43.981551  8060 tablet_bootstrap.cc:492] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:43.982321  8060 ts_tablet_manager.cc:1403] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.107s	user 0.013s	sys 0.002s
I20260709 13:16:43.990921  8063 ts_tablet_manager.cc:1434] T b5e46a5b31234af492e77dbf435ead58 P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.078s	user 0.009s	sys 0.006s
I20260709 13:16:43.995074  8012 raft_consensus.cc:3060] T 932dad2d4cee49e296e9359aa665ef9d P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.006987  8059 tablet_bootstrap.cc:654] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.013523  8247 consensus_queue.cc:1048] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:44.013490  7687 catalog_manager.cc:5697] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "1c5936948a84476fb0dcc1fa2d895740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:44.014222  7689 catalog_manager.cc:5697] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "7de07e50a1714f5d9055bb4b86655200" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:44.019160  8063 tablet_bootstrap.cc:492] T 3fa297fedf4549fd89f9a179ef9147a8 P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:44.035079  8060 raft_consensus.cc:359] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:44.035897  8060 raft_consensus.cc:385] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.036164  8060 raft_consensus.cc:740] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.036832  8060 consensus_queue.cc:260] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:44.040818  8060 ts_tablet_manager.cc:1434] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.000s
I20260709 13:16:44.044183  7939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932dad2d4cee49e296e9359aa665ef9d" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:44.053655  7980 leader_election.cc:304] T 932dad2d4cee49e296e9359aa665ef9d P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:44.058651  8060 tablet_bootstrap.cc:492] T d1b12aa42b0f49a49b24d2433fdca7a8 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:44.070986  8063 tablet_bootstrap.cc:654] T 3fa297fedf4549fd89f9a179ef9147a8 P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.073231  8451 raft_consensus.cc:2749] T 932dad2d4cee49e296e9359aa665ef9d P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:44.074534  8390 raft_consensus.cc:493] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.075237  8390 raft_consensus.cc:515] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:44.080323  8390 leader_election.cc:290] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:44.081111  8059 tablet_bootstrap.cc:492] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:44.081835  8059 ts_tablet_manager.cc:1403] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.149s	user 0.019s	sys 0.000s
I20260709 13:16:44.092634  7939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044eb7b4196a4ac595bec86f29fca1bf" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:44.092901  8064 tablet_bootstrap.cc:492] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:44.093453  8064 ts_tablet_manager.cc:1403] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.153s	user 0.029s	sys 0.039s
I20260709 13:16:44.094713  8391 consensus_queue.cc:1048] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:44.096330  8064 raft_consensus.cc:359] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:44.097105  8064 raft_consensus.cc:385] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.097404  8064 raft_consensus.cc:740] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.097270  8391 consensus_queue.cc:1048] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:44.098067  8064 consensus_queue.cc:260] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:44.102814  7865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044eb7b4196a4ac595bec86f29fca1bf" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:44.106257  8119 consensus_queue.cc:1048] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:44.112003  8060 tablet_bootstrap.cc:654] T d1b12aa42b0f49a49b24d2433fdca7a8 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.112828  8064 ts_tablet_manager.cc:1434] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:16:44.114020  8064 tablet_bootstrap.cc:492] T ea7f3171e8b84ac48e0abd056c43f778 P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:44.114475  8059 raft_consensus.cc:359] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:44.115178  8059 raft_consensus.cc:385] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.115448  8059 raft_consensus.cc:740] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.116811  8430 consensus_queue.cc:1048] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:44.117821  8382 consensus_queue.cc:1048] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:44.118207  8059 consensus_queue.cc:260] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
W20260709 13:16:44.118984  7758 leader_election.cc:343] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.120203  8064 tablet_bootstrap.cc:654] T ea7f3171e8b84ac48e0abd056c43f778 P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.139142  8059 ts_tablet_manager.cc:1434] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
W20260709 13:16:44.146864  7757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:46031, user_credentials={real_user=slave}} blocked reactor thread for 49806.2us
I20260709 13:16:44.147238  8059 tablet_bootstrap.cc:492] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:44.153849  8064 tablet_bootstrap.cc:492] T ea7f3171e8b84ac48e0abd056c43f778 P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:44.154413  8064 ts_tablet_manager.cc:1403] T ea7f3171e8b84ac48e0abd056c43f778 P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.010s
I20260709 13:16:44.165552  8390 raft_consensus.cc:493] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.166579  8059 tablet_bootstrap.cc:654] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.166277  8390 raft_consensus.cc:515] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:44.170466  8390 leader_election.cc:290] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
W20260709 13:16:44.170990  7757 leader_election.cc:343] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.160912  8064 raft_consensus.cc:359] T ea7f3171e8b84ac48e0abd056c43f778 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:44.177274  8064 raft_consensus.cc:385] T ea7f3171e8b84ac48e0abd056c43f778 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.171605  8119 consensus_queue.cc:1048] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:44.177821  8064 raft_consensus.cc:740] T ea7f3171e8b84ac48e0abd056c43f778 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.177176  7757 leader_election.cc:304] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:44.179241  8064 consensus_queue.cc:260] T ea7f3171e8b84ac48e0abd056c43f778 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:44.180955  8059 tablet_bootstrap.cc:492] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:44.181090  8247 raft_consensus.cc:493] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.181774  8059 ts_tablet_manager.cc:1403] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.001s
I20260709 13:16:44.181898  8064 ts_tablet_manager.cc:1434] T ea7f3171e8b84ac48e0abd056c43f778 P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:16:44.181675  8247 raft_consensus.cc:515] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:44.199608  8064 tablet_bootstrap.cc:492] T 3fa297fedf4549fd89f9a179ef9147a8 P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:44.216239  8060 tablet_bootstrap.cc:492] T d1b12aa42b0f49a49b24d2433fdca7a8 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:44.217872  8060 ts_tablet_manager.cc:1403] T d1b12aa42b0f49a49b24d2433fdca7a8 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.159s	user 0.017s	sys 0.019s
I20260709 13:16:44.197237  8390 raft_consensus.cc:2749] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:44.225822  8059 raft_consensus.cc:359] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:44.221796  7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7f3171e8b84ac48e0abd056c43f778" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:44.226622  8059 raft_consensus.cc:385] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.226375  8430 consensus_queue.cc:1048] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:44.227030  8059 raft_consensus.cc:740] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.233428  8119 consensus_queue.cc:1048] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:44.239960  8010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7f3171e8b84ac48e0abd056c43f778" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:44.240955  8010 raft_consensus.cc:2468] T ea7f3171e8b84ac48e0abd056c43f778 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 0.
W20260709 13:16:44.260739  7737 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:44.252839  8451 raft_consensus.cc:493] T f584d75fb3ee4c80958b7b9e5322cf2b P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.286470  8451 raft_consensus.cc:515] T f584d75fb3ee4c80958b7b9e5322cf2b P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
W20260709 13:16:44.297333  8464 log.cc:927] Time spent T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:16:44.297914  8451 leader_election.cc:290] T f584d75fb3ee4c80958b7b9e5322cf2b P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:44.307405  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f584d75fb3ee4c80958b7b9e5322cf2b" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:44.310252  7864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f584d75fb3ee4c80958b7b9e5322cf2b" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:44.329173  8063 tablet_bootstrap.cc:492] T 3fa297fedf4549fd89f9a179ef9147a8 P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:44.315764  8247 leader_election.cc:290] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:44.329924  8063 ts_tablet_manager.cc:1403] T 3fa297fedf4549fd89f9a179ef9147a8 P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.338s	user 0.034s	sys 0.032s
W20260709 13:16:44.344991  7981 leader_election.cc:343] T f584d75fb3ee4c80958b7b9e5322cf2b P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.353372  8060 raft_consensus.cc:359] T d1b12aa42b0f49a49b24d2433fdca7a8 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:44.354462  8060 raft_consensus.cc:385] T d1b12aa42b0f49a49b24d2433fdca7a8 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.354800  8060 raft_consensus.cc:740] T d1b12aa42b0f49a49b24d2433fdca7a8 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.355702  8060 consensus_queue.cc:260] T d1b12aa42b0f49a49b24d2433fdca7a8 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:44.387427  8064 tablet_bootstrap.cc:654] T 3fa297fedf4549fd89f9a179ef9147a8 P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.391562  8060 ts_tablet_manager.cc:1434] T d1b12aa42b0f49a49b24d2433fdca7a8 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.173s	user 0.009s	sys 0.001s
W20260709 13:16:44.381567  7980 leader_election.cc:343] T f584d75fb3ee4c80958b7b9e5322cf2b P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.399808  8060 tablet_bootstrap.cc:492] T f584d75fb3ee4c80958b7b9e5322cf2b P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
W20260709 13:16:44.401984  7757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:46031, user_credentials={real_user=slave}} blocked reactor thread for 80483.3us
I20260709 13:16:44.405462  7757 leader_election.cc:304] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:44.415397  8475 raft_consensus.cc:2804] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:44.415850  8475 raft_consensus.cc:493] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.416190  8475 raft_consensus.cc:3060] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.401505  7980 leader_election.cc:304] T f584d75fb3ee4c80958b7b9e5322cf2b P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:44.438752  7786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c64de12c904e15892de849a597eeae" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:44.443866  8060 tablet_bootstrap.cc:654] T f584d75fb3ee4c80958b7b9e5322cf2b P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.450019  8063 raft_consensus.cc:359] T 3fa297fedf4549fd89f9a179ef9147a8 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:44.451093  8063 raft_consensus.cc:385] T 3fa297fedf4549fd89f9a179ef9147a8 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.451450  8063 raft_consensus.cc:740] T 3fa297fedf4549fd89f9a179ef9147a8 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
W20260709 13:16:44.454167  7757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:46031, user_credentials={real_user=slave}} blocked reactor thread for 50019.7us
I20260709 13:16:44.427006  8473 raft_consensus.cc:493] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:44.455421  7757 leader_election.cc:343] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.457516  8063 consensus_queue.cc:260] T 3fa297fedf4549fd89f9a179ef9147a8 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:44.461364  7941 raft_consensus.cc:3060] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.462132  8451 raft_consensus.cc:2749] T f584d75fb3ee4c80958b7b9e5322cf2b P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:44.459141  8473 raft_consensus.cc:515] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:44.486246  8063 ts_tablet_manager.cc:1434] T 3fa297fedf4549fd89f9a179ef9147a8 P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.156s	user 0.009s	sys 0.001s
I20260709 13:16:44.483269  8473 leader_election.cc:290] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:44.518448  8063 tablet_bootstrap.cc:492] T 569ddc7f4d23481a852ea6ef24d38e31 P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
W20260709 13:16:44.518283  7978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:35503, user_credentials={real_user=slave}} blocked reactor thread for 78838.9us
I20260709 13:16:44.530529  8059 consensus_queue.cc:260] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
W20260709 13:16:44.537088  7758 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:45491, user_credentials={real_user=slave}} blocked reactor thread for 65829.6us
I20260709 13:16:44.538743  8060 tablet_bootstrap.cc:492] T f584d75fb3ee4c80958b7b9e5322cf2b P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:44.539269  8060 ts_tablet_manager.cc:1403] T f584d75fb3ee4c80958b7b9e5322cf2b P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.141s	user 0.017s	sys 0.018s
I20260709 13:16:44.542032  8060 raft_consensus.cc:359] T f584d75fb3ee4c80958b7b9e5322cf2b P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:44.547591  8060 raft_consensus.cc:385] T f584d75fb3ee4c80958b7b9e5322cf2b P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.551805  8428 raft_consensus.cc:493] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.552397  8428 raft_consensus.cc:515] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:44.554457  8428 leader_election.cc:290] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:44.547951  8060 raft_consensus.cc:740] T f584d75fb3ee4c80958b7b9e5322cf2b P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
W20260709 13:16:44.542124  7980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:44141, user_credentials={real_user=slave}} blocked reactor thread for 174722us
I20260709 13:16:44.561492  8475 raft_consensus.cc:515] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:44.563601  8475 leader_election.cc:290] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Requested vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:44.564522  8451 raft_consensus.cc:493] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.565079  8451 raft_consensus.cc:515] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:44.565399  7861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b5a061ff84745af17197de774ac96" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:44.566098  7861 raft_consensus.cc:2468] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 0.
I20260709 13:16:44.567279  8451 leader_election.cc:290] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:44.565074  8059 ts_tablet_manager.cc:1434] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.383s	user 0.012s	sys 0.010s
I20260709 13:16:44.569756  8059 tablet_bootstrap.cc:492] T 1f5409294f3e4162a75137e616968afb P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:44.572144  8060 consensus_queue.cc:260] T f584d75fb3ee4c80958b7b9e5322cf2b P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:44.584074  8064 tablet_bootstrap.cc:492] T 3fa297fedf4549fd89f9a179ef9147a8 P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:44.584666  8064 ts_tablet_manager.cc:1403] T 3fa297fedf4549fd89f9a179ef9147a8 P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.388s	user 0.017s	sys 0.011s
I20260709 13:16:44.590083  8475 consensus_queue.cc:1048] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:44.591468  8064 raft_consensus.cc:359] T 3fa297fedf4549fd89f9a179ef9147a8 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:44.592227  8064 raft_consensus.cc:385] T 3fa297fedf4549fd89f9a179ef9147a8 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.594144  7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5409294f3e4162a75137e616968afb" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:44.592489  8064 raft_consensus.cc:740] T 3fa297fedf4549fd89f9a179ef9147a8 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.595451  7940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa297fedf4549fd89f9a179ef9147a8" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:44.595618  8064 consensus_queue.cc:260] T 3fa297fedf4549fd89f9a179ef9147a8 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:44.596113  7940 raft_consensus.cc:2468] T 3fa297fedf4549fd89f9a179ef9147a8 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 0.
I20260709 13:16:44.597522  8064 ts_tablet_manager.cc:1434] T 3fa297fedf4549fd89f9a179ef9147a8 P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:16:44.598675  8064 tablet_bootstrap.cc:492] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:44.599280  8247 consensus_queue.cc:1048] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:44.602495  7978 leader_election.cc:343] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.605227  8011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa297fedf4549fd89f9a179ef9147a8" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:44.606020  8010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b5a061ff84745af17197de774ac96" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:44.607327  8011 raft_consensus.cc:2468] T 3fa297fedf4549fd89f9a179ef9147a8 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 0.
I20260709 13:16:44.579916  7861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5409294f3e4162a75137e616968afb" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:44.608039  8014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7f3171e8b84ac48e0abd056c43f778" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:44.608512  7861 raft_consensus.cc:2468] T 1f5409294f3e4162a75137e616968afb P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 0.
I20260709 13:16:44.608942  8014 raft_consensus.cc:3060] T ea7f3171e8b84ac48e0abd056c43f778 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.587459  8244 consensus_queue.cc:1048] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:16:44.610736  7981 leader_election.cc:304] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:44.620369  7940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7f3171e8b84ac48e0abd056c43f778" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:44.621382  8063 tablet_bootstrap.cc:654] T 569ddc7f4d23481a852ea6ef24d38e31 P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.620042  7758 leader_election.cc:304] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 
W20260709 13:16:44.628029  7757 leader_election.cc:343] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.629297  8451 raft_consensus.cc:2804] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:44.647608  8451 raft_consensus.cc:493] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.649031  8451 raft_consensus.cc:3060] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.651104  7865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c64de12c904e15892de849a597eeae" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
W20260709 13:16:44.655433  7904 consensus_peers.cc:597] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:44.626875  8476 raft_consensus.cc:2804] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:44.657105  7832 leader_election.cc:304] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:16:44.667778  8244 raft_consensus.cc:2804] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:16:44.686158  7757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:46031, user_credentials={real_user=slave}} blocked reactor thread for 54454.7us
I20260709 13:16:44.664819  8476 raft_consensus.cc:493] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.690824  8014 raft_consensus.cc:2468] T ea7f3171e8b84ac48e0abd056c43f778 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 1.
I20260709 13:16:44.673869  8244 raft_consensus.cc:493] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:44.693403  7757 leader_election.cc:343] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.667044  8488 raft_consensus.cc:493] T d1b12aa42b0f49a49b24d2433fdca7a8 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.713618  8059 tablet_bootstrap.cc:654] T 1f5409294f3e4162a75137e616968afb P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.707597  8476 raft_consensus.cc:3060] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.719981  8488 raft_consensus.cc:515] T d1b12aa42b0f49a49b24d2433fdca7a8 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:44.723935  8488 leader_election.cc:290] T d1b12aa42b0f49a49b24d2433fdca7a8 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:44.716634  8244 raft_consensus.cc:3060] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.730773  8428 consensus_queue.cc:1048] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:44.731076  7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b12aa42b0f49a49b24d2433fdca7a8" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:44.766979  8472 raft_consensus.cc:493] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.767717  8472 raft_consensus.cc:515] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:44.770531  8472 leader_election.cc:290] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:44.778262  7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b12aa42b0f49a49b24d2433fdca7a8" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:44.782702  7938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cc9c8ab28ac4825a9ddbc9a7ef56f12" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:44.786083  8014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cc9c8ab28ac4825a9ddbc9a7ef56f12" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:44.789335  8476 raft_consensus.cc:515] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:44.798122  8244 raft_consensus.cc:515] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:44.800447  7832 leader_election.cc:304] T d1b12aa42b0f49a49b24d2433fdca7a8 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:44.802443  8488 raft_consensus.cc:2749] T d1b12aa42b0f49a49b24d2433fdca7a8 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:44.807114  7757 leader_election.cc:304] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:44.724440  8064 tablet_bootstrap.cc:654] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.800345  8244 leader_election.cc:290] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Requested vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:44.830107  8475 raft_consensus.cc:2804] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:44.830667  8475 raft_consensus.cc:697] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:16:44.831522  8475 consensus_queue.cc:237] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:44.834419  8451 raft_consensus.cc:515] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:44.838446  8476 leader_election.cc:290] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:44.838946  7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5409294f3e4162a75137e616968afb" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
W20260709 13:16:44.840898  7978 leader_election.cc:343] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.847193  7861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b5a061ff84745af17197de774ac96" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:44.848239  7861 raft_consensus.cc:3060] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.852262  7757 leader_election.cc:304] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690
I20260709 13:16:44.860646  7938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa297fedf4549fd89f9a179ef9147a8" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:44.861249  8014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa297fedf4549fd89f9a179ef9147a8" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:44.861680  7938 raft_consensus.cc:3060] T 3fa297fedf4549fd89f9a179ef9147a8 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.862097  8014 raft_consensus.cc:3060] T 3fa297fedf4549fd89f9a179ef9147a8 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.872124  8119 raft_consensus.cc:2749] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:44.875759  8014 raft_consensus.cc:2468] T 3fa297fedf4549fd89f9a179ef9147a8 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 1.
W20260709 13:16:44.878316  7907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:45491, user_credentials={real_user=slave}} blocked reactor thread for 188386us
I20260709 13:16:44.904162  7907 leader_election.cc:304] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200; no voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:44.879427  8011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b5a061ff84745af17197de774ac96" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:44.916013  8060 ts_tablet_manager.cc:1434] T f584d75fb3ee4c80958b7b9e5322cf2b P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.376s	user 0.035s	sys 0.014s
W20260709 13:16:44.919581  7757 leader_election.cc:343] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.882530  7787 raft_consensus.cc:3060] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.930861  8495 raft_consensus.cc:2749] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:44.883879  7864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5409294f3e4162a75137e616968afb" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:44.932960  7864 raft_consensus.cc:3060] T 1f5409294f3e4162a75137e616968afb P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.947867  8451 leader_election.cc:290] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 election: Requested vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:44.952654  7864 raft_consensus.cc:2468] T 1f5409294f3e4162a75137e616968afb P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 1.
I20260709 13:16:44.953743  7861 raft_consensus.cc:2468] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 1.
I20260709 13:16:44.953970  7981 leader_election.cc:304] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:44.964161  7758 leader_election.cc:304] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: c9a569f7d1ad42359002386a73702690
I20260709 13:16:44.968847  8493 raft_consensus.cc:493] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.969408  8493 raft_consensus.cc:515] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:44.970075  8059 tablet_bootstrap.cc:492] T 1f5409294f3e4162a75137e616968afb P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:44.970613  8059 ts_tablet_manager.cc:1403] T 1f5409294f3e4162a75137e616968afb P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.401s	user 0.013s	sys 0.006s
I20260709 13:16:44.971527  8493 leader_election.cc:290] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:44.973654  8059 raft_consensus.cc:359] T 1f5409294f3e4162a75137e616968afb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:44.974421  8059 raft_consensus.cc:385] T 1f5409294f3e4162a75137e616968afb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.974697  8059 raft_consensus.cc:740] T 1f5409294f3e4162a75137e616968afb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.975652  8059 consensus_queue.cc:260] T 1f5409294f3e4162a75137e616968afb P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:44.964744  7832 leader_election.cc:304] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:44.981230  8060 tablet_bootstrap.cc:492] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
I20260709 13:16:44.982548  8476 raft_consensus.cc:2804] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:44.984086  8490 raft_consensus.cc:2804] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:44.984692  8490 raft_consensus.cc:697] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Becoming Leader. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:16:44.985626  8490 consensus_queue.cc:237] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:44.989355  8063 tablet_bootstrap.cc:492] T 569ddc7f4d23481a852ea6ef24d38e31 P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:44.989816  8244 raft_consensus.cc:493] T f584d75fb3ee4c80958b7b9e5322cf2b P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.990958  8063 ts_tablet_manager.cc:1403] T 569ddc7f4d23481a852ea6ef24d38e31 P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.473s	user 0.021s	sys 0.012s
I20260709 13:16:44.963246  8451 raft_consensus.cc:2804] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:44.996958  7938 raft_consensus.cc:2468] T 3fa297fedf4549fd89f9a179ef9147a8 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 1.
I20260709 13:16:44.997690  8064 tablet_bootstrap.cc:492] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:44.999547  8064 ts_tablet_manager.cc:1403] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.401s	user 0.009s	sys 0.008s
I20260709 13:16:44.984369  8476 raft_consensus.cc:697] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:16:45.013051  8476 consensus_queue.cc:237] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:45.016907  8244 raft_consensus.cc:515] T f584d75fb3ee4c80958b7b9e5322cf2b P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:45.019805  8244 leader_election.cc:290] T f584d75fb3ee4c80958b7b9e5322cf2b P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:45.034237  8059 ts_tablet_manager.cc:1434] T 1f5409294f3e4162a75137e616968afb P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.000s
I20260709 13:16:45.045287  8064 raft_consensus.cc:359] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:45.046173  8064 raft_consensus.cc:385] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.046588  8064 raft_consensus.cc:740] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.046743  8063 raft_consensus.cc:359] T 569ddc7f4d23481a852ea6ef24d38e31 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:45.048312  8064 consensus_queue.cc:260] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:45.048853  8063 raft_consensus.cc:385] T 569ddc7f4d23481a852ea6ef24d38e31 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.049268  8063 raft_consensus.cc:740] T 569ddc7f4d23481a852ea6ef24d38e31 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.025157  8451 raft_consensus.cc:697] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690 [term 1 LEADER]: Becoming Leader. State: Replica: c9a569f7d1ad42359002386a73702690, State: Running, Role: LEADER
I20260709 13:16:45.064821  8059 tablet_bootstrap.cc:492] T e74f9555b1f64bc080273bc35b9ef15b P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:45.066193  8060 tablet_bootstrap.cc:654] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.071221  8064 ts_tablet_manager.cc:1434] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.071s	user 0.005s	sys 0.003s
I20260709 13:16:45.058172  8063 consensus_queue.cc:260] T 569ddc7f4d23481a852ea6ef24d38e31 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:45.085047  8064 tablet_bootstrap.cc:492] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:45.094281  8063 ts_tablet_manager.cc:1434] T 569ddc7f4d23481a852ea6ef24d38e31 P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.100s	user 0.011s	sys 0.000s
I20260709 13:16:45.092798  7938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569ddc7f4d23481a852ea6ef24d38e31" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:45.104180  8063 tablet_bootstrap.cc:492] T 272dd059968c4493bb875e3bf32a3183 P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:45.108239  8012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f584d75fb3ee4c80958b7b9e5322cf2b" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:45.108860  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569ddc7f4d23481a852ea6ef24d38e31" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:45.108996  8012 raft_consensus.cc:2468] T f584d75fb3ee4c80958b7b9e5322cf2b P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 0.
I20260709 13:16:45.112075  7938 raft_consensus.cc:2468] T 569ddc7f4d23481a852ea6ef24d38e31 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 0.
I20260709 13:16:45.114867  7832 leader_election.cc:304] T f584d75fb3ee4c80958b7b9e5322cf2b P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:45.121799  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f584d75fb3ee4c80958b7b9e5322cf2b" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:45.124935  8489 raft_consensus.cc:2804] T f584d75fb3ee4c80958b7b9e5322cf2b P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:45.125433  8489 raft_consensus.cc:493] T f584d75fb3ee4c80958b7b9e5322cf2b P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.125784  8489 raft_consensus.cc:3060] T f584d75fb3ee4c80958b7b9e5322cf2b P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.103245  8451 consensus_queue.cc:237] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:45.134171  7689 catalog_manager.cc:5697] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:45.153316  7689 catalog_manager.cc:5697] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:45.155951  7832 leader_election.cc:304] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:16:45.162937  8059 tablet_bootstrap.cc:654] T e74f9555b1f64bc080273bc35b9ef15b P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:45.163815  7832 leader_election.cc:343] T f584d75fb3ee4c80958b7b9e5322cf2b P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:45.166388  7832 leader_election.cc:343] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.167804  8244 raft_consensus.cc:2804] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:45.176889  8244 raft_consensus.cc:493] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.177310  8244 raft_consensus.cc:3060] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.204981  8060 tablet_bootstrap.cc:492] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:45.205610  8060 ts_tablet_manager.cc:1403] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.225s	user 0.025s	sys 0.050s
I20260709 13:16:45.213153  8060 raft_consensus.cc:359] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:45.214068  8060 raft_consensus.cc:385] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.214395  7865 raft_consensus.cc:3060] T d1b12aa42b0f49a49b24d2433fdca7a8 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.214422  8060 raft_consensus.cc:740] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.215559  8060 consensus_queue.cc:260] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:45.217727  8489 raft_consensus.cc:515] T f584d75fb3ee4c80958b7b9e5322cf2b P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:45.218343  8060 ts_tablet_manager.cc:1434] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:16:45.219611  8060 tablet_bootstrap.cc:492] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740: Bootstrap starting.
W20260709 13:16:45.232684  7832 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:44141, user_credentials={real_user=slave}} blocked reactor thread for 47029.1us
I20260709 13:16:45.220306  8489 leader_election.cc:290] T f584d75fb3ee4c80958b7b9e5322cf2b P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Requested vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:45.260846  7687 catalog_manager.cc:5697] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "1c5936948a84476fb0dcc1fa2d895740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:45.263353  8064 tablet_bootstrap.cc:654] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.257949  7938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f584d75fb3ee4c80958b7b9e5322cf2b" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
W20260709 13:16:45.268385  7832 leader_election.cc:343] T f584d75fb3ee4c80958b7b9e5322cf2b P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.272920  8063 tablet_bootstrap.cc:654] T 272dd059968c4493bb875e3bf32a3183 P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.275360  8012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f584d75fb3ee4c80958b7b9e5322cf2b" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:45.276154  8012 raft_consensus.cc:3060] T f584d75fb3ee4c80958b7b9e5322cf2b P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:45.320067  8516 log.cc:927] Time spent T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 13:16:45.335032  7737 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:45.344028  8244 raft_consensus.cc:515] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:45.348961  8244 leader_election.cc:290] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Requested vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:45.349898  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569ddc7f4d23481a852ea6ef24d38e31" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
W20260709 13:16:45.351889  7832 leader_election.cc:343] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.357620  8451 raft_consensus.cc:493] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.356444  7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569ddc7f4d23481a852ea6ef24d38e31" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:45.358539  7937 raft_consensus.cc:3060] T 569ddc7f4d23481a852ea6ef24d38e31 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.358361  8451 raft_consensus.cc:515] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:45.365356  8391 consensus_queue.cc:1048] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:45.365947  8059 tablet_bootstrap.cc:492] T e74f9555b1f64bc080273bc35b9ef15b P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:45.366504  8059 ts_tablet_manager.cc:1403] T e74f9555b1f64bc080273bc35b9ef15b P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.313s	user 0.023s	sys 0.012s
I20260709 13:16:45.368992  8012 raft_consensus.cc:2468] T f584d75fb3ee4c80958b7b9e5322cf2b P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 1.
I20260709 13:16:45.369115  8451 leader_election.cc:290] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:45.370051  7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74f9555b1f64bc080273bc35b9ef15b" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:45.370326  8063 tablet_bootstrap.cc:492] T 272dd059968c4493bb875e3bf32a3183 P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:45.370857  8063 ts_tablet_manager.cc:1403] T 272dd059968c4493bb875e3bf32a3183 P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.270s	user 0.029s	sys 0.016s
I20260709 13:16:45.374583  7832 leader_election.cc:304] T f584d75fb3ee4c80958b7b9e5322cf2b P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:45.375550  8244 raft_consensus.cc:2804] T f584d75fb3ee4c80958b7b9e5322cf2b P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:45.376029  8244 raft_consensus.cc:697] T f584d75fb3ee4c80958b7b9e5322cf2b P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Becoming Leader. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:16:45.376694  8244 consensus_queue.cc:237] T f584d75fb3ee4c80958b7b9e5322cf2b P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:45.378803  8060 tablet_bootstrap.cc:654] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.378252  8059 raft_consensus.cc:359] T e74f9555b1f64bc080273bc35b9ef15b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:45.385061  8064 tablet_bootstrap.cc:492] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:45.386922  8059 raft_consensus.cc:385] T e74f9555b1f64bc080273bc35b9ef15b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.387367  8059 raft_consensus.cc:740] T e74f9555b1f64bc080273bc35b9ef15b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.387516  8064 ts_tablet_manager.cc:1403] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.312s	user 0.003s	sys 0.014s
I20260709 13:16:45.382645  7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74f9555b1f64bc080273bc35b9ef15b" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
W20260709 13:16:45.393033  7980 leader_election.cc:343] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.397169  8063 raft_consensus.cc:359] T 272dd059968c4493bb875e3bf32a3183 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:45.401569  8063 raft_consensus.cc:385] T 272dd059968c4493bb875e3bf32a3183 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.402520  8063 raft_consensus.cc:740] T 272dd059968c4493bb875e3bf32a3183 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.403476  8063 consensus_queue.cc:260] T 272dd059968c4493bb875e3bf32a3183 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:45.398552  8059 consensus_queue.cc:260] T e74f9555b1f64bc080273bc35b9ef15b P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:45.408057  8063 ts_tablet_manager.cc:1434] T 272dd059968c4493bb875e3bf32a3183 P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.002s
I20260709 13:16:45.409246  8063 tablet_bootstrap.cc:492] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:45.409114  7787 raft_consensus.cc:2468] T e74f9555b1f64bc080273bc35b9ef15b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 0.
I20260709 13:16:45.415045  7978 leader_election.cc:304] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:45.415657  8064 raft_consensus.cc:359] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:45.416461  8064 raft_consensus.cc:385] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.416244  8480 raft_consensus.cc:2804] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:45.416853  8064 raft_consensus.cc:740] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.417083  8480 raft_consensus.cc:493] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.417657  8064 consensus_queue.cc:260] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:45.421010  8063 tablet_bootstrap.cc:654] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.421622  8059 ts_tablet_manager.cc:1434] T e74f9555b1f64bc080273bc35b9ef15b P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.055s	user 0.010s	sys 0.001s
I20260709 13:16:45.422444  8480 raft_consensus.cc:3060] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.427814  8059 tablet_bootstrap.cc:492] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:45.437891  8064 ts_tablet_manager.cc:1434] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.001s
W20260709 13:16:45.439600  7757 consensus_peers.cc:597] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 -> Peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Couldn't send request to peer 7de07e50a1714f5d9055bb4b86655200. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:45.446586  8059 tablet_bootstrap.cc:654] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.449124  7937 raft_consensus.cc:2468] T 569ddc7f4d23481a852ea6ef24d38e31 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 1.
I20260709 13:16:45.454836  7690 catalog_manager.cc:5697] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a569f7d1ad42359002386a73702690 (127.30.63.4). New cstate: current_term: 1 leader_uuid: "c9a569f7d1ad42359002386a73702690" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:45.461370  8484 raft_consensus.cc:493] T 1f5409294f3e4162a75137e616968afb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.461933  8484 raft_consensus.cc:515] T 1f5409294f3e4162a75137e616968afb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:45.463598  7832 leader_election.cc:304] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: c9a569f7d1ad42359002386a73702690
I20260709 13:16:45.464668  8064 tablet_bootstrap.cc:492] T 569ddc7f4d23481a852ea6ef24d38e31 P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
I20260709 13:16:45.475041  8490 raft_consensus.cc:2804] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:45.459524  8480 raft_consensus.cc:515] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:45.487366  8059 tablet_bootstrap.cc:492] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:45.487910  8059 ts_tablet_manager.cc:1403] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.065s	user 0.007s	sys 0.017s
I20260709 13:16:45.489027  8480 leader_election.cc:290] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 election: Requested vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:45.491128  8059 raft_consensus.cc:359] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:45.491858  8059 raft_consensus.cc:385] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.492101  8059 raft_consensus.cc:740] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.492794  8059 consensus_queue.cc:260] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:45.493435  8488 raft_consensus.cc:493] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.493942  8488 raft_consensus.cc:515] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:45.494470  8059 ts_tablet_manager.cc:1434] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:16:45.495568  8059 tablet_bootstrap.cc:492] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:45.501469  7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044eb7b4196a4ac595bec86f29fca1bf" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:45.502014  8059 tablet_bootstrap.cc:654] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.502586  8484 leader_election.cc:290] T 1f5409294f3e4162a75137e616968afb P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
W20260709 13:16:45.503925  7832 leader_election.cc:343] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.504338  7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74f9555b1f64bc080273bc35b9ef15b" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:45.506250  7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74f9555b1f64bc080273bc35b9ef15b" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:45.507211  8063 tablet_bootstrap.cc:492] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:45.507146  7787 raft_consensus.cc:3060] T e74f9555b1f64bc080273bc35b9ef15b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.507826  8063 ts_tablet_manager.cc:1403] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.099s	user 0.010s	sys 0.007s
W20260709 13:16:45.508885  7980 leader_election.cc:343] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.516904  7861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5409294f3e4162a75137e616968afb" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:45.517827  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044eb7b4196a4ac595bec86f29fca1bf" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:45.518043  7861 raft_consensus.cc:2393] T 1f5409294f3e4162a75137e616968afb P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in current term 1: Already voted for candidate c9a569f7d1ad42359002386a73702690 in this term.
I20260709 13:16:45.518502  7792 raft_consensus.cc:2468] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 0.
I20260709 13:16:45.519553  8488 leader_election.cc:290] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:45.482700  8490 raft_consensus.cc:697] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Becoming Leader. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:16:45.522403  8490 consensus_queue.cc:237] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:45.525620  8012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5409294f3e4162a75137e616968afb" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:45.531473  7830 leader_election.cc:304] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:45.532899  8244 raft_consensus.cc:2804] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:45.533303  8244 raft_consensus.cc:493] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.533607  8244 raft_consensus.cc:3060] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.538033  7757 leader_election.cc:304] T 1f5409294f3e4162a75137e616968afb P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690
I20260709 13:16:45.539755  8484 raft_consensus.cc:3060] T 1f5409294f3e4162a75137e616968afb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.542742  8488 consensus_queue.cc:1048] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:16:45.550336  7757 consensus_peers.cc:597] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7 -> Peer c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031): Couldn't send request to peer c9a569f7d1ad42359002386a73702690. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:45.543991  8063 raft_consensus.cc:359] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:45.552831  8063 raft_consensus.cc:385] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.553144  8063 raft_consensus.cc:740] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.558072  8060 tablet_bootstrap.cc:492] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740: No bootstrap required, opened a new log
I20260709 13:16:45.558625  8060 ts_tablet_manager.cc:1403] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740: Time spent bootstrapping tablet: real 0.339s	user 0.019s	sys 0.017s
I20260709 13:16:45.561575  8119 raft_consensus.cc:493] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.562373  8119 raft_consensus.cc:515] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:45.663904  8064 tablet_bootstrap.cc:654] T 569ddc7f4d23481a852ea6ef24d38e31 P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.667816  8484 raft_consensus.cc:2749] T 1f5409294f3e4162a75137e616968afb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:45.672503  8244 raft_consensus.cc:515] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:45.673149  8119 leader_election.cc:290] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:45.674670  8244 leader_election.cc:290] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Requested vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:45.682097  7787 raft_consensus.cc:2468] T e74f9555b1f64bc080273bc35b9ef15b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 1.
I20260709 13:16:45.682857  8060 raft_consensus.cc:359] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:45.733052  8060 raft_consensus.cc:385] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.733345  8060 raft_consensus.cc:740] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.693497  7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044eb7b4196a4ac595bec86f29fca1bf" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:45.714627  8063 consensus_queue.cc:260] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:45.734033  8060 consensus_queue.cc:260] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:45.734596  8522 raft_consensus.cc:493] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.735036  8522 raft_consensus.cc:515] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:45.736282  8060 ts_tablet_manager.cc:1434] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740: Time spent starting tablet: real 0.177s	user 0.005s	sys 0.004s
I20260709 13:16:45.738984  8522 leader_election.cc:290] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:45.719072  8064 tablet_bootstrap.cc:492] T 569ddc7f4d23481a852ea6ef24d38e31 P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
W20260709 13:16:45.721026  7757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:46031, user_credentials={real_user=slave}} blocked reactor thread for 151409us
I20260709 13:16:45.743387  8011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e84fab0d4fc43359b4219baa6171aa5" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:45.746220  8011 raft_consensus.cc:2468] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 0.
I20260709 13:16:45.747207  8518 consensus_queue.cc:1048] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:45.750126  7757 leader_election.cc:304] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:45.724707  8381 consensus_queue.cc:1048] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:45.731555  7687 catalog_manager.cc:5697] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "1c5936948a84476fb0dcc1fa2d895740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:45.753276  7687 catalog_manager.cc:5697] T f584d75fb3ee4c80958b7b9e5322cf2b P 1c5936948a84476fb0dcc1fa2d895740 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "1c5936948a84476fb0dcc1fa2d895740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:45.754714  8475 raft_consensus.cc:2804] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:45.755362  8475 raft_consensus.cc:493] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.755897  8475 raft_consensus.cc:3060] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.753511  8451 consensus_queue.cc:1048] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:16:45.722751  7758 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:45491, user_credentials={real_user=slave}} blocked reactor thread for 109275us
I20260709 13:16:45.766387  7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044eb7b4196a4ac595bec86f29fca1bf" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:45.767524  7790 raft_consensus.cc:3060] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.775995  8011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7f3171e8b84ac48e0abd056c43f778" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:45.783340  8064 ts_tablet_manager.cc:1403] T 569ddc7f4d23481a852ea6ef24d38e31 P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.323s	user 0.012s	sys 0.000s
I20260709 13:16:45.787519  8064 raft_consensus.cc:359] T 569ddc7f4d23481a852ea6ef24d38e31 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:45.802632  8063 ts_tablet_manager.cc:1434] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.294s	user 0.008s	sys 0.008s
I20260709 13:16:45.812834  8119 consensus_queue.cc:1048] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:45.798266  7861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e84fab0d4fc43359b4219baa6171aa5" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:45.817508  7861 raft_consensus.cc:2468] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 0.
I20260709 13:16:45.807389  7978 leader_election.cc:304] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:45.801231  8382 raft_consensus.cc:493] T 272dd059968c4493bb875e3bf32a3183 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.788516  8064 raft_consensus.cc:385] T 569ddc7f4d23481a852ea6ef24d38e31 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.828655  8064 raft_consensus.cc:740] T 569ddc7f4d23481a852ea6ef24d38e31 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
W20260709 13:16:45.832883  7832 leader_election.cc:343] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.830993  7790 raft_consensus.cc:2468] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 1.
I20260709 13:16:45.834838  8480 raft_consensus.cc:2804] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:45.843539  8064 consensus_queue.cc:260] T 569ddc7f4d23481a852ea6ef24d38e31 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:45.861905  8063 tablet_bootstrap.cc:492] T e74f9555b1f64bc080273bc35b9ef15b P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:45.830219  8382 raft_consensus.cc:515] T 272dd059968c4493bb875e3bf32a3183 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
W20260709 13:16:45.885138  7980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:44141, user_credentials={real_user=slave}} blocked reactor thread for 146750us
I20260709 13:16:45.893749  8382 leader_election.cc:290] T 272dd059968c4493bb875e3bf32a3183 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:45.898383  7830 leader_election.cc:304] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:45.898803  8063 tablet_bootstrap.cc:654] T e74f9555b1f64bc080273bc35b9ef15b P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.887104  7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7f3171e8b84ac48e0abd056c43f778" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:45.910763  8064 ts_tablet_manager.cc:1434] T 569ddc7f4d23481a852ea6ef24d38e31 P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.127s	user 0.010s	sys 0.000s
I20260709 13:16:45.899441  8493 raft_consensus.cc:2804] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:45.888895  8480 raft_consensus.cc:697] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690 [term 1 LEADER]: Becoming Leader. State: Replica: c9a569f7d1ad42359002386a73702690, State: Running, Role: LEADER
I20260709 13:16:45.905005  8381 raft_consensus.cc:493] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.941751  8064 tablet_bootstrap.cc:492] T c04b5a061ff84745af17197de774ac96 P c9a569f7d1ad42359002386a73702690: Bootstrap starting.
W20260709 13:16:45.945936  7904 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:35503, user_credentials={real_user=slave}} blocked reactor thread for 104215us
I20260709 13:16:45.947578  7904 leader_election.cc:304] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690
I20260709 13:16:45.937291  8493 raft_consensus.cc:697] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Becoming Leader. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:16:45.939173  8381 raft_consensus.cc:515] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:45.973722  7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272dd059968c4493bb875e3bf32a3183" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
W20260709 13:16:45.977032  7832 consensus_peers.cc:597] T f584d75fb3ee4c80958b7b9e5322cf2b P 1c5936948a84476fb0dcc1fa2d895740 -> Peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Couldn't send request to peer 7de07e50a1714f5d9055bb4b86655200. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:45.954463  7906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:46031, user_credentials={real_user=slave}} blocked reactor thread for 115983us
W20260709 13:16:45.978715  7904 leader_election.cc:343] T 272dd059968c4493bb875e3bf32a3183 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.001086  8538 raft_consensus.cc:493] T 569ddc7f4d23481a852ea6ef24d38e31 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.985319  8012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272dd059968c4493bb875e3bf32a3183" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:46.009063  8538 raft_consensus.cc:515] T 569ddc7f4d23481a852ea6ef24d38e31 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:46.010521  8381 leader_election.cc:290] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:46.011298  8538 leader_election.cc:290] T 569ddc7f4d23481a852ea6ef24d38e31 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:46.008407  8012 raft_consensus.cc:2468] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 0.
I20260709 13:16:46.016429  7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272dd059968c4493bb875e3bf32a3183" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
W20260709 13:16:46.018834  7978 leader_election.cc:343] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:46.020273  8539 log.cc:927] Time spent T 1f5409294f3e4162a75137e616968afb P 1c5936948a84476fb0dcc1fa2d895740: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:16:45.970412  8480 consensus_queue.cc:237] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:46.005332  8543 raft_consensus.cc:2749] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:46.040197  8064 tablet_bootstrap.cc:654] T c04b5a061ff84745af17197de774ac96 P c9a569f7d1ad42359002386a73702690: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.050143  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272dd059968c4493bb875e3bf32a3183" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:46.050918  7941 raft_consensus.cc:2468] T 272dd059968c4493bb875e3bf32a3183 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 0.
I20260709 13:16:46.055243  7980 leader_election.cc:304] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:46.056857  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569ddc7f4d23481a852ea6ef24d38e31" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:46.006924  8493 consensus_queue.cc:237] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:46.064474  7941 raft_consensus.cc:2393] T 569ddc7f4d23481a852ea6ef24d38e31 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a569f7d1ad42359002386a73702690 in current term 1: Already voted for candidate 1c5936948a84476fb0dcc1fa2d895740 in this term.
W20260709 13:16:46.081274  8059 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.084s	sys 0.143s
W20260709 13:16:46.081686  8059 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.084s	sys 0.143s
I20260709 13:16:46.059965  8381 raft_consensus.cc:2804] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:46.096900  8475 raft_consensus.cc:515] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:46.098692  8063 tablet_bootstrap.cc:492] T e74f9555b1f64bc080273bc35b9ef15b P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:46.091400  8381 raft_consensus.cc:493] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.099301  8381 raft_consensus.cc:3060] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.103717  8059 tablet_bootstrap.cc:492] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7: No bootstrap required, opened a new log
I20260709 13:16:46.104285  8059 ts_tablet_manager.cc:1403] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.609s	user 0.090s	sys 0.143s
W20260709 13:16:46.091678  8540 log.cc:927] Time spent T 1f5409294f3e4162a75137e616968afb P 59fcc1f631f642d6a7cf2d772ab1eba7: Append to log took a long time: real 0.185s	user 0.001s	sys 0.001s
I20260709 13:16:46.105592  7906 leader_election.cc:304] T 272dd059968c4493bb875e3bf32a3183 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:46.109818  7866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569ddc7f4d23481a852ea6ef24d38e31" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:46.107107  8059 raft_consensus.cc:359] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:46.099301  8063 ts_tablet_manager.cc:1403] T e74f9555b1f64bc080273bc35b9ef15b P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.254s	user 0.011s	sys 0.015s
I20260709 13:16:46.117269  8059 raft_consensus.cc:385] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.118165  8059 raft_consensus.cc:740] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.119495  8059 consensus_queue.cc:260] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:46.111126  8475 leader_election.cc:290] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:46.107760  8543 raft_consensus.cc:2804] T 272dd059968c4493bb875e3bf32a3183 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:46.133010  8543 raft_consensus.cc:493] T 272dd059968c4493bb875e3bf32a3183 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.133363  8543 raft_consensus.cc:3060] T 272dd059968c4493bb875e3bf32a3183 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.144706  8059 ts_tablet_manager.cc:1434] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.002s
W20260709 13:16:46.144555  7832 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:46031, user_credentials={real_user=slave}} blocked reactor thread for 85160.7us
I20260709 13:16:46.148192  8518 consensus_queue.cc:1048] T f584d75fb3ee4c80958b7b9e5322cf2b P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:46.151538  8381 raft_consensus.cc:515] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:46.156009  8063 raft_consensus.cc:359] T e74f9555b1f64bc080273bc35b9ef15b P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:46.157001  8063 raft_consensus.cc:385] T e74f9555b1f64bc080273bc35b9ef15b P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.157346  8063 raft_consensus.cc:740] T e74f9555b1f64bc080273bc35b9ef15b P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.158227  8063 consensus_queue.cc:260] T e74f9555b1f64bc080273bc35b9ef15b P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:46.179435  7981 leader_election.cc:304] T 569ddc7f4d23481a852ea6ef24d38e31 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:46.180665  7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272dd059968c4493bb875e3bf32a3183" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:46.192646  8063 ts_tablet_manager.cc:1434] T e74f9555b1f64bc080273bc35b9ef15b P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.000s
I20260709 13:16:46.225730  7938 raft_consensus.cc:3060] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.226333  8063 tablet_bootstrap.cc:492] T 044eb7b4196a4ac595bec86f29fca1bf P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:46.232925  8063 tablet_bootstrap.cc:654] T 044eb7b4196a4ac595bec86f29fca1bf P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.195122  8480 raft_consensus.cc:3060] T 569ddc7f4d23481a852ea6ef24d38e31 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.191825  8381 leader_election.cc:290] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 election: Requested vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:46.290709  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272dd059968c4493bb875e3bf32a3183" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:46.291414  7792 raft_consensus.cc:3060] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:46.329331  7757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:44141, user_credentials={real_user=slave}} blocked reactor thread for 260769us
I20260709 13:16:46.357313  7792 raft_consensus.cc:2468] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 1.
I20260709 13:16:46.362866  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e84fab0d4fc43359b4219baa6171aa5" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:46.363977  8015 raft_consensus.cc:3060] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:46.378625  8561 log.cc:927] Time spent T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:16:46.371738  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e84fab0d4fc43359b4219baa6171aa5" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:46.380838  7862 raft_consensus.cc:3060] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:46.385059  8562 log.cc:927] Time spent T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:16:46.389132  8543 raft_consensus.cc:515] T 272dd059968c4493bb875e3bf32a3183 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:46.410400  8542 raft_consensus.cc:493] T e74f9555b1f64bc080273bc35b9ef15b P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.417173  8542 raft_consensus.cc:515] T e74f9555b1f64bc080273bc35b9ef15b P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:46.418903  7862 raft_consensus.cc:2468] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 1.
I20260709 13:16:46.433105  8064 tablet_bootstrap.cc:492] T c04b5a061ff84745af17197de774ac96 P c9a569f7d1ad42359002386a73702690: No bootstrap required, opened a new log
I20260709 13:16:46.433900  8064 ts_tablet_manager.cc:1403] T c04b5a061ff84745af17197de774ac96 P c9a569f7d1ad42359002386a73702690: Time spent bootstrapping tablet: real 0.495s	user 0.024s	sys 0.013s
I20260709 13:16:46.423818  8542 leader_election.cc:290] T e74f9555b1f64bc080273bc35b9ef15b P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:46.468930  7936 raft_consensus.cc:2393] T 272dd059968c4493bb875e3bf32a3183 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c9a569f7d1ad42359002386a73702690 in current term 1: Already voted for candidate 7de07e50a1714f5d9055bb4b86655200 in this term.
I20260709 13:16:46.494694  8015 raft_consensus.cc:2468] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 1.
W20260709 13:16:46.495788  7830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:35503, user_credentials={real_user=slave}} blocked reactor thread for 112016us
I20260709 13:16:46.609336  7978 leader_election.cc:304] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:46.605162  7791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74f9555b1f64bc080273bc35b9ef15b" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
W20260709 13:16:46.607807  7907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:45491, user_credentials={real_user=slave}} blocked reactor thread for 93253.8us
I20260709 13:16:46.629972  8064 raft_consensus.cc:359] T c04b5a061ff84745af17197de774ac96 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:46.633168  8014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74f9555b1f64bc080273bc35b9ef15b" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:46.638652  8064 raft_consensus.cc:385] T c04b5a061ff84745af17197de774ac96 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.639485  8064 raft_consensus.cc:740] T c04b5a061ff84745af17197de774ac96 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.635694  8480 raft_consensus.cc:2749] T 569ddc7f4d23481a852ea6ef24d38e31 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:46.646900  7791 raft_consensus.cc:2393] T e74f9555b1f64bc080273bc35b9ef15b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7de07e50a1714f5d9055bb4b86655200 in current term 1: Already voted for candidate c9a569f7d1ad42359002386a73702690 in this term.
I20260709 13:16:46.638100  8547 raft_consensus.cc:2804] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:16:46.649037  7737 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:46.652312  8063 tablet_bootstrap.cc:492] T 044eb7b4196a4ac595bec86f29fca1bf P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:46.653136  8063 ts_tablet_manager.cc:1403] T 044eb7b4196a4ac595bec86f29fca1bf P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.427s	user 0.029s	sys 0.042s
I20260709 13:16:46.642211  8064 consensus_queue.cc:260] T c04b5a061ff84745af17197de774ac96 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
W20260709 13:16:46.713632  7978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:35503, user_credentials={real_user=slave}} blocked reactor thread for 74009.3us
I20260709 13:16:46.720036  8064 ts_tablet_manager.cc:1434] T c04b5a061ff84745af17197de774ac96 P c9a569f7d1ad42359002386a73702690: Time spent starting tablet: real 0.286s	user 0.007s	sys 0.007s
I20260709 13:16:46.728000  8063 raft_consensus.cc:359] T 044eb7b4196a4ac595bec86f29fca1bf P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:46.738232  8063 raft_consensus.cc:385] T 044eb7b4196a4ac595bec86f29fca1bf P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.738724  8063 raft_consensus.cc:740] T 044eb7b4196a4ac595bec86f29fca1bf P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.649323  8547 raft_consensus.cc:697] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [term 1 LEADER]: Becoming Leader. State: Replica: c9a569f7d1ad42359002386a73702690, State: Running, Role: LEADER
I20260709 13:16:46.739616  8063 consensus_queue.cc:260] T 044eb7b4196a4ac595bec86f29fca1bf P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:46.777520  8063 ts_tablet_manager.cc:1434] T 044eb7b4196a4ac595bec86f29fca1bf P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.124s	user 0.007s	sys 0.001s
W20260709 13:16:46.780902  8574 log.cc:927] Time spent T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:16:46.780160  8547 consensus_queue.cc:237] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:46.789196  7933 raft_consensus.cc:3060] T e74f9555b1f64bc080273bc35b9ef15b P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.809130  7940 raft_consensus.cc:3060] T 044eb7b4196a4ac595bec86f29fca1bf P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.811694  8553 consensus_queue.cc:1048] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:46.857393  8513 consensus_queue.cc:1048] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:46.858217  7686 catalog_manager.cc:5697] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a569f7d1ad42359002386a73702690 (127.30.63.4). New cstate: current_term: 1 leader_uuid: "c9a569f7d1ad42359002386a73702690" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:46.865291  7906 leader_election.cc:304] T e74f9555b1f64bc080273bc35b9ef15b P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690
I20260709 13:16:46.872753  8063 tablet_bootstrap.cc:492] T f584d75fb3ee4c80958b7b9e5322cf2b P 7de07e50a1714f5d9055bb4b86655200: Bootstrap starting.
I20260709 13:16:46.874650  8008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272dd059968c4493bb875e3bf32a3183" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:46.874826  8543 leader_election.cc:290] T 272dd059968c4493bb875e3bf32a3183 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:46.879493  8063 tablet_bootstrap.cc:654] T f584d75fb3ee4c80958b7b9e5322cf2b P 7de07e50a1714f5d9055bb4b86655200: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.880895  8568 consensus_queue.cc:1048] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:46.882730  7689 catalog_manager.cc:5697] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "1c5936948a84476fb0dcc1fa2d895740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:46.872282  8495 raft_consensus.cc:2749] T e74f9555b1f64bc080273bc35b9ef15b P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:46.888556  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272dd059968c4493bb875e3bf32a3183" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:46.889357  7792 raft_consensus.cc:2393] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7de07e50a1714f5d9055bb4b86655200 in current term 1: Already voted for candidate c9a569f7d1ad42359002386a73702690 in this term.
I20260709 13:16:46.890967  7904 leader_election.cc:304] T 272dd059968c4493bb875e3bf32a3183 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690
I20260709 13:16:46.886484  8553 consensus_queue.cc:1048] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:46.894780  8568 consensus_queue.cc:1048] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:46.901763  8063 tablet_bootstrap.cc:492] T f584d75fb3ee4c80958b7b9e5322cf2b P 7de07e50a1714f5d9055bb4b86655200: No bootstrap required, opened a new log
I20260709 13:16:46.910586  8063 ts_tablet_manager.cc:1403] T f584d75fb3ee4c80958b7b9e5322cf2b P 7de07e50a1714f5d9055bb4b86655200: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.000s
I20260709 13:16:46.913321  8567 raft_consensus.cc:2749] T 272dd059968c4493bb875e3bf32a3183 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:46.913928  8063 raft_consensus.cc:359] T f584d75fb3ee4c80958b7b9e5322cf2b P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:46.914732  8063 raft_consensus.cc:385] T f584d75fb3ee4c80958b7b9e5322cf2b P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.914989  8063 raft_consensus.cc:740] T f584d75fb3ee4c80958b7b9e5322cf2b P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.915656  8063 consensus_queue.cc:260] T f584d75fb3ee4c80958b7b9e5322cf2b P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:46.917796  8063 ts_tablet_manager.cc:1434] T f584d75fb3ee4c80958b7b9e5322cf2b P 7de07e50a1714f5d9055bb4b86655200: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:16:46.906816  7758 leader_election.cc:304] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 
I20260709 13:16:46.924832  8575 raft_consensus.cc:2804] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:46.926777  8575 raft_consensus.cc:697] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:16:46.927656  8575 consensus_queue.cc:237] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:46.941636  8013 raft_consensus.cc:3060] T c04b5a061ff84745af17197de774ac96 P c9a569f7d1ad42359002386a73702690 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.993808  7939 raft_consensus.cc:3060] T f584d75fb3ee4c80958b7b9e5322cf2b P 7de07e50a1714f5d9055bb4b86655200 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.013577  8568 consensus_queue.cc:1048] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:47.095615  7690 catalog_manager.cc:5697] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a569f7d1ad42359002386a73702690 (127.30.63.4). New cstate: current_term: 1 leader_uuid: "c9a569f7d1ad42359002386a73702690" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.122268  7686 catalog_manager.cc:5697] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.388536  8475 consensus_queue.cc:1048] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:47.393393  8492 consensus_queue.cc:1048] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:47.397013  8480 consensus_queue.cc:1048] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:47.410030  8553 consensus_queue.cc:1048] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:48.108429 30972 tablet_server.cc:179] TabletServer@127.30.63.1:0 shutting down...
W20260709 13:16:48.140254  7904 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:16:48.147477  7904 consensus_peers.cc:597] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:48.158015  7978 consensus_peers.cc:597] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:48.161919 30972 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:16:48.162681  7830 consensus_peers.cc:597] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:48.163000 30972 tablet_replica.cc:333] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.164317 30972 raft_consensus.cc:2243] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:48.165252 30972 raft_consensus.cc:2272] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.168202 30972 tablet_replica.cc:333] T 1f5409294f3e4162a75137e616968afb P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.168946 30972 raft_consensus.cc:2243] T 1f5409294f3e4162a75137e616968afb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.169378 30972 raft_consensus.cc:2272] T 1f5409294f3e4162a75137e616968afb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.171074 30972 tablet_replica.cc:333] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.171648 30972 raft_consensus.cc:2243] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.172055 30972 raft_consensus.cc:2272] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.173857 30972 tablet_replica.cc:333] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.174438 30972 raft_consensus.cc:2243] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:48.175168 30972 raft_consensus.cc:2272] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.177009 30972 tablet_replica.cc:333] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.177804 30972 raft_consensus.cc:2243] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:48.178763 30972 raft_consensus.cc:2272] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.181243 30972 tablet_replica.cc:333] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.181912 30972 raft_consensus.cc:2243] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:48.182711 30972 raft_consensus.cc:2272] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.184461 30972 tablet_replica.cc:333] T e74f9555b1f64bc080273bc35b9ef15b P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.185101 30972 raft_consensus.cc:2243] T e74f9555b1f64bc080273bc35b9ef15b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.185523 30972 raft_consensus.cc:2272] T e74f9555b1f64bc080273bc35b9ef15b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.187501 30972 tablet_replica.cc:333] T ffeb7520452b4edcb0421cee5ab0e516 P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.188089 30972 raft_consensus.cc:2243] T ffeb7520452b4edcb0421cee5ab0e516 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.188505 30972 raft_consensus.cc:2272] T ffeb7520452b4edcb0421cee5ab0e516 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:48.189890  7904 consensus_peers.cc:597] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:48.190699 30972 tablet_replica.cc:333] T 2e6d18ad10a340e2aa1fba5831e6db57 P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.191591 30972 raft_consensus.cc:2243] T 2e6d18ad10a340e2aa1fba5831e6db57 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.192065 30972 raft_consensus.cc:2272] T 2e6d18ad10a340e2aa1fba5831e6db57 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.194182 30972 tablet_replica.cc:333] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.194975 30972 raft_consensus.cc:2243] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.195447 30972 raft_consensus.cc:2272] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.197782 30972 tablet_replica.cc:333] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.198626 30972 raft_consensus.cc:2243] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:48.199477 30972 raft_consensus.cc:2272] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.201786 30972 tablet_replica.cc:333] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.202562 30972 raft_consensus.cc:2243] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:48.203512 30972 raft_consensus.cc:2272] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:48.204748  7978 consensus_peers.cc:597] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:48.205794 30972 tablet_replica.cc:333] T afc39d65d52c48e3a959c8876930ab07 P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.206691 30972 raft_consensus.cc:2243] T afc39d65d52c48e3a959c8876930ab07 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.207082 30972 raft_consensus.cc:2272] T afc39d65d52c48e3a959c8876930ab07 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.208967 30972 tablet_replica.cc:333] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.209510 30972 raft_consensus.cc:2243] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.209870 30972 raft_consensus.cc:2272] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.212708 30972 tablet_replica.cc:333] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.213373 30972 raft_consensus.cc:2243] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:48.214263 30972 raft_consensus.cc:2272] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.216656 30972 tablet_replica.cc:333] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.217428 30972 raft_consensus.cc:2243] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:48.218335 30972 raft_consensus.cc:2272] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:48.220196  7830 consensus_peers.cc:597] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:48.220624 30972 tablet_replica.cc:333] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.221288 30972 raft_consensus.cc:2243] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.221710 30972 raft_consensus.cc:2272] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.223520 30972 tablet_replica.cc:333] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.224273 30972 raft_consensus.cc:2243] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:48.225188 30972 raft_consensus.cc:2272] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:48.227499  7904 consensus_peers.cc:597] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:48.227568 30972 tablet_replica.cc:333] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.228354 30972 raft_consensus.cc:2243] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.228799 30972 raft_consensus.cc:2272] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.230785 30972 tablet_replica.cc:333] T d99b23f5044644c1b270bc5afcaf2119 P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.231477 30972 raft_consensus.cc:2243] T d99b23f5044644c1b270bc5afcaf2119 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.231961 30972 raft_consensus.cc:2272] T d99b23f5044644c1b270bc5afcaf2119 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.234069 30972 tablet_replica.cc:333] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.234658 30972 raft_consensus.cc:2243] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.235062 30972 raft_consensus.cc:2272] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.236807 30972 tablet_replica.cc:333] T 9eeed88ecdc244a98599a38459ae66b8 P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.237371 30972 raft_consensus.cc:2243] T 9eeed88ecdc244a98599a38459ae66b8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.237841 30972 raft_consensus.cc:2272] T 9eeed88ecdc244a98599a38459ae66b8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.239595 30972 tablet_replica.cc:333] T 7141f7bef8234a56bdbb17df0b302a75 P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.240062 30972 raft_consensus.cc:2243] T 7141f7bef8234a56bdbb17df0b302a75 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.240451 30972 raft_consensus.cc:2272] T 7141f7bef8234a56bdbb17df0b302a75 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.242202 30972 tablet_replica.cc:333] T 7806fa697a044140850e326d8e5889d1 P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.242933 30972 raft_consensus.cc:2243] T 7806fa697a044140850e326d8e5889d1 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.243337 30972 raft_consensus.cc:2272] T 7806fa697a044140850e326d8e5889d1 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.245299 30972 tablet_replica.cc:333] T 5ba560db35494ad2b64a9b728d510c1a P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.245843 30972 raft_consensus.cc:2243] T 5ba560db35494ad2b64a9b728d510c1a P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.246256 30972 raft_consensus.cc:2272] T 5ba560db35494ad2b64a9b728d510c1a P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.248245 30972 tablet_replica.cc:333] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.248965 30972 raft_consensus.cc:2243] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.249399 30972 raft_consensus.cc:2272] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.251398 30972 tablet_replica.cc:333] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.251927 30972 raft_consensus.cc:2243] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.252401 30972 raft_consensus.cc:2272] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.255287 30972 tablet_replica.cc:333] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.255978 30972 raft_consensus.cc:2243] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.256445 30972 raft_consensus.cc:2272] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.258977 30972 tablet_replica.cc:333] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.259908 30972 raft_consensus.cc:2243] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.260444 30972 raft_consensus.cc:2272] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.262463 30972 tablet_replica.cc:333] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.263091 30972 raft_consensus.cc:2243] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:48.263917 30972 raft_consensus.cc:2272] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.266620 30972 tablet_replica.cc:333] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.267171 30972 raft_consensus.cc:2243] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:48.268227 30972 raft_consensus.cc:2272] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.271200 30972 tablet_replica.cc:333] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.272089 30972 raft_consensus.cc:2243] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:48.274178 30972 raft_consensus.cc:2272] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.277314 30972 tablet_replica.cc:333] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.278323 30972 raft_consensus.cc:2243] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.278947 30972 raft_consensus.cc:2272] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.281147 30972 tablet_replica.cc:333] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.281754 30972 raft_consensus.cc:2243] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:48.282725 30972 raft_consensus.cc:2272] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.285097 30972 tablet_replica.cc:333] T 87d445d744434f90baaf040e708b1e98 P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.286652 30972 raft_consensus.cc:2243] T 87d445d744434f90baaf040e708b1e98 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.287350 30972 raft_consensus.cc:2272] T 87d445d744434f90baaf040e708b1e98 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.290227 30972 tablet_replica.cc:333] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.290939 30972 raft_consensus.cc:2243] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:48.291810 30972 raft_consensus.cc:2272] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.294145 30972 tablet_replica.cc:333] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.294734 30972 raft_consensus.cc:2243] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:48.295616 30972 raft_consensus.cc:2272] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.298077 30972 tablet_replica.cc:333] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.298794 30972 raft_consensus.cc:2243] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:48.299805 30972 raft_consensus.cc:2272] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.302042 30972 tablet_replica.cc:333] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.302654 30972 raft_consensus.cc:2243] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:48.303529 30972 raft_consensus.cc:2272] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.305747 30972 tablet_replica.cc:333] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.306339 30972 raft_consensus.cc:2243] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:48.307212 30972 raft_consensus.cc:2272] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.309857 30972 tablet_replica.cc:333] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.310595 30972 raft_consensus.cc:2243] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:48.311367 30972 raft_consensus.cc:2272] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.313416 30972 tablet_replica.cc:333] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.314113 30972 raft_consensus.cc:2243] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:48.315019 30972 raft_consensus.cc:2272] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.317189 30972 tablet_replica.cc:333] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.317659 30972 raft_consensus.cc:2243] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:48.318370 30972 raft_consensus.cc:2272] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.320225 30972 tablet_replica.cc:333] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.320845 30972 raft_consensus.cc:2243] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.321368 30972 raft_consensus.cc:2272] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.323894 30972 tablet_replica.cc:333] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7: stopping tablet replica
I20260709 13:16:48.324536 30972 raft_consensus.cc:2243] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:16:48.324995  7830 consensus_peers.cc:597] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:48.325132 30972 raft_consensus.cc:2272] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:48.375793  7830 consensus_peers.cc:597] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:48.380323  7978 consensus_peers.cc:597] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:48.400385 30972 tablet_server.cc:196] TabletServer@127.30.63.1:0 shutdown complete.
W20260709 13:16:48.410113  7978 consensus_peers.cc:597] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:48.417182  7830 consensus_peers.cc:597] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:48.425967  7830 consensus_peers.cc:597] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:48.425985  7978 consensus_peers.cc:597] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:48.447892  7978 consensus_peers.cc:597] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:48.451718  7904 consensus_peers.cc:597] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:48.467916  7904 consensus_peers.cc:597] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:48.468676  7830 consensus_peers.cc:597] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:48.478685 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:48.485780  8615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:48.486979  8616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:48.490479  8618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:48.492172  7978 consensus_peers.cc:597] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:48.493192 30972 server_base.cc:1061] running on GCE node
W20260709 13:16:48.496531  7978 consensus_peers.cc:597] T 7806fa697a044140850e326d8e5889d1 P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:48.499050 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:48.499431 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:48.499666 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783603008499644 us; error 0 us; skew 500 ppm
I20260709 13:16:48.500841 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:48.504020 30972 webserver.cc:533] Webserver started at http://127.30.63.1:43761/ using document root <none> and password file <none>
I20260709 13:16:48.504559 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:48.504843 30972 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 13:16:48.505612  7978 consensus_peers.cc:597] T 87d445d744434f90baaf040e708b1e98 P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:48.509003 30972 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:16:48.517473  8623 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:48.518726 30972 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.001s
I20260709 13:16:48.519104 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602730526113-30972-0/minicluster-data/ts-0-root
uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
format_stamp: "Formatted at 2026-07-09 13:16:34 on dist-test-slave-c08m"
I20260709 13:16:48.519495 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602730526113-30972-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602730526113-30972-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602730526113-30972-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:16:48.546526  7904 consensus_peers.cc:597] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:48.551307 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:48.552815 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:48.554582 30972 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:48.561698  8631 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:16:48.562294  7904 consensus_peers.cc:597] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:48.682458  7904 consensus_peers.cc:597] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:48.812083 30972 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:16:48.812493 30972 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.254s	user 0.011s	sys 0.000s
I20260709 13:16:48.812872 30972 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:16:48.819468  8631 tablet_bootstrap.cc:492] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:48.834254  8631 tablet_bootstrap.cc:492] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:48.835202  8631 tablet_bootstrap.cc:492] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:48.835807  8631 ts_tablet_manager.cc:1403] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:16:48.838522  8631 raft_consensus.cc:359] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:48.839110  8631 raft_consensus.cc:740] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.839671  8631 consensus_queue.cc:260] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:48.841722  8631 ts_tablet_manager.cc:1434] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:16:48.842442  8631 tablet_bootstrap.cc:492] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:48.854686  8631 tablet_bootstrap.cc:492] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:48.855437  8631 tablet_bootstrap.cc:492] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:48.855955  8631 ts_tablet_manager.cc:1403] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.004s
I20260709 13:16:48.857733  8631 raft_consensus.cc:359] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:48.858253  8631 raft_consensus.cc:740] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.858744  8631 consensus_queue.cc:260] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:48.860397  8631 ts_tablet_manager.cc:1434] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:16:48.861168  8631 tablet_bootstrap.cc:492] T 7806fa697a044140850e326d8e5889d1 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:48.875016  8631 tablet_bootstrap.cc:492] T 7806fa697a044140850e326d8e5889d1 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:48.875964  8631 tablet_bootstrap.cc:492] T 7806fa697a044140850e326d8e5889d1 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:48.876607  8631 ts_tablet_manager.cc:1403] T 7806fa697a044140850e326d8e5889d1 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 13:16:48.878827  8631 raft_consensus.cc:359] T 7806fa697a044140850e326d8e5889d1 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:48.879482  8631 raft_consensus.cc:740] T 7806fa697a044140850e326d8e5889d1 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.880251  8631 consensus_queue.cc:260] T 7806fa697a044140850e326d8e5889d1 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:48.881968  8631 ts_tablet_manager.cc:1434] T 7806fa697a044140850e326d8e5889d1 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:16:48.882633  8631 tablet_bootstrap.cc:492] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:48.899452  8631 tablet_bootstrap.cc:492] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:48.900427  8631 tablet_bootstrap.cc:492] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:48.901144  8631 ts_tablet_manager.cc:1403] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:16:48.903612  8631 raft_consensus.cc:359] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:48.904421  8631 raft_consensus.cc:740] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.905112  8631 consensus_queue.cc:260] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:48.906478  8631 ts_tablet_manager.cc:1434] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:16:48.907150  8631 tablet_bootstrap.cc:492] T 1f5409294f3e4162a75137e616968afb P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:48.925253  8631 tablet_bootstrap.cc:492] T 1f5409294f3e4162a75137e616968afb P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:48.926137  8631 tablet_bootstrap.cc:492] T 1f5409294f3e4162a75137e616968afb P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:48.926705  8631 ts_tablet_manager.cc:1403] T 1f5409294f3e4162a75137e616968afb P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:16:48.928798  8631 raft_consensus.cc:359] T 1f5409294f3e4162a75137e616968afb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:48.929423  8631 raft_consensus.cc:740] T 1f5409294f3e4162a75137e616968afb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.930023  8631 consensus_queue.cc:260] T 1f5409294f3e4162a75137e616968afb P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:48.931862  8631 ts_tablet_manager.cc:1434] T 1f5409294f3e4162a75137e616968afb P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:16:48.932567  8631 tablet_bootstrap.cc:492] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:48.946209  8631 tablet_bootstrap.cc:492] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:48.947113  8631 tablet_bootstrap.cc:492] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:48.947652  8631 ts_tablet_manager.cc:1403] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:16:48.949440  8631 raft_consensus.cc:359] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:48.949913  8631 raft_consensus.cc:740] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.950471  8631 consensus_queue.cc:260] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:48.951817  8631 ts_tablet_manager.cc:1434] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:16:48.952476  8631 tablet_bootstrap.cc:492] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:48.964735  8631 tablet_bootstrap.cc:492] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:48.965677  8631 tablet_bootstrap.cc:492] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:48.966341  8631 ts_tablet_manager.cc:1403] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.014s	user 0.004s	sys 0.008s
I20260709 13:16:48.968379  8631 raft_consensus.cc:359] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:48.968994  8631 raft_consensus.cc:740] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.969642  8631 consensus_queue.cc:260] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:48.971608  8631 ts_tablet_manager.cc:1434] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:16:48.972378  8631 tablet_bootstrap.cc:492] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:48.984273  8631 tablet_bootstrap.cc:492] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:48.985090  8631 tablet_bootstrap.cc:492] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:48.985749  8631 ts_tablet_manager.cc:1403] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:16:48.987493  8631 raft_consensus.cc:359] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:48.987998  8631 raft_consensus.cc:740] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.988523  8631 consensus_queue.cc:260] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:48.990319  8631 ts_tablet_manager.cc:1434] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:16:48.991034  8631 tablet_bootstrap.cc:492] T afc39d65d52c48e3a959c8876930ab07 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:49.021080  8631 tablet_bootstrap.cc:492] T afc39d65d52c48e3a959c8876930ab07 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:49.022109  8631 tablet_bootstrap.cc:492] T afc39d65d52c48e3a959c8876930ab07 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:49.022751  8631 ts_tablet_manager.cc:1403] T afc39d65d52c48e3a959c8876930ab07 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.000s
I20260709 13:16:49.025177  8631 raft_consensus.cc:359] T afc39d65d52c48e3a959c8876930ab07 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:49.025980  8631 raft_consensus.cc:740] T afc39d65d52c48e3a959c8876930ab07 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.026618  8631 consensus_queue.cc:260] T afc39d65d52c48e3a959c8876930ab07 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:49.029868  8631 ts_tablet_manager.cc:1434] T afc39d65d52c48e3a959c8876930ab07 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:49.030673  8631 tablet_bootstrap.cc:492] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:49.052485 30972 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:16:49.052953 30972 ts_tablet_manager.cc:595] Time spent register tablets: real 0.240s	user 0.231s	sys 0.003s
I20260709 13:16:49.054522  8631 tablet_bootstrap.cc:492] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:49.055562  8631 tablet_bootstrap.cc:492] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:49.056231  8631 ts_tablet_manager.cc:1403] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.004s
I20260709 13:16:49.058825  8631 raft_consensus.cc:359] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:49.059391  8631 raft_consensus.cc:740] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.060348  8631 consensus_queue.cc:260] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:49.062714  8631 ts_tablet_manager.cc:1434] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:16:49.063524  8631 tablet_bootstrap.cc:492] T 87d445d744434f90baaf040e708b1e98 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:49.118705  8631 tablet_bootstrap.cc:492] T 87d445d744434f90baaf040e708b1e98 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:49.119663  8631 tablet_bootstrap.cc:492] T 87d445d744434f90baaf040e708b1e98 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:49.124203  8631 ts_tablet_manager.cc:1403] T 87d445d744434f90baaf040e708b1e98 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.061s	user 0.030s	sys 0.024s
I20260709 13:16:49.126849  8631 raft_consensus.cc:359] T 87d445d744434f90baaf040e708b1e98 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:49.127369  8631 raft_consensus.cc:740] T 87d445d744434f90baaf040e708b1e98 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.128065  8631 consensus_queue.cc:260] T 87d445d744434f90baaf040e708b1e98 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:49.130079  8631 ts_tablet_manager.cc:1434] T 87d445d744434f90baaf040e708b1e98 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:16:49.130836  8631 tablet_bootstrap.cc:492] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:49.149495  8631 tablet_bootstrap.cc:492] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:49.150239  8631 tablet_bootstrap.cc:492] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:49.150755  8631 ts_tablet_manager.cc:1403] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 13:16:49.152702  8631 raft_consensus.cc:359] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:49.153270  8631 raft_consensus.cc:740] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.153878  8631 consensus_queue.cc:260] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:49.155369  8631 ts_tablet_manager.cc:1434] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:16:49.155985  8631 tablet_bootstrap.cc:492] T e74f9555b1f64bc080273bc35b9ef15b P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:49.171934  8631 tablet_bootstrap.cc:492] T e74f9555b1f64bc080273bc35b9ef15b P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:49.172895  8631 tablet_bootstrap.cc:492] T e74f9555b1f64bc080273bc35b9ef15b P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:49.173496  8631 ts_tablet_manager.cc:1403] T e74f9555b1f64bc080273bc35b9ef15b P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 13:16:49.175944  8631 raft_consensus.cc:359] T e74f9555b1f64bc080273bc35b9ef15b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:49.176610  8631 raft_consensus.cc:740] T e74f9555b1f64bc080273bc35b9ef15b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.177294  8631 consensus_queue.cc:260] T e74f9555b1f64bc080273bc35b9ef15b P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:49.179291  8631 ts_tablet_manager.cc:1434] T e74f9555b1f64bc080273bc35b9ef15b P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:49.180073  8631 tablet_bootstrap.cc:492] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:49.201563  8631 tablet_bootstrap.cc:492] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:49.202595  8631 tablet_bootstrap.cc:492] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:49.203315  8631 ts_tablet_manager.cc:1403] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 13:16:49.205845  8631 raft_consensus.cc:359] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:49.206598  8631 raft_consensus.cc:740] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.207461  8631 consensus_queue.cc:260] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:49.209827  8631 ts_tablet_manager.cc:1434] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:16:49.210587  8631 tablet_bootstrap.cc:492] T d99b23f5044644c1b270bc5afcaf2119 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:49.213838 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.1:35503
I20260709 13:16:49.213946  8704 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.1:35503 every 8 connection(s)
I20260709 13:16:49.238965  8631 tablet_bootstrap.cc:492] T d99b23f5044644c1b270bc5afcaf2119 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:49.240027  8631 tablet_bootstrap.cc:492] T d99b23f5044644c1b270bc5afcaf2119 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:49.240726  8631 ts_tablet_manager.cc:1403] T d99b23f5044644c1b270bc5afcaf2119 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.004s
I20260709 13:16:49.243309  8631 raft_consensus.cc:359] T d99b23f5044644c1b270bc5afcaf2119 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:49.244050  8631 raft_consensus.cc:740] T d99b23f5044644c1b270bc5afcaf2119 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.244938  8631 consensus_queue.cc:260] T d99b23f5044644c1b270bc5afcaf2119 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:49.246938  8705 heartbeater.cc:344] Connected to a master server at 127.30.63.62:45347
I20260709 13:16:49.247375  8705 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:49.247454  8631 ts_tablet_manager.cc:1434] T d99b23f5044644c1b270bc5afcaf2119 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:16:49.248199  8705 heartbeater.cc:507] Master 127.30.63.62:45347 requested a full tablet report, sending...
I20260709 13:16:49.248384  8631 tablet_bootstrap.cc:492] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:49.264034  8632 raft_consensus.cc:493] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.267939  8632 raft_consensus.cc:515] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:49.269858  8631 tablet_bootstrap.cc:492] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:49.270895  8631 tablet_bootstrap.cc:492] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:49.271600  8631 ts_tablet_manager.cc:1403] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.008s
I20260709 13:16:49.272378  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7f3171e8b84ac48e0abd056c43f778" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:49.275453  8632 leader_election.cc:290] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:49.278620  8678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7f3171e8b84ac48e0abd056c43f778" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:49.282773  8678 raft_consensus.cc:2468] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 1.
I20260709 13:16:49.282797  8631 raft_consensus.cc:359] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:49.284993  8631 raft_consensus.cc:740] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.286340  8631 consensus_queue.cc:260] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:49.268407  7689 ts_manager.cc:194] Re-registered known tserver with Master: 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:49.289085  7904 leader_election.cc:304] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: c9a569f7d1ad42359002386a73702690
I20260709 13:16:49.289459  8631 ts_tablet_manager.cc:1434] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.001s
I20260709 13:16:49.290555  8631 tablet_bootstrap.cc:492] T 2e6d18ad10a340e2aa1fba5831e6db57 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:49.291746  8632 raft_consensus.cc:2804] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:49.292171  8632 raft_consensus.cc:493] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.292538  8632 raft_consensus.cc:3060] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.295406  8555 raft_consensus.cc:493] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.295969  8555 raft_consensus.cc:515] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:49.300884  7939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985b6cf5ffe74ecfabc7ba74e262a88f" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:49.304777  8555 leader_election.cc:290] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:49.305784  8555 raft_consensus.cc:493] T de92af0966804027bbe4ec91b14382d4 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.306281  8555 raft_consensus.cc:515] T de92af0966804027bbe4ec91b14382d4 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:49.309072  8678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985b6cf5ffe74ecfabc7ba74e262a88f" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:49.310132  8678 raft_consensus.cc:2468] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 1.
I20260709 13:16:49.309093  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de92af0966804027bbe4ec91b14382d4" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:49.313537  7830 leader_election.cc:304] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:49.314749  8568 raft_consensus.cc:2804] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:49.315198  8568 raft_consensus.cc:493] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.315559  8568 raft_consensus.cc:3060] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.324894  8495 raft_consensus.cc:493] T 93cca694a49b44ba8eda19c91491696e P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.325775  8495 raft_consensus.cc:515] T 93cca694a49b44ba8eda19c91491696e P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:49.326962  8568 raft_consensus.cc:515] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:49.330152  8547 raft_consensus.cc:493] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.330947  8547 raft_consensus.cc:515] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:49.332401  8633 raft_consensus.cc:493] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.332777  8522 raft_consensus.cc:493] T da682789343c4852b052f5fa4483c715 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.333189  8633 raft_consensus.cc:515] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:49.333693  8522 raft_consensus.cc:515] T da682789343c4852b052f5fa4483c715 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:49.335632  8633 leader_election.cc:290] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:49.337612  8012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed88d7e51364cb28224875b51de8f8e" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:49.337749  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93cca694a49b44ba8eda19c91491696e" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:49.342320  8678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed88d7e51364cb28224875b51de8f8e" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:49.343146  8555 leader_election.cc:290] T de92af0966804027bbe4ec91b14382d4 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:49.344902  8678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de92af0966804027bbe4ec91b14382d4" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:49.349712  7689 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42640
I20260709 13:16:49.349495  7865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceaecfbd6ac84206af71ba2b5fe22259" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:49.352092  8547 leader_election.cc:290] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:49.353550  8611 raft_consensus.cc:493] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.355224  8705 heartbeater.cc:499] Master 127.30.63.62:45347 was elected leader, sending a full tablet report...
I20260709 13:16:49.355427  8611 raft_consensus.cc:515] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:49.358574  8611 leader_election.cc:290] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:49.359670  8714 raft_consensus.cc:493] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.354682  8628 raft_consensus.cc:493] T ea7f3171e8b84ac48e0abd056c43f778 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.367545  8628 raft_consensus.cc:515] T ea7f3171e8b84ac48e0abd056c43f778 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:49.369894  8628 leader_election.cc:290] T ea7f3171e8b84ac48e0abd056c43f778 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:49.360160  8495 leader_election.cc:290] T 93cca694a49b44ba8eda19c91491696e P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:49.361174  8522 leader_election.cc:290] T da682789343c4852b052f5fa4483c715 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:49.361191  8678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93cca694a49b44ba8eda19c91491696e" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:49.371430  8495 raft_consensus.cc:493] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
W20260709 13:16:49.353622  7830 leader_election.cc:343] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.362244  8679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da682789343c4852b052f5fa4483c715" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:49.372517  8495 raft_consensus.cc:515] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:49.373507  7830 leader_election.cc:304] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690
I20260709 13:16:49.374768  8495 leader_election.cc:290] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:49.365633  7939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c64de12c904e15892de849a597eeae" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:49.376305  7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7f3171e8b84ac48e0abd056c43f778" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
W20260709 13:16:49.375442  7830 leader_election.cc:343] T de92af0966804027bbe4ec91b14382d4 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.377192  7830 leader_election.cc:304] T de92af0966804027bbe4ec91b14382d4 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690
I20260709 13:16:49.378330  8555 raft_consensus.cc:2749] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:49.379189  8679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c64de12c904e15892de849a597eeae" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:49.366348  8547 raft_consensus.cc:493] T f35a05f13eee42d4bdd19ff8b2b98212 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.366786  7935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985b6cf5ffe74ecfabc7ba74e262a88f" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:49.381709  8547 raft_consensus.cc:515] T f35a05f13eee42d4bdd19ff8b2b98212 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:49.375313  8714 raft_consensus.cc:515] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:49.385963  7865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35a05f13eee42d4bdd19ff8b2b98212" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:49.386443  7939 raft_consensus.cc:2468] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 1.
I20260709 13:16:49.387928  8714 leader_election.cc:290] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:49.388505  7865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c64de12c904e15892de849a597eeae" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:49.389367  7865 raft_consensus.cc:2468] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 1.
I20260709 13:16:49.375998  8568 leader_election.cc:290] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Requested vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:49.390969  7907 leader_election.cc:304] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:16:49.392112  8547 leader_election.cc:290] T f35a05f13eee42d4bdd19ff8b2b98212 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:49.393261  8679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985b6cf5ffe74ecfabc7ba74e262a88f" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:49.394053  8679 raft_consensus.cc:3060] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.396677  8547 raft_consensus.cc:493] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.397212  8495 raft_consensus.cc:2804] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:49.397455  8547 raft_consensus.cc:515] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:49.398008  8495 raft_consensus.cc:493] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.398588  8495 raft_consensus.cc:3060] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.401818  7865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06dd732d5f194c5f8bacb0d12d551212" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:49.403784  8547 leader_election.cc:290] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:49.405025  8678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8725967bab0469eb6a5ed9c6bddf3cb" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:49.405150  8676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c64de12c904e15892de849a597eeae" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:49.407289  7832 leader_election.cc:304] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 
W20260709 13:16:49.408499  7904 leader_election.cc:343] T 93cca694a49b44ba8eda19c91491696e P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:49.409374  7904 leader_election.cc:343] T da682789343c4852b052f5fa4483c715 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:49.410073  7904 leader_election.cc:343] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:49.410776  7904 leader_election.cc:343] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.358701  8632 raft_consensus.cc:515] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:49.412382  7933 raft_consensus.cc:2393] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a569f7d1ad42359002386a73702690 in current term 2: Already voted for candidate 7de07e50a1714f5d9055bb4b86655200 in this term.
I20260709 13:16:49.412810  8633 raft_consensus.cc:2749] T de92af0966804027bbe4ec91b14382d4 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:49.415355  8568 raft_consensus.cc:2804] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:49.415796  8568 raft_consensus.cc:493] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.416236  8568 raft_consensus.cc:3060] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.418637  8495 raft_consensus.cc:515] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:49.423791  7865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c64de12c904e15892de849a597eeae" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:49.424795  8495 leader_election.cc:290] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 election: Requested vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:49.424844  8714 raft_consensus.cc:493] T 985b6cf5ffe74ecfabc7ba74e262a88f P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.426286  8714 raft_consensus.cc:515] T 985b6cf5ffe74ecfabc7ba74e262a88f P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:49.428618  8555 raft_consensus.cc:493] T 5391ca2d8a8747bebb865e71268e06ad P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.429201  8555 raft_consensus.cc:515] T 5391ca2d8a8747bebb865e71268e06ad P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:49.431115  7860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985b6cf5ffe74ecfabc7ba74e262a88f" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:49.431434  8555 leader_election.cc:290] T 5391ca2d8a8747bebb865e71268e06ad P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:49.432291  7860 raft_consensus.cc:2393] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7de07e50a1714f5d9055bb4b86655200 in current term 2: Already voted for candidate 1c5936948a84476fb0dcc1fa2d895740 in this term.
I20260709 13:16:49.433197  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5391ca2d8a8747bebb865e71268e06ad" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:49.434475  8714 leader_election.cc:290] T 985b6cf5ffe74ecfabc7ba74e262a88f P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
W20260709 13:16:49.428260  7830 leader_election.cc:343] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.437042  8632 leader_election.cc:290] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:49.438428  8676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5391ca2d8a8747bebb865e71268e06ad" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:49.440012  8679 raft_consensus.cc:2468] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 2.
W20260709 13:16:49.441378  7830 leader_election.cc:343] T 5391ca2d8a8747bebb865e71268e06ad P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.441795  8676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c64de12c904e15892de849a597eeae" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:49.442085  7830 leader_election.cc:304] T 5391ca2d8a8747bebb865e71268e06ad P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690
I20260709 13:16:49.443157  8555 raft_consensus.cc:2749] T 5391ca2d8a8747bebb865e71268e06ad P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:49.449893  8676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985b6cf5ffe74ecfabc7ba74e262a88f" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:49.451151  8676 raft_consensus.cc:2393] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7de07e50a1714f5d9055bb4b86655200 in current term 2: Already voted for candidate 1c5936948a84476fb0dcc1fa2d895740 in this term.
I20260709 13:16:49.461165  8628 raft_consensus.cc:493] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.461874  8628 raft_consensus.cc:515] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:49.464987  8547 raft_consensus.cc:493] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.465603  8547 raft_consensus.cc:515] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:49.465909  7860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5391ca2d8a8747bebb865e71268e06ad" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:49.466869  7860 raft_consensus.cc:2468] T 5391ca2d8a8747bebb865e71268e06ad P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 1.
I20260709 13:16:49.467865  8547 leader_election.cc:290] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:49.470634  8633 raft_consensus.cc:493] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.471256  8633 raft_consensus.cc:515] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:49.471884  7981 leader_election.cc:304] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:49.472085  7860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e84fab0d4fc43359b4219baa6171aa5" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:49.472862  8547 raft_consensus.cc:2804] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:49.473275  8547 raft_consensus.cc:493] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.473649  8547 raft_consensus.cc:3060] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.464363  8628 leader_election.cc:290] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:49.480062  8633 leader_election.cc:290] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:49.485824  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35a05f13eee42d4bdd19ff8b2b98212" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:49.486583  8013 raft_consensus.cc:2468] T f35a05f13eee42d4bdd19ff8b2b98212 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 1.
I20260709 13:16:49.487776  7832 leader_election.cc:304] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:49.491026  8547 raft_consensus.cc:515] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:49.493718  8628 raft_consensus.cc:493] T 9c126cef127140f48a31bbd723a86051 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.494325  8628 raft_consensus.cc:515] T 9c126cef127140f48a31bbd723a86051 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:49.496714  8628 leader_election.cc:290] T 9c126cef127140f48a31bbd723a86051 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:49.497545  7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c126cef127140f48a31bbd723a86051" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:49.499154  8611 raft_consensus.cc:2804] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:49.499711  8611 raft_consensus.cc:493] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.500136  8611 raft_consensus.cc:3060] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.502245  8719 raft_consensus.cc:493] T deeaf93ab6424e9c8013e6c9fbccb724 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.502928  8719 raft_consensus.cc:515] T deeaf93ab6424e9c8013e6c9fbccb724 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:49.506124  8555 raft_consensus.cc:493] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.506866  8555 raft_consensus.cc:515] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:49.512370  8555 leader_election.cc:290] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:49.508517  8547 leader_election.cc:290] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 election: Requested vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:49.508718  8719 leader_election.cc:290] T deeaf93ab6424e9c8013e6c9fbccb724 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:49.515800  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceaecfbd6ac84206af71ba2b5fe22259" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:49.517413  8013 raft_consensus.cc:2468] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 2.
I20260709 13:16:49.519200  7832 leader_election.cc:304] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:49.529301  8673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7f3171e8b84ac48e0abd056c43f778" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:49.530362  8673 raft_consensus.cc:2468] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 1.
I20260709 13:16:49.531947  8673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e84fab0d4fc43359b4219baa6171aa5" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:49.535840  8671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35a05f13eee42d4bdd19ff8b2b98212" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:49.532401  8676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35a05f13eee42d4bdd19ff8b2b98212" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:49.536842  8671 raft_consensus.cc:2468] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 1.
I20260709 13:16:49.524304  8678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7f3171e8b84ac48e0abd056c43f778" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:49.538570  8678 raft_consensus.cc:3060] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.538419  8670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06dd732d5f194c5f8bacb0d12d551212" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:49.530267  8675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5391ca2d8a8747bebb865e71268e06ad" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:49.556053  8717 raft_consensus.cc:2804] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:49.556869  8717 raft_consensus.cc:493] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.557338  8717 raft_consensus.cc:3060] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:49.570132  8723 raft_consensus.cc:493] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.549311  8714 raft_consensus.cc:493] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.570987  8723 raft_consensus.cc:515] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:49.571760  8714 raft_consensus.cc:515] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:49.521413  8633 raft_consensus.cc:493] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.512233  8568 raft_consensus.cc:515] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:49.544204  8719 raft_consensus.cc:493] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.585598  7939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deeaf93ab6424e9c8013e6c9fbccb724" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:49.577503  7860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5391ca2d8a8747bebb865e71268e06ad" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:49.588054  8719 raft_consensus.cc:515] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:49.588698  7860 raft_consensus.cc:3060] T 5391ca2d8a8747bebb865e71268e06ad P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.590242  8719 leader_election.cc:290] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:49.569989  8717 raft_consensus.cc:515] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:49.594208  8674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceaecfbd6ac84206af71ba2b5fe22259" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:49.595742  8631 tablet_bootstrap.cc:492] T 2e6d18ad10a340e2aa1fba5831e6db57 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:49.596841  7865 raft_consensus.cc:2393] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7de07e50a1714f5d9055bb4b86655200 in current term 2: Already voted for candidate 1c5936948a84476fb0dcc1fa2d895740 in this term.
I20260709 13:16:49.600437  8631 tablet_bootstrap.cc:492] T 2e6d18ad10a340e2aa1fba5831e6db57 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:49.601161  8631 ts_tablet_manager.cc:1403] T 2e6d18ad10a340e2aa1fba5831e6db57 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.311s	user 0.076s	sys 0.103s
I20260709 13:16:49.602649  8670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5391ca2d8a8747bebb865e71268e06ad" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:49.603629  8673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06dd732d5f194c5f8bacb0d12d551212" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:49.604401  8675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceaecfbd6ac84206af71ba2b5fe22259" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:49.605733  8631 raft_consensus.cc:359] T 2e6d18ad10a340e2aa1fba5831e6db57 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:49.606509  8631 raft_consensus.cc:740] T 2e6d18ad10a340e2aa1fba5831e6db57 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.607206  8631 consensus_queue.cc:260] T 2e6d18ad10a340e2aa1fba5831e6db57 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:49.604435  7830 leader_election.cc:304] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:49.609562  8631 ts_tablet_manager.cc:1434] T 2e6d18ad10a340e2aa1fba5831e6db57 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
W20260709 13:16:49.610183  7830 leader_election.cc:343] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.610437  8631 tablet_bootstrap.cc:492] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:49.579991  8633 raft_consensus.cc:515] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:49.613318  7860 raft_consensus.cc:2468] T 5391ca2d8a8747bebb865e71268e06ad P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 2.
I20260709 13:16:49.615010  7981 leader_election.cc:304] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:49.615355  8633 leader_election.cc:290] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:49.616181  8628 raft_consensus.cc:2804] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:49.617270  8628 raft_consensus.cc:697] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [term 2 LEADER]: Becoming Leader. State: Replica: c9a569f7d1ad42359002386a73702690, State: Running, Role: LEADER
I20260709 13:16:49.617676  8632 raft_consensus.cc:493] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.595254  8679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deeaf93ab6424e9c8013e6c9fbccb724" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:49.618338  8628 consensus_queue.cc:237] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:49.618345  8632 raft_consensus.cc:515] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:49.619637  8674 raft_consensus.cc:2468] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 2.
I20260709 13:16:49.621049  8632 leader_election.cc:290] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:49.621520  8714 leader_election.cc:290] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
W20260709 13:16:49.633150  7904 leader_election.cc:343] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.633894  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06dd732d5f194c5f8bacb0d12d551212" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:49.633939  7904 leader_election.cc:304] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200; no voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:49.634647  8013 raft_consensus.cc:2468] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 1.
I20260709 13:16:49.635535  8547 raft_consensus.cc:493] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.643909  7904 leader_election.cc:304] T 985b6cf5ffe74ecfabc7ba74e262a88f P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200; no voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:49.645804  8522 raft_consensus.cc:2749] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:49.658034  7939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4af0a88c7f43bcaa15fc11bdfaf591" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:49.637424  8495 raft_consensus.cc:493] T 191eb110a7ae4009a2184d4c3af4f439 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.636147  8547 raft_consensus.cc:515] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:49.653463  8555 raft_consensus.cc:2804] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:49.660228  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deeaf93ab6424e9c8013e6c9fbccb724" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:49.655539  8670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c126cef127140f48a31bbd723a86051" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:49.672814  7862 raft_consensus.cc:2468] T deeaf93ab6424e9c8013e6c9fbccb724 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 1.
I20260709 13:16:49.675401  8547 leader_election.cc:290] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:49.675765  8678 raft_consensus.cc:2468] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 2.
I20260709 13:16:49.676493  8674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4af0a88c7f43bcaa15fc11bdfaf591" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:49.688164  8547 raft_consensus.cc:493] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.677436  8674 raft_consensus.cc:2468] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 1.
I20260709 13:16:49.689488  8611 raft_consensus.cc:515] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:49.695103  8717 leader_election.cc:290] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 3 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:49.695889  8715 raft_consensus.cc:3060] T 985b6cf5ffe74ecfabc7ba74e262a88f P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:49.692973  7832 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:44141, user_credentials={real_user=slave}} blocked reactor thread for 47878.4us
I20260709 13:16:49.698904  8611 leader_election.cc:290] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:49.701977  8727 raft_consensus.cc:493] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.702616  8727 raft_consensus.cc:515] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:49.704282  8723 leader_election.cc:290] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:49.704298  8555 raft_consensus.cc:697] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Becoming Leader. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:16:49.706212  8555 consensus_queue.cc:237] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:49.708069  7861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72bd809944d47a395c4bc1b0fc18c19" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:49.708748  7861 raft_consensus.cc:2468] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 1.
I20260709 13:16:49.708833  8720 raft_consensus.cc:493] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.709429  8720 raft_consensus.cc:515] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:49.710692  8008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceaecfbd6ac84206af71ba2b5fe22259" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:49.711293  8008 raft_consensus.cc:3060] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:49.711789  8720 leader_election.cc:290] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:49.711191  8679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72bd809944d47a395c4bc1b0fc18c19" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:49.712802  8719 raft_consensus.cc:493] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.713550  8723 raft_consensus.cc:493] T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.714078  8723 raft_consensus.cc:515] T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:49.717788  8678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deeaf93ab6424e9c8013e6c9fbccb724" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:49.718258  7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191eb110a7ae4009a2184d4c3af4f439" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:49.718525  8553 raft_consensus.cc:493] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.719168  8553 raft_consensus.cc:515] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:49.669160  8495 raft_consensus.cc:515] T 191eb110a7ae4009a2184d4c3af4f439 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:49.721138  7904 leader_election.cc:304] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:16:49.722110  8716 raft_consensus.cc:2804] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:49.722568  8716 raft_consensus.cc:697] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200 [term 2 LEADER]: Becoming Leader. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Running, Role: LEADER
I20260709 13:16:49.722867  8495 leader_election.cc:290] T 191eb110a7ae4009a2184d4c3af4f439 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:49.723382  8716 consensus_queue.cc:237] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:49.723765  8547 raft_consensus.cc:515] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:49.725802  8012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35a05f13eee42d4bdd19ff8b2b98212" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:49.726076  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc8636f68ae4121ac05d99e24866633" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:49.726413  8012 raft_consensus.cc:3060] T f35a05f13eee42d4bdd19ff8b2b98212 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.726647  8015 raft_consensus.cc:2468] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 1.
I20260709 13:16:49.727317  7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72bd809944d47a395c4bc1b0fc18c19" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:49.727718  8722 raft_consensus.cc:493] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.728150  7937 raft_consensus.cc:2468] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 1.
I20260709 13:16:49.728287  8722 raft_consensus.cc:515] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:49.730327  8568 leader_election.cc:290] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Requested vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:49.731268  7933 raft_consensus.cc:2468] T 191eb110a7ae4009a2184d4c3af4f439 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 1.
I20260709 13:16:49.713308  8719 raft_consensus.cc:515] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:49.733870  7980 leader_election.cc:304] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:49.724076  7832 leader_election.cc:304] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:49.735121  8717 raft_consensus.cc:2804] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:16:49.738132  7830 leader_election.cc:343] T deeaf93ab6424e9c8013e6c9fbccb724 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.738610  7830 leader_election.cc:304] T deeaf93ab6424e9c8013e6c9fbccb724 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:49.740383  8012 raft_consensus.cc:2468] T f35a05f13eee42d4bdd19ff8b2b98212 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 2.
I20260709 13:16:49.741715  7832 leader_election.cc:304] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:49.712481  8720 raft_consensus.cc:493] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.766455  7832 leader_election.cc:304] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:49.766387  7830 leader_election.cc:304] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 7de07e50a1714f5d9055bb4b86655200
W20260709 13:16:49.768047  7904 leader_election.cc:343] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.777292  7939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c64de12c904e15892de849a597eeae" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:49.778368  7939 raft_consensus.cc:2393] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c5936948a84476fb0dcc1fa2d895740 in current term 2: Already voted for candidate 7de07e50a1714f5d9055bb4b86655200 in this term.
I20260709 13:16:49.778426  7832 leader_election.cc:304] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:16:49.778647  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b5a061ff84745af17197de774ac96" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:49.735291  8722 leader_election.cc:290] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:49.779270  8013 raft_consensus.cc:2468] T c04b5a061ff84745af17197de774ac96 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 1.
I20260709 13:16:49.735554  8723 leader_election.cc:290] T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:49.735953  8717 raft_consensus.cc:493] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.768174  8726 raft_consensus.cc:2749] T deeaf93ab6424e9c8013e6c9fbccb724 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:49.798826  8717 raft_consensus.cc:3060] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.783928  7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eb35ec786da4450bcf232cf85ba857b" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:49.787199  8678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191eb110a7ae4009a2184d4c3af4f439" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:49.787629  8727 leader_election.cc:290] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:49.788525  8522 raft_consensus.cc:493] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.801160  8522 raft_consensus.cc:515] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:49.777345  8633 raft_consensus.cc:2804] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:49.803365  8633 raft_consensus.cc:493] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.803938  8633 raft_consensus.cc:3060] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.804471  8723 raft_consensus.cc:2804] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:49.804908  8723 raft_consensus.cc:493] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.805260  8723 raft_consensus.cc:3060] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.806850  8522 leader_election.cc:290] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:49.780834  8714 raft_consensus.cc:493] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.808782  8725 raft_consensus.cc:2804] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:49.808498  8714 raft_consensus.cc:515] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:49.809217  8725 raft_consensus.cc:493] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.809620  8725 raft_consensus.cc:3060] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.810971  8717 raft_consensus.cc:515] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:49.811266  8714 leader_election.cc:290] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:49.781258  8718 raft_consensus.cc:2804] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:49.812490  8718 raft_consensus.cc:697] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Becoming Leader. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:16:49.813757  8718 consensus_queue.cc:237] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
W20260709 13:16:49.793481  7904 leader_election.cc:343] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:49.818516  7904 leader_election.cc:343] T 191eb110a7ae4009a2184d4c3af4f439 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.784401  8547 leader_election.cc:290] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:49.793810  7861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de92af0966804027bbe4ec91b14382d4" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:49.777411  8720 raft_consensus.cc:515] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:49.777770  8008 raft_consensus.cc:2468] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 3.
I20260709 13:16:49.797966  8715 raft_consensus.cc:2749] T 985b6cf5ffe74ecfabc7ba74e262a88f P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:49.807596  7937 raft_consensus.cc:2468] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 1.
I20260709 13:16:49.788602  7906 leader_election.cc:304] T 93cca694a49b44ba8eda19c91491696e P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690
I20260709 13:16:49.803845  8719 leader_election.cc:290] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
W20260709 13:16:49.828433  7907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:45491, user_credentials={real_user=slave}} blocked reactor thread for 165500us
I20260709 13:16:49.830191  8717 leader_election.cc:290] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:49.850965  7865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4af0a88c7f43bcaa15fc11bdfaf591" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:49.826821  8547 raft_consensus.cc:2804] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:49.858268  7907 leader_election.cc:304] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:49.859431  7907 leader_election.cc:304] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:49.826246  7861 raft_consensus.cc:2468] T de92af0966804027bbe4ec91b14382d4 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 1.
I20260709 13:16:49.874766  8495 raft_consensus.cc:2804] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:49.875383  8495 raft_consensus.cc:493] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.875872  8495 raft_consensus.cc:3060] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.857030  8547 raft_consensus.cc:493] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
W20260709 13:16:49.879961  7830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:35503, user_credentials={real_user=slave}} blocked reactor thread for 113645us
I20260709 13:16:49.861963  8522 raft_consensus.cc:493] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.869973  7860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eb35ec786da4450bcf232cf85ba857b" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:49.913478  8495 raft_consensus.cc:515] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
W20260709 13:16:49.922277  7906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:46031, user_credentials={real_user=slave}} blocked reactor thread for 133777us
I20260709 13:16:49.879020  8553 leader_election.cc:290] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:49.877924  8678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eb35ec786da4450bcf232cf85ba857b" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:49.940797  8678 raft_consensus.cc:2468] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 1.
I20260709 13:16:49.940917  8675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72bd809944d47a395c4bc1b0fc18c19" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:49.942459  7904 leader_election.cc:304] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: 
W20260709 13:16:49.943361  7904 leader_election.cc:343] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.935842  8495 leader_election.cc:290] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 election: Requested vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:49.918520  7859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc8636f68ae4121ac05d99e24866633" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:49.877605  8732 raft_consensus.cc:2804] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:49.893558  8547 raft_consensus.cc:3060] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:49.960398  7907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:45491, user_credentials={real_user=slave}} blocked reactor thread for 100037us
I20260709 13:16:49.966264  8495 raft_consensus.cc:2804] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:49.877347  8725 raft_consensus.cc:515] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:49.966661  8495 raft_consensus.cc:493] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.970973  8495 raft_consensus.cc:3060] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.944433  7860 raft_consensus.cc:2468] T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 1.
I20260709 13:16:49.916762  8522 raft_consensus.cc:515] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:49.946511  8728 raft_consensus.cc:493] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.930821  8674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4af0a88c7f43bcaa15fc11bdfaf591" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:49.961802  8732 raft_consensus.cc:493] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:49.967527  8670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72bd809944d47a395c4bc1b0fc18c19" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:49.984872  7865 raft_consensus.cc:2393] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7de07e50a1714f5d9055bb4b86655200 in current term 2: Already voted for candidate 1c5936948a84476fb0dcc1fa2d895740 in this term.
I20260709 13:16:49.975623  7978 leader_election.cc:304] T ea7f3171e8b84ac48e0abd056c43f778 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:49.917425  8720 leader_election.cc:290] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
W20260709 13:16:49.968777  7981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:45491, user_credentials={real_user=slave}} blocked reactor thread for 102968us
I20260709 13:16:49.978176  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72bd809944d47a395c4bc1b0fc18c19" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:49.977165  8716 raft_consensus.cc:2749] T 93cca694a49b44ba8eda19c91491696e P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:49.989220  8495 raft_consensus.cc:515] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:49.995319  7689 catalog_manager.cc:5697] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 reported cstate change: term changed from 1 to 2, leader changed from 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1) to c9a569f7d1ad42359002386a73702690 (127.30.63.4). New cstate: current_term: 2 leader_uuid: "c9a569f7d1ad42359002386a73702690" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:50.001315  7978 leader_election.cc:304] T f35a05f13eee42d4bdd19ff8b2b98212 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 1c5936948a84476fb0dcc1fa2d895740
I20260709 13:16:49.989494  8669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceaecfbd6ac84206af71ba2b5fe22259" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:49.988920  8732 raft_consensus.cc:3060] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:50.007952  7978 leader_election.cc:343] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.997504  7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da682789343c4852b052f5fa4483c715" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:50.010038  7978 leader_election.cc:304] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:49.991622  8674 raft_consensus.cc:2468] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 1.
I20260709 13:16:49.988147  8728 raft_consensus.cc:515] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
W20260709 13:16:50.014370  7978 leader_election.cc:343] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.016382  7978 leader_election.cc:304] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:50.021829  8675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c64de12c904e15892de849a597eeae" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:50.024727  8723 raft_consensus.cc:515] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:50.026005  8678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b5a061ff84745af17197de774ac96" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:50.022030  8728 leader_election.cc:290] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:50.010504  8669 raft_consensus.cc:3060] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:50.029839  7830 leader_election.cc:343] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.046068  8495 leader_election.cc:290] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 election: Requested vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:50.008538  8744 raft_consensus.cc:2804] T ea7f3171e8b84ac48e0abd056c43f778 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:16:50.050465  7830 leader_election.cc:343] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.045506  8741 raft_consensus.cc:2749] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:50.057483  8725 leader_election.cc:290] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Requested vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:50.009358  8743 raft_consensus.cc:2764] T f35a05f13eee42d4bdd19ff8b2b98212 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 13:16:50.053643  7978 leader_election.cc:343] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.013942  8672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35a05f13eee42d4bdd19ff8b2b98212" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:50.052426  8631 tablet_bootstrap.cc:492] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:16:50.056420  7832 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:44141, user_credentials={real_user=slave}} blocked reactor thread for 278041us
I20260709 13:16:50.058604  7981 leader_election.cc:304] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 
W20260709 13:16:50.049489  8740 log.cc:927] Time spent T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:16:50.014179  7937 raft_consensus.cc:2468] T da682789343c4852b052f5fa4483c715 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 1.
W20260709 13:16:50.060913  7978 leader_election.cc:343] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.072060  7978 leader_election.cc:304] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 1c5936948a84476fb0dcc1fa2d895740
W20260709 13:16:50.063313  7904 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:35503, user_credentials={real_user=slave}} blocked reactor thread for 119314us
I20260709 13:16:50.074776  7904 leader_election.cc:304] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:16:50.071674  7832 leader_election.cc:304] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:50.079138  7865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eb35ec786da4450bcf232cf85ba857b" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:50.079635  8631 tablet_bootstrap.cc:492] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:50.079785  7865 raft_consensus.cc:3060] T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:50.080806  8631 ts_tablet_manager.cc:1403] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.471s	user 0.022s	sys 0.028s
I20260709 13:16:50.079900  7832 leader_election.cc:304] T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 
W20260709 13:16:50.083184  7978 leader_election.cc:343] T 9c126cef127140f48a31bbd723a86051 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.083779  7978 leader_election.cc:304] T 9c126cef127140f48a31bbd723a86051 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:50.085513  8013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06dd732d5f194c5f8bacb0d12d551212" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:50.087955  8633 raft_consensus.cc:515] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:50.090098  8633 leader_election.cc:290] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:50.060763  8628 raft_consensus.cc:2749] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:50.093103  8720 raft_consensus.cc:2764] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:16:50.094682  8522 leader_election.cc:290] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:50.095305  8522 raft_consensus.cc:2804] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:50.095656  8522 raft_consensus.cc:493] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:50.096061  8522 raft_consensus.cc:3060] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:50.076956  8671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e84fab0d4fc43359b4219baa6171aa5" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:50.097424  8670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eb35ec786da4450bcf232cf85ba857b" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:50.098089  8670 raft_consensus.cc:2468] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 1.
I20260709 13:16:50.085582  8718 raft_consensus.cc:2749] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:50.108083  7980 leader_election.cc:304] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:50.099175  8676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06dd732d5f194c5f8bacb0d12d551212" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:50.080955  7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8725967bab0469eb6a5ed9c6bddf3cb" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:50.078279  7862 raft_consensus.cc:2393] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7de07e50a1714f5d9055bb4b86655200 in current term 2: Already voted for candidate 1c5936948a84476fb0dcc1fa2d895740 in this term.
I20260709 13:16:50.100992  8679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72bd809944d47a395c4bc1b0fc18c19" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:50.101218  8678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eb35ec786da4450bcf232cf85ba857b" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:50.102844  8013 raft_consensus.cc:3060] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:50.117580  7865 raft_consensus.cc:2468] T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 2.
I20260709 13:16:50.088330  8008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e84fab0d4fc43359b4219baa6171aa5" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
W20260709 13:16:50.104179  7830 leader_election.cc:343] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.104966  8012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da682789343c4852b052f5fa4483c715" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:50.101475  8673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc8636f68ae4121ac05d99e24866633" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:50.114324  7686 catalog_manager.cc:5697] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 reported cstate change: term changed from 1 to 2, leader changed from 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1) to 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "1c5936948a84476fb0dcc1fa2d895740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:50.072384  8672 raft_consensus.cc:3060] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:50.068938  8723 leader_election.cc:290] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Requested vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:50.120214  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8725967bab0469eb6a5ed9c6bddf3cb" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:50.149006  8015 raft_consensus.cc:2468] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 1.
I20260709 13:16:50.054596  8744 raft_consensus.cc:493] T ea7f3171e8b84ac48e0abd056c43f778 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:50.120198  8628 raft_consensus.cc:2804] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:50.150030  7832 leader_election.cc:304] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:50.147250  7690 catalog_manager.cc:5697] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200 reported cstate change: term changed from 1 to 2, leader changed from 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1) to 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3). New cstate: current_term: 2 leader_uuid: "7de07e50a1714f5d9055bb4b86655200" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:50.085300  7981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:45491, user_credentials={real_user=slave}} blocked reactor thread for 64835.7us
I20260709 13:16:50.180924  8013 raft_consensus.cc:2468] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 2.
I20260709 13:16:50.113687  8553 raft_consensus.cc:2749] T 9c126cef127140f48a31bbd723a86051 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:50.120968  7907 leader_election.cc:304] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:16:50.160493  7932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4af0a88c7f43bcaa15fc11bdfaf591" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:50.161412  8719 raft_consensus.cc:2804] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:50.157681  8628 raft_consensus.cc:493] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:50.165174  7859 raft_consensus.cc:2393] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a569f7d1ad42359002386a73702690 in current term 2: Already voted for candidate 1c5936948a84476fb0dcc1fa2d895740 in this term.
I20260709 13:16:50.196528  8628 raft_consensus.cc:3060] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:50.194118  7860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed88d7e51364cb28224875b51de8f8e" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:50.199129  7860 raft_consensus.cc:2468] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 1.
I20260709 13:16:50.181030  8675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c126cef127140f48a31bbd723a86051" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:50.101989  8743 raft_consensus.cc:2804] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:50.157756  8744 raft_consensus.cc:3060] T ea7f3171e8b84ac48e0abd056c43f778 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:50.145431  7933 raft_consensus.cc:2468] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 1.
I20260709 13:16:50.177016  7939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72bd809944d47a395c4bc1b0fc18c19" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:50.206707  7939 raft_consensus.cc:2393] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c5936948a84476fb0dcc1fa2d895740 in current term 2: Already voted for candidate 7de07e50a1714f5d9055bb4b86655200 in this term.
I20260709 13:16:50.216086  7981 leader_election.cc:304] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:50.158608  7832 leader_election.cc:304] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:50.187105  8714 raft_consensus.cc:2804] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:50.220485  8714 raft_consensus.cc:697] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200 [term 2 LEADER]: Becoming Leader. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Running, Role: LEADER
I20260709 13:16:50.221781  8714 consensus_queue.cc:237] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
W20260709 13:16:50.225052  7832 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:46031, user_credentials={real_user=slave}} blocked reactor thread for 66516.4us
I20260709 13:16:50.225159  8732 raft_consensus.cc:515] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:50.226862  8739 raft_consensus.cc:2804] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:50.227628  8732 leader_election.cc:290] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 election: Requested vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:50.187606  8719 raft_consensus.cc:493] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:50.190493  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7f3171e8b84ac48e0abd056c43f778" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:50.228322  8719 raft_consensus.cc:3060] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:50.186906  8678 raft_consensus.cc:3060] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:50.166651  8674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4af0a88c7f43bcaa15fc11bdfaf591" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:50.232510  8674 raft_consensus.cc:3060] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:50.202678  7904 leader_election.cc:343] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.206529  7980 leader_election.cc:304] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:50.218240  8675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc8636f68ae4121ac05d99e24866633" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:50.227571  8739 raft_consensus.cc:697] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [term 3 LEADER]: Becoming Leader. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:16:50.238469  8739 consensus_queue.cc:237] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:50.193813  8631 raft_consensus.cc:359] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:50.240430  8675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deeaf93ab6424e9c8013e6c9fbccb724" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:50.241074  8631 raft_consensus.cc:740] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.242513  8631 consensus_queue.cc:260] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:50.244233  7859 raft_consensus.cc:1275] T 5391ca2d8a8747bebb865e71268e06ad P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Refusing update from remote peer c9a569f7d1ad42359002386a73702690: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:16:50.147079  7830 leader_election.cc:343] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:50.252110  7830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:35503, user_credentials={real_user=slave}} blocked reactor thread for 105055us
W20260709 13:16:50.253717  7830 leader_election.cc:343] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:50.254786  7830 leader_election.cc:343] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:50.255728  7830 leader_election.cc:343] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:50.256132  7830 leader_election.cc:343] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:50.257450  7904 leader_election.cc:343] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.258533  8631 ts_tablet_manager.cc:1434] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.177s	user 0.007s	sys 0.000s
I20260709 13:16:50.259459  8631 tablet_bootstrap.cc:492] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
W20260709 13:16:50.183202  7907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:45491, user_credentials={real_user=slave}} blocked reactor thread for 62359.1us
W20260709 13:16:50.261801  7980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:44141, user_credentials={real_user=slave}} blocked reactor thread for 55339.9us
I20260709 13:16:50.120955  8568 raft_consensus.cc:2764] T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:16:50.277522  8011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc8636f68ae4121ac05d99e24866633" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:50.266742  8741 raft_consensus.cc:2804] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:50.282892  7907 leader_election.cc:304] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200; no voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:50.257164  8743 raft_consensus.cc:493] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:50.201772  8008 raft_consensus.cc:2468] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 1.
I20260709 13:16:50.291627  8014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191eb110a7ae4009a2184d4c3af4f439" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:50.288918  8748 raft_consensus.cc:2749] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:50.268260  8553 raft_consensus.cc:2804] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:50.288861  8011 raft_consensus.cc:3060] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:50.286625  8741 raft_consensus.cc:493] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:50.304642  8672 raft_consensus.cc:2468] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 2.
I20260709 13:16:50.304817  8741 raft_consensus.cc:3060] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:50.280701  8547 raft_consensus.cc:515] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:50.307320  8678 raft_consensus.cc:2468] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 2.
I20260709 13:16:50.308192  8547 leader_election.cc:290] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 election: Requested vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:50.309074  8014 raft_consensus.cc:2393] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7de07e50a1714f5d9055bb4b86655200 in current term 2: Already voted for candidate c9a569f7d1ad42359002386a73702690 in this term.
I20260709 13:16:50.300107  8553 raft_consensus.cc:493] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:50.309589  8553 raft_consensus.cc:3060] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:50.312079  8744 raft_consensus.cc:515] T ea7f3171e8b84ac48e0abd056c43f778 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:50.313299  8015 raft_consensus.cc:2393] T ea7f3171e8b84ac48e0abd056c43f778 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7de07e50a1714f5d9055bb4b86655200 in current term 2: Already voted for candidate c9a569f7d1ad42359002386a73702690 in this term.
I20260709 13:16:50.316046  8744 leader_election.cc:290] T ea7f3171e8b84ac48e0abd056c43f778 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 election: Requested vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:50.267838  8669 raft_consensus.cc:2468] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 3.
I20260709 13:16:50.317344  8741 raft_consensus.cc:515] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:50.295655  8743 raft_consensus.cc:3060] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:50.322391  8522 raft_consensus.cc:515] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:50.326088  8675 raft_consensus.cc:1275] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Refusing update from remote peer 1c5936948a84476fb0dcc1fa2d895740: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:50.327190  8674 raft_consensus.cc:2468] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 2.
I20260709 13:16:50.328138  8628 raft_consensus.cc:515] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:50.328979  8719 raft_consensus.cc:515] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:50.330384  8628 leader_election.cc:290] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 election: Requested vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:50.330965  8719 leader_election.cc:290] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:50.340085  8741 leader_election.cc:290] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 election: Requested vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
W20260709 13:16:50.386722  7907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:45491, user_credentials={real_user=slave}} blocked reactor thread for 101626us
I20260709 13:16:50.388146  7832 leader_election.cc:304] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:50.392278  7932 raft_consensus.cc:2393] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c5936948a84476fb0dcc1fa2d895740 in current term 2: Already voted for candidate 7de07e50a1714f5d9055bb4b86655200 in this term.
W20260709 13:16:50.264230  7981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:45491, user_credentials={real_user=slave}} blocked reactor thread for 48234.5us
I20260709 13:16:50.407328  8007 raft_consensus.cc:1275] T ea7f3171e8b84ac48e0abd056c43f778 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Refusing update from remote peer 7de07e50a1714f5d9055bb4b86655200: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:50.409634  8010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c126cef127140f48a31bbd723a86051" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:50.411463  8522 leader_election.cc:290] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 election: Requested vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:50.411504  8010 raft_consensus.cc:2468] T 9c126cef127140f48a31bbd723a86051 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 1.
I20260709 13:16:50.417547  8674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de92af0966804027bbe4ec91b14382d4" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:50.420177  8676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4af0a88c7f43bcaa15fc11bdfaf591" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:50.421082  7906 leader_election.cc:304] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:50.421590  8676 raft_consensus.cc:2393] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7de07e50a1714f5d9055bb4b86655200 in current term 2: Already voted for candidate 1c5936948a84476fb0dcc1fa2d895740 in this term.
I20260709 13:16:50.422648  8672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191eb110a7ae4009a2184d4c3af4f439" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:50.424309  8012 raft_consensus.cc:2393] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7de07e50a1714f5d9055bb4b86655200 in current term 2: Already voted for candidate c9a569f7d1ad42359002386a73702690 in this term.
I20260709 13:16:50.431725  8728 consensus_queue.cc:1048] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:16:50.439373  8724 raft_consensus.cc:2749] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:50.440032  7935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191eb110a7ae4009a2184d4c3af4f439" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:50.440794  8723 consensus_queue.cc:1048] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:50.422966  8716 raft_consensus.cc:2804] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:50.448791  7935 raft_consensus.cc:3060] T 191eb110a7ae4009a2184d4c3af4f439 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:50.454319  8672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc8636f68ae4121ac05d99e24866633" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:50.446364  8716 raft_consensus.cc:493] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:50.457021  8716 raft_consensus.cc:3060] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:50.459558  8675 raft_consensus.cc:1275] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Refusing update from remote peer 7de07e50a1714f5d9055bb4b86655200: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:50.461226  8674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da682789343c4852b052f5fa4483c715" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:50.463620  8679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed88d7e51364cb28224875b51de8f8e" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:50.466580  8631 tablet_bootstrap.cc:492] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:50.468394  8631 tablet_bootstrap.cc:492] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:50.468567  8670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8725967bab0469eb6a5ed9c6bddf3cb" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:50.456558  8669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b5a061ff84745af17197de774ac96" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:50.473932  8631 ts_tablet_manager.cc:1403] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.215s	user 0.023s	sys 0.008s
I20260709 13:16:50.477950  8714 consensus_queue.cc:1048] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:50.493310  8631 raft_consensus.cc:359] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:50.500839  8631 raft_consensus.cc:740] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
W20260709 13:16:50.516011  7832 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:44141, user_credentials={real_user=slave}} blocked reactor thread for 128471us
I20260709 13:16:50.496105  7906 leader_election.cc:304] T 191eb110a7ae4009a2184d4c3af4f439 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690
I20260709 13:16:50.505970  8670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191eb110a7ae4009a2184d4c3af4f439" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:50.531021  7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7f3171e8b84ac48e0abd056c43f778" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:50.531087  8675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7f3171e8b84ac48e0abd056c43f778" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:50.533845  8011 raft_consensus.cc:2468] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 2.
I20260709 13:16:50.534732  7932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8725967bab0469eb6a5ed9c6bddf3cb" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:50.527667  8631 consensus_queue.cc:260] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:50.521133  7935 raft_consensus.cc:2468] T 191eb110a7ae4009a2184d4c3af4f439 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 2.
I20260709 13:16:50.546558  8720 raft_consensus.cc:493] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:50.547676  8720 raft_consensus.cc:515] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:50.550407  8522 raft_consensus.cc:2749] T 191eb110a7ae4009a2184d4c3af4f439 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:50.555523  8553 raft_consensus.cc:515] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:50.564067  8553 leader_election.cc:290] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 election: Requested vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
W20260709 13:16:50.564527  7830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:35503, user_credentials={real_user=slave}} blocked reactor thread for 135333us
I20260709 13:16:50.564934  8670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da682789343c4852b052f5fa4483c715" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:50.559792  8669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8725967bab0469eb6a5ed9c6bddf3cb" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:50.570312  8631 ts_tablet_manager.cc:1434] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.087s	user 0.002s	sys 0.007s
I20260709 13:16:50.595048  7830 leader_election.cc:304] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:50.596979  8631 tablet_bootstrap.cc:492] T ffeb7520452b4edcb0421cee5ab0e516 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:50.598284  8761 raft_consensus.cc:2804] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:50.601776  7832 leader_election.cc:304] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:50.550387  7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da682789343c4852b052f5fa4483c715" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:50.602500  8761 raft_consensus.cc:697] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Becoming Leader. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
W20260709 13:16:50.581588  7978 leader_election.cc:343] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.588308  8672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed88d7e51364cb28224875b51de8f8e" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:50.589159  7939 raft_consensus.cc:1275] T 985b6cf5ffe74ecfabc7ba74e262a88f P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Refusing update from remote peer 1c5936948a84476fb0dcc1fa2d895740: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:50.603793  8679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93cca694a49b44ba8eda19c91491696e" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
W20260709 13:16:50.600836  7904 consensus_peers.cc:597] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:50.604040  8761 consensus_queue.cc:237] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:50.567736  8743 raft_consensus.cc:515] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:50.577090  7906 leader_election.cc:304] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7
W20260709 13:16:50.606915  7978 leader_election.cc:343] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:50.608896  7978 leader_election.cc:343] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.602723  7937 raft_consensus.cc:3060] T da682789343c4852b052f5fa4483c715 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:50.609495  7906 leader_election.cc:304] T da682789343c4852b052f5fa4483c715 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690
I20260709 13:16:50.610162  8522 raft_consensus.cc:2804] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:50.620850  8716 raft_consensus.cc:515] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:50.621495  8522 raft_consensus.cc:493] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:50.622066  8522 raft_consensus.cc:3060] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:50.622258  7932 raft_consensus.cc:2393] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c9a569f7d1ad42359002386a73702690 in current term 2: Already voted for candidate 7de07e50a1714f5d9055bb4b86655200 in this term.
I20260709 13:16:50.610734  8714 consensus_queue.cc:1048] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:50.624810  7859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deeaf93ab6424e9c8013e6c9fbccb724" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:50.625656  7859 raft_consensus.cc:3060] T deeaf93ab6424e9c8013e6c9fbccb724 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:50.571941  8720 leader_election.cc:290] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:50.613626  8743 leader_election.cc:290] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 election: Requested vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
W20260709 13:16:50.601336  7830 leader_election.cc:343] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.628981  7978 leader_election.cc:304] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:50.631470  7937 raft_consensus.cc:2468] T da682789343c4852b052f5fa4483c715 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 2.
I20260709 13:16:50.639554  8679 raft_consensus.cc:1275] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Refusing update from remote peer 1c5936948a84476fb0dcc1fa2d895740: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:50.617103  8760 raft_consensus.cc:2804] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:50.610948  7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93cca694a49b44ba8eda19c91491696e" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200" is_pre_election: true
I20260709 13:16:50.641065  7832 leader_election.cc:304] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:50.632139  8720 raft_consensus.cc:2749] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:50.633507  7978 leader_election.cc:343] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.639690  8746 raft_consensus.cc:2749] T da682789343c4852b052f5fa4483c715 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:50.643006  8760 raft_consensus.cc:697] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Becoming Leader. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:16:50.641192  7933 raft_consensus.cc:2468] T 93cca694a49b44ba8eda19c91491696e P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 1.
I20260709 13:16:50.645020  8675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8725967bab0469eb6a5ed9c6bddf3cb" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
W20260709 13:16:50.645181  7978 leader_election.cc:343] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:50.646494  7978 leader_election.cc:343] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.644291  8760 consensus_queue.cc:237] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:50.648308  7832 leader_election.cc:304] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:50.647541  8762 raft_consensus.cc:2804] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:50.650071  8762 raft_consensus.cc:493] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:50.650470  8762 raft_consensus.cc:3060] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:50.646613  7904 leader_election.cc:343] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.614847  7980 leader_election.cc:304] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:50.603746  7690 catalog_manager.cc:5697] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 reported cstate change: term changed from 1 to 2, leader changed from 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1) to 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "1c5936948a84476fb0dcc1fa2d895740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:50.654495  7865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4af0a88c7f43bcaa15fc11bdfaf591" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:50.654881  7690 catalog_manager.cc:5697] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 reported cstate change: term changed from 2 to 3, leader changed from 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1) to 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2). New cstate: current_term: 3 leader_uuid: "1c5936948a84476fb0dcc1fa2d895740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:50.666023  8723 raft_consensus.cc:2804] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:50.668771  8729 raft_consensus.cc:2804] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:16:50.669401  7980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:44141, user_credentials={real_user=slave}} blocked reactor thread for 54881us
I20260709 13:16:50.673240  8729 raft_consensus.cc:697] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690 [term 2 LEADER]: Becoming Leader. State: Replica: c9a569f7d1ad42359002386a73702690, State: Running, Role: LEADER
I20260709 13:16:50.674463  8729 consensus_queue.cc:237] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:50.677047  7978 leader_election.cc:304] T ea7f3171e8b84ac48e0abd056c43f778 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:50.677981  8553 raft_consensus.cc:2749] T ea7f3171e8b84ac48e0abd056c43f778 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:50.678499  7907 leader_election.cc:304] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200; no voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7
W20260709 13:16:50.679389  7978 leader_election.cc:343] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.680233  8747 raft_consensus.cc:2749] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:50.672636  8723 raft_consensus.cc:697] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Becoming Leader. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:16:50.669883  8716 leader_election.cc:290] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
W20260709 13:16:50.680796  7978 consensus_peers.cc:597] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:50.685140  8723 consensus_queue.cc:237] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
W20260709 13:16:50.690222  7830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:35503, user_credentials={real_user=slave}} blocked reactor thread for 43720us
I20260709 13:16:50.692102  7980 leader_election.cc:304] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:50.693579  8762 raft_consensus.cc:515] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:50.698549  7859 raft_consensus.cc:2468] T deeaf93ab6424e9c8013e6c9fbccb724 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 2.
I20260709 13:16:50.702419  7980 leader_election.cc:304] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:50.710232  7862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed88d7e51364cb28224875b51de8f8e" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:50.710809  7907 leader_election.cc:304] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:50.711231  7862 raft_consensus.cc:3060] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:50.711854  8743 raft_consensus.cc:2804] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:50.713151  7861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de92af0966804027bbe4ec91b14382d4" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:50.713900  7861 raft_consensus.cc:3060] T de92af0966804027bbe4ec91b14382d4 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:50.714375  8716 raft_consensus.cc:2804] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:50.715057  8716 raft_consensus.cc:697] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [term 2 LEADER]: Becoming Leader. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Running, Role: LEADER
I20260709 13:16:50.716317  8716 consensus_queue.cc:237] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:50.719652  7865 raft_consensus.cc:1275] T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Refusing update from remote peer 7de07e50a1714f5d9055bb4b86655200: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:50.725777  8547 raft_consensus.cc:2804] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:50.726329  8547 raft_consensus.cc:493] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:16:50.726706  8547 raft_consensus.cc:3060] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:50.722853  8724 consensus_queue.cc:1048] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:16:50.728956  8012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04b5a061ff84745af17197de774ac96" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:50.729715  8012 raft_consensus.cc:3060] T c04b5a061ff84745af17197de774ac96 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:50.730687  8743 raft_consensus.cc:697] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [term 2 LEADER]: Becoming Leader. State: Replica: c9a569f7d1ad42359002386a73702690, State: Running, Role: LEADER
I20260709 13:16:50.743662  8743 consensus_queue.cc:237] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:50.755905  8547 raft_consensus.cc:515] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:50.756323  8633 consensus_queue.cc:1048] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:50.759861  7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93cca694a49b44ba8eda19c91491696e" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:50.760550  7937 raft_consensus.cc:3060] T 93cca694a49b44ba8eda19c91491696e P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:50.722275  7978 leader_election.cc:343] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.769382  7978 leader_election.cc:304] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:16:50.774197  8762 leader_election.cc:290] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:50.768550  7862 raft_consensus.cc:2468] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 2.
I20260709 13:16:50.782799  8013 raft_consensus.cc:1275] T f35a05f13eee42d4bdd19ff8b2b98212 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Refusing update from remote peer 1c5936948a84476fb0dcc1fa2d895740: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:50.783455  8012 raft_consensus.cc:2468] T c04b5a061ff84745af17197de774ac96 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 2.
I20260709 13:16:50.790647  7937 raft_consensus.cc:2468] T 93cca694a49b44ba8eda19c91491696e P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 2.
I20260709 13:16:50.792778  7980 leader_election.cc:304] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:50.793529  8553 raft_consensus.cc:2804] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:50.794075  8553 raft_consensus.cc:697] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [term 2 LEADER]: Becoming Leader. State: Replica: c9a569f7d1ad42359002386a73702690, State: Running, Role: LEADER
I20260709 13:16:50.795061  8553 consensus_queue.cc:237] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:50.799149  7981 leader_election.cc:304] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:50.800164  8568 consensus_queue.cc:1048] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:50.804260  8673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e84fab0d4fc43359b4219baa6171aa5" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
W20260709 13:16:50.812043  7978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:35503, user_credentials={real_user=slave}} blocked reactor thread for 105208us
I20260709 13:16:50.812865  8679 raft_consensus.cc:1275] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 FOLLOWER]: Refusing update from remote peer 1c5936948a84476fb0dcc1fa2d895740: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:16:50.813118  7978 leader_election.cc:343] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.810129  8729 raft_consensus.cc:2749] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:50.815235  8744 raft_consensus.cc:2804] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:50.815985  8744 raft_consensus.cc:697] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690 [term 2 LEADER]: Becoming Leader. State: Replica: c9a569f7d1ad42359002386a73702690, State: Running, Role: LEADER
W20260709 13:16:50.816926  7830 leader_election.cc:343] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.817126  8744 consensus_queue.cc:237] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:50.817989  8717 consensus_queue.cc:1048] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:50.818140  8742 consensus_queue.cc:1048] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 13:16:50.821398  7832 leader_election.cc:304] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7
W20260709 13:16:50.814626  7978 leader_election.cc:343] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:50.825863  7978 leader_election.cc:343] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.838825  8679 raft_consensus.cc:1275] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Refusing update from remote peer 7de07e50a1714f5d9055bb4b86655200: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:50.839149  7861 raft_consensus.cc:2468] T de92af0966804027bbe4ec91b14382d4 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 2.
I20260709 13:16:50.839357  8669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de92af0966804027bbe4ec91b14382d4" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:50.850816  8631 tablet_bootstrap.cc:492] T ffeb7520452b4edcb0421cee5ab0e516 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:50.811154  8547 leader_election.cc:290] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 election: Requested vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
W20260709 13:16:50.872849  7832 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.4:46031, user_credentials={real_user=slave}} blocked reactor thread for 63251us
I20260709 13:16:50.874492  8723 raft_consensus.cc:2804] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:50.875268  8723 raft_consensus.cc:697] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Becoming Leader. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:16:50.876430  8723 consensus_queue.cc:237] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:50.880864  8007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8725967bab0469eb6a5ed9c6bddf3cb" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:50.882261  8007 raft_consensus.cc:2393] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7de07e50a1714f5d9055bb4b86655200 in current term 2: Already voted for candidate c9a569f7d1ad42359002386a73702690 in this term.
I20260709 13:16:50.883034  8672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93cca694a49b44ba8eda19c91491696e" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:50.890162  8631 tablet_bootstrap.cc:492] T ffeb7520452b4edcb0421cee5ab0e516 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:50.891237  8631 ts_tablet_manager.cc:1403] T ffeb7520452b4edcb0421cee5ab0e516 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.295s	user 0.005s	sys 0.029s
I20260709 13:16:50.849411  8742 consensus_queue.cc:1048] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
W20260709 13:16:50.908769  8770 log.cc:927] Time spent T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:16:50.862686  7981 leader_election.cc:304] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 
W20260709 13:16:50.914645  7978 leader_election.cc:343] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:50.915940  7981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:45491, user_credentials={real_user=slave}} blocked reactor thread for 61085.4us
I20260709 13:16:50.916877  8729 raft_consensus.cc:2804] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:50.909106  8009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e84fab0d4fc43359b4219baa6171aa5" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:50.921267  8729 raft_consensus.cc:697] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690 [term 2 LEADER]: Becoming Leader. State: Replica: c9a569f7d1ad42359002386a73702690, State: Running, Role: LEADER
I20260709 13:16:50.961696  8729 consensus_queue.cc:237] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:50.963722  8631 raft_consensus.cc:359] T ffeb7520452b4edcb0421cee5ab0e516 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
W20260709 13:16:50.973443  8774 log.cc:927] Time spent T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:16:50.973971  8631 raft_consensus.cc:740] T ffeb7520452b4edcb0421cee5ab0e516 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.976125  8522 raft_consensus.cc:515] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:50.980891  8631 consensus_queue.cc:260] T ffeb7520452b4edcb0421cee5ab0e516 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:50.983047  8631 ts_tablet_manager.cc:1434] T ffeb7520452b4edcb0421cee5ab0e516 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.091s	user 0.007s	sys 0.001s
I20260709 13:16:50.986443  8631 tablet_bootstrap.cc:492] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:50.975081  8009 raft_consensus.cc:3060] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:50.983069  8522 leader_election.cc:290] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:51.069672  8008 raft_consensus.cc:1275] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Refusing update from remote peer 1c5936948a84476fb0dcc1fa2d895740: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:16:51.087142  8779 log.cc:927] Time spent T f35a05f13eee42d4bdd19ff8b2b98212 P c9a569f7d1ad42359002386a73702690: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 13:16:51.110948  7978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:35503, user_credentials={real_user=slave}} blocked reactor thread for 252136us
I20260709 13:16:51.106284  8722 consensus_queue.cc:1048] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:16:51.118054  8013 raft_consensus.cc:1275] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Refusing update from remote peer 1c5936948a84476fb0dcc1fa2d895740: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:51.120702  7906 leader_election.cc:304] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690
W20260709 13:16:51.093222  7981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:45491, user_credentials={real_user=slave}} blocked reactor thread for 94487.7us
I20260709 13:16:51.200485  8632 raft_consensus.cc:2749] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:51.209015  8714 raft_consensus.cc:493] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.209645  8714 raft_consensus.cc:515] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:51.212119  8714 leader_election.cc:290] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
W20260709 13:16:51.249351  7832 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:46031, user_credentials={real_user=slave}} blocked reactor thread for 60592.2us
W20260709 13:16:51.270520  7978 leader_election.cc:343] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:51.284925  8772 log.cc:927] Time spent T 985b6cf5ffe74ecfabc7ba74e262a88f P 7de07e50a1714f5d9055bb4b86655200: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 13:16:51.289458  8783 log.cc:927] Time spent T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:16:51.282503  8724 consensus_queue.cc:1048] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:16:51.292024  8676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c126cef127140f48a31bbd723a86051" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:51.279458  8008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c126cef127140f48a31bbd723a86051" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:51.297322  8008 raft_consensus.cc:3060] T 9c126cef127140f48a31bbd723a86051 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:51.309876  8670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c64de12c904e15892de849a597eeae" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
W20260709 13:16:51.320741  7978 consensus_peers.cc:597] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:51.322014  7978 consensus_peers.cc:597] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:51.329473  7904 leader_election.cc:343] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:51.349946  7904 consensus_peers.cc:597] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:51.332975  7830 consensus_peers.cc:597] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:51.330921  8009 raft_consensus.cc:2468] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 2.
I20260709 13:16:51.363576  8008 raft_consensus.cc:2468] T 9c126cef127140f48a31bbd723a86051 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 2.
W20260709 13:16:51.379264  8778 log.cc:927] Time spent T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690: Append to log took a long time: real 0.121s	user 0.004s	sys 0.000s
I20260709 13:16:51.380366  7932 raft_consensus.cc:1275] T da682789343c4852b052f5fa4483c715 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Refusing update from remote peer c9a569f7d1ad42359002386a73702690: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:51.380615  7933 raft_consensus.cc:1275] T 93cca694a49b44ba8eda19c91491696e P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Refusing update from remote peer c9a569f7d1ad42359002386a73702690: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:51.381641  7934 raft_consensus.cc:1275] T 191eb110a7ae4009a2184d4c3af4f439 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Refusing update from remote peer c9a569f7d1ad42359002386a73702690: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:16:51.382836  7978 consensus_peers.cc:597] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:51.386027  7832 leader_election.cc:304] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:51.385573  7686 catalog_manager.cc:5697] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200 reported cstate change: term changed from 1 to 2, leader changed from 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1) to 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3). New cstate: current_term: 2 leader_uuid: "7de07e50a1714f5d9055bb4b86655200" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:51.350873  7904 consensus_peers.cc:597] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:51.395262  7904 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:35503, user_credentials={real_user=slave}} blocked reactor thread for 44524us
I20260709 13:16:51.392946  7906 leader_election.cc:304] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7
W20260709 13:16:51.353274  7830 consensus_peers.cc:597] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:51.402283  7904 leader_election.cc:343] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:51.399262  7830 consensus_peers.cc:597] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:51.421288  8669 raft_consensus.cc:1275] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Refusing update from remote peer 1c5936948a84476fb0dcc1fa2d895740: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:51.404943  8714 raft_consensus.cc:2804] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:51.424220  8714 raft_consensus.cc:697] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [term 2 LEADER]: Becoming Leader. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Running, Role: LEADER
I20260709 13:16:51.425544  8670 raft_consensus.cc:3060] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:51.425269  8714 consensus_queue.cc:237] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:51.400570  8724 raft_consensus.cc:2804] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:51.394050  7686 catalog_manager.cc:5697] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 reported cstate change: term changed from 1 to 2, leader changed from 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1) to 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3). New cstate: current_term: 2 leader_uuid: "7de07e50a1714f5d9055bb4b86655200" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:51.431915  7830 consensus_peers.cc:597] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:51.458966  7830 consensus_peers.cc:597] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:51.437729  8724 raft_consensus.cc:697] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Becoming Leader. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
W20260709 13:16:51.438237  7981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:45491, user_credentials={real_user=slave}} blocked reactor thread for 267469us
W20260709 13:16:51.493216  7904 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.1:35503, user_credentials={real_user=slave}} blocked reactor thread for 51793.1us
I20260709 13:16:51.511740  8724 consensus_queue.cc:237] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:51.492430  7859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c64de12c904e15892de849a597eeae" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
W20260709 13:16:51.534111  7832 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:46031, user_credentials={real_user=slave}} blocked reactor thread for 71964.9us
I20260709 13:16:51.462548  8760 consensus_queue.cc:1048] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:16:51.463279  8547 consensus_queue.cc:1048] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:16:51.558976  7861 raft_consensus.cc:1275] T deeaf93ab6424e9c8013e6c9fbccb724 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Refusing update from remote peer 7de07e50a1714f5d9055bb4b86655200: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:51.558815  8628 consensus_queue.cc:1048] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:16:51.546542  7859 raft_consensus.cc:2468] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 2.
I20260709 13:16:51.558863  8752 consensus_queue.cc:1048] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:16:51.600149  7865 raft_consensus.cc:1275] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Refusing update from remote peer c9a569f7d1ad42359002386a73702690: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:51.605345  7862 raft_consensus.cc:1275] T de92af0966804027bbe4ec91b14382d4 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Refusing update from remote peer c9a569f7d1ad42359002386a73702690: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:16:51.610944  7978 consensus_peers.cc:597] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:51.613337  8670 raft_consensus.cc:1275] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Refusing update from remote peer 1c5936948a84476fb0dcc1fa2d895740: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:16:51.619666  7978 consensus_peers.cc:597] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:51.647428  7830 consensus_peers.cc:597] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:51.669450  8795 consensus_queue.cc:1048] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
W20260709 13:16:51.670532  7978 consensus_peers.cc:597] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:51.705011  8809 consensus_queue.cc:1048] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:16:51.731196  8628 consensus_queue.cc:1048] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:16:51.744290  7830 consensus_peers.cc:597] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:51.762790  7907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:45491, user_credentials={real_user=slave}} blocked reactor thread for 116870us
W20260709 13:16:51.758677  7978 consensus_peers.cc:597] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:51.767488  7907 leader_election.cc:304] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7
W20260709 13:16:51.767892  7830 consensus_peers.cc:597] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:51.772141  8714 raft_consensus.cc:2804] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:51.800894  8495 consensus_queue.cc:1048] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:16:51.807081  8631 tablet_bootstrap.cc:492] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:51.791859  8714 raft_consensus.cc:493] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:51.814913  7978 consensus_peers.cc:597] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:51.822517  8714 raft_consensus.cc:3060] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:51.828296  8009 raft_consensus.cc:1275] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Refusing update from remote peer 1c5936948a84476fb0dcc1fa2d895740: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:51.835974  8015 raft_consensus.cc:1275] T c04b5a061ff84745af17197de774ac96 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Refusing update from remote peer 1c5936948a84476fb0dcc1fa2d895740: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:16:51.840492  8820 log.cc:927] Time spent T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:16:51.848888  7937 raft_consensus.cc:1275] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Refusing update from remote peer 1c5936948a84476fb0dcc1fa2d895740: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:16:51.859952  7904 consensus_peers.cc:597] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:51.866386  8631 tablet_bootstrap.cc:492] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:51.871663  8631 ts_tablet_manager.cc:1403] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.886s	user 0.026s	sys 0.021s
I20260709 13:16:51.874459  8631 raft_consensus.cc:359] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:51.877643  8631 raft_consensus.cc:740] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.882802  8633 consensus_queue.cc:1048] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:51.893412  8631 consensus_queue.cc:260] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:51.907357  8761 consensus_queue.cc:1048] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:16:51.913072  8796 consensus_queue.cc:1048] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:16:51.912210  7690 catalog_manager.cc:5697] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 reported cstate change: term changed from 1 to 2, leader changed from 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1) to 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "1c5936948a84476fb0dcc1fa2d895740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:51.915980  7690 catalog_manager.cc:5697] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 reported cstate change: term changed from 1 to 2, leader changed from 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1) to 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "1c5936948a84476fb0dcc1fa2d895740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:51.917814  7690 catalog_manager.cc:5697] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 reported cstate change: term changed from 1 to 2, leader changed from 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1) to 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "1c5936948a84476fb0dcc1fa2d895740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:51.925267  7690 catalog_manager.cc:5697] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 reported cstate change: term changed from 1 to 2, leader changed from 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1) to 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "1c5936948a84476fb0dcc1fa2d895740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:51.928167  8631 ts_tablet_manager.cc:1434] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.000s
I20260709 13:16:51.945058  8631 tablet_bootstrap.cc:492] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:51.952976  8015 raft_consensus.cc:1275] T 9c126cef127140f48a31bbd723a86051 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Refusing update from remote peer 7de07e50a1714f5d9055bb4b86655200: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:51.954556  8495 consensus_queue.cc:1048] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:16:51.970496  7830 consensus_peers.cc:597] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:51.976992  8009 raft_consensus.cc:1275] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Refusing update from remote peer 1c5936948a84476fb0dcc1fa2d895740: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:51.948387  8714 raft_consensus.cc:515] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:51.979653  8761 consensus_queue.cc:1048] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:52.018997  7686 catalog_manager.cc:5697] T 191eb110a7ae4009a2184d4c3af4f439 P 7de07e50a1714f5d9055bb4b86655200 reported cstate change: term changed from 1 to 2, leader changed from 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1) to c9a569f7d1ad42359002386a73702690 (127.30.63.4). New cstate: current_term: 2 leader_uuid: "c9a569f7d1ad42359002386a73702690" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } }
I20260709 13:16:52.024343  7686 catalog_manager.cc:5697] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 reported cstate change: term changed from 1 to 2, leader changed from 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1) to 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3). New cstate: current_term: 2 leader_uuid: "7de07e50a1714f5d9055bb4b86655200" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.027791  7686 catalog_manager.cc:5697] T da682789343c4852b052f5fa4483c715 P 7de07e50a1714f5d9055bb4b86655200 reported cstate change: term changed from 1 to 2, leader changed from 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1) to c9a569f7d1ad42359002386a73702690 (127.30.63.4). New cstate: current_term: 2 leader_uuid: "c9a569f7d1ad42359002386a73702690" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } }
I20260709 13:16:52.047515  8631 tablet_bootstrap.cc:492] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:52.051896  8631 tablet_bootstrap.cc:492] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:52.052631  8631 ts_tablet_manager.cc:1403] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.117s	user 0.026s	sys 0.004s
I20260709 13:16:52.053040  7686 catalog_manager.cc:5697] T 93cca694a49b44ba8eda19c91491696e P 7de07e50a1714f5d9055bb4b86655200 reported cstate change: term changed from 1 to 2, leader changed from 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1) to c9a569f7d1ad42359002386a73702690 (127.30.63.4). New cstate: current_term: 2 leader_uuid: "c9a569f7d1ad42359002386a73702690" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } }
I20260709 13:16:52.065721  8669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c64de12c904e15892de849a597eeae" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
W20260709 13:16:52.067571  7904 leader_election.cc:343] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.080901  8714 leader_election.cc:290] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 3 election: Requested vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:52.086318  7863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c64de12c904e15892de849a597eeae" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:52.089145  7863 raft_consensus.cc:3060] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:52.098721  8631 raft_consensus.cc:359] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:52.099524  8631 raft_consensus.cc:740] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.105665  8631 consensus_queue.cc:260] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:52.111660  7863 raft_consensus.cc:2468] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 3.
I20260709 13:16:52.112793  8631 ts_tablet_manager.cc:1434] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 13:16:52.112202  7687 catalog_manager.cc:5697] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690 reported cstate change: term changed from 1 to 2, leader changed from 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1) to c9a569f7d1ad42359002386a73702690 (127.30.63.4). New cstate: current_term: 2 leader_uuid: "c9a569f7d1ad42359002386a73702690" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.120404  7687 catalog_manager.cc:5697] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690 reported cstate change: term changed from 1 to 2, leader changed from 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1) to c9a569f7d1ad42359002386a73702690 (127.30.63.4). New cstate: current_term: 2 leader_uuid: "c9a569f7d1ad42359002386a73702690" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.136524  7907 leader_election.cc:304] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:52.138832  8631 tablet_bootstrap.cc:492] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:52.141906  8670 raft_consensus.cc:3060] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:52.142529  8522 raft_consensus.cc:2804] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:52.143231  8522 raft_consensus.cc:697] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [term 3 LEADER]: Becoming Leader. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Running, Role: LEADER
I20260709 13:16:52.144117  8522 consensus_queue.cc:237] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:52.182845  7690 catalog_manager.cc:5697] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 reported cstate change: term changed from 1 to 2, leader changed from 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1) to 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "1c5936948a84476fb0dcc1fa2d895740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.198156  8495 raft_consensus.cc:493] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.209306  8495 raft_consensus.cc:515] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:52.225598  8495 leader_election.cc:290] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:52.227357  7863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72bd809944d47a395c4bc1b0fc18c19" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740" is_pre_election: true
I20260709 13:16:52.239079  8678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72bd809944d47a395c4bc1b0fc18c19" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:52.241639  7863 raft_consensus.cc:2468] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 2.
W20260709 13:16:52.242595  7904 leader_election.cc:343] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.246297  7907 leader_election.cc:304] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:52.247470  8495 raft_consensus.cc:2804] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:52.247846  8495 raft_consensus.cc:493] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.248152  8495 raft_consensus.cc:3060] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:52.255252  8631 tablet_bootstrap.cc:492] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:52.256858  8631 tablet_bootstrap.cc:492] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:52.257519  8631 ts_tablet_manager.cc:1403] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.119s	user 0.019s	sys 0.000s
I20260709 13:16:52.258670  8495 raft_consensus.cc:515] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:52.260633  8631 raft_consensus.cc:359] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:52.261373  8631 raft_consensus.cc:740] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.261492  8669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72bd809944d47a395c4bc1b0fc18c19" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:52.262115  8631 consensus_queue.cc:260] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
W20260709 13:16:52.263087  7904 leader_election.cc:343] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.264855  8495 leader_election.cc:290] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 3 election: Requested vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:52.268752  8631 ts_tablet_manager.cc:1434] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:16:52.269739  8631 tablet_bootstrap.cc:492] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:52.272358  7863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72bd809944d47a395c4bc1b0fc18c19" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:52.273218  7863 raft_consensus.cc:3060] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:52.287017  7687 catalog_manager.cc:5697] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 reported cstate change: term changed from 1 to 3, leader changed from 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1) to 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3). New cstate: current_term: 3 leader_uuid: "7de07e50a1714f5d9055bb4b86655200" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.294940  8631 tablet_bootstrap.cc:492] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:52.296137  8631 tablet_bootstrap.cc:492] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:52.299306  8631 ts_tablet_manager.cc:1403] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.030s	user 0.023s	sys 0.000s
I20260709 13:16:52.301977  8631 raft_consensus.cc:359] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:52.302647  8631 raft_consensus.cc:740] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.303462  8631 consensus_queue.cc:260] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
W20260709 13:16:52.307060  7978 consensus_peers.cc:597] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:52.311021  8631 ts_tablet_manager.cc:1434] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:16:52.312063  8631 tablet_bootstrap.cc:492] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:52.295998  7863 raft_consensus.cc:2468] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 3.
I20260709 13:16:52.335650  7907 leader_election.cc:304] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:52.338385  8522 raft_consensus.cc:2804] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:52.339538  8522 raft_consensus.cc:697] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 3 LEADER]: Becoming Leader. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Running, Role: LEADER
I20260709 13:16:52.342453  8522 consensus_queue.cc:237] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:52.362594  8631 tablet_bootstrap.cc:492] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:52.363649  8631 tablet_bootstrap.cc:492] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:52.364310  8631 ts_tablet_manager.cc:1403] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.005s
I20260709 13:16:52.367257  8631 raft_consensus.cc:359] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:52.368156  8631 raft_consensus.cc:740] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.369176  8631 consensus_queue.cc:260] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:52.371788  8631 ts_tablet_manager.cc:1434] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:16:52.372632  8631 tablet_bootstrap.cc:492] T 5ba560db35494ad2b64a9b728d510c1a P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:52.383563  7685 catalog_manager.cc:5697] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 reported cstate change: term changed from 1 to 3, leader changed from 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1) to 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3). New cstate: current_term: 3 leader_uuid: "7de07e50a1714f5d9055bb4b86655200" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.394120  8631 tablet_bootstrap.cc:492] T 5ba560db35494ad2b64a9b728d510c1a P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:52.395113  8631 tablet_bootstrap.cc:492] T 5ba560db35494ad2b64a9b728d510c1a P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:52.395785  8631 ts_tablet_manager.cc:1403] T 5ba560db35494ad2b64a9b728d510c1a P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.003s
I20260709 13:16:52.398741  8631 raft_consensus.cc:359] T 5ba560db35494ad2b64a9b728d510c1a P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:52.399418  8631 raft_consensus.cc:740] T 5ba560db35494ad2b64a9b728d510c1a P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.400144  8631 consensus_queue.cc:260] T 5ba560db35494ad2b64a9b728d510c1a P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:52.401363  8669 raft_consensus.cc:3060] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:52.402489  8631 ts_tablet_manager.cc:1434] T 5ba560db35494ad2b64a9b728d510c1a P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:16:52.403451  8631 tablet_bootstrap.cc:492] T 7141f7bef8234a56bdbb17df0b302a75 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:52.470309  8670 raft_consensus.cc:3060] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:52.527097  8631 tablet_bootstrap.cc:492] T 7141f7bef8234a56bdbb17df0b302a75 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:52.528625  8631 tablet_bootstrap.cc:492] T 7141f7bef8234a56bdbb17df0b302a75 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:52.529250  8631 ts_tablet_manager.cc:1403] T 7141f7bef8234a56bdbb17df0b302a75 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.126s	user 0.015s	sys 0.053s
I20260709 13:16:52.531750  8631 raft_consensus.cc:359] T 7141f7bef8234a56bdbb17df0b302a75 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:52.532428  8631 raft_consensus.cc:740] T 7141f7bef8234a56bdbb17df0b302a75 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.533236  8631 consensus_queue.cc:260] T 7141f7bef8234a56bdbb17df0b302a75 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:52.535252  8631 ts_tablet_manager.cc:1434] T 7141f7bef8234a56bdbb17df0b302a75 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:52.536073  8631 tablet_bootstrap.cc:492] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:52.554885  8631 tablet_bootstrap.cc:492] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:52.555585  8631 tablet_bootstrap.cc:492] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:52.556079  8631 ts_tablet_manager.cc:1403] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.000s
I20260709 13:16:52.558127  8631 raft_consensus.cc:359] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:52.558784  8631 raft_consensus.cc:740] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.559432  8631 consensus_queue.cc:260] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:52.561924  8631 ts_tablet_manager.cc:1434] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:16:52.563067  8631 tablet_bootstrap.cc:492] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:52.564087  8670 raft_consensus.cc:3060] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:52.580365  8631 tablet_bootstrap.cc:492] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:52.581450  8631 tablet_bootstrap.cc:492] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:52.582077  8631 ts_tablet_manager.cc:1403] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:16:52.584272  8631 raft_consensus.cc:359] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:52.584990  8631 raft_consensus.cc:740] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.585631  8631 consensus_queue.cc:260] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:52.588017  8631 ts_tablet_manager.cc:1434] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:16:52.589555  8631 tablet_bootstrap.cc:492] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:52.610776  8631 tablet_bootstrap.cc:492] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:52.611922  8631 tablet_bootstrap.cc:492] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:52.612511  8631 ts_tablet_manager.cc:1403] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.004s
I20260709 13:16:52.614799  8631 raft_consensus.cc:359] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:52.615473  8631 raft_consensus.cc:740] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.616190  8631 consensus_queue.cc:260] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:52.617769  8631 ts_tablet_manager.cc:1434] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:16:52.618692  8631 tablet_bootstrap.cc:492] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:52.637108  8631 tablet_bootstrap.cc:492] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:52.638033  8631 tablet_bootstrap.cc:492] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:52.638684  8631 ts_tablet_manager.cc:1403] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.000s
I20260709 13:16:52.643144  8631 raft_consensus.cc:359] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:52.643836  8631 raft_consensus.cc:740] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.644481  8631 consensus_queue.cc:260] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:52.646082  8631 ts_tablet_manager.cc:1434] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:52.646765  8631 tablet_bootstrap.cc:492] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:52.660089  8631 tablet_bootstrap.cc:492] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:52.661105  8631 tablet_bootstrap.cc:492] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:52.661813  8631 ts_tablet_manager.cc:1403] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.003s
I20260709 13:16:52.664078  8631 raft_consensus.cc:359] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:52.664621  8631 raft_consensus.cc:740] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.665266  8631 consensus_queue.cc:260] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:52.667332  8631 ts_tablet_manager.cc:1434] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:16:52.668390  8631 tablet_bootstrap.cc:492] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:52.681087  8631 tablet_bootstrap.cc:492] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:52.681833  8631 tablet_bootstrap.cc:492] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:52.682462  8631 ts_tablet_manager.cc:1403] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:16:52.684768  8631 raft_consensus.cc:359] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:52.685503  8631 raft_consensus.cc:740] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.686208  8631 consensus_queue.cc:260] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:52.688251  8631 ts_tablet_manager.cc:1434] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:16:52.689486  8631 tablet_bootstrap.cc:492] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:52.703522  8631 tablet_bootstrap.cc:492] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:52.704470  8631 tablet_bootstrap.cc:492] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:52.704818  8670 raft_consensus.cc:3060] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:52.705166  8631 ts_tablet_manager.cc:1403] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 13:16:52.707917  8631 raft_consensus.cc:359] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:52.708572  8631 raft_consensus.cc:740] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.709287  8631 consensus_queue.cc:260] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:52.711737  8631 ts_tablet_manager.cc:1434] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:16:52.712783  8631 tablet_bootstrap.cc:492] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:52.722607  8495 raft_consensus.cc:493] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.723178  8495 raft_consensus.cc:515] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:52.725301  8495 leader_election.cc:290] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:52.727627  8669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8725967bab0469eb6a5ed9c6bddf3cb" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" is_pre_election: true
I20260709 13:16:52.728643  8669 raft_consensus.cc:2468] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 1.
I20260709 13:16:52.730038  8009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8725967bab0469eb6a5ed9c6bddf3cb" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690" is_pre_election: true
I20260709 13:16:52.730844  8009 raft_consensus.cc:2468] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 2.
I20260709 13:16:52.731120  7904 leader_election.cc:304] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:16:52.732281  8495 raft_consensus.cc:2804] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:52.732663  8495 raft_consensus.cc:493] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.732980  8495 raft_consensus.cc:3060] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:52.737439  8631 tablet_bootstrap.cc:492] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:52.738688  8631 tablet_bootstrap.cc:492] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:52.739320  8631 ts_tablet_manager.cc:1403] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.008s
I20260709 13:16:52.740173  8495 raft_consensus.cc:515] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:52.741885  8669 raft_consensus.cc:3060] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:52.742136  8495 leader_election.cc:290] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 3 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:16:52.742013  8631 raft_consensus.cc:359] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:52.742969  8631 raft_consensus.cc:740] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.744334  7863 raft_consensus.cc:1275] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [term 3 FOLLOWER]: Refusing update from remote peer 7de07e50a1714f5d9055bb4b86655200: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:52.746374  8678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8725967bab0469eb6a5ed9c6bddf3cb" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
I20260709 13:16:52.747062  8678 raft_consensus.cc:3060] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:52.746932  8631 consensus_queue.cc:260] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:52.748440  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8725967bab0469eb6a5ed9c6bddf3cb" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:52.749047  8015 raft_consensus.cc:3060] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:52.749773  8631 ts_tablet_manager.cc:1434] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.005s
I20260709 13:16:52.750731  8631 tablet_bootstrap.cc:492] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:52.753899  8669 raft_consensus.cc:1275] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 FOLLOWER]: Refusing update from remote peer 7de07e50a1714f5d9055bb4b86655200: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:52.754664  8522 consensus_queue.cc:1048] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:52.762609  8679 raft_consensus.cc:3060] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:52.762737  8669 raft_consensus.cc:3060] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:52.764881  8522 consensus_queue.cc:1048] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:52.778880  8015 raft_consensus.cc:2468] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 3.
I20260709 13:16:52.780465  7906 leader_election.cc:304] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:52.781315  8495 raft_consensus.cc:2804] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:52.781476  8669 raft_consensus.cc:1275] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 FOLLOWER]: Refusing update from remote peer 7de07e50a1714f5d9055bb4b86655200: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:52.782716  8495 raft_consensus.cc:697] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [term 3 LEADER]: Becoming Leader. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Running, Role: LEADER
I20260709 13:16:52.783206  8522 consensus_queue.cc:1048] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:52.785650  8495 consensus_queue.cc:237] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:52.788595  8678 raft_consensus.cc:2468] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 3.
I20260709 13:16:52.831486  7687 catalog_manager.cc:5697] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 reported cstate change: term changed from 1 to 3, leader changed from 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1) to 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3). New cstate: current_term: 3 leader_uuid: "7de07e50a1714f5d9055bb4b86655200" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.951422  8631 tablet_bootstrap.cc:492] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:52.952416  8631 tablet_bootstrap.cc:492] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:52.953166  8631 ts_tablet_manager.cc:1403] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.203s	user 0.042s	sys 0.044s
I20260709 13:16:52.972015  8631 raft_consensus.cc:359] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:52.973681  8631 raft_consensus.cc:740] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.980180  7861 raft_consensus.cc:1275] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [term 3 FOLLOWER]: Refusing update from remote peer 7de07e50a1714f5d9055bb4b86655200: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:52.983098  8631 consensus_queue.cc:260] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:52.998447  8631 ts_tablet_manager.cc:1434] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 13:16:53.003690  8631 tablet_bootstrap.cc:492] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
W20260709 13:16:52.993703  7981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:45491, user_credentials={real_user=slave}} blocked reactor thread for 89461.6us
W20260709 13:16:53.016528  8863 log.cc:927] Time spent T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7: Append to log took a long time: real 0.111s	user 0.002s	sys 0.000s
I20260709 13:16:53.004711  8806 consensus_queue.cc:1048] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
W20260709 13:16:53.061944  8864 log.cc:927] Time spent T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7: Append to log took a long time: real 0.166s	user 0.008s	sys 0.000s
I20260709 13:16:53.113265  8675 raft_consensus.cc:3060] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:53.142998  7980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.3:44141, user_credentials={real_user=slave}} blocked reactor thread for 45473.4us
I20260709 13:16:53.291530  8631 tablet_bootstrap.cc:492] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:53.292495  8631 tablet_bootstrap.cc:492] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:53.293906  8631 ts_tablet_manager.cc:1403] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.295s	user 0.039s	sys 0.006s
I20260709 13:16:53.296438  8631 raft_consensus.cc:359] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:53.298522  8631 raft_consensus.cc:740] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.300277  8631 consensus_queue.cc:260] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:53.306355  8631 ts_tablet_manager.cc:1434] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:16:53.307463  8631 tablet_bootstrap.cc:492] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:53.334491  8631 tablet_bootstrap.cc:492] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:53.335278  8631 tablet_bootstrap.cc:492] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:53.335850  8631 ts_tablet_manager.cc:1403] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.004s
I20260709 13:16:53.337914  8631 raft_consensus.cc:359] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:53.338598  8631 raft_consensus.cc:740] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.339192  8631 consensus_queue.cc:260] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:53.341821  8631 ts_tablet_manager.cc:1434] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.006s	user 0.009s	sys 0.000s
I20260709 13:16:53.343276  8631 tablet_bootstrap.cc:492] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:53.356730  8631 tablet_bootstrap.cc:492] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:53.357592  8631 tablet_bootstrap.cc:492] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:53.358142  8631 ts_tablet_manager.cc:1403] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.003s
I20260709 13:16:53.359903  8631 raft_consensus.cc:359] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:53.360395  8631 raft_consensus.cc:740] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.360934  8631 consensus_queue.cc:260] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:53.362666  8631 ts_tablet_manager.cc:1434] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:16:53.363624  8631 tablet_bootstrap.cc:492] T 9eeed88ecdc244a98599a38459ae66b8 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:53.375651  8631 tablet_bootstrap.cc:492] T 9eeed88ecdc244a98599a38459ae66b8 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:53.376667  8631 tablet_bootstrap.cc:492] T 9eeed88ecdc244a98599a38459ae66b8 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:53.377341  8631 ts_tablet_manager.cc:1403] T 9eeed88ecdc244a98599a38459ae66b8 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:16:53.381489  8631 raft_consensus.cc:359] T 9eeed88ecdc244a98599a38459ae66b8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:53.382339  8631 raft_consensus.cc:740] T 9eeed88ecdc244a98599a38459ae66b8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.382954  8631 consensus_queue.cc:260] T 9eeed88ecdc244a98599a38459ae66b8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:53.385118  8631 ts_tablet_manager.cc:1434] T 9eeed88ecdc244a98599a38459ae66b8 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:16:53.386169  8631 tablet_bootstrap.cc:492] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:53.410403  8631 tablet_bootstrap.cc:492] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:53.411423  8631 tablet_bootstrap.cc:492] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:53.412091  8631 ts_tablet_manager.cc:1403] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.004s
I20260709 13:16:53.414561  8631 raft_consensus.cc:359] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:53.415230  8631 raft_consensus.cc:740] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.415881  8631 consensus_queue.cc:260] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:53.416998  8675 raft_consensus.cc:1275] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 FOLLOWER]: Refusing update from remote peer 7de07e50a1714f5d9055bb4b86655200: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:53.417207  8012 raft_consensus.cc:1275] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Refusing update from remote peer 7de07e50a1714f5d9055bb4b86655200: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:53.417982  8631 ts_tablet_manager.cc:1434] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:16:53.418823  8631 tablet_bootstrap.cc:492] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:53.418789  8806 consensus_queue.cc:1048] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:53.419716  8522 consensus_queue.cc:1048] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:53.447216  8631 tablet_bootstrap.cc:492] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:53.448292  8631 tablet_bootstrap.cc:492] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:53.449004  8631 ts_tablet_manager.cc:1403] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.030s	user 0.026s	sys 0.004s
I20260709 13:16:53.451625  8631 raft_consensus.cc:359] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:53.452283  8631 raft_consensus.cc:740] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.453101  8631 consensus_queue.cc:260] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:53.455264  8631 ts_tablet_manager.cc:1434] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:16:53.459046  8672 raft_consensus.cc:3060] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:53.466706  8631 tablet_bootstrap.cc:492] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:53.512193  8631 tablet_bootstrap.cc:492] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:53.513363  8631 tablet_bootstrap.cc:492] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:53.514276  8631 ts_tablet_manager.cc:1403] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.004s
I20260709 13:16:53.532650  8631 raft_consensus.cc:359] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:53.533627  8631 raft_consensus.cc:740] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.534308  8631 consensus_queue.cc:260] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:53.536638  8631 ts_tablet_manager.cc:1434] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:16:53.537670  8631 tablet_bootstrap.cc:492] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:53.552042  8631 tablet_bootstrap.cc:492] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:53.552978  8631 tablet_bootstrap.cc:492] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:53.553567  8631 ts_tablet_manager.cc:1403] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.007s
I20260709 13:16:53.555931  8631 raft_consensus.cc:359] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:53.556548  8631 raft_consensus.cc:740] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.557482  8631 consensus_queue.cc:260] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:53.559034  8631 ts_tablet_manager.cc:1434] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:16:53.560040  8631 tablet_bootstrap.cc:492] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap starting.
I20260709 13:16:53.573191  8631 tablet_bootstrap.cc:492] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:53.574441  8631 tablet_bootstrap.cc:492] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7: Bootstrap complete.
I20260709 13:16:53.575204  8631 ts_tablet_manager.cc:1403] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent bootstrapping tablet: real 0.015s	user 0.005s	sys 0.007s
I20260709 13:16:53.577801  8631 raft_consensus.cc:359] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:53.578469  8631 raft_consensus.cc:740] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.578998  8631 consensus_queue.cc:260] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:53.580847  8631 ts_tablet_manager.cc:1434] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:16:53.702363  8675 raft_consensus.cc:3060] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:53.795848  8672 raft_consensus.cc:3060] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:53.960089  8669 raft_consensus.cc:3060] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:59.219384 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:59.272434  7860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "044eb7b4196a4ac595bec86f29fca1bf"
dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
mode: GRACEFUL
new_leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
 from {username='slave'} at 127.0.0.1:46688
I20260709 13:16:59.273141  7860 raft_consensus.cc:606] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Received request to transfer leadership to TS 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:59.275803  7860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06dd732d5f194c5f8bacb0d12d551212"
dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
mode: GRACEFUL
new_leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
 from {username='slave'} at 127.0.0.1:46688
I20260709 13:16:59.276553  7860 raft_consensus.cc:606] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Received request to transfer leadership to TS 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:59.279222  7860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e84fab0d4fc43359b4219baa6171aa5"
dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
mode: GRACEFUL
new_leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
 from {username='slave'} at 127.0.0.1:46688
I20260709 13:16:59.279362  8908 raft_consensus.cc:993] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740: : Instructing follower 59fcc1f631f642d6a7cf2d772ab1eba7 to start an election
I20260709 13:16:59.279808  7860 raft_consensus.cc:606] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Received request to transfer leadership to TS 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:59.279985  8918 raft_consensus.cc:1081] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Signalling peer 59fcc1f631f642d6a7cf2d772ab1eba7 to start an election
I20260709 13:16:59.281579  8669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06dd732d5f194c5f8bacb0d12d551212"
dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
 from {username='slave'} at 127.0.0.1:57186
I20260709 13:16:59.282135  8669 raft_consensus.cc:493] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:59.282483  8669 raft_consensus.cc:3060] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:59.282671  7860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fa297fedf4549fd89f9a179ef9147a8"
dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
mode: GRACEFUL
new_leader_uuid: "c9a569f7d1ad42359002386a73702690"
 from {username='slave'} at 127.0.0.1:46688
I20260709 13:16:59.283306  7860 raft_consensus.cc:606] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Received request to transfer leadership to TS c9a569f7d1ad42359002386a73702690
I20260709 13:16:59.289359  8669 raft_consensus.cc:515] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:59.298115  8669 leader_election.cc:290] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 3 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:59.302977  7941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48ee265806af41dfb77624fadfa04e6b"
dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
mode: GRACEFUL
new_leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
 from {username='slave'} at 127.0.0.1:42456
I20260709 13:16:59.303565  7941 raft_consensus.cc:606] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Received request to transfer leadership to TS 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:59.316308  7860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af8981a911484760ab96a4d042148094"
dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
mode: GRACEFUL
new_leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
 from {username='slave'} at 127.0.0.1:46688
I20260709 13:16:59.316955  7860 raft_consensus.cc:606] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Received request to transfer leadership to TS 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:16:59.332465  8007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06dd732d5f194c5f8bacb0d12d551212" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:59.333137  8007 raft_consensus.cc:3060] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:59.337067  7861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06dd732d5f194c5f8bacb0d12d551212" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:59.337724  7861 raft_consensus.cc:3055] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:59.337975  7861 raft_consensus.cc:740] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:16:59.338699  7861 consensus_queue.cc:260] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:59.339641  7861 raft_consensus.cc:3060] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:59.343071  8007 raft_consensus.cc:2468] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 3.
I20260709 13:16:59.344646  8626 leader_election.cc:304] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:59.351028  7861 raft_consensus.cc:2468] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 3.
I20260709 13:16:59.353289  8928 raft_consensus.cc:2804] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:59.356818  8007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d28b4b42078f421f85ebc87a2481aa87"
dest_uuid: "c9a569f7d1ad42359002386a73702690"
mode: GRACEFUL
new_leader_uuid: "1c5936948a84476fb0dcc1fa2d895740"
 from {username='slave'} at 127.0.0.1:51676
I20260709 13:16:59.357450  8007 raft_consensus.cc:606] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [term 1 LEADER]: Received request to transfer leadership to TS 1c5936948a84476fb0dcc1fa2d895740
I20260709 13:16:59.358312  8928 raft_consensus.cc:697] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:16:59.358816 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:16:59.359163  8928 consensus_queue.cc:237] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:59.360296 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:59.369607  7687 catalog_manager.cc:5697] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 2 to 3, leader changed from 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2) to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 3 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:59.443468  8908 raft_consensus.cc:993] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740: : Instructing follower 59fcc1f631f642d6a7cf2d772ab1eba7 to start an election
I20260709 13:16:59.444062  8908 raft_consensus.cc:1081] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Signalling peer 59fcc1f631f642d6a7cf2d772ab1eba7 to start an election
I20260709 13:16:59.445915  8675 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "044eb7b4196a4ac595bec86f29fca1bf"
dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
 from {username='slave'} at 127.0.0.1:57186
I20260709 13:16:59.446554  8675 raft_consensus.cc:493] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:59.446924  8675 raft_consensus.cc:3060] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:59.448031  8918 raft_consensus.cc:993] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740: : Instructing follower c9a569f7d1ad42359002386a73702690 to start an election
I20260709 13:16:59.448637  8918 raft_consensus.cc:1081] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Signalling peer c9a569f7d1ad42359002386a73702690 to start an election
I20260709 13:16:59.450431  8007 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3fa297fedf4549fd89f9a179ef9147a8"
dest_uuid: "c9a569f7d1ad42359002386a73702690"
 from {username='slave'} at 127.0.0.1:49006
I20260709 13:16:59.451013  8007 raft_consensus.cc:493] T 3fa297fedf4549fd89f9a179ef9147a8 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:59.451370  8007 raft_consensus.cc:3060] T 3fa297fedf4549fd89f9a179ef9147a8 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:59.456030  8675 raft_consensus.cc:515] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:59.458839  8675 leader_election.cc:290] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 2 election: Requested vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:59.458729  7860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044eb7b4196a4ac595bec86f29fca1bf" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:59.457796  8007 raft_consensus.cc:515] T 3fa297fedf4549fd89f9a179ef9147a8 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:59.459467  7860 raft_consensus.cc:3055] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:59.459811  7860 raft_consensus.cc:740] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:16:59.460531  7860 consensus_queue.cc:260] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:59.461659  7860 raft_consensus.cc:3060] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:59.462116  7932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa297fedf4549fd89f9a179ef9147a8" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:59.462723  7932 raft_consensus.cc:3060] T 3fa297fedf4549fd89f9a179ef9147a8 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:59.465221  7861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa297fedf4549fd89f9a179ef9147a8" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:59.465814  7861 raft_consensus.cc:3055] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:59.466097  7861 raft_consensus.cc:740] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:16:59.466812  7861 consensus_queue.cc:260] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:59.467832  7861 raft_consensus.cc:3060] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:59.470966  7860 raft_consensus.cc:2468] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 2.
I20260709 13:16:59.473351  8627 leader_election.cc:304] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 
I20260709 13:16:59.473865  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044eb7b4196a4ac595bec86f29fca1bf" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:59.474541  7941 raft_consensus.cc:3060] T 044eb7b4196a4ac595bec86f29fca1bf P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:59.474960  8928 raft_consensus.cc:2804] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:59.475442  8007 leader_election.cc:290] T 3fa297fedf4549fd89f9a179ef9147a8 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 election: Requested vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:16:59.475773  8928 raft_consensus.cc:697] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:16:59.476929  7861 raft_consensus.cc:2468] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 2.
I20260709 13:16:59.476835  8928 consensus_queue.cc:237] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:16:59.477483  7932 raft_consensus.cc:2468] T 3fa297fedf4549fd89f9a179ef9147a8 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 2.
I20260709 13:16:59.478745  7980 leader_election.cc:304] T 3fa297fedf4549fd89f9a179ef9147a8 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:59.479590  8920 raft_consensus.cc:2804] T 3fa297fedf4549fd89f9a179ef9147a8 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:59.480130  8920 raft_consensus.cc:697] T 3fa297fedf4549fd89f9a179ef9147a8 P c9a569f7d1ad42359002386a73702690 [term 2 LEADER]: Becoming Leader. State: Replica: c9a569f7d1ad42359002386a73702690, State: Running, Role: LEADER
I20260709 13:16:59.481195  8920 consensus_queue.cc:237] T 3fa297fedf4549fd89f9a179ef9147a8 P c9a569f7d1ad42359002386a73702690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:59.485492  7941 raft_consensus.cc:2468] T 044eb7b4196a4ac595bec86f29fca1bf P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 2.
I20260709 13:16:59.498513  7687 catalog_manager.cc:5697] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 1 to 2, leader changed from 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2) to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 2 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:59.502009  7685 catalog_manager.cc:5697] T 3fa297fedf4549fd89f9a179ef9147a8 P c9a569f7d1ad42359002386a73702690 reported cstate change: term changed from 1 to 2, leader changed from 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2) to c9a569f7d1ad42359002386a73702690 (127.30.63.4). New cstate: current_term: 2 leader_uuid: "c9a569f7d1ad42359002386a73702690" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:59.550107  8908 raft_consensus.cc:993] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740: : Instructing follower 59fcc1f631f642d6a7cf2d772ab1eba7 to start an election
I20260709 13:16:59.550633  8918 raft_consensus.cc:1081] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Signalling peer 59fcc1f631f642d6a7cf2d772ab1eba7 to start an election
I20260709 13:16:59.552318  8669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af8981a911484760ab96a4d042148094"
dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
 from {username='slave'} at 127.0.0.1:57186
I20260709 13:16:59.552959  8669 raft_consensus.cc:493] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:59.553306  8669 raft_consensus.cc:3060] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:59.561012  8913 raft_consensus.cc:993] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200: : Instructing follower 59fcc1f631f642d6a7cf2d772ab1eba7 to start an election
I20260709 13:16:59.561806  8919 raft_consensus.cc:1081] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Signalling peer 59fcc1f631f642d6a7cf2d772ab1eba7 to start an election
I20260709 13:16:59.562258  8669 raft_consensus.cc:515] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:59.564276  8669 leader_election.cc:290] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 2 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:59.565217  8669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48ee265806af41dfb77624fadfa04e6b"
dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
 from {username='slave'} at 127.0.0.1:57172
I20260709 13:16:59.565735  8669 raft_consensus.cc:493] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:59.566068  8007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8981a911484760ab96a4d042148094" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:59.566097  8669 raft_consensus.cc:3060] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:59.567494  7861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8981a911484760ab96a4d042148094" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:59.568076  7861 raft_consensus.cc:3055] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:59.568374  7861 raft_consensus.cc:740] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:16:59.566744  8007 raft_consensus.cc:3060] T af8981a911484760ab96a4d042148094 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:59.569537  7861 consensus_queue.cc:260] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:59.570858  7861 raft_consensus.cc:3060] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:59.575098  8669 raft_consensus.cc:515] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:59.577253  8669 leader_election.cc:290] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 2 election: Requested vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:59.578217  8007 raft_consensus.cc:2468] T af8981a911484760ab96a4d042148094 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 2.
I20260709 13:16:59.578378  8015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ee265806af41dfb77624fadfa04e6b" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:59.579079  8015 raft_consensus.cc:3060] T 48ee265806af41dfb77624fadfa04e6b P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:59.579350  8626 leader_election.cc:304] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:59.580201  8928 raft_consensus.cc:2804] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:59.580673  8928 raft_consensus.cc:697] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:16:59.581460  8928 consensus_queue.cc:237] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:59.581971  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ee265806af41dfb77624fadfa04e6b" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:59.582648  7941 raft_consensus.cc:3055] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:59.582964  7941 raft_consensus.cc:740] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Running, Role: LEADER
I20260709 13:16:59.583698  7941 consensus_queue.cc:260] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:59.586369  7861 raft_consensus.cc:2468] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 2.
I20260709 13:16:59.587513  7941 raft_consensus.cc:3060] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:59.594442  8015 raft_consensus.cc:2468] T 48ee265806af41dfb77624fadfa04e6b P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 2.
I20260709 13:16:59.595743  8626 leader_election.cc:304] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:59.595873  7941 raft_consensus.cc:2468] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 2.
I20260709 13:16:59.596763  8929 raft_consensus.cc:2804] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:59.604871  8929 raft_consensus.cc:697] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:16:59.605919  8929 consensus_queue.cc:237] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:16:59.621713  7685 catalog_manager.cc:5697] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 1 to 2, leader changed from 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2) to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 2 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:59.639066  7685 catalog_manager.cc:5697] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 1 to 2, leader changed from 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3) to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 2 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:59.743253  8908 raft_consensus.cc:993] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740: : Instructing follower 59fcc1f631f642d6a7cf2d772ab1eba7 to start an election
I20260709 13:16:59.743731  8918 raft_consensus.cc:1081] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Signalling peer 59fcc1f631f642d6a7cf2d772ab1eba7 to start an election
I20260709 13:16:59.745093  8669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e84fab0d4fc43359b4219baa6171aa5"
dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
 from {username='slave'} at 127.0.0.1:57186
I20260709 13:16:59.745565  8669 raft_consensus.cc:493] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:59.745850  8669 raft_consensus.cc:3060] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:59.752206  8669 raft_consensus.cc:515] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:59.753600  8669 leader_election.cc:290] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 3 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:16:59.754433  8007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e84fab0d4fc43359b4219baa6171aa5" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:59.754520  7861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e84fab0d4fc43359b4219baa6171aa5" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:16:59.755090  8007 raft_consensus.cc:3060] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:59.755206  7861 raft_consensus.cc:3055] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:59.755618  7861 raft_consensus.cc:740] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:16:59.756256  7861 consensus_queue.cc:260] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:59.757155  7861 raft_consensus.cc:3060] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:59.759689  8007 raft_consensus.cc:2468] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 3.
I20260709 13:16:59.760859  8626 leader_election.cc:304] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:16:59.761626  8929 raft_consensus.cc:2804] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:59.761653  7861 raft_consensus.cc:2468] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 3.
I20260709 13:16:59.762331  8929 raft_consensus.cc:697] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:16:59.763151  8929 consensus_queue.cc:237] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:16:59.775098  7685 catalog_manager.cc:5697] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 2 to 3, leader changed from 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2) to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 3 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:59.793668  8910 raft_consensus.cc:993] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690: : Instructing follower 1c5936948a84476fb0dcc1fa2d895740 to start an election
I20260709 13:16:59.794164  8920 raft_consensus.cc:1081] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [term 1 LEADER]: Signalling peer 1c5936948a84476fb0dcc1fa2d895740 to start an election
I20260709 13:16:59.795821  7861 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d28b4b42078f421f85ebc87a2481aa87"
dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
 from {username='slave'} at 127.0.0.1:46734
I20260709 13:16:59.796263  7861 raft_consensus.cc:493] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:59.796537  7861 raft_consensus.cc:3060] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:59.801285  7861 raft_consensus.cc:515] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:59.803279  7861 leader_election.cc:290] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Requested vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:16:59.804620  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28b4b42078f421f85ebc87a2481aa87" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:16:59.804764  8007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28b4b42078f421f85ebc87a2481aa87" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:16:59.805285  7941 raft_consensus.cc:3060] T d28b4b42078f421f85ebc87a2481aa87 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:59.805387  8007 raft_consensus.cc:3055] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:59.805868  8007 raft_consensus.cc:740] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Running, Role: LEADER
I20260709 13:16:59.806707  8007 consensus_queue.cc:260] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:59.807888  8007 raft_consensus.cc:3060] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:59.809092  8015 raft_consensus.cc:1275] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Refusing update from remote peer 59fcc1f631f642d6a7cf2d772ab1eba7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:59.811228  8929 consensus_queue.cc:1048] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:59.813109  7941 raft_consensus.cc:2468] T d28b4b42078f421f85ebc87a2481aa87 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 2.
I20260709 13:16:59.816639  7832 leader_election.cc:304] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:16:59.817126  8007 raft_consensus.cc:2468] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 2.
I20260709 13:16:59.817516  8918 raft_consensus.cc:2804] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:59.819702  8918 raft_consensus.cc:697] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Becoming Leader. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:16:59.820572  8918 consensus_queue.cc:237] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:16:59.835090  7687 catalog_manager.cc:5697] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740 reported cstate change: term changed from 1 to 2, leader changed from c9a569f7d1ad42359002386a73702690 (127.30.63.4) to 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "1c5936948a84476fb0dcc1fa2d895740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:59.839035  7861 raft_consensus.cc:1275] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [term 3 FOLLOWER]: Refusing update from remote peer 59fcc1f631f642d6a7cf2d772ab1eba7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:59.842262  8928 consensus_queue.cc:1048] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:59.955842  7860 raft_consensus.cc:1275] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Refusing update from remote peer 59fcc1f631f642d6a7cf2d772ab1eba7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:59.957077  8928 consensus_queue.cc:1048] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:59.972776  7941 raft_consensus.cc:1275] T 044eb7b4196a4ac595bec86f29fca1bf P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Refusing update from remote peer 59fcc1f631f642d6a7cf2d772ab1eba7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:59.974109  8929 consensus_queue.cc:1048] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:00.020392  8015 raft_consensus.cc:1275] T af8981a911484760ab96a4d042148094 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Refusing update from remote peer 59fcc1f631f642d6a7cf2d772ab1eba7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:00.021633  8929 consensus_queue.cc:1048] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:00.030715  7860 raft_consensus.cc:1275] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Refusing update from remote peer 59fcc1f631f642d6a7cf2d772ab1eba7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:00.032061  8948 consensus_queue.cc:1048] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:00.042958  7861 raft_consensus.cc:1275] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Refusing update from remote peer c9a569f7d1ad42359002386a73702690: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:00.044668  8910 consensus_queue.cc:1048] T 3fa297fedf4549fd89f9a179ef9147a8 P c9a569f7d1ad42359002386a73702690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:00.061041  7937 raft_consensus.cc:1275] T 3fa297fedf4549fd89f9a179ef9147a8 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Refusing update from remote peer c9a569f7d1ad42359002386a73702690: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:00.062628  8910 consensus_queue.cc:1048] T 3fa297fedf4549fd89f9a179ef9147a8 P c9a569f7d1ad42359002386a73702690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:00.157356  8015 raft_consensus.cc:1275] T 48ee265806af41dfb77624fadfa04e6b P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Refusing update from remote peer 59fcc1f631f642d6a7cf2d772ab1eba7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:00.158735  8948 consensus_queue.cc:1048] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:00.170439  7937 raft_consensus.cc:1275] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Refusing update from remote peer 59fcc1f631f642d6a7cf2d772ab1eba7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:00.172005  8938 consensus_queue.cc:1048] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:00.228484  8015 raft_consensus.cc:1275] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Refusing update from remote peer 59fcc1f631f642d6a7cf2d772ab1eba7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:00.229847  8928 consensus_queue.cc:1048] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:00.242120  7860 raft_consensus.cc:1275] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [term 3 FOLLOWER]: Refusing update from remote peer 59fcc1f631f642d6a7cf2d772ab1eba7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:00.243607  8928 consensus_queue.cc:1048] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:00.360172  8007 raft_consensus.cc:1275] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Refusing update from remote peer 1c5936948a84476fb0dcc1fa2d895740: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:00.361387  8908 consensus_queue.cc:1048] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:00.361527 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:00.378961  7937 raft_consensus.cc:1275] T d28b4b42078f421f85ebc87a2481aa87 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Refusing update from remote peer 1c5936948a84476fb0dcc1fa2d895740: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:00.380764  8908 consensus_queue.cc:1048] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:00.503819  7832 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.4:46031, user_credentials={real_user=slave}} blocked reactor thread for 90282.7us
I20260709 13:17:00.618261 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:00.716077  8007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45dba482a30c44a58bf79b2a8a890aee"
dest_uuid: "c9a569f7d1ad42359002386a73702690"
mode: GRACEFUL
new_leader_uuid: "1c5936948a84476fb0dcc1fa2d895740"
 from {username='slave'} at 127.0.0.1:51676
I20260709 13:17:00.719933  8007 raft_consensus.cc:606] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [term 1 LEADER]: Received request to transfer leadership to TS 1c5936948a84476fb0dcc1fa2d895740
I20260709 13:17:00.727732  7861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5cc8636f68ae4121ac05d99e24866633"
dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
mode: GRACEFUL
new_leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
 from {username='slave'} at 127.0.0.1:46688
I20260709 13:17:00.728837  7861 raft_consensus.cc:606] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Received request to transfer leadership to TS 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:17:00.743858  7861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "940bca2247d04fb495fba36734ace153"
dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
mode: GRACEFUL
new_leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
 from {username='slave'} at 127.0.0.1:46688
I20260709 13:17:00.744704  7861 raft_consensus.cc:606] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Received request to transfer leadership to TS 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:17:00.771559  7861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5e46a5b31234af492e77dbf435ead58"
dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
mode: GRACEFUL
new_leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
 from {username='slave'} at 127.0.0.1:46688
I20260709 13:17:00.772454  7861 raft_consensus.cc:606] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Received request to transfer leadership to TS 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:17:00.806797  8964 raft_consensus.cc:993] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740: : Instructing follower 59fcc1f631f642d6a7cf2d772ab1eba7 to start an election
I20260709 13:17:00.807564  8918 raft_consensus.cc:1081] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Signalling peer 59fcc1f631f642d6a7cf2d772ab1eba7 to start an election
I20260709 13:17:00.810945  7859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b66f54819dda4cca9214096155a16694"
dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
mode: GRACEFUL
new_leader_uuid: "c9a569f7d1ad42359002386a73702690"
 from {username='slave'} at 127.0.0.1:46688
I20260709 13:17:00.811796  8672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5e46a5b31234af492e77dbf435ead58"
dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
 from {username='slave'} at 127.0.0.1:57186
I20260709 13:17:00.811940  7859 raft_consensus.cc:606] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Received request to transfer leadership to TS c9a569f7d1ad42359002386a73702690
I20260709 13:17:00.812573  8672 raft_consensus.cc:493] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:00.813140  8672 raft_consensus.cc:3060] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:00.823840  7937 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b72bd809944d47a395c4bc1b0fc18c19"
dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
mode: GRACEFUL
new_leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
 from {username='slave'} at 127.0.0.1:42456
I20260709 13:17:00.826218  7937 raft_consensus.cc:606] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 3 LEADER]: Received request to transfer leadership to TS 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:17:00.828135 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:00.829157  8672 raft_consensus.cc:515] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:17:00.830250 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:00.831817  8672 leader_election.cc:290] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 2 election: Requested vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:17:00.832499  7859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e46a5b31234af492e77dbf435ead58" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:17:00.833108  7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e46a5b31234af492e77dbf435ead58" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:17:00.833418  7859 raft_consensus.cc:3055] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:00.833756  7937 raft_consensus.cc:3060] T b5e46a5b31234af492e77dbf435ead58 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:00.833804  7859 raft_consensus.cc:740] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:17:00.834976  7859 consensus_queue.cc:260] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:17:00.836632  7859 raft_consensus.cc:3060] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:00.844825  7937 raft_consensus.cc:2468] T b5e46a5b31234af492e77dbf435ead58 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 2.
I20260709 13:17:00.845515  7859 raft_consensus.cc:2468] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 2.
I20260709 13:17:00.846343  8626 leader_election.cc:304] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:17:00.847756  8928 raft_consensus.cc:2804] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:00.848312  8928 raft_consensus.cc:697] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:17:00.852854  8928 consensus_queue.cc:237] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:17:00.890389  7687 catalog_manager.cc:5697] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 1 to 2, leader changed from 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2) to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 2 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:00.963913  8918 raft_consensus.cc:993] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740: : Instructing follower 59fcc1f631f642d6a7cf2d772ab1eba7 to start an election
I20260709 13:17:00.964485  8918 raft_consensus.cc:1081] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Signalling peer 59fcc1f631f642d6a7cf2d772ab1eba7 to start an election
I20260709 13:17:00.966599  8675 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5cc8636f68ae4121ac05d99e24866633"
dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
 from {username='slave'} at 127.0.0.1:57186
I20260709 13:17:00.967171  8675 raft_consensus.cc:493] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:00.967540  8675 raft_consensus.cc:3060] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:00.975615  8675 raft_consensus.cc:515] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:17:00.977998  8675 leader_election.cc:290] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 3 election: Requested vote from peers c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:17:00.978649  7859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc8636f68ae4121ac05d99e24866633" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:17:00.979424  7859 raft_consensus.cc:3055] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:00.979741  7859 raft_consensus.cc:740] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:17:00.980290  8009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc8636f68ae4121ac05d99e24866633" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:17:00.981182  8918 raft_consensus.cc:993] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740: : Instructing follower c9a569f7d1ad42359002386a73702690 to start an election
I20260709 13:17:00.981042  8009 raft_consensus.cc:3060] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:00.980897  7859 consensus_queue.cc:260] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:17:00.981680  8918 raft_consensus.cc:1081] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Signalling peer c9a569f7d1ad42359002386a73702690 to start an election
I20260709 13:17:00.982734  7859 raft_consensus.cc:3060] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:00.983579  8007 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b66f54819dda4cca9214096155a16694"
dest_uuid: "c9a569f7d1ad42359002386a73702690"
 from {username='slave'} at 127.0.0.1:49006
I20260709 13:17:00.984112  8007 raft_consensus.cc:493] T b66f54819dda4cca9214096155a16694 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:00.984424  8007 raft_consensus.cc:3060] T b66f54819dda4cca9214096155a16694 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:00.991055  7859 raft_consensus.cc:2468] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 3.
I20260709 13:17:00.993955  8627 leader_election.cc:304] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 
I20260709 13:17:00.995186  8928 raft_consensus.cc:2804] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:00.995817  8928 raft_consensus.cc:697] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:17:00.997380  8928 consensus_queue.cc:237] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:17:01.002971  8007 raft_consensus.cc:515] T b66f54819dda4cca9214096155a16694 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:17:01.006973  8007 leader_election.cc:290] T b66f54819dda4cca9214096155a16694 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 election: Requested vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:17:01.008756  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f54819dda4cca9214096155a16694" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:17:01.008906  7859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f54819dda4cca9214096155a16694" candidate_uuid: "c9a569f7d1ad42359002386a73702690" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:17:01.009595  7941 raft_consensus.cc:3060] T b66f54819dda4cca9214096155a16694 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:01.009967  7859 raft_consensus.cc:3055] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:01.010591  7859 raft_consensus.cc:740] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:17:01.011770  7859 consensus_queue.cc:260] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:17:01.012712  8009 raft_consensus.cc:2468] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 3.
I20260709 13:17:01.015307  7859 raft_consensus.cc:3060] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:01.018707  8968 raft_consensus.cc:993] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690: : Instructing follower 1c5936948a84476fb0dcc1fa2d895740 to start an election
I20260709 13:17:01.019420  8914 raft_consensus.cc:1081] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [term 1 LEADER]: Signalling peer 1c5936948a84476fb0dcc1fa2d895740 to start an election
I20260709 13:17:01.021634  7860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45dba482a30c44a58bf79b2a8a890aee"
dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
 from {username='slave'} at 127.0.0.1:46734
I20260709 13:17:01.022338  7860 raft_consensus.cc:493] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:01.022693  7860 raft_consensus.cc:3060] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:01.021556  7941 raft_consensus.cc:2468] T b66f54819dda4cca9214096155a16694 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 2.
I20260709 13:17:01.024945  7980 leader_election.cc:304] T b66f54819dda4cca9214096155a16694 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:17:01.026940  8920 raft_consensus.cc:2804] T b66f54819dda4cca9214096155a16694 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:01.026321  7687 catalog_manager.cc:5697] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 2 to 3, leader changed from 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2) to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 3 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:01.027607  8920 raft_consensus.cc:697] T b66f54819dda4cca9214096155a16694 P c9a569f7d1ad42359002386a73702690 [term 2 LEADER]: Becoming Leader. State: Replica: c9a569f7d1ad42359002386a73702690, State: Running, Role: LEADER
I20260709 13:17:01.028772  8920 consensus_queue.cc:237] T b66f54819dda4cca9214096155a16694 P c9a569f7d1ad42359002386a73702690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:17:01.032836  7859 raft_consensus.cc:2468] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a569f7d1ad42359002386a73702690 in term 2.
I20260709 13:17:01.054489  7860 raft_consensus.cc:515] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:17:01.057864  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dba482a30c44a58bf79b2a8a890aee" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:17:01.058471  7941 raft_consensus.cc:3060] T 45dba482a30c44a58bf79b2a8a890aee P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:01.059722  8918 raft_consensus.cc:993] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740: : Instructing follower 59fcc1f631f642d6a7cf2d772ab1eba7 to start an election
I20260709 13:17:01.060254  8918 raft_consensus.cc:1081] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Signalling peer 59fcc1f631f642d6a7cf2d772ab1eba7 to start an election
I20260709 13:17:01.062814  8672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "940bca2247d04fb495fba36734ace153"
dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
 from {username='slave'} at 127.0.0.1:57186
I20260709 13:17:01.063524  8672 raft_consensus.cc:493] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:01.063930  8672 raft_consensus.cc:3060] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:01.060860  7687 catalog_manager.cc:5697] T b66f54819dda4cca9214096155a16694 P c9a569f7d1ad42359002386a73702690 reported cstate change: term changed from 1 to 2, leader changed from 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2) to c9a569f7d1ad42359002386a73702690 (127.30.63.4). New cstate: current_term: 2 leader_uuid: "c9a569f7d1ad42359002386a73702690" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:01.076808  7941 raft_consensus.cc:2468] T 45dba482a30c44a58bf79b2a8a890aee P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 2.
I20260709 13:17:01.078438  7832 leader_election.cc:304] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:17:01.080986  8964 raft_consensus.cc:2804] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:01.081779  8964 raft_consensus.cc:697] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Becoming Leader. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:17:01.082962  8964 consensus_queue.cc:237] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:17:01.100997  8672 raft_consensus.cc:515] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:17:01.107096  7860 leader_election.cc:290] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Requested vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:17:01.109351  8009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dba482a30c44a58bf79b2a8a890aee" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:17:01.110214  8009 raft_consensus.cc:3055] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:01.110682  8009 raft_consensus.cc:740] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Running, Role: LEADER
I20260709 13:17:01.111543  7860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940bca2247d04fb495fba36734ace153" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:17:01.112272  7860 raft_consensus.cc:3055] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:01.113016  8672 leader_election.cc:290] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 2 election: Requested vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:17:01.112571  7860 raft_consensus.cc:740] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:17:01.111713  8009 consensus_queue.cc:260] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:17:01.118597  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940bca2247d04fb495fba36734ace153" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:17:01.119745  7941 raft_consensus.cc:3060] T 940bca2247d04fb495fba36734ace153 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:01.117610  8009 raft_consensus.cc:3060] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:01.115980  7860 consensus_queue.cc:260] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:17:01.122016  7860 raft_consensus.cc:3060] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:01.128973  7687 catalog_manager.cc:5697] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 reported cstate change: term changed from 1 to 2, leader changed from c9a569f7d1ad42359002386a73702690 (127.30.63.4) to 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "1c5936948a84476fb0dcc1fa2d895740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:01.130393  8009 raft_consensus.cc:2468] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 2.
I20260709 13:17:01.133975  7941 raft_consensus.cc:2468] T 940bca2247d04fb495fba36734ace153 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 2.
I20260709 13:17:01.135751  8626 leader_election.cc:304] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:17:01.136842  8928 raft_consensus.cc:2804] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:01.137320  8928 raft_consensus.cc:697] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:17:01.138165  8928 consensus_queue.cc:237] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:17:01.140357  8969 raft_consensus.cc:993] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200: : Instructing follower 59fcc1f631f642d6a7cf2d772ab1eba7 to start an election
I20260709 13:17:01.140983  8969 raft_consensus.cc:1081] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 3 LEADER]: Signalling peer 59fcc1f631f642d6a7cf2d772ab1eba7 to start an election
I20260709 13:17:01.142328  7860 raft_consensus.cc:2468] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 2.
I20260709 13:17:01.142817  8672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b72bd809944d47a395c4bc1b0fc18c19"
dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
 from {username='slave'} at 127.0.0.1:57172
I20260709 13:17:01.143359  8672 raft_consensus.cc:493] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:01.143736  8672 raft_consensus.cc:3060] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:01.150753  8672 raft_consensus.cc:515] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:17:01.151316  7687 catalog_manager.cc:5697] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 1 to 2, leader changed from 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2) to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 2 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:01.152730  8672 leader_election.cc:290] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 4 election: Requested vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:17:01.152925  7860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72bd809944d47a395c4bc1b0fc18c19" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:17:01.153242  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72bd809944d47a395c4bc1b0fc18c19" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:17:01.153519  7860 raft_consensus.cc:3060] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:01.153821  7941 raft_consensus.cc:3055] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:01.154117  7941 raft_consensus.cc:740] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Running, Role: LEADER
I20260709 13:17:01.154870  7941 consensus_queue.cc:260] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:17:01.155961  7941 raft_consensus.cc:3060] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:01.159744  7860 raft_consensus.cc:2468] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 4.
I20260709 13:17:01.160989  8627 leader_election.cc:304] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7; no voters: 
I20260709 13:17:01.161774  8928 raft_consensus.cc:2804] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:01.162230  8928 raft_consensus.cc:697] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 4 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:17:01.162879  7941 raft_consensus.cc:2468] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 4.
I20260709 13:17:01.163167  8928 consensus_queue.cc:237] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:17:01.172863  7687 catalog_manager.cc:5697] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 3 to 4, leader changed from 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3) to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 4 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:01.383914  7860 raft_consensus.cc:1275] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Refusing update from remote peer 59fcc1f631f642d6a7cf2d772ab1eba7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:01.385355  8928 consensus_queue.cc:1048] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:01.417930  7941 raft_consensus.cc:1275] T b5e46a5b31234af492e77dbf435ead58 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Refusing update from remote peer 59fcc1f631f642d6a7cf2d772ab1eba7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:01.425407  8928 consensus_queue.cc:1048] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:01.499199  8009 raft_consensus.cc:1275] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Refusing update from remote peer 59fcc1f631f642d6a7cf2d772ab1eba7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:01.500396  8928 consensus_queue.cc:1048] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:01.511318  7859 raft_consensus.cc:1275] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [term 3 FOLLOWER]: Refusing update from remote peer 59fcc1f631f642d6a7cf2d772ab1eba7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:01.513062  8938 consensus_queue.cc:1048] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:01.524039  7860 raft_consensus.cc:1275] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Refusing update from remote peer 59fcc1f631f642d6a7cf2d772ab1eba7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:01.527391  7941 raft_consensus.cc:1275] T 45dba482a30c44a58bf79b2a8a890aee P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Refusing update from remote peer 1c5936948a84476fb0dcc1fa2d895740: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:01.527539  8938 consensus_queue.cc:1048] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:01.529181  8918 consensus_queue.cc:1048] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:01.534497  7932 raft_consensus.cc:1275] T b66f54819dda4cca9214096155a16694 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Refusing update from remote peer c9a569f7d1ad42359002386a73702690: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:01.536504  8920 consensus_queue.cc:1048] T b66f54819dda4cca9214096155a16694 P c9a569f7d1ad42359002386a73702690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:01.567282  8009 raft_consensus.cc:1275] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Refusing update from remote peer 1c5936948a84476fb0dcc1fa2d895740: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:01.570992  8908 consensus_queue.cc:1048] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:01.582743  7932 raft_consensus.cc:1275] T 940bca2247d04fb495fba36734ace153 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Refusing update from remote peer 59fcc1f631f642d6a7cf2d772ab1eba7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:01.598273  8928 consensus_queue.cc:1048] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:01.618371  7860 raft_consensus.cc:1275] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Refusing update from remote peer c9a569f7d1ad42359002386a73702690: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:01.624630  8997 consensus_queue.cc:1048] T b66f54819dda4cca9214096155a16694 P c9a569f7d1ad42359002386a73702690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:01.700567  7932 raft_consensus.cc:1275] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 4 FOLLOWER]: Refusing update from remote peer 59fcc1f631f642d6a7cf2d772ab1eba7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:01.701929  8928 consensus_queue.cc:1048] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:01.711560  7860 raft_consensus.cc:1275] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [term 4 FOLLOWER]: Refusing update from remote peer 59fcc1f631f642d6a7cf2d772ab1eba7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:01.713766  8938 consensus_queue.cc:1048] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:01.831437 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:01.890858 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:01.938112  7932 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d8e359e2c264806bd048cd1baed4db4"
dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
mode: GRACEFUL
new_leader_uuid: "1c5936948a84476fb0dcc1fa2d895740"
 from {username='slave'} at 127.0.0.1:42456
I20260709 13:17:01.938741  7932 raft_consensus.cc:606] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Received request to transfer leadership to TS 1c5936948a84476fb0dcc1fa2d895740
I20260709 13:17:01.941562  8009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "272dd059968c4493bb875e3bf32a3183"
dest_uuid: "c9a569f7d1ad42359002386a73702690"
mode: GRACEFUL
new_leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
 from {username='slave'} at 127.0.0.1:51676
I20260709 13:17:01.942016  8009 raft_consensus.cc:606] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [term 1 LEADER]: Received request to transfer leadership to TS 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:17:01.944510  7937 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32f607aa832749eeb8e3b97bab01b9f3"
dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
mode: GRACEFUL
new_leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
 from {username='slave'} at 127.0.0.1:42456
I20260709 13:17:01.944952  7937 raft_consensus.cc:606] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Received request to transfer leadership to TS 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:17:01.947606  7859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "878f83ec036345f69ff96a6b46613485"
dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
mode: GRACEFUL
new_leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
 from {username='slave'} at 127.0.0.1:46688
I20260709 13:17:01.948225  7859 raft_consensus.cc:606] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Received request to transfer leadership to TS 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:17:01.951172  8009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93cca694a49b44ba8eda19c91491696e"
dest_uuid: "c9a569f7d1ad42359002386a73702690"
mode: GRACEFUL
new_leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
 from {username='slave'} at 127.0.0.1:51676
I20260709 13:17:01.951674  8009 raft_consensus.cc:606] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [term 2 LEADER]: Received request to transfer leadership to TS 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:17:01.952823 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:01.954061 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:02.016508  8982 raft_consensus.cc:993] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200: : Instructing follower 1c5936948a84476fb0dcc1fa2d895740 to start an election
I20260709 13:17:02.017115  8969 raft_consensus.cc:1081] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Signalling peer 1c5936948a84476fb0dcc1fa2d895740 to start an election
I20260709 13:17:02.018615  7859 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d8e359e2c264806bd048cd1baed4db4"
dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
 from {username='slave'} at 127.0.0.1:46732
I20260709 13:17:02.019109  7859 raft_consensus.cc:493] T 0d8e359e2c264806bd048cd1baed4db4 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:02.019361  7859 raft_consensus.cc:3060] T 0d8e359e2c264806bd048cd1baed4db4 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:02.027526  7859 raft_consensus.cc:515] T 0d8e359e2c264806bd048cd1baed4db4 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:17:02.030648  7859 leader_election.cc:290] T 0d8e359e2c264806bd048cd1baed4db4 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Requested vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:17:02.031373  7932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8e359e2c264806bd048cd1baed4db4" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:17:02.032051  7932 raft_consensus.cc:3055] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:02.032366  7932 raft_consensus.cc:740] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Running, Role: LEADER
I20260709 13:17:02.032385  8007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8e359e2c264806bd048cd1baed4db4" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:17:02.033077  8007 raft_consensus.cc:3060] T 0d8e359e2c264806bd048cd1baed4db4 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:02.033197  7932 consensus_queue.cc:260] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:17:02.034464  7932 raft_consensus.cc:3060] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:02.038254  8007 raft_consensus.cc:2468] T 0d8e359e2c264806bd048cd1baed4db4 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 2.
I20260709 13:17:02.039460  7832 leader_election.cc:304] T 0d8e359e2c264806bd048cd1baed4db4 P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:17:02.040117  8964 raft_consensus.cc:2804] T 0d8e359e2c264806bd048cd1baed4db4 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:02.040532  8964 raft_consensus.cc:697] T 0d8e359e2c264806bd048cd1baed4db4 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Becoming Leader. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:17:02.041293  8964 consensus_queue.cc:237] T 0d8e359e2c264806bd048cd1baed4db4 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:17:02.042331  7932 raft_consensus.cc:2468] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 2.
I20260709 13:17:02.053357  7687 catalog_manager.cc:5697] T 0d8e359e2c264806bd048cd1baed4db4 P 1c5936948a84476fb0dcc1fa2d895740 reported cstate change: term changed from 1 to 2, leader changed from 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3) to 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "1c5936948a84476fb0dcc1fa2d895740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:02.069450  8965 raft_consensus.cc:993] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740: : Instructing follower 59fcc1f631f642d6a7cf2d772ab1eba7 to start an election
I20260709 13:17:02.069965  8964 raft_consensus.cc:1081] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Signalling peer 59fcc1f631f642d6a7cf2d772ab1eba7 to start an election
I20260709 13:17:02.071539  8672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "878f83ec036345f69ff96a6b46613485"
dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
 from {username='slave'} at 127.0.0.1:57186
I20260709 13:17:02.072118  8672 raft_consensus.cc:493] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:02.072497  8672 raft_consensus.cc:3060] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:02.077734  8672 raft_consensus.cc:515] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:17:02.079313  8672 leader_election.cc:290] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 2 election: Requested vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:17:02.080658  7932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878f83ec036345f69ff96a6b46613485" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:17:02.081390  7932 raft_consensus.cc:3060] T 878f83ec036345f69ff96a6b46613485 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:02.080542  7859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878f83ec036345f69ff96a6b46613485" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:17:02.082535  7859 raft_consensus.cc:3055] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:02.082892  7859 raft_consensus.cc:740] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:17:02.083909  7859 consensus_queue.cc:260] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:17:02.085939  7859 raft_consensus.cc:3060] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:02.088220  7932 raft_consensus.cc:2468] T 878f83ec036345f69ff96a6b46613485 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 2.
I20260709 13:17:02.089768  8626 leader_election.cc:304] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:17:02.090466  8938 raft_consensus.cc:2804] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:02.090952  8938 raft_consensus.cc:697] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:17:02.091858  8938 consensus_queue.cc:237] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:17:02.093061  7859 raft_consensus.cc:2468] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 2.
I20260709 13:17:02.104990  7687 catalog_manager.cc:5697] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 1 to 2, leader changed from 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2) to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 2 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:02.115458  8997 raft_consensus.cc:993] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690: : Instructing follower 59fcc1f631f642d6a7cf2d772ab1eba7 to start an election
I20260709 13:17:02.115938  8920 raft_consensus.cc:1081] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [term 1 LEADER]: Signalling peer 59fcc1f631f642d6a7cf2d772ab1eba7 to start an election
I20260709 13:17:02.117442  8672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "272dd059968c4493bb875e3bf32a3183"
dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
 from {username='slave'} at 127.0.0.1:57188
I20260709 13:17:02.117962  8672 raft_consensus.cc:493] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:02.118299  8672 raft_consensus.cc:3060] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:02.124828  8672 raft_consensus.cc:515] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:17:02.126579  8672 leader_election.cc:290] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 2 election: Requested vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:17:02.127295  7932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272dd059968c4493bb875e3bf32a3183" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:17:02.127534  8007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272dd059968c4493bb875e3bf32a3183" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:17:02.127924  7932 raft_consensus.cc:3060] T 272dd059968c4493bb875e3bf32a3183 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:02.128060  8007 raft_consensus.cc:3055] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:02.128422  8007 raft_consensus.cc:740] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Running, Role: LEADER
I20260709 13:17:02.129220  8007 consensus_queue.cc:260] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:17:02.130283  8007 raft_consensus.cc:3060] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:02.135643  7932 raft_consensus.cc:2468] T 272dd059968c4493bb875e3bf32a3183 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 2.
I20260709 13:17:02.136888  8626 leader_election.cc:304] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:17:02.137814  8928 raft_consensus.cc:2804] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:02.138393  8928 raft_consensus.cc:697] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:17:02.139354  8928 consensus_queue.cc:237] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:17:02.149590  8007 raft_consensus.cc:2468] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 2.
I20260709 13:17:02.154639  7687 catalog_manager.cc:5697] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 1 to 2, leader changed from c9a569f7d1ad42359002386a73702690 (127.30.63.4) to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 2 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:02.380998  8969 raft_consensus.cc:993] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200: : Instructing follower 59fcc1f631f642d6a7cf2d772ab1eba7 to start an election
I20260709 13:17:02.381513  8982 raft_consensus.cc:1081] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Signalling peer 59fcc1f631f642d6a7cf2d772ab1eba7 to start an election
I20260709 13:17:02.383010  8669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "32f607aa832749eeb8e3b97bab01b9f3"
dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
 from {username='slave'} at 127.0.0.1:57172
I20260709 13:17:02.383502  8669 raft_consensus.cc:493] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:02.383807  8669 raft_consensus.cc:3060] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:02.392916  8669 raft_consensus.cc:515] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:17:02.396230  8669 leader_election.cc:290] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 2 election: Requested vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:17:02.397910  7932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f607aa832749eeb8e3b97bab01b9f3" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:17:02.398149  8007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f607aa832749eeb8e3b97bab01b9f3" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:17:02.398403  7932 raft_consensus.cc:3055] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:02.398757  8007 raft_consensus.cc:3060] T 32f607aa832749eeb8e3b97bab01b9f3 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:02.398778  7932 raft_consensus.cc:740] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Running, Role: LEADER
I20260709 13:17:02.399648  7932 consensus_queue.cc:260] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:17:02.400544  7932 raft_consensus.cc:3060] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:02.404138  8007 raft_consensus.cc:2468] T 32f607aa832749eeb8e3b97bab01b9f3 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 2.
I20260709 13:17:02.405316  7932 raft_consensus.cc:2468] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 2.
I20260709 13:17:02.405370  8626 leader_election.cc:304] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:17:02.406260  8938 raft_consensus.cc:2804] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:02.406733  8938 raft_consensus.cc:697] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:17:02.407549  8938 consensus_queue.cc:237] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:17:02.416810  7685 catalog_manager.cc:5697] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 1 to 2, leader changed from 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3) to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 2 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:02.436643  8009 raft_consensus.cc:1275] T 0d8e359e2c264806bd048cd1baed4db4 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Refusing update from remote peer 1c5936948a84476fb0dcc1fa2d895740: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:02.438338  9011 consensus_queue.cc:1048] T 0d8e359e2c264806bd048cd1baed4db4 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:02.439790  9014 raft_consensus.cc:993] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690: : Instructing follower 59fcc1f631f642d6a7cf2d772ab1eba7 to start an election
I20260709 13:17:02.440371  9014 raft_consensus.cc:1081] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [term 2 LEADER]: Signalling peer 59fcc1f631f642d6a7cf2d772ab1eba7 to start an election
I20260709 13:17:02.442106  8672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93cca694a49b44ba8eda19c91491696e"
dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
 from {username='slave'} at 127.0.0.1:57188
I20260709 13:17:02.442651  8672 raft_consensus.cc:493] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:02.442983  8672 raft_consensus.cc:3060] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:02.451577  8672 raft_consensus.cc:515] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:17:02.455073  8672 leader_election.cc:290] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 3 election: Requested vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:17:02.457990  7932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93cca694a49b44ba8eda19c91491696e" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:17:02.458750  7932 raft_consensus.cc:3060] T 93cca694a49b44ba8eda19c91491696e P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:02.461831  8009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93cca694a49b44ba8eda19c91491696e" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:17:02.462528  8009 raft_consensus.cc:3055] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:02.462863  8009 raft_consensus.cc:740] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c9a569f7d1ad42359002386a73702690, State: Running, Role: LEADER
I20260709 13:17:02.463681  8009 consensus_queue.cc:260] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:17:02.466730  8009 raft_consensus.cc:3060] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:02.471195  7932 raft_consensus.cc:2468] T 93cca694a49b44ba8eda19c91491696e P 7de07e50a1714f5d9055bb4b86655200 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 3.
I20260709 13:17:02.472602  8626 leader_election.cc:304] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:17:02.473585  8938 raft_consensus.cc:2804] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:02.474135  8938 raft_consensus.cc:697] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:17:02.475404  8938 consensus_queue.cc:237] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:17:02.476938  8009 raft_consensus.cc:2468] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 3.
I20260709 13:17:02.487946  7932 raft_consensus.cc:1275] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Refusing update from remote peer 1c5936948a84476fb0dcc1fa2d895740: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:02.489363  8965 consensus_queue.cc:1048] T 0d8e359e2c264806bd048cd1baed4db4 P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:02.488776  7685 catalog_manager.cc:5697] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 2 to 3, leader changed from c9a569f7d1ad42359002386a73702690 (127.30.63.4) to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 3 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:02.523784  7932 raft_consensus.cc:1275] T 878f83ec036345f69ff96a6b46613485 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Refusing update from remote peer 59fcc1f631f642d6a7cf2d772ab1eba7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:02.526077  8938 consensus_queue.cc:1048] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:02.539168  8009 raft_consensus.cc:1275] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Refusing update from remote peer 59fcc1f631f642d6a7cf2d772ab1eba7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:02.542142  8938 consensus_queue.cc:1048] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:02.548234  7937 raft_consensus.cc:1275] T 272dd059968c4493bb875e3bf32a3183 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Refusing update from remote peer 59fcc1f631f642d6a7cf2d772ab1eba7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:02.549880  7859 raft_consensus.cc:1275] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Refusing update from remote peer 59fcc1f631f642d6a7cf2d772ab1eba7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:02.554319  9005 consensus_queue.cc:1048] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:02.561141  8938 consensus_queue.cc:1048] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:02.796541  8007 raft_consensus.cc:1275] T 32f607aa832749eeb8e3b97bab01b9f3 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Refusing update from remote peer 59fcc1f631f642d6a7cf2d772ab1eba7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:02.798071  9025 consensus_queue.cc:1048] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:02.817407  7937 raft_consensus.cc:1275] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Refusing update from remote peer 59fcc1f631f642d6a7cf2d772ab1eba7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:02.820194  9025 consensus_queue.cc:1048] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:02.863672  7937 raft_consensus.cc:1275] T 93cca694a49b44ba8eda19c91491696e P 7de07e50a1714f5d9055bb4b86655200 [term 3 FOLLOWER]: Refusing update from remote peer 59fcc1f631f642d6a7cf2d772ab1eba7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:02.865480  9025 consensus_queue.cc:1048] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:02.876171  8007 raft_consensus.cc:1275] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Refusing update from remote peer 59fcc1f631f642d6a7cf2d772ab1eba7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:02.879539  9025 consensus_queue.cc:1048] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:02.955057 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:03.001089 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:03.035930  7860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45dba482a30c44a58bf79b2a8a890aee"
dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
mode: GRACEFUL
new_leader_uuid: "7de07e50a1714f5d9055bb4b86655200"
 from {username='slave'} at 127.0.0.1:46688
I20260709 13:17:03.036516  7860 raft_consensus.cc:606] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Received request to transfer leadership to TS 7de07e50a1714f5d9055bb4b86655200
I20260709 13:17:03.037762 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:17:03.039175 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:03.116940  9011 raft_consensus.cc:993] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740: : Instructing follower 7de07e50a1714f5d9055bb4b86655200 to start an election
I20260709 13:17:03.117479  9033 raft_consensus.cc:1081] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Signalling peer 7de07e50a1714f5d9055bb4b86655200 to start an election
I20260709 13:17:03.118964  7937 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45dba482a30c44a58bf79b2a8a890aee"
dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
 from {username='slave'} at 127.0.0.1:47294
I20260709 13:17:03.119463  7937 raft_consensus.cc:493] T 45dba482a30c44a58bf79b2a8a890aee P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:03.119752  7937 raft_consensus.cc:3060] T 45dba482a30c44a58bf79b2a8a890aee P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:03.125092  7937 raft_consensus.cc:515] T 45dba482a30c44a58bf79b2a8a890aee P 7de07e50a1714f5d9055bb4b86655200 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:17:03.126770  7937 leader_election.cc:290] T 45dba482a30c44a58bf79b2a8a890aee P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 3 election: Requested vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:17:03.127668  8007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dba482a30c44a58bf79b2a8a890aee" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:17:03.127890  7859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dba482a30c44a58bf79b2a8a890aee" candidate_uuid: "7de07e50a1714f5d9055bb4b86655200" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:17:03.128314  8007 raft_consensus.cc:3060] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:03.128525  7859 raft_consensus.cc:3055] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:03.128901  7859 raft_consensus.cc:740] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:17:03.129613  7859 consensus_queue.cc:260] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:17:03.130772  7859 raft_consensus.cc:3060] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:03.134449  8007 raft_consensus.cc:2468] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 3.
I20260709 13:17:03.135725  7906 leader_election.cc:304] T 45dba482a30c44a58bf79b2a8a890aee P 7de07e50a1714f5d9055bb4b86655200 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7de07e50a1714f5d9055bb4b86655200, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:17:03.137066  8969 raft_consensus.cc:2804] T 45dba482a30c44a58bf79b2a8a890aee P 7de07e50a1714f5d9055bb4b86655200 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:03.137537  8969 raft_consensus.cc:697] T 45dba482a30c44a58bf79b2a8a890aee P 7de07e50a1714f5d9055bb4b86655200 [term 3 LEADER]: Becoming Leader. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Running, Role: LEADER
I20260709 13:17:03.138664  8969 consensus_queue.cc:237] T 45dba482a30c44a58bf79b2a8a890aee P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:17:03.138980  7859 raft_consensus.cc:2468] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7de07e50a1714f5d9055bb4b86655200 in term 3.
I20260709 13:17:03.148726  7690 catalog_manager.cc:5697] T 45dba482a30c44a58bf79b2a8a890aee P 7de07e50a1714f5d9055bb4b86655200 reported cstate change: term changed from 2 to 3, leader changed from 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2) to 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3). New cstate: current_term: 3 leader_uuid: "7de07e50a1714f5d9055bb4b86655200" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:03.670948  7860 raft_consensus.cc:1275] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [term 3 FOLLOWER]: Refusing update from remote peer 7de07e50a1714f5d9055bb4b86655200: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:03.672097  9038 consensus_queue.cc:1048] T 45dba482a30c44a58bf79b2a8a890aee P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:03.684798  8009 raft_consensus.cc:1275] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Refusing update from remote peer 7de07e50a1714f5d9055bb4b86655200: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:03.687165  9038 consensus_queue.cc:1048] T 45dba482a30c44a58bf79b2a8a890aee P 7de07e50a1714f5d9055bb4b86655200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:04.040083 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:04.089979 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:04.128571  7937 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "932dad2d4cee49e296e9359aa665ef9d"
dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
mode: GRACEFUL
new_leader_uuid: "1c5936948a84476fb0dcc1fa2d895740"
 from {username='slave'} at 127.0.0.1:42456
I20260709 13:17:04.129175  7937 raft_consensus.cc:606] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Received request to transfer leadership to TS 1c5936948a84476fb0dcc1fa2d895740
I20260709 13:17:04.130306 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:17:04.131479 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:04.593670  8969 raft_consensus.cc:993] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200: : Instructing follower 1c5936948a84476fb0dcc1fa2d895740 to start an election
I20260709 13:17:04.594151  9038 raft_consensus.cc:1081] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Signalling peer 1c5936948a84476fb0dcc1fa2d895740 to start an election
I20260709 13:17:04.595674  7860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "932dad2d4cee49e296e9359aa665ef9d"
dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
 from {username='slave'} at 127.0.0.1:46732
I20260709 13:17:04.596118  7860 raft_consensus.cc:493] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:04.596422  7860 raft_consensus.cc:3060] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:04.601542  7860 raft_consensus.cc:515] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:17:04.602829  7860 leader_election.cc:290] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Requested vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), c9a569f7d1ad42359002386a73702690 (127.30.63.4:46031)
I20260709 13:17:04.603926  7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932dad2d4cee49e296e9359aa665ef9d" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:17:04.604537  7937 raft_consensus.cc:3055] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:04.604863  7937 raft_consensus.cc:740] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7de07e50a1714f5d9055bb4b86655200, State: Running, Role: LEADER
I20260709 13:17:04.605013  8007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932dad2d4cee49e296e9359aa665ef9d" candidate_uuid: "1c5936948a84476fb0dcc1fa2d895740" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9a569f7d1ad42359002386a73702690"
I20260709 13:17:04.605587  8007 raft_consensus.cc:3060] T 932dad2d4cee49e296e9359aa665ef9d P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:04.605648  7937 consensus_queue.cc:260] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:17:04.606904  7937 raft_consensus.cc:3060] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:04.612448  8007 raft_consensus.cc:2468] T 932dad2d4cee49e296e9359aa665ef9d P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 2.
I20260709 13:17:04.613447  7937 raft_consensus.cc:2468] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5936948a84476fb0dcc1fa2d895740 in term 2.
I20260709 13:17:04.614111  7832 leader_election.cc:304] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5936948a84476fb0dcc1fa2d895740, c9a569f7d1ad42359002386a73702690; no voters: 
I20260709 13:17:04.615083  9033 raft_consensus.cc:2804] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:04.615608  9033 raft_consensus.cc:697] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Becoming Leader. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:17:04.616282  9033 consensus_queue.cc:237] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:17:04.625978  7687 catalog_manager.cc:5697] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740 reported cstate change: term changed from 1 to 2, leader changed from 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3) to 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "1c5936948a84476fb0dcc1fa2d895740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:05.132493 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:05.142385  8009 raft_consensus.cc:1275] T 932dad2d4cee49e296e9359aa665ef9d P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Refusing update from remote peer 1c5936948a84476fb0dcc1fa2d895740: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:05.143771  9046 consensus_queue.cc:1048] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:05.172541  7941 raft_consensus.cc:1275] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Refusing update from remote peer 1c5936948a84476fb0dcc1fa2d895740: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:05.175520  9055 consensus_queue.cc:1048] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:05.207294 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:05.255671  7860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee4af0a88c7f43bcaa15fc11bdfaf591"
dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
mode: GRACEFUL
new_leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
 from {username='slave'} at 127.0.0.1:46688
I20260709 13:17:05.256304  7860 raft_consensus.cc:606] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Received request to transfer leadership to TS 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:17:05.257529 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:17:05.258759 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:05.335969  9033 raft_consensus.cc:993] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740: : Instructing follower 59fcc1f631f642d6a7cf2d772ab1eba7 to start an election
I20260709 13:17:05.336553  9033 raft_consensus.cc:1081] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Signalling peer 59fcc1f631f642d6a7cf2d772ab1eba7 to start an election
I20260709 13:17:05.338398  8669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee4af0a88c7f43bcaa15fc11bdfaf591"
dest_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7"
 from {username='slave'} at 127.0.0.1:57186
I20260709 13:17:05.339057  8669 raft_consensus.cc:493] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:05.339887  8669 raft_consensus.cc:3060] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:05.353478  8669 raft_consensus.cc:515] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:17:05.356365  7860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4af0a88c7f43bcaa15fc11bdfaf591" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1c5936948a84476fb0dcc1fa2d895740"
I20260709 13:17:05.356746  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4af0a88c7f43bcaa15fc11bdfaf591" candidate_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7de07e50a1714f5d9055bb4b86655200"
I20260709 13:17:05.357365  7860 raft_consensus.cc:3055] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:05.357671  7941 raft_consensus.cc:3060] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:05.357729  7860 raft_consensus.cc:740] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c5936948a84476fb0dcc1fa2d895740, State: Running, Role: LEADER
I20260709 13:17:05.358621  7860 consensus_queue.cc:260] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:17:05.359669  7860 raft_consensus.cc:3060] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:05.367827  7941 raft_consensus.cc:2468] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 3.
I20260709 13:17:05.357307  8669 leader_election.cc:290] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 3 election: Requested vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:17:05.369894  8626 leader_election.cc:304] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200; no voters: 
I20260709 13:17:05.370350  7860 raft_consensus.cc:2468] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fcc1f631f642d6a7cf2d772ab1eba7 in term 3.
I20260709 13:17:05.370965  9025 raft_consensus.cc:2804] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:05.371868  9025 raft_consensus.cc:697] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 LEADER]: Becoming Leader. State: Replica: 59fcc1f631f642d6a7cf2d772ab1eba7, State: Running, Role: LEADER
I20260709 13:17:05.372869  9025 consensus_queue.cc:237] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } }
I20260709 13:17:05.383064  7690 catalog_manager.cc:5697] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 reported cstate change: term changed from 2 to 3, leader changed from 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2) to 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1). New cstate: current_term: 3 leader_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:05.904115  7937 raft_consensus.cc:1275] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200 [term 3 FOLLOWER]: Refusing update from remote peer 59fcc1f631f642d6a7cf2d772ab1eba7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:05.905552  9025 consensus_queue.cc:1048] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:05.924635  7860 raft_consensus.cc:1275] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [term 3 FOLLOWER]: Refusing update from remote peer 59fcc1f631f642d6a7cf2d772ab1eba7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:05.928483  9053 consensus_queue.cc:1048] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:06.259594 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:06.298687 30972 tablet_server.cc:179] TabletServer@127.30.63.1:35503 shutting down...
W20260709 13:17:06.307516  7978 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 51 similar messages]
W20260709 13:17:06.332790  7978 consensus_peers.cc:597] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:06.333717  7978 consensus_peers.cc:597] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:06.342923  7904 consensus_peers.cc:597] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:06.344961  7904 consensus_peers.cc:597] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:06.352221  7830 consensus_peers.cc:597] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.354106 30972 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:06.355165 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.355954 30972 raft_consensus.cc:2243] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.356914 30972 raft_consensus.cc:2272] T 940bca2247d04fb495fba36734ace153 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.359145 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.359851 30972 raft_consensus.cc:2243] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.360250 30972 raft_consensus.cc:2272] T deeaf93ab6424e9c8013e6c9fbccb724 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.362932 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.363976 30972 raft_consensus.cc:2243] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.365087 30972 raft_consensus.cc:2272] T 2e84fab0d4fc43359b4219baa6171aa5 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.367441 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.368112 30972 raft_consensus.cc:2243] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.369042 30972 raft_consensus.cc:2272] T 272dd059968c4493bb875e3bf32a3183 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.371961 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.372915 30972 raft_consensus.cc:2243] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:17:06.373045  7978 consensus_peers.cc:597] T 7806fa697a044140850e326d8e5889d1 P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.374112 30972 raft_consensus.cc:2272] T 06dd732d5f194c5f8bacb0d12d551212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:06.377255  7830 consensus_peers.cc:597] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.377483 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.378469 30972 raft_consensus.cc:2243] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.379065 30972 raft_consensus.cc:2272] T 242ac51169564e5e9b95c521387a853b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:06.380036  7904 consensus_peers.cc:597] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.382735 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.383706 30972 raft_consensus.cc:2243] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.384307 30972 raft_consensus.cc:2272] T da682789343c4852b052f5fa4483c715 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.387681 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.388645 30972 raft_consensus.cc:2243] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.389240 30972 raft_consensus.cc:2272] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.392784 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.393868 30972 raft_consensus.cc:2243] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.395243 30972 raft_consensus.cc:2272] T af8981a911484760ab96a4d042148094 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:06.395581  7904 consensus_peers.cc:597] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:06.397205  7904 consensus_peers.cc:597] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.398518 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.399452 30972 raft_consensus.cc:2243] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.400465 30972 raft_consensus.cc:2272] T 93cca694a49b44ba8eda19c91491696e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.403012 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.403680 30972 raft_consensus.cc:2243] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.404302 30972 raft_consensus.cc:2272] T 66c64de12c904e15892de849a597eeae P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.407181 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.408191 30972 raft_consensus.cc:2243] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.409456 30972 raft_consensus.cc:2272] T b72bd809944d47a395c4bc1b0fc18c19 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.412405 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.413160 30972 raft_consensus.cc:2243] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.414075 30972 raft_consensus.cc:2272] T b5e46a5b31234af492e77dbf435ead58 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:06.414217  7830 consensus_peers.cc:597] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.416529 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.417434 30972 raft_consensus.cc:2243] T 7141f7bef8234a56bdbb17df0b302a75 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.418023 30972 raft_consensus.cc:2272] T 7141f7bef8234a56bdbb17df0b302a75 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.421397 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.422235 30972 raft_consensus.cc:2243] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.422837 30972 raft_consensus.cc:2272] T e8725967bab0469eb6a5ed9c6bddf3cb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.425869 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.426961 30972 raft_consensus.cc:2243] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.427877 30972 raft_consensus.cc:2272] T 9c126cef127140f48a31bbd723a86051 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.430888 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.431533 30972 raft_consensus.cc:2243] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.432237 30972 raft_consensus.cc:2272] T 6ed88d7e51364cb28224875b51de8f8e P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.434979 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.435774 30972 raft_consensus.cc:2243] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.436714 30972 raft_consensus.cc:2272] T 5cc8636f68ae4121ac05d99e24866633 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.440703 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.441425 30972 raft_consensus.cc:2243] T 2e6d18ad10a340e2aa1fba5831e6db57 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.442167 30972 raft_consensus.cc:2272] T 2e6d18ad10a340e2aa1fba5831e6db57 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:06.445497  7904 consensus_peers.cc:597] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.445915 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.446974 30972 raft_consensus.cc:2243] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.447638 30972 raft_consensus.cc:2272] T d1b12aa42b0f49a49b24d2433fdca7a8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:06.449985  7978 consensus_peers.cc:597] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.450986 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.452009 30972 raft_consensus.cc:2243] T d99b23f5044644c1b270bc5afcaf2119 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.452481 30972 raft_consensus.cc:2272] T d99b23f5044644c1b270bc5afcaf2119 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.454923 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.455543 30972 raft_consensus.cc:2243] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.456032 30972 raft_consensus.cc:2272] T 985b6cf5ffe74ecfabc7ba74e262a88f P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.458192 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.458799 30972 raft_consensus.cc:2243] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.459265 30972 raft_consensus.cc:2272] T 5391ca2d8a8747bebb865e71268e06ad P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.461499 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.462078 30972 raft_consensus.cc:2243] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.462534 30972 raft_consensus.cc:2272] T f35a05f13eee42d4bdd19ff8b2b98212 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.464727 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.465348 30972 raft_consensus.cc:2243] T 9eeed88ecdc244a98599a38459ae66b8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.465708 30972 raft_consensus.cc:2272] T 9eeed88ecdc244a98599a38459ae66b8 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.467859 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.468489 30972 raft_consensus.cc:2243] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.469367 30972 raft_consensus.cc:2272] T 48ee265806af41dfb77624fadfa04e6b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.471743 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.472378 30972 raft_consensus.cc:2243] T ffeb7520452b4edcb0421cee5ab0e516 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.472857 30972 raft_consensus.cc:2272] T ffeb7520452b4edcb0421cee5ab0e516 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.475334 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.476421 30972 raft_consensus.cc:2243] T e74f9555b1f64bc080273bc35b9ef15b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.477039 30972 raft_consensus.cc:2272] T e74f9555b1f64bc080273bc35b9ef15b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.479990 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.480808 30972 raft_consensus.cc:2243] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.481999 30972 raft_consensus.cc:2272] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.485085 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.485821 30972 raft_consensus.cc:2243] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.486413 30972 raft_consensus.cc:2272] T c04b5a061ff84745af17197de774ac96 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.489092 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.489840 30972 raft_consensus.cc:2243] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.490409 30972 raft_consensus.cc:2272] T 0eb35ec786da4450bcf232cf85ba857b P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:06.490794  7830 consensus_peers.cc:597] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.493260 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.494223 30972 raft_consensus.cc:2243] T 87d445d744434f90baaf040e708b1e98 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.494796 30972 raft_consensus.cc:2272] T 87d445d744434f90baaf040e708b1e98 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.498108 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.498754 30972 raft_consensus.cc:2243] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.499730 30972 raft_consensus.cc:2272] T 044eb7b4196a4ac595bec86f29fca1bf P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:06.502048  7978 consensus_peers.cc:597] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.502683 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.503532 30972 raft_consensus.cc:2243] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.504268 30972 raft_consensus.cc:2272] T de92af0966804027bbe4ec91b14382d4 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:06.504777  7830 consensus_peers.cc:597] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.506712 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.507369 30972 raft_consensus.cc:2243] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.507858 30972 raft_consensus.cc:2272] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.510026 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.510586 30972 raft_consensus.cc:2243] T afc39d65d52c48e3a959c8876930ab07 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.511005 30972 raft_consensus.cc:2272] T afc39d65d52c48e3a959c8876930ab07 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.513530 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.514288 30972 raft_consensus.cc:2243] T 1f5409294f3e4162a75137e616968afb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.514807 30972 raft_consensus.cc:2272] T 1f5409294f3e4162a75137e616968afb P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.517632 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.518420 30972 raft_consensus.cc:2243] T 5ba560db35494ad2b64a9b728d510c1a P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.518901 30972 raft_consensus.cc:2272] T 5ba560db35494ad2b64a9b728d510c1a P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.522110 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.522957 30972 raft_consensus.cc:2243] T 7806fa697a044140850e326d8e5889d1 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.523531 30972 raft_consensus.cc:2272] T 7806fa697a044140850e326d8e5889d1 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.525774 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.526342 30972 raft_consensus.cc:2243] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.527117 30972 raft_consensus.cc:2272] T 32f607aa832749eeb8e3b97bab01b9f3 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.529266 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.529796 30972 raft_consensus.cc:2243] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.530233 30972 raft_consensus.cc:2272] T ceaecfbd6ac84206af71ba2b5fe22259 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.532191 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.532812 30972 raft_consensus.cc:2243] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.533315 30972 raft_consensus.cc:2272] T 4877bb8fb91844ddab1c717b7dec231d P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.535496 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.536204 30972 raft_consensus.cc:2243] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.536733 30972 raft_consensus.cc:2272] T 191eb110a7ae4009a2184d4c3af4f439 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:06.538631  7830 consensus_peers.cc:597] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.539216 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.539844 30972 raft_consensus.cc:2243] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.540300 30972 raft_consensus.cc:2272] T ea7f3171e8b84ac48e0abd056c43f778 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.542389 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:06.542974 30972 raft_consensus.cc:2243] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.543807 30972 raft_consensus.cc:2272] T 878f83ec036345f69ff96a6b46613485 P 59fcc1f631f642d6a7cf2d772ab1eba7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:06.561866  7978 consensus_peers.cc:597] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:06.568102  7978 consensus_peers.cc:597] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:06.575632  7978 consensus_peers.cc:597] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:06.593806  7904 consensus_peers.cc:597] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:06.594405  7904 consensus_peers.cc:597] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:06.598731  7904 consensus_peers.cc:597] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.615135 30972 tablet_server.cc:196] TabletServer@127.30.63.1:35503 shutdown complete.
W20260709 13:17:06.647131  7978 consensus_peers.cc:597] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:06.657735  7978 consensus_peers.cc:597] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:06.664901  7978 consensus_peers.cc:597] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:06.704103  7978 consensus_peers.cc:597] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.708968 30972 tablet_server.cc:179] TabletServer@127.30.63.2:0 shutting down...
W20260709 13:17:06.721060  7981 consensus_peers.cc:597] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690 -> Peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Couldn't send request to peer 1c5936948a84476fb0dcc1fa2d895740. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.776293 30972 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:17:06.777053  7981 consensus_peers.cc:597] T b66f54819dda4cca9214096155a16694 P c9a569f7d1ad42359002386a73702690 -> Peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Couldn't send request to peer 1c5936948a84476fb0dcc1fa2d895740. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.779146 30972 tablet_replica.cc:333] T 1f5409294f3e4162a75137e616968afb P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
W20260709 13:17:06.779826  7981 consensus_peers.cc:597] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 -> Peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Couldn't send request to peer 1c5936948a84476fb0dcc1fa2d895740. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.780200 30972 raft_consensus.cc:2243] T 1f5409294f3e4162a75137e616968afb P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.780956 30972 raft_consensus.cc:2272] T 1f5409294f3e4162a75137e616968afb P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.784502 30972 tablet_replica.cc:333] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
W20260709 13:17:06.784974  7904 consensus_peers.cc:597] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.785669 30972 raft_consensus.cc:2243] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.786358 30972 raft_consensus.cc:2272] T 66c64de12c904e15892de849a597eeae P 1c5936948a84476fb0dcc1fa2d895740 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.789009 30972 tablet_replica.cc:333] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.790030 30972 raft_consensus.cc:2243] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.790635 30972 raft_consensus.cc:2272] T 5cc8636f68ae4121ac05d99e24866633 P 1c5936948a84476fb0dcc1fa2d895740 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.794605 30972 tablet_replica.cc:333] T 2e6d18ad10a340e2aa1fba5831e6db57 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.795341 30972 raft_consensus.cc:2243] T 2e6d18ad10a340e2aa1fba5831e6db57 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.795886 30972 raft_consensus.cc:2272] T 2e6d18ad10a340e2aa1fba5831e6db57 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.798476 30972 tablet_replica.cc:333] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
W20260709 13:17:06.799006  7904 consensus_peers.cc:597] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.799336 30972 raft_consensus.cc:2243] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.800626 30972 raft_consensus.cc:2272] T f35a05f13eee42d4bdd19ff8b2b98212 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:06.803081  7981 consensus_peers.cc:597] T 7806fa697a044140850e326d8e5889d1 P c9a569f7d1ad42359002386a73702690 -> Peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Couldn't send request to peer 1c5936948a84476fb0dcc1fa2d895740. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.804420 30972 tablet_replica.cc:333] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.805385 30972 raft_consensus.cc:2243] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.805939 30972 raft_consensus.cc:2272] T 940bca2247d04fb495fba36734ace153 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.808931 30972 tablet_replica.cc:333] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.809803 30972 raft_consensus.cc:2243] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.810734 30972 raft_consensus.cc:2272] T 932dad2d4cee49e296e9359aa665ef9d P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.813504 30972 tablet_replica.cc:333] T ffeb7520452b4edcb0421cee5ab0e516 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.814430 30972 raft_consensus.cc:2243] T ffeb7520452b4edcb0421cee5ab0e516 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.814978 30972 raft_consensus.cc:2272] T ffeb7520452b4edcb0421cee5ab0e516 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:06.816021  7907 consensus_peers.cc:597] T c265324643494522a597d6dab81e7893 P 7de07e50a1714f5d9055bb4b86655200 -> Peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Couldn't send request to peer 1c5936948a84476fb0dcc1fa2d895740. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.817751 30972 tablet_replica.cc:333] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.818707 30972 raft_consensus.cc:2243] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.819249 30972 raft_consensus.cc:2272] T 45dba482a30c44a58bf79b2a8a890aee P 1c5936948a84476fb0dcc1fa2d895740 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.822074 30972 tablet_replica.cc:333] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.822902 30972 raft_consensus.cc:2243] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.823474 30972 raft_consensus.cc:2272] T 6ed88d7e51364cb28224875b51de8f8e P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.826447 30972 tablet_replica.cc:333] T f584d75fb3ee4c80958b7b9e5322cf2b P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.827247 30972 raft_consensus.cc:2243] T f584d75fb3ee4c80958b7b9e5322cf2b P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.828168 30972 raft_consensus.cc:2272] T f584d75fb3ee4c80958b7b9e5322cf2b P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:06.828364  7907 consensus_peers.cc:597] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200 -> Peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Couldn't send request to peer 1c5936948a84476fb0dcc1fa2d895740. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.833841 30972 tablet_replica.cc:333] T ea27688f1e2442e18da64b6f636beaf4 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.834800 30972 raft_consensus.cc:2243] T ea27688f1e2442e18da64b6f636beaf4 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.836031 30972 raft_consensus.cc:2272] T ea27688f1e2442e18da64b6f636beaf4 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:06.837792  7978 consensus_peers.cc:597] T 87d445d744434f90baaf040e708b1e98 P c9a569f7d1ad42359002386a73702690 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.838977 30972 tablet_replica.cc:333] T c265324643494522a597d6dab81e7893 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.839954 30972 raft_consensus.cc:2243] T c265324643494522a597d6dab81e7893 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.840544 30972 raft_consensus.cc:2272] T c265324643494522a597d6dab81e7893 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.843441 30972 tablet_replica.cc:333] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.844271 30972 raft_consensus.cc:2243] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.844815 30972 raft_consensus.cc:2272] T 06dd732d5f194c5f8bacb0d12d551212 P 1c5936948a84476fb0dcc1fa2d895740 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.847500 30972 tablet_replica.cc:333] T d1b12aa42b0f49a49b24d2433fdca7a8 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.848157 30972 raft_consensus.cc:2243] T d1b12aa42b0f49a49b24d2433fdca7a8 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.848685 30972 raft_consensus.cc:2272] T d1b12aa42b0f49a49b24d2433fdca7a8 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.851554 30972 tablet_replica.cc:333] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
W20260709 13:17:06.851614  7907 consensus_peers.cc:597] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 -> Peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Couldn't send request to peer 1c5936948a84476fb0dcc1fa2d895740. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.852402 30972 raft_consensus.cc:2243] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.853489 30972 raft_consensus.cc:2272] T 569ddc7f4d23481a852ea6ef24d38e31 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.856042 30972 tablet_replica.cc:333] T d99b23f5044644c1b270bc5afcaf2119 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.856804 30972 raft_consensus.cc:2243] T d99b23f5044644c1b270bc5afcaf2119 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.857329 30972 raft_consensus.cc:2272] T d99b23f5044644c1b270bc5afcaf2119 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.859951 30972 tablet_replica.cc:333] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.860773 30972 raft_consensus.cc:2243] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.861209 30972 raft_consensus.cc:2272] T b66f54819dda4cca9214096155a16694 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:06.862864  7904 consensus_peers.cc:597] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200 -> Peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Couldn't send request to peer 59fcc1f631f642d6a7cf2d772ab1eba7. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.863842 30972 tablet_replica.cc:333] T 8b505df72528474496f1a81ffa9ad0a6 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.864637 30972 raft_consensus.cc:2243] T 8b505df72528474496f1a81ffa9ad0a6 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.865685 30972 raft_consensus.cc:2272] T 8b505df72528474496f1a81ffa9ad0a6 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.868188 30972 tablet_replica.cc:333] T 7806fa697a044140850e326d8e5889d1 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.869004 30972 raft_consensus.cc:2243] T 7806fa697a044140850e326d8e5889d1 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.869463 30972 raft_consensus.cc:2272] T 7806fa697a044140850e326d8e5889d1 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.871459 30972 tablet_replica.cc:333] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.871981 30972 raft_consensus.cc:2243] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.872818 30972 raft_consensus.cc:2272] T 5ba560db35494ad2b64a9b728d510c1a P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.874779 30972 tablet_replica.cc:333] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.875320 30972 raft_consensus.cc:2243] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.876063 30972 raft_consensus.cc:2272] T d28b4b42078f421f85ebc87a2481aa87 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.877954 30972 tablet_replica.cc:333] T b750f6e7ca2b48ef942ad988e6c4dd8d P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.878484 30972 raft_consensus.cc:2243] T b750f6e7ca2b48ef942ad988e6c4dd8d P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.878906 30972 raft_consensus.cc:2272] T b750f6e7ca2b48ef942ad988e6c4dd8d P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.880801 30972 tablet_replica.cc:333] T 7141f7bef8234a56bdbb17df0b302a75 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.881493 30972 raft_consensus.cc:2243] T 7141f7bef8234a56bdbb17df0b302a75 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.881940 30972 raft_consensus.cc:2272] T 7141f7bef8234a56bdbb17df0b302a75 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.883710 30972 tablet_replica.cc:333] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.884253 30972 raft_consensus.cc:2243] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.884728 30972 raft_consensus.cc:2272] T b72bd809944d47a395c4bc1b0fc18c19 P 1c5936948a84476fb0dcc1fa2d895740 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.886608 30972 tablet_replica.cc:333] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.887135 30972 raft_consensus.cc:2243] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.887949 30972 raft_consensus.cc:2272] T 985b6cf5ffe74ecfabc7ba74e262a88f P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.890473 30972 tablet_replica.cc:333] T 5391ca2d8a8747bebb865e71268e06ad P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.891072 30972 raft_consensus.cc:2243] T 5391ca2d8a8747bebb865e71268e06ad P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.891558 30972 raft_consensus.cc:2272] T 5391ca2d8a8747bebb865e71268e06ad P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.894239 30972 tablet_replica.cc:333] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.894932 30972 raft_consensus.cc:2243] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:17:06.895398  7981 consensus_peers.cc:597] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690 -> Peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Couldn't send request to peer 1c5936948a84476fb0dcc1fa2d895740. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.895941 30972 raft_consensus.cc:2272] T ceaecfbd6ac84206af71ba2b5fe22259 P 1c5936948a84476fb0dcc1fa2d895740 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.898041 30972 tablet_replica.cc:333] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.898627 30972 raft_consensus.cc:2243] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.899060 30972 raft_consensus.cc:2272] T 2e84fab0d4fc43359b4219baa6171aa5 P 1c5936948a84476fb0dcc1fa2d895740 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.901436 30972 tablet_replica.cc:333] T 0d8e359e2c264806bd048cd1baed4db4 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.902132 30972 raft_consensus.cc:2243] T 0d8e359e2c264806bd048cd1baed4db4 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.903014 30972 raft_consensus.cc:2272] T 0d8e359e2c264806bd048cd1baed4db4 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.905350 30972 tablet_replica.cc:333] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.905922 30972 raft_consensus.cc:2243] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.906347 30972 raft_consensus.cc:2272] T 878f83ec036345f69ff96a6b46613485 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.908252 30972 tablet_replica.cc:333] T deeaf93ab6424e9c8013e6c9fbccb724 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.908890 30972 raft_consensus.cc:2243] T deeaf93ab6424e9c8013e6c9fbccb724 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.909333 30972 raft_consensus.cc:2272] T deeaf93ab6424e9c8013e6c9fbccb724 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.911410 30972 tablet_replica.cc:333] T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.911973 30972 raft_consensus.cc:2243] T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.912424 30972 raft_consensus.cc:2272] T 0eb35ec786da4450bcf232cf85ba857b P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.916453 30972 tablet_replica.cc:333] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.917213 30972 raft_consensus.cc:2243] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.918248 30972 raft_consensus.cc:2272] T 9eeed88ecdc244a98599a38459ae66b8 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.920817 30972 tablet_replica.cc:333] T aa3b3005e3634f858a7e68a789b5f827 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.921581 30972 raft_consensus.cc:2243] T aa3b3005e3634f858a7e68a789b5f827 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.922572 30972 raft_consensus.cc:2272] T aa3b3005e3634f858a7e68a789b5f827 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.925246 30972 tablet_replica.cc:333] T afc39d65d52c48e3a959c8876930ab07 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
W20260709 13:17:06.925870  7981 consensus_peers.cc:597] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690 -> Peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Couldn't send request to peer 1c5936948a84476fb0dcc1fa2d895740. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.925933 30972 raft_consensus.cc:2243] T afc39d65d52c48e3a959c8876930ab07 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.926983 30972 raft_consensus.cc:2272] T afc39d65d52c48e3a959c8876930ab07 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:06.927433  7907 consensus_peers.cc:597] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200 -> Peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Couldn't send request to peer 1c5936948a84476fb0dcc1fa2d895740. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.929785 30972 tablet_replica.cc:333] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.930641 30972 raft_consensus.cc:2243] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.931162 30972 raft_consensus.cc:2272] T 044eb7b4196a4ac595bec86f29fca1bf P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.933707 30972 tablet_replica.cc:333] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.934396 30972 raft_consensus.cc:2243] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.934934 30972 raft_consensus.cc:2272] T 3fa297fedf4549fd89f9a179ef9147a8 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.937419 30972 tablet_replica.cc:333] T de92af0966804027bbe4ec91b14382d4 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.938884 30972 raft_consensus.cc:2243] T de92af0966804027bbe4ec91b14382d4 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.939625 30972 raft_consensus.cc:2272] T de92af0966804027bbe4ec91b14382d4 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.942461 30972 tablet_replica.cc:333] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.943171 30972 raft_consensus.cc:2243] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.943753 30972 raft_consensus.cc:2272] T af8981a911484760ab96a4d042148094 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.946350 30972 tablet_replica.cc:333] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.946859 30972 raft_consensus.cc:2243] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.947365 30972 raft_consensus.cc:2272] T b5e46a5b31234af492e77dbf435ead58 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.949483 30972 tablet_replica.cc:333] T a8fe051592e64e39905b33d218b96822 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.949988 30972 raft_consensus.cc:2243] T a8fe051592e64e39905b33d218b96822 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.950798 30972 raft_consensus.cc:2272] T a8fe051592e64e39905b33d218b96822 P 1c5936948a84476fb0dcc1fa2d895740 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.952968 30972 tablet_replica.cc:333] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.953491 30972 raft_consensus.cc:2243] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.954363 30972 raft_consensus.cc:2272] T c04b5a061ff84745af17197de774ac96 P 1c5936948a84476fb0dcc1fa2d895740 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.956418 30972 tablet_replica.cc:333] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740: stopping tablet replica
I20260709 13:17:06.956957 30972 raft_consensus.cc:2243] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.957407 30972 raft_consensus.cc:2272] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 1c5936948a84476fb0dcc1fa2d895740 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:06.999751  7907 consensus_peers.cc:597] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200 -> Peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Couldn't send request to peer 1c5936948a84476fb0dcc1fa2d895740. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:07.018837  7907 consensus_peers.cc:597] T b750f6e7ca2b48ef942ad988e6c4dd8d P 7de07e50a1714f5d9055bb4b86655200 -> Peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Couldn't send request to peer 1c5936948a84476fb0dcc1fa2d895740. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:07.037943 30972 tablet_server.cc:196] TabletServer@127.30.63.2:0 shutdown complete.
W20260709 13:17:07.096999  7981 consensus_peers.cc:597] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690 -> Peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Couldn't send request to peer 1c5936948a84476fb0dcc1fa2d895740. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:45491: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:07.102788  7981 consensus_peers.cc:597] T 3fa297fedf4549fd89f9a179ef9147a8 P c9a569f7d1ad42359002386a73702690 -> Peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Couldn't send request to peer 1c5936948a84476fb0dcc1fa2d895740. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:45491: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:07.123924 30972 tablet_server.cc:179] TabletServer@127.30.63.3:0 shutting down...
I20260709 13:17:07.207125 30972 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:07.208165 30972 tablet_replica.cc:333] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.209347 30972 raft_consensus.cc:2243] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.210606 30972 raft_consensus.cc:2272] T 66c64de12c904e15892de849a597eeae P 7de07e50a1714f5d9055bb4b86655200 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.214542 30972 tablet_replica.cc:333] T 044eb7b4196a4ac595bec86f29fca1bf P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.215479 30972 raft_consensus.cc:2243] T 044eb7b4196a4ac595bec86f29fca1bf P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.216090 30972 raft_consensus.cc:2272] T 044eb7b4196a4ac595bec86f29fca1bf P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.219185 30972 tablet_replica.cc:333] T 3fa297fedf4549fd89f9a179ef9147a8 P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
W20260709 13:17:07.219971  7980 consensus_peers.cc:597] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690 -> Peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Couldn't send request to peer 7de07e50a1714f5d9055bb4b86655200. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:07.220122 30972 raft_consensus.cc:2243] T 3fa297fedf4549fd89f9a179ef9147a8 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.220872 30972 raft_consensus.cc:2272] T 3fa297fedf4549fd89f9a179ef9147a8 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.225286 30972 tablet_replica.cc:333] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.226212 30972 raft_consensus.cc:2243] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.227370 30972 raft_consensus.cc:2272] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.230198 30972 tablet_replica.cc:333] T 93cca694a49b44ba8eda19c91491696e P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.231132 30972 raft_consensus.cc:2243] T 93cca694a49b44ba8eda19c91491696e P 7de07e50a1714f5d9055bb4b86655200 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.231778 30972 raft_consensus.cc:2272] T 93cca694a49b44ba8eda19c91491696e P 7de07e50a1714f5d9055bb4b86655200 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.234747 30972 tablet_replica.cc:333] T e74f9555b1f64bc080273bc35b9ef15b P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.235639 30972 raft_consensus.cc:2243] T e74f9555b1f64bc080273bc35b9ef15b P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.236233 30972 raft_consensus.cc:2272] T e74f9555b1f64bc080273bc35b9ef15b P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.239363 30972 tablet_replica.cc:333] T 45dba482a30c44a58bf79b2a8a890aee P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.240325 30972 raft_consensus.cc:2243] T 45dba482a30c44a58bf79b2a8a890aee P 7de07e50a1714f5d9055bb4b86655200 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.241331 30972 raft_consensus.cc:2272] T 45dba482a30c44a58bf79b2a8a890aee P 7de07e50a1714f5d9055bb4b86655200 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:07.240003  7981 consensus_peers.cc:597] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690 -> Peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Couldn't send request to peer 1c5936948a84476fb0dcc1fa2d895740. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:45491: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:07.244346 30972 tablet_replica.cc:333] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.245363 30972 raft_consensus.cc:2243] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.246258 30972 raft_consensus.cc:2272] T ffeb7520452b4edcb0421cee5ab0e516 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.248978 30972 tablet_replica.cc:333] T 272dd059968c4493bb875e3bf32a3183 P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.249677 30972 raft_consensus.cc:2243] T 272dd059968c4493bb875e3bf32a3183 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.250286 30972 raft_consensus.cc:2272] T 272dd059968c4493bb875e3bf32a3183 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.253093 30972 tablet_replica.cc:333] T c265324643494522a597d6dab81e7893 P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.254055 30972 raft_consensus.cc:2243] T c265324643494522a597d6dab81e7893 P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.254878 30972 raft_consensus.cc:2272] T c265324643494522a597d6dab81e7893 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.257396 30972 tablet_replica.cc:333] T 940bca2247d04fb495fba36734ace153 P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.258044 30972 raft_consensus.cc:2243] T 940bca2247d04fb495fba36734ace153 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.258512 30972 raft_consensus.cc:2272] T 940bca2247d04fb495fba36734ace153 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.260517 30972 tablet_replica.cc:333] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.261339 30972 raft_consensus.cc:2243] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.262499 30972 raft_consensus.cc:2272] T ea7f3171e8b84ac48e0abd056c43f778 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.265658 30972 tablet_replica.cc:333] T 191eb110a7ae4009a2184d4c3af4f439 P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
W20260709 13:17:07.265820  7980 consensus_peers.cc:597] T 87d445d744434f90baaf040e708b1e98 P c9a569f7d1ad42359002386a73702690 -> Peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Couldn't send request to peer 7de07e50a1714f5d9055bb4b86655200. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:07.266834 30972 raft_consensus.cc:2243] T 191eb110a7ae4009a2184d4c3af4f439 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.267413 30972 raft_consensus.cc:2272] T 191eb110a7ae4009a2184d4c3af4f439 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.270030 30972 tablet_replica.cc:333] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.270646 30972 raft_consensus.cc:2243] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.271083 30972 raft_consensus.cc:2272] T 32f607aa832749eeb8e3b97bab01b9f3 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.274053 30972 tablet_replica.cc:333] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.274880 30972 raft_consensus.cc:2243] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.275843 30972 raft_consensus.cc:2272] T afc39d65d52c48e3a959c8876930ab07 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.278661 30972 tablet_replica.cc:333] T 569ddc7f4d23481a852ea6ef24d38e31 P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.279362 30972 raft_consensus.cc:2243] T 569ddc7f4d23481a852ea6ef24d38e31 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.280022 30972 raft_consensus.cc:2272] T 569ddc7f4d23481a852ea6ef24d38e31 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.282474 30972 tablet_replica.cc:333] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.283058 30972 raft_consensus.cc:2243] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.283746 30972 raft_consensus.cc:2272] T d1b12aa42b0f49a49b24d2433fdca7a8 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.285979 30972 tablet_replica.cc:333] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.286552 30972 raft_consensus.cc:2243] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.287323 30972 raft_consensus.cc:2272] T d99b23f5044644c1b270bc5afcaf2119 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.289598 30972 tablet_replica.cc:333] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.290216 30972 raft_consensus.cc:2243] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.291298 30972 raft_consensus.cc:2272] T e8725967bab0469eb6a5ed9c6bddf3cb P 7de07e50a1714f5d9055bb4b86655200 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.294260 30972 tablet_replica.cc:333] T 242ac51169564e5e9b95c521387a853b P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
W20260709 13:17:07.294795  7980 consensus_peers.cc:597] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690 -> Peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Couldn't send request to peer 7de07e50a1714f5d9055bb4b86655200. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:07.295373  7980 consensus_peers.cc:597] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690 -> Peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Couldn't send request to peer 7de07e50a1714f5d9055bb4b86655200. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:07.295913 30972 raft_consensus.cc:2243] T 242ac51169564e5e9b95c521387a853b P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.296442 30972 raft_consensus.cc:2272] T 242ac51169564e5e9b95c521387a853b P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.298619 30972 tablet_replica.cc:333] T b5e46a5b31234af492e77dbf435ead58 P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.299214 30972 raft_consensus.cc:2243] T b5e46a5b31234af492e77dbf435ead58 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.299624 30972 raft_consensus.cc:2272] T b5e46a5b31234af492e77dbf435ead58 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.301805 30972 tablet_replica.cc:333] T a8fe051592e64e39905b33d218b96822 P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.302353 30972 raft_consensus.cc:2243] T a8fe051592e64e39905b33d218b96822 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.302871 30972 raft_consensus.cc:2272] T a8fe051592e64e39905b33d218b96822 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.306007 30972 tablet_replica.cc:333] T d28b4b42078f421f85ebc87a2481aa87 P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.306713 30972 raft_consensus.cc:2243] T d28b4b42078f421f85ebc87a2481aa87 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.307365 30972 raft_consensus.cc:2272] T d28b4b42078f421f85ebc87a2481aa87 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.310356 30972 tablet_replica.cc:333] T f584d75fb3ee4c80958b7b9e5322cf2b P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.311256 30972 raft_consensus.cc:2243] T f584d75fb3ee4c80958b7b9e5322cf2b P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.311875 30972 raft_consensus.cc:2272] T f584d75fb3ee4c80958b7b9e5322cf2b P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.314895 30972 tablet_replica.cc:333] T ea27688f1e2442e18da64b6f636beaf4 P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.315711 30972 raft_consensus.cc:2243] T ea27688f1e2442e18da64b6f636beaf4 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.316383 30972 raft_consensus.cc:2272] T ea27688f1e2442e18da64b6f636beaf4 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.319298 30972 tablet_replica.cc:333] T b750f6e7ca2b48ef942ad988e6c4dd8d P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.320147 30972 raft_consensus.cc:2243] T b750f6e7ca2b48ef942ad988e6c4dd8d P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.321108 30972 raft_consensus.cc:2272] T b750f6e7ca2b48ef942ad988e6c4dd8d P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.323989 30972 tablet_replica.cc:333] T 985b6cf5ffe74ecfabc7ba74e262a88f P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.325054 30972 raft_consensus.cc:2243] T 985b6cf5ffe74ecfabc7ba74e262a88f P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.325585 30972 raft_consensus.cc:2272] T 985b6cf5ffe74ecfabc7ba74e262a88f P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.328263 30972 tablet_replica.cc:333] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.328925 30972 raft_consensus.cc:2243] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.329618 30972 raft_consensus.cc:2272] T deeaf93ab6424e9c8013e6c9fbccb724 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.331934 30972 tablet_replica.cc:333] T 87d445d744434f90baaf040e708b1e98 P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.332551 30972 raft_consensus.cc:2243] T 87d445d744434f90baaf040e708b1e98 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.333067 30972 raft_consensus.cc:2272] T 87d445d744434f90baaf040e708b1e98 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.335131 30972 tablet_replica.cc:333] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.335703 30972 raft_consensus.cc:2243] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.336570 30972 raft_consensus.cc:2272] T 0eb35ec786da4450bcf232cf85ba857b P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.338796 30972 tablet_replica.cc:333] T 878f83ec036345f69ff96a6b46613485 P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.339402 30972 raft_consensus.cc:2243] T 878f83ec036345f69ff96a6b46613485 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.339838 30972 raft_consensus.cc:2272] T 878f83ec036345f69ff96a6b46613485 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.342128 30972 tablet_replica.cc:333] T b66f54819dda4cca9214096155a16694 P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.342931 30972 raft_consensus.cc:2243] T b66f54819dda4cca9214096155a16694 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.343407 30972 raft_consensus.cc:2272] T b66f54819dda4cca9214096155a16694 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.345330 30972 tablet_replica.cc:333] T 8b505df72528474496f1a81ffa9ad0a6 P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.345837 30972 raft_consensus.cc:2243] T 8b505df72528474496f1a81ffa9ad0a6 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.346217 30972 raft_consensus.cc:2272] T 8b505df72528474496f1a81ffa9ad0a6 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.348317 30972 tablet_replica.cc:333] T aa3b3005e3634f858a7e68a789b5f827 P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.348922 30972 raft_consensus.cc:2243] T aa3b3005e3634f858a7e68a789b5f827 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.349361 30972 raft_consensus.cc:2272] T aa3b3005e3634f858a7e68a789b5f827 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.351256 30972 tablet_replica.cc:333] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.351840 30972 raft_consensus.cc:2243] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.352210 30972 raft_consensus.cc:2272] T 3462b69ce46f4d49b5c5f1a6872a03e4 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.354053 30972 tablet_replica.cc:333] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.354545 30972 raft_consensus.cc:2243] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.354926 30972 raft_consensus.cc:2272] T 932dad2d4cee49e296e9359aa665ef9d P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.356760 30972 tablet_replica.cc:333] T da682789343c4852b052f5fa4483c715 P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.357229 30972 raft_consensus.cc:2243] T da682789343c4852b052f5fa4483c715 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.357690 30972 raft_consensus.cc:2272] T da682789343c4852b052f5fa4483c715 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.359521 30972 tablet_replica.cc:333] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.359972 30972 raft_consensus.cc:2243] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.360322 30972 raft_consensus.cc:2272] T ee4af0a88c7f43bcaa15fc11bdfaf591 P 7de07e50a1714f5d9055bb4b86655200 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.362147 30972 tablet_replica.cc:333] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.362624 30972 raft_consensus.cc:2243] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.362973 30972 raft_consensus.cc:2272] T b72bd809944d47a395c4bc1b0fc18c19 P 7de07e50a1714f5d9055bb4b86655200 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.364720 30972 tablet_replica.cc:333] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.365171 30972 raft_consensus.cc:2243] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.365967 30972 raft_consensus.cc:2272] T 4877bb8fb91844ddab1c717b7dec231d P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.367753 30972 tablet_replica.cc:333] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.368204 30972 raft_consensus.cc:2243] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.368538 30972 raft_consensus.cc:2272] T 0d8e359e2c264806bd048cd1baed4db4 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.370374 30972 tablet_replica.cc:333] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.370819 30972 raft_consensus.cc:2243] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.371279 30972 raft_consensus.cc:2272] T 48ee265806af41dfb77624fadfa04e6b P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.373248 30972 tablet_replica.cc:333] T 9eeed88ecdc244a98599a38459ae66b8 P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.373677 30972 raft_consensus.cc:2243] T 9eeed88ecdc244a98599a38459ae66b8 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.374063 30972 raft_consensus.cc:2272] T 9eeed88ecdc244a98599a38459ae66b8 P 7de07e50a1714f5d9055bb4b86655200 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.375758 30972 tablet_replica.cc:333] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200: stopping tablet replica
I20260709 13:17:07.376140 30972 raft_consensus.cc:2243] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.377014 30972 raft_consensus.cc:2272] T 9c126cef127140f48a31bbd723a86051 P 7de07e50a1714f5d9055bb4b86655200 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:07.380765  7980 consensus_peers.cc:597] T 3fa297fedf4549fd89f9a179ef9147a8 P c9a569f7d1ad42359002386a73702690 -> Peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Couldn't send request to peer 7de07e50a1714f5d9055bb4b86655200. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:07.384511  7980 consensus_peers.cc:597] T b66f54819dda4cca9214096155a16694 P c9a569f7d1ad42359002386a73702690 -> Peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Couldn't send request to peer 7de07e50a1714f5d9055bb4b86655200. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:07.408921  9076 raft_consensus.cc:493] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:17:07.409420  9076 raft_consensus.cc:515] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:17:07.411327  9076 leader_election.cc:290] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
W20260709 13:17:07.415154  7978 leader_election.cc:336] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111)
W20260709 13:17:07.415781  7981 leader_election.cc:336] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Network error: Client connection negotiation failed: client connection to 127.30.63.2:45491: connect: Connection refused (error 111)
I20260709 13:17:07.416116  7981 leader_election.cc:304] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:17:07.416867  9076 raft_consensus.cc:2749] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:17:07.433552  7980 consensus_peers.cc:597] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690 -> Peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Couldn't send request to peer 7de07e50a1714f5d9055bb4b86655200. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:07.437856  7904 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.550626  9076 raft_consensus.cc:493] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:17:07.551280  9076 raft_consensus.cc:515] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:17:07.553122  9076 leader_election.cc:290] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
W20260709 13:17:07.557773  7978 leader_election.cc:336] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111)
W20260709 13:17:07.558260  7981 leader_election.cc:336] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Network error: Client connection negotiation failed: client connection to 127.30.63.2:45491: connect: Connection refused (error 111)
I20260709 13:17:07.558682  7981 leader_election.cc:304] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:17:07.559430  9076 raft_consensus.cc:2749] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:17:07.567180  7907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.575426  9084 raft_consensus.cc:493] T af8981a911484760ab96a4d042148094 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:17:07.575959  9084 raft_consensus.cc:515] T af8981a911484760ab96a4d042148094 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:17:07.577796  9084 leader_election.cc:290] T af8981a911484760ab96a4d042148094 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
W20260709 13:17:07.581957  7978 leader_election.cc:336] T af8981a911484760ab96a4d042148094 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111)
W20260709 13:17:07.582480  7981 leader_election.cc:336] T af8981a911484760ab96a4d042148094 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Network error: Client connection negotiation failed: client connection to 127.30.63.2:45491: connect: Connection refused (error 111)
I20260709 13:17:07.583099  7981 leader_election.cc:304] T af8981a911484760ab96a4d042148094 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:17:07.583984  9084 raft_consensus.cc:2749] T af8981a911484760ab96a4d042148094 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:07.615734  7905 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.624809  9084 raft_consensus.cc:493] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:17:07.625420  9084 raft_consensus.cc:515] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:17:07.627125  9084 leader_election.cc:290] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
W20260709 13:17:07.629343  7907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:07.629976  7980 leader_election.cc:336] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:17:07.630997  7978 leader_election.cc:336] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111)
I20260709 13:17:07.631317  7978 leader_election.cc:304] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:17:07.631871  9084 raft_consensus.cc:2749] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:07.669586  9083 raft_consensus.cc:493] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:17:07.670217  9083 raft_consensus.cc:515] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:17:07.672314  9083 leader_election.cc:290] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
W20260709 13:17:07.676087  7981 leader_election.cc:336] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Network error: Client connection negotiation failed: client connection to 127.30.63.2:45491: connect: Connection refused (error 111)
W20260709 13:17:07.676668  7978 leader_election.cc:336] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111)
I20260709 13:17:07.677011  7978 leader_election.cc:304] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:17:07.677573  9083 raft_consensus.cc:2749] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:07.701020  9083 raft_consensus.cc:493] T 48ee265806af41dfb77624fadfa04e6b P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:17:07.701453  9083 raft_consensus.cc:515] T 48ee265806af41dfb77624fadfa04e6b P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:17:07.703365  9083 leader_election.cc:290] T 48ee265806af41dfb77624fadfa04e6b P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
W20260709 13:17:07.705543  7980 leader_election.cc:336] T 48ee265806af41dfb77624fadfa04e6b P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:17:07.706831  7978 leader_election.cc:336] T 48ee265806af41dfb77624fadfa04e6b P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111)
I20260709 13:17:07.707167  7978 leader_election.cc:304] T 48ee265806af41dfb77624fadfa04e6b P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:17:07.707795  9084 raft_consensus.cc:2749] T 48ee265806af41dfb77624fadfa04e6b P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:07.708912  7906 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:07.720965  7980 consensus_peers.cc:597] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 -> Peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Couldn't send request to peer 7de07e50a1714f5d9055bb4b86655200. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:07.731734  7906 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.885106  9076 raft_consensus.cc:493] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:17:07.885728  9076 raft_consensus.cc:515] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:17:07.887645  9076 leader_election.cc:290] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
W20260709 13:17:07.890443  7980 leader_election.cc:336] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:17:07.891667  7978 leader_election.cc:336] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111)
I20260709 13:17:07.892050  7978 leader_election.cc:304] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:17:07.892720  9076 raft_consensus.cc:2749] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:07.920392  9076 raft_consensus.cc:493] T 32f607aa832749eeb8e3b97bab01b9f3 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 59fcc1f631f642d6a7cf2d772ab1eba7)
I20260709 13:17:07.920966  9076 raft_consensus.cc:515] T 32f607aa832749eeb8e3b97bab01b9f3 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } }
I20260709 13:17:07.922757  9076 leader_election.cc:290] T 32f607aa832749eeb8e3b97bab01b9f3 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141), 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503)
I20260709 13:17:07.923022  9084 raft_consensus.cc:493] T 5ba560db35494ad2b64a9b728d510c1a P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c5936948a84476fb0dcc1fa2d895740)
I20260709 13:17:07.923686  9084 raft_consensus.cc:515] T 5ba560db35494ad2b64a9b728d510c1a P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
W20260709 13:17:07.927551  7978 leader_election.cc:336] T 32f607aa832749eeb8e3b97bab01b9f3 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111)
I20260709 13:17:07.928840  9084 leader_election.cc:290] T 5ba560db35494ad2b64a9b728d510c1a P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:17:07.929260  9076 raft_consensus.cc:493] T 932dad2d4cee49e296e9359aa665ef9d P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c5936948a84476fb0dcc1fa2d895740)
W20260709 13:17:07.929627  7980 leader_election.cc:336] T 32f607aa832749eeb8e3b97bab01b9f3 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:17:07.930228  7980 leader_election.cc:304] T 32f607aa832749eeb8e3b97bab01b9f3 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 59fcc1f631f642d6a7cf2d772ab1eba7, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:17:07.930159  9076 raft_consensus.cc:515] T 932dad2d4cee49e296e9359aa665ef9d P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
W20260709 13:17:07.930856  7981 leader_election.cc:336] T 5ba560db35494ad2b64a9b728d510c1a P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Network error: Client connection negotiation failed: client connection to 127.30.63.2:45491: connect: Connection refused (error 111)
W20260709 13:17:07.931391  7978 leader_election.cc:336] T 5ba560db35494ad2b64a9b728d510c1a P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111)
I20260709 13:17:07.931843  7978 leader_election.cc:304] T 5ba560db35494ad2b64a9b728d510c1a P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:17:07.932423  9076 leader_election.cc:290] T 932dad2d4cee49e296e9359aa665ef9d P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:17:07.932653  9084 raft_consensus.cc:2749] T 5ba560db35494ad2b64a9b728d510c1a P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:07.933250  9076 raft_consensus.cc:2749] T 32f607aa832749eeb8e3b97bab01b9f3 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:07.936395  7980 leader_election.cc:336] T 932dad2d4cee49e296e9359aa665ef9d P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:17:07.936939  7981 leader_election.cc:336] T 932dad2d4cee49e296e9359aa665ef9d P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Network error: Client connection negotiation failed: client connection to 127.30.63.2:45491: connect: Connection refused (error 111)
I20260709 13:17:07.937355  7981 leader_election.cc:304] T 932dad2d4cee49e296e9359aa665ef9d P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:17:07.938050  9076 raft_consensus.cc:2749] T 932dad2d4cee49e296e9359aa665ef9d P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:07.945902  9076 raft_consensus.cc:493] T f584d75fb3ee4c80958b7b9e5322cf2b P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c5936948a84476fb0dcc1fa2d895740)
I20260709 13:17:07.946470  9076 raft_consensus.cc:515] T f584d75fb3ee4c80958b7b9e5322cf2b P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:17:07.947857  9084 raft_consensus.cc:493] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1c5936948a84476fb0dcc1fa2d895740)
I20260709 13:17:07.948625  9084 raft_consensus.cc:515] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } } peers { permanent_uuid: "59fcc1f631f642d6a7cf2d772ab1eba7" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 35503 } } peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } }
I20260709 13:17:07.951810  9084 leader_election.cc:290] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503), 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491)
I20260709 13:17:07.949000  9076 leader_election.cc:290] T f584d75fb3ee4c80958b7b9e5322cf2b P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
W20260709 13:17:07.955090  7981 leader_election.cc:336] T f584d75fb3ee4c80958b7b9e5322cf2b P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Network error: Client connection negotiation failed: client connection to 127.30.63.2:45491: connect: Connection refused (error 111)
W20260709 13:17:07.956526  7980 leader_election.cc:336] T f584d75fb3ee4c80958b7b9e5322cf2b P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:17:07.958397  7981 leader_election.cc:336] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Network error: Client connection negotiation failed: client connection to 127.30.63.2:45491: connect: Connection refused (error 111)
I20260709 13:17:07.958650  7980 leader_election.cc:304] T f584d75fb3ee4c80958b7b9e5322cf2b P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:17:07.959302  9076 raft_consensus.cc:2749] T f584d75fb3ee4c80958b7b9e5322cf2b P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:17:07.961467  7978 leader_election.cc:336] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 59fcc1f631f642d6a7cf2d772ab1eba7 (127.30.63.1:35503): Network error: Client connection negotiation failed: client connection to 127.30.63.1:35503: connect: Connection refused (error 111)
I20260709 13:17:07.961961  7978 leader_election.cc:304] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 1c5936948a84476fb0dcc1fa2d895740, 59fcc1f631f642d6a7cf2d772ab1eba7
I20260709 13:17:07.962576  9076 raft_consensus.cc:2749] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:17:07.980965  7904 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:08.007997  7907 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.087683 30972 tablet_server.cc:196] TabletServer@127.30.63.3:0 shutdown complete.
I20260709 13:17:08.104046  9076 raft_consensus.cc:493] T 8b505df72528474496f1a81ffa9ad0a6 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c5936948a84476fb0dcc1fa2d895740)
I20260709 13:17:08.104753  9076 raft_consensus.cc:515] T 8b505df72528474496f1a81ffa9ad0a6 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:17:08.106763  9076 leader_election.cc:290] T 8b505df72528474496f1a81ffa9ad0a6 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
W20260709 13:17:08.111725  7981 leader_election.cc:336] T 8b505df72528474496f1a81ffa9ad0a6 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Network error: Client connection negotiation failed: client connection to 127.30.63.2:45491: connect: Connection refused (error 111)
W20260709 13:17:08.113531  7980 leader_election.cc:336] T 8b505df72528474496f1a81ffa9ad0a6 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Network error: Client connection negotiation failed: client connection to 127.30.63.3:44141: connect: Connection refused (error 111)
I20260709 13:17:08.114108  7980 leader_election.cc:304] T 8b505df72528474496f1a81ffa9ad0a6 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:17:08.114924  9076 raft_consensus.cc:2749] T 8b505df72528474496f1a81ffa9ad0a6 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:08.163129 30972 tablet_server.cc:179] TabletServer@127.30.63.4:0 shutting down...
I20260709 13:17:08.206246 30972 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:08.207165 30972 tablet_replica.cc:333] T c04b5a061ff84745af17197de774ac96 P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.208184 30972 raft_consensus.cc:2243] T c04b5a061ff84745af17197de774ac96 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.208874 30972 raft_consensus.cc:2272] T c04b5a061ff84745af17197de774ac96 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.211054 30972 tablet_replica.cc:333] T 569ddc7f4d23481a852ea6ef24d38e31 P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.211651 30972 raft_consensus.cc:2243] T 569ddc7f4d23481a852ea6ef24d38e31 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.212064 30972 raft_consensus.cc:2272] T 569ddc7f4d23481a852ea6ef24d38e31 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:08.212473  7981 raft_consensus.cc:687] T 569ddc7f4d23481a852ea6ef24d38e31 P c9a569f7d1ad42359002386a73702690: failed to submit failure detected task: Service unavailable: Thread pool token was shut down
I20260709 13:17:08.214515 30972 tablet_replica.cc:333] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.215224 30972 raft_consensus.cc:2243] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:08.216070 30972 raft_consensus.cc:2272] T 1f5409294f3e4162a75137e616968afb P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.217381  9076 raft_consensus.cc:493] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c5936948a84476fb0dcc1fa2d895740)
I20260709 13:17:08.218034  9076 raft_consensus.cc:515] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5936948a84476fb0dcc1fa2d895740" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 45491 } } peers { permanent_uuid: "7de07e50a1714f5d9055bb4b86655200" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 44141 } } peers { permanent_uuid: "c9a569f7d1ad42359002386a73702690" member_type: VOTER last_known_addr { host: "127.30.63.4" port: 46031 } }
I20260709 13:17:08.219014 30972 tablet_replica.cc:333] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.220026 30972 raft_consensus.cc:2243] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.220752 30972 raft_consensus.cc:2272] T 5cc8636f68ae4121ac05d99e24866633 P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.220240  9076 leader_election.cc:290] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491), 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141)
I20260709 13:17:08.223891 30972 tablet_replica.cc:333] T f35a05f13eee42d4bdd19ff8b2b98212 P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.224961 30972 raft_consensus.cc:2243] T f35a05f13eee42d4bdd19ff8b2b98212 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.225634 30972 raft_consensus.cc:2272] T f35a05f13eee42d4bdd19ff8b2b98212 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:08.226240  7981 leader_election.cc:336] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1c5936948a84476fb0dcc1fa2d895740 (127.30.63.2:45491): Network error: Client connection negotiation failed: client connection to 127.30.63.2:45491: connect: Connection refused (error 111)
W20260709 13:17:08.226887  7980 leader_election.cc:336] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7de07e50a1714f5d9055bb4b86655200 (127.30.63.3:44141): Network error: Client connection negotiation failed: client connection to 127.30.63.3:44141: connect: Connection refused (error 111)
I20260709 13:17:08.227308  7980 leader_election.cc:304] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a569f7d1ad42359002386a73702690; no voters: 1c5936948a84476fb0dcc1fa2d895740, 7de07e50a1714f5d9055bb4b86655200
I20260709 13:17:08.227932  9076 raft_consensus.cc:2749] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:08.228871 30972 tablet_replica.cc:333] T ea7f3171e8b84ac48e0abd056c43f778 P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.229876 30972 raft_consensus.cc:2243] T ea7f3171e8b84ac48e0abd056c43f778 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.230500 30972 raft_consensus.cc:2272] T ea7f3171e8b84ac48e0abd056c43f778 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.233497 30972 tablet_replica.cc:333] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.234371 30972 raft_consensus.cc:2243] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:08.235460 30972 raft_consensus.cc:2272] T 191eb110a7ae4009a2184d4c3af4f439 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.238336 30972 tablet_replica.cc:333] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.239360 30972 raft_consensus.cc:2243] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:08.240494 30972 raft_consensus.cc:2272] T e74f9555b1f64bc080273bc35b9ef15b P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.243536 30972 tablet_replica.cc:333] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.244418 30972 raft_consensus.cc:2243] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.244988 30972 raft_consensus.cc:2272] T 45dba482a30c44a58bf79b2a8a890aee P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.248153 30972 tablet_replica.cc:333] T 48ee265806af41dfb77624fadfa04e6b P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.249132 30972 raft_consensus.cc:2243] T 48ee265806af41dfb77624fadfa04e6b P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.249784 30972 raft_consensus.cc:2272] T 48ee265806af41dfb77624fadfa04e6b P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.252754 30972 tablet_replica.cc:333] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.253690 30972 raft_consensus.cc:2243] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:08.254825 30972 raft_consensus.cc:2272] T 2e6d18ad10a340e2aa1fba5831e6db57 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.257874 30972 tablet_replica.cc:333] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.258939 30972 raft_consensus.cc:2243] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.259507 30972 raft_consensus.cc:2272] T 272dd059968c4493bb875e3bf32a3183 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.262483 30972 tablet_replica.cc:333] T c265324643494522a597d6dab81e7893 P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.263342 30972 raft_consensus.cc:2243] T c265324643494522a597d6dab81e7893 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.263935 30972 raft_consensus.cc:2272] T c265324643494522a597d6dab81e7893 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.266999 30972 tablet_replica.cc:333] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.267843 30972 raft_consensus.cc:2243] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.268496 30972 raft_consensus.cc:2272] T 06dd732d5f194c5f8bacb0d12d551212 P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.271219 30972 tablet_replica.cc:333] T f584d75fb3ee4c80958b7b9e5322cf2b P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.272094 30972 raft_consensus.cc:2243] T f584d75fb3ee4c80958b7b9e5322cf2b P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.272722 30972 raft_consensus.cc:2272] T f584d75fb3ee4c80958b7b9e5322cf2b P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.275807 30972 tablet_replica.cc:333] T ea27688f1e2442e18da64b6f636beaf4 P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.276692 30972 raft_consensus.cc:2243] T ea27688f1e2442e18da64b6f636beaf4 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.277298 30972 raft_consensus.cc:2272] T ea27688f1e2442e18da64b6f636beaf4 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.280403 30972 tablet_replica.cc:333] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.281350 30972 raft_consensus.cc:2243] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.281994 30972 raft_consensus.cc:2272] T ceaecfbd6ac84206af71ba2b5fe22259 P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.284966 30972 tablet_replica.cc:333] T 32f607aa832749eeb8e3b97bab01b9f3 P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.285914 30972 raft_consensus.cc:2243] T 32f607aa832749eeb8e3b97bab01b9f3 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.286583 30972 raft_consensus.cc:2272] T 32f607aa832749eeb8e3b97bab01b9f3 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.289628 30972 tablet_replica.cc:333] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.290438 30972 raft_consensus.cc:2243] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.291240 30972 raft_consensus.cc:2272] T e8725967bab0469eb6a5ed9c6bddf3cb P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.294811 30972 tablet_replica.cc:333] T 7806fa697a044140850e326d8e5889d1 P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.295775 30972 raft_consensus.cc:2243] T 7806fa697a044140850e326d8e5889d1 P c9a569f7d1ad42359002386a73702690 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:08.297029 30972 raft_consensus.cc:2272] T 7806fa697a044140850e326d8e5889d1 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.300128 30972 tablet_replica.cc:333] T 5ba560db35494ad2b64a9b728d510c1a P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.301075 30972 raft_consensus.cc:2243] T 5ba560db35494ad2b64a9b728d510c1a P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.301810 30972 raft_consensus.cc:2272] T 5ba560db35494ad2b64a9b728d510c1a P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.304576 30972 tablet_replica.cc:333] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.305271 30972 raft_consensus.cc:2243] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.305752 30972 raft_consensus.cc:2272] T d28b4b42078f421f85ebc87a2481aa87 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.307950 30972 tablet_replica.cc:333] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.308779 30972 raft_consensus.cc:2243] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:08.309695 30972 raft_consensus.cc:2272] T 7141f7bef8234a56bdbb17df0b302a75 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.312142 30972 tablet_replica.cc:333] T 9c126cef127140f48a31bbd723a86051 P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.312830 30972 raft_consensus.cc:2243] T 9c126cef127140f48a31bbd723a86051 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.313292 30972 raft_consensus.cc:2272] T 9c126cef127140f48a31bbd723a86051 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.315351 30972 tablet_replica.cc:333] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.315935 30972 raft_consensus.cc:2243] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:08.316823 30972 raft_consensus.cc:2272] T 6ed88d7e51364cb28224875b51de8f8e P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.318938 30972 tablet_replica.cc:333] T b750f6e7ca2b48ef942ad988e6c4dd8d P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.319555 30972 raft_consensus.cc:2243] T b750f6e7ca2b48ef942ad988e6c4dd8d P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.320029 30972 raft_consensus.cc:2272] T b750f6e7ca2b48ef942ad988e6c4dd8d P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.322322 30972 tablet_replica.cc:333] T 3fa297fedf4549fd89f9a179ef9147a8 P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.322962 30972 raft_consensus.cc:2243] T 3fa297fedf4549fd89f9a179ef9147a8 P c9a569f7d1ad42359002386a73702690 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:08.323771 30972 raft_consensus.cc:2272] T 3fa297fedf4549fd89f9a179ef9147a8 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.325951 30972 tablet_replica.cc:333] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.326581 30972 raft_consensus.cc:2243] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.327056 30972 raft_consensus.cc:2272] T 9cc9c8ab28ac4825a9ddbc9a7ef56f12 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.329787 30972 tablet_replica.cc:333] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.330425 30972 raft_consensus.cc:2243] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:08.331450 30972 raft_consensus.cc:2272] T de92af0966804027bbe4ec91b14382d4 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.334070 30972 tablet_replica.cc:333] T 8b505df72528474496f1a81ffa9ad0a6 P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.334704 30972 raft_consensus.cc:2243] T 8b505df72528474496f1a81ffa9ad0a6 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.335196 30972 raft_consensus.cc:2272] T 8b505df72528474496f1a81ffa9ad0a6 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.337244 30972 tablet_replica.cc:333] T b66f54819dda4cca9214096155a16694 P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.337913 30972 raft_consensus.cc:2243] T b66f54819dda4cca9214096155a16694 P c9a569f7d1ad42359002386a73702690 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:08.338768 30972 raft_consensus.cc:2272] T b66f54819dda4cca9214096155a16694 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.340888 30972 tablet_replica.cc:333] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.341475 30972 raft_consensus.cc:2243] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.341944 30972 raft_consensus.cc:2272] T 93cca694a49b44ba8eda19c91491696e P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.344018 30972 tablet_replica.cc:333] T af8981a911484760ab96a4d042148094 P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.344630 30972 raft_consensus.cc:2243] T af8981a911484760ab96a4d042148094 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.345105 30972 raft_consensus.cc:2272] T af8981a911484760ab96a4d042148094 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.347100 30972 tablet_replica.cc:333] T a8fe051592e64e39905b33d218b96822 P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.347720 30972 raft_consensus.cc:2243] T a8fe051592e64e39905b33d218b96822 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.348161 30972 raft_consensus.cc:2272] T a8fe051592e64e39905b33d218b96822 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.350162 30972 tablet_replica.cc:333] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.350746 30972 raft_consensus.cc:2243] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:08.351605 30972 raft_consensus.cc:2272] T 242ac51169564e5e9b95c521387a853b P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.353760 30972 tablet_replica.cc:333] T aa3b3005e3634f858a7e68a789b5f827 P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.354321 30972 raft_consensus.cc:2243] T aa3b3005e3634f858a7e68a789b5f827 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.354765 30972 raft_consensus.cc:2272] T aa3b3005e3634f858a7e68a789b5f827 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.356832 30972 tablet_replica.cc:333] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.357398 30972 raft_consensus.cc:2243] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:08.358255 30972 raft_consensus.cc:2272] T 3462b69ce46f4d49b5c5f1a6872a03e4 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.360357 30972 tablet_replica.cc:333] T 4877bb8fb91844ddab1c717b7dec231d P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.360963 30972 raft_consensus.cc:2243] T 4877bb8fb91844ddab1c717b7dec231d P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.361433 30972 raft_consensus.cc:2272] T 4877bb8fb91844ddab1c717b7dec231d P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.363389 30972 tablet_replica.cc:333] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.363961 30972 raft_consensus.cc:2243] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.364447 30972 raft_consensus.cc:2272] T 2e84fab0d4fc43359b4219baa6171aa5 P c9a569f7d1ad42359002386a73702690 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.366569 30972 tablet_replica.cc:333] T 0d8e359e2c264806bd048cd1baed4db4 P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.367142 30972 raft_consensus.cc:2243] T 0d8e359e2c264806bd048cd1baed4db4 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.367611 30972 raft_consensus.cc:2272] T 0d8e359e2c264806bd048cd1baed4db4 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.369678 30972 tablet_replica.cc:333] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.370252 30972 raft_consensus.cc:2243] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:08.371032 30972 raft_consensus.cc:2272] T 5391ca2d8a8747bebb865e71268e06ad P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.373101 30972 tablet_replica.cc:333] T 87d445d744434f90baaf040e708b1e98 P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.373675 30972 raft_consensus.cc:2243] T 87d445d744434f90baaf040e708b1e98 P c9a569f7d1ad42359002386a73702690 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:08.374480 30972 raft_consensus.cc:2272] T 87d445d744434f90baaf040e708b1e98 P c9a569f7d1ad42359002386a73702690 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.376561 30972 tablet_replica.cc:333] T 932dad2d4cee49e296e9359aa665ef9d P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.377205 30972 raft_consensus.cc:2243] T 932dad2d4cee49e296e9359aa665ef9d P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.377664 30972 raft_consensus.cc:2272] T 932dad2d4cee49e296e9359aa665ef9d P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.379671 30972 tablet_replica.cc:333] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690: stopping tablet replica
I20260709 13:17:08.380165 30972 raft_consensus.cc:2243] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:08.381031 30972 raft_consensus.cc:2272] T da682789343c4852b052f5fa4483c715 P c9a569f7d1ad42359002386a73702690 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.455844 30972 tablet_server.cc:196] TabletServer@127.30.63.4:0 shutdown complete.
I20260709 13:17:08.520561 30972 master.cc:562] Master@127.30.63.62:45347 shutting down...
I20260709 13:17:08.552078 30972 raft_consensus.cc:2243] T 00000000000000000000000000000000 P cf4ae385c4e84919bd77fd3e88afe143 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:08.552843 30972 raft_consensus.cc:2272] T 00000000000000000000000000000000 P cf4ae385c4e84919bd77fd3e88afe143 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.553184 30972 tablet_replica.cc:333] T 00000000000000000000000000000000 P cf4ae385c4e84919bd77fd3e88afe143: stopping tablet replica
I20260709 13:17:08.576287 30972 master.cc:584] Master@127.30.63.62:45347 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (34058 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:17:08.671159 30972 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.30.63.62:40839
I20260709 13:17:08.672955 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:08.679603  9087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:08.679942  9088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:08.680871  9090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:08.681479 30972 server_base.cc:1061] running on GCE node
I20260709 13:17:08.682525 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:08.682920 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:08.683121 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783603028683102 us; error 0 us; skew 500 ppm
I20260709 13:17:08.683835 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:08.686842 30972 webserver.cc:533] Webserver started at http://127.30.63.62:37343/ using document root <none> and password file <none>
I20260709 13:17:08.687376 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:08.687587 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:08.687862 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:08.689136 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602730526113-30972-0/minicluster-data/master-0-root/instance:
uuid: "b4f0cf888beb46b2bf86593bf41d0e86"
format_stamp: "Formatted at 2026-07-09 13:17:08 on dist-test-slave-c08m"
I20260709 13:17:08.694180 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:17:08.697790  9095 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:08.698788 30972 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:17:08.699069 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602730526113-30972-0/minicluster-data/master-0-root
uuid: "b4f0cf888beb46b2bf86593bf41d0e86"
format_stamp: "Formatted at 2026-07-09 13:17:08 on dist-test-slave-c08m"
I20260709 13:17:08.699313 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602730526113-30972-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602730526113-30972-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602730526113-30972-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:08.715763 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:08.717257 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:08.761185 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.62:40839
I20260709 13:17:08.761299  9146 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.62:40839 every 8 connection(s)
I20260709 13:17:08.765463  9147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.777315  9147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4f0cf888beb46b2bf86593bf41d0e86: Bootstrap starting.
I20260709 13:17:08.782397  9147 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b4f0cf888beb46b2bf86593bf41d0e86: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:08.787145  9147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4f0cf888beb46b2bf86593bf41d0e86: No bootstrap required, opened a new log
I20260709 13:17:08.789471  9147 raft_consensus.cc:359] T 00000000000000000000000000000000 P b4f0cf888beb46b2bf86593bf41d0e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4f0cf888beb46b2bf86593bf41d0e86" member_type: VOTER }
I20260709 13:17:08.789875  9147 raft_consensus.cc:385] T 00000000000000000000000000000000 P b4f0cf888beb46b2bf86593bf41d0e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:08.790056  9147 raft_consensus.cc:740] T 00000000000000000000000000000000 P b4f0cf888beb46b2bf86593bf41d0e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4f0cf888beb46b2bf86593bf41d0e86, State: Initialized, Role: FOLLOWER
I20260709 13:17:08.790653  9147 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4f0cf888beb46b2bf86593bf41d0e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4f0cf888beb46b2bf86593bf41d0e86" member_type: VOTER }
I20260709 13:17:08.791090  9147 raft_consensus.cc:399] T 00000000000000000000000000000000 P b4f0cf888beb46b2bf86593bf41d0e86 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:17:08.791324  9147 raft_consensus.cc:493] T 00000000000000000000000000000000 P b4f0cf888beb46b2bf86593bf41d0e86 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:17:08.791536  9147 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b4f0cf888beb46b2bf86593bf41d0e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:08.796393  9147 raft_consensus.cc:515] T 00000000000000000000000000000000 P b4f0cf888beb46b2bf86593bf41d0e86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4f0cf888beb46b2bf86593bf41d0e86" member_type: VOTER }
I20260709 13:17:08.797065  9147 leader_election.cc:304] T 00000000000000000000000000000000 P b4f0cf888beb46b2bf86593bf41d0e86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b4f0cf888beb46b2bf86593bf41d0e86; no voters: 
I20260709 13:17:08.798259  9147 leader_election.cc:290] T 00000000000000000000000000000000 P b4f0cf888beb46b2bf86593bf41d0e86 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:17:08.798735  9150 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b4f0cf888beb46b2bf86593bf41d0e86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:08.800236  9150 raft_consensus.cc:697] T 00000000000000000000000000000000 P b4f0cf888beb46b2bf86593bf41d0e86 [term 1 LEADER]: Becoming Leader. State: Replica: b4f0cf888beb46b2bf86593bf41d0e86, State: Running, Role: LEADER
I20260709 13:17:08.801007  9150 consensus_queue.cc:237] T 00000000000000000000000000000000 P b4f0cf888beb46b2bf86593bf41d0e86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4f0cf888beb46b2bf86593bf41d0e86" member_type: VOTER }
I20260709 13:17:08.801446  9147 sys_catalog.cc:565] T 00000000000000000000000000000000 P b4f0cf888beb46b2bf86593bf41d0e86 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:17:08.805470  9151 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4f0cf888beb46b2bf86593bf41d0e86 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b4f0cf888beb46b2bf86593bf41d0e86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4f0cf888beb46b2bf86593bf41d0e86" member_type: VOTER } }
I20260709 13:17:08.805656  9152 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4f0cf888beb46b2bf86593bf41d0e86 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b4f0cf888beb46b2bf86593bf41d0e86. Latest consensus state: current_term: 1 leader_uuid: "b4f0cf888beb46b2bf86593bf41d0e86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4f0cf888beb46b2bf86593bf41d0e86" member_type: VOTER } }
I20260709 13:17:08.806380  9151 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4f0cf888beb46b2bf86593bf41d0e86 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:08.806617  9152 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4f0cf888beb46b2bf86593bf41d0e86 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:08.809916  9156 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:17:08.815550  9156 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:17:08.818077 30972 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:17:08.824887  9156 catalog_manager.cc:1383] Generated new cluster ID: 1da00bf18b64414c8f68141ecb09616a
I20260709 13:17:08.825235  9156 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:17:08.841161  9156 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:17:08.842530  9156 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:17:08.855511  9156 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b4f0cf888beb46b2bf86593bf41d0e86: Generated new TSK 0
I20260709 13:17:08.856170  9156 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:17:08.884861 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:08.891273  9168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:08.892691  9169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:08.894894  9171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:08.895607 30972 server_base.cc:1061] running on GCE node
I20260709 13:17:08.897025 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:08.897226 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:08.897425 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783603028897409 us; error 0 us; skew 500 ppm
I20260709 13:17:08.898358 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:08.901182 30972 webserver.cc:533] Webserver started at http://127.30.63.1:43243/ using document root <none> and password file <none>
I20260709 13:17:08.901736 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:08.901916 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:08.902257 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:08.903937 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602730526113-30972-0/minicluster-data/ts-0-root/instance:
uuid: "8b853d87511945de82e91ce1e4e13b16"
format_stamp: "Formatted at 2026-07-09 13:17:08 on dist-test-slave-c08m"
I20260709 13:17:08.909355 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:17:08.913201  9176 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:08.914408 30972 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:17:08.914777 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602730526113-30972-0/minicluster-data/ts-0-root
uuid: "8b853d87511945de82e91ce1e4e13b16"
format_stamp: "Formatted at 2026-07-09 13:17:08 on dist-test-slave-c08m"
I20260709 13:17:08.915124 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602730526113-30972-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602730526113-30972-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602730526113-30972-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:08.944000 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:08.945451 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:08.947168 30972 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:08.949635 30972 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:08.949883 30972 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:08.950169 30972 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:08.950387 30972 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:08.994818 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.1:34715
I20260709 13:17:08.994913  9238 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.1:34715 every 8 connection(s)
I20260709 13:17:09.000177 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:09.008085  9243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:09.009235  9244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:09.013141 30972 server_base.cc:1061] running on GCE node
W20260709 13:17:09.013763  9246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:09.015079  9239 heartbeater.cc:344] Connected to a master server at 127.30.63.62:40839
I20260709 13:17:09.015404 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:17:09.015534  9239 heartbeater.cc:461] Registering TS with master...
W20260709 13:17:09.015714 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:09.015945 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783603029015929 us; error 0 us; skew 500 ppm
I20260709 13:17:09.016501  9239 heartbeater.cc:507] Master 127.30.63.62:40839 requested a full tablet report, sending...
I20260709 13:17:09.016762 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:09.018965  9112 ts_manager.cc:194] Registered new tserver with Master: 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715)
I20260709 13:17:09.019547 30972 webserver.cc:533] Webserver started at http://127.30.63.2:44399/ using document root <none> and password file <none>
I20260709 13:17:09.020052 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:09.020198 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:09.020392 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:09.020903  9112 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37138
I20260709 13:17:09.021550 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602730526113-30972-0/minicluster-data/ts-1-root/instance:
uuid: "810aa394d3b24560a5b4dd2b78c8966e"
format_stamp: "Formatted at 2026-07-09 13:17:09 on dist-test-slave-c08m"
I20260709 13:17:09.027027 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:17:09.030803  9251 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:09.031632 30972 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:17:09.031899 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602730526113-30972-0/minicluster-data/ts-1-root
uuid: "810aa394d3b24560a5b4dd2b78c8966e"
format_stamp: "Formatted at 2026-07-09 13:17:09 on dist-test-slave-c08m"
I20260709 13:17:09.032177 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602730526113-30972-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602730526113-30972-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602730526113-30972-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:09.057543 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:09.058717 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:09.060253 30972 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:09.062785 30972 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:09.062975 30972 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:09.063283 30972 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:09.063437 30972 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:09.106479 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.2:39969
I20260709 13:17:09.106601  9313 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.2:39969 every 8 connection(s)
I20260709 13:17:09.111364 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:09.118980  9317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:09.122284  9318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:09.123277 30972 server_base.cc:1061] running on GCE node
W20260709 13:17:09.123482  9320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:09.124289  9314 heartbeater.cc:344] Connected to a master server at 127.30.63.62:40839
I20260709 13:17:09.124693 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:17:09.124768  9314 heartbeater.cc:461] Registering TS with master...
W20260709 13:17:09.125196 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:09.125427 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783603029125408 us; error 0 us; skew 500 ppm
I20260709 13:17:09.125909  9314 heartbeater.cc:507] Master 127.30.63.62:40839 requested a full tablet report, sending...
I20260709 13:17:09.126236 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:09.128257  9112 ts_manager.cc:194] Registered new tserver with Master: 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969)
I20260709 13:17:09.129371 30972 webserver.cc:533] Webserver started at http://127.30.63.3:38609/ using document root <none> and password file <none>
I20260709 13:17:09.129973 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:09.129994  9112 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37154
I20260709 13:17:09.130192 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:09.130649 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:09.132047 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602730526113-30972-0/minicluster-data/ts-2-root/instance:
uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
format_stamp: "Formatted at 2026-07-09 13:17:09 on dist-test-slave-c08m"
I20260709 13:17:09.137164 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:17:09.140640  9325 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:09.141521 30972 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:17:09.141877 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602730526113-30972-0/minicluster-data/ts-2-root
uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
format_stamp: "Formatted at 2026-07-09 13:17:09 on dist-test-slave-c08m"
I20260709 13:17:09.142163 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602730526113-30972-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602730526113-30972-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602730526113-30972-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:09.152299 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:09.153779 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:09.155403 30972 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:09.157790 30972 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:09.158028 30972 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:09.158330 30972 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:09.158610 30972 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.001s
I20260709 13:17:09.208232 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.3:35957
I20260709 13:17:09.208336  9387 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.3:35957 every 8 connection(s)
I20260709 13:17:09.223239  9388 heartbeater.cc:344] Connected to a master server at 127.30.63.62:40839
I20260709 13:17:09.223687  9388 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:09.224509  9388 heartbeater.cc:507] Master 127.30.63.62:40839 requested a full tablet report, sending...
I20260709 13:17:09.226990  9112 ts_manager.cc:194] Registered new tserver with Master: 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:09.227087 30972 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015763895s
I20260709 13:17:09.228997  9112 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37162
I20260709 13:17:09.256986  9112 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37170:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:09.259960  9112 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:09.335783  9353 tablet_service.cc:1511] Processing CreateTablet for tablet e8f0b2f6fc574e328e072a92f5192c79 (DEFAULT_TABLE table=test-workload [id=3190f7deb75443cab3be08945dde1ada]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:17:09.337402  9353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f0b2f6fc574e328e072a92f5192c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.335783  9351 tablet_service.cc:1511] Processing CreateTablet for tablet a9e2a2f0d5754921996f26c015b13e67 (DEFAULT_TABLE table=test-workload [id=3190f7deb75443cab3be08945dde1ada]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:17:09.342438  9351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9e2a2f0d5754921996f26c015b13e67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.335780  9352 tablet_service.cc:1511] Processing CreateTablet for tablet a87554f5c20f4f5cb0a2c7deb51eec5b (DEFAULT_TABLE table=test-workload [id=3190f7deb75443cab3be08945dde1ada]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:17:09.346131  9352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a87554f5c20f4f5cb0a2c7deb51eec5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.349272  9204 tablet_service.cc:1511] Processing CreateTablet for tablet e8f0b2f6fc574e328e072a92f5192c79 (DEFAULT_TABLE table=test-workload [id=3190f7deb75443cab3be08945dde1ada]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:17:09.350762  9204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f0b2f6fc574e328e072a92f5192c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.352439  9200 tablet_service.cc:1511] Processing CreateTablet for tablet 3bc4d66484094db0aae6dfb29587774a (DEFAULT_TABLE table=test-workload [id=3190f7deb75443cab3be08945dde1ada]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:17:09.353922  9200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bc4d66484094db0aae6dfb29587774a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.356972  9201 tablet_service.cc:1511] Processing CreateTablet for tablet 69a49b7ef53144babd52bc66266d5aa1 (DEFAULT_TABLE table=test-workload [id=3190f7deb75443cab3be08945dde1ada]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:17:09.358513  9201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69a49b7ef53144babd52bc66266d5aa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.359022  9199 tablet_service.cc:1511] Processing CreateTablet for tablet 41b6746cc1154961b2c27c96e04bbdab (DEFAULT_TABLE table=test-workload [id=3190f7deb75443cab3be08945dde1ada]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:17:09.360008  9279 tablet_service.cc:1511] Processing CreateTablet for tablet e8f0b2f6fc574e328e072a92f5192c79 (DEFAULT_TABLE table=test-workload [id=3190f7deb75443cab3be08945dde1ada]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:17:09.360476  9199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41b6746cc1154961b2c27c96e04bbdab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.361588  9279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f0b2f6fc574e328e072a92f5192c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.361698  9202 tablet_service.cc:1511] Processing CreateTablet for tablet a9e2a2f0d5754921996f26c015b13e67 (DEFAULT_TABLE table=test-workload [id=3190f7deb75443cab3be08945dde1ada]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:17:09.363205  9202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9e2a2f0d5754921996f26c015b13e67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.365830  9203 tablet_service.cc:1511] Processing CreateTablet for tablet a87554f5c20f4f5cb0a2c7deb51eec5b (DEFAULT_TABLE table=test-workload [id=3190f7deb75443cab3be08945dde1ada]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:17:09.367348  9203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a87554f5c20f4f5cb0a2c7deb51eec5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.371210  9350 tablet_service.cc:1511] Processing CreateTablet for tablet 69a49b7ef53144babd52bc66266d5aa1 (DEFAULT_TABLE table=test-workload [id=3190f7deb75443cab3be08945dde1ada]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:17:09.374430  9349 tablet_service.cc:1511] Processing CreateTablet for tablet 3bc4d66484094db0aae6dfb29587774a (DEFAULT_TABLE table=test-workload [id=3190f7deb75443cab3be08945dde1ada]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:17:09.377300  9348 tablet_service.cc:1511] Processing CreateTablet for tablet 41b6746cc1154961b2c27c96e04bbdab (DEFAULT_TABLE table=test-workload [id=3190f7deb75443cab3be08945dde1ada]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:17:09.377986  9346 tablet_service.cc:1511] Processing CreateTablet for tablet faaef8ba24094ff399cbfb39f7894125 (DEFAULT_TABLE table=test-workload [id=3190f7deb75443cab3be08945dde1ada]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:17:09.380038  9347 tablet_service.cc:1511] Processing CreateTablet for tablet 7c0c24e4de70467b86659171853fd6de (DEFAULT_TABLE table=test-workload [id=3190f7deb75443cab3be08945dde1ada]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:17:09.380530  9350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69a49b7ef53144babd52bc66266d5aa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.381489  9347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c0c24e4de70467b86659171853fd6de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.382123  9346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faaef8ba24094ff399cbfb39f7894125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.383435  9349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bc4d66484094db0aae6dfb29587774a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.386298  9348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41b6746cc1154961b2c27c96e04bbdab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.386435  9345 tablet_service.cc:1511] Processing CreateTablet for tablet eb93f7930f19442bbf52f407b7123fe7 (DEFAULT_TABLE table=test-workload [id=3190f7deb75443cab3be08945dde1ada]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:17:09.388638  9345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb93f7930f19442bbf52f407b7123fe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.390758  9344 tablet_service.cc:1511] Processing CreateTablet for tablet 5b61ab45e369457b8a3824ee01df4030 (DEFAULT_TABLE table=test-workload [id=3190f7deb75443cab3be08945dde1ada]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:17:09.391057  9278 tablet_service.cc:1511] Processing CreateTablet for tablet a87554f5c20f4f5cb0a2c7deb51eec5b (DEFAULT_TABLE table=test-workload [id=3190f7deb75443cab3be08945dde1ada]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:17:09.392419  9344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b61ab45e369457b8a3824ee01df4030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.397405  9198 tablet_service.cc:1511] Processing CreateTablet for tablet 7c0c24e4de70467b86659171853fd6de (DEFAULT_TABLE table=test-workload [id=3190f7deb75443cab3be08945dde1ada]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:17:09.399282  9198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c0c24e4de70467b86659171853fd6de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.402557  9278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a87554f5c20f4f5cb0a2c7deb51eec5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.410817  9197 tablet_service.cc:1511] Processing CreateTablet for tablet faaef8ba24094ff399cbfb39f7894125 (DEFAULT_TABLE table=test-workload [id=3190f7deb75443cab3be08945dde1ada]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:17:09.413864  9196 tablet_service.cc:1511] Processing CreateTablet for tablet eb93f7930f19442bbf52f407b7123fe7 (DEFAULT_TABLE table=test-workload [id=3190f7deb75443cab3be08945dde1ada]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:17:09.412412  9197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faaef8ba24094ff399cbfb39f7894125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.416407  9195 tablet_service.cc:1511] Processing CreateTablet for tablet 5b61ab45e369457b8a3824ee01df4030 (DEFAULT_TABLE table=test-workload [id=3190f7deb75443cab3be08945dde1ada]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:17:09.418555  9196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb93f7930f19442bbf52f407b7123fe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.421288  9277 tablet_service.cc:1511] Processing CreateTablet for tablet a9e2a2f0d5754921996f26c015b13e67 (DEFAULT_TABLE table=test-workload [id=3190f7deb75443cab3be08945dde1ada]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:17:09.422757  9277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9e2a2f0d5754921996f26c015b13e67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.425004  9195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b61ab45e369457b8a3824ee01df4030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.442456  9275 tablet_service.cc:1511] Processing CreateTablet for tablet 3bc4d66484094db0aae6dfb29587774a (DEFAULT_TABLE table=test-workload [id=3190f7deb75443cab3be08945dde1ada]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:17:09.442456  9276 tablet_service.cc:1511] Processing CreateTablet for tablet 69a49b7ef53144babd52bc66266d5aa1 (DEFAULT_TABLE table=test-workload [id=3190f7deb75443cab3be08945dde1ada]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:17:09.446491  9275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bc4d66484094db0aae6dfb29587774a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.449189  9276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69a49b7ef53144babd52bc66266d5aa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.458864  9403 tablet_bootstrap.cc:492] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16: Bootstrap starting.
I20260709 13:17:09.472182  9274 tablet_service.cc:1511] Processing CreateTablet for tablet 41b6746cc1154961b2c27c96e04bbdab (DEFAULT_TABLE table=test-workload [id=3190f7deb75443cab3be08945dde1ada]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:17:09.474028  9273 tablet_service.cc:1511] Processing CreateTablet for tablet 7c0c24e4de70467b86659171853fd6de (DEFAULT_TABLE table=test-workload [id=3190f7deb75443cab3be08945dde1ada]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:17:09.476372  9272 tablet_service.cc:1511] Processing CreateTablet for tablet faaef8ba24094ff399cbfb39f7894125 (DEFAULT_TABLE table=test-workload [id=3190f7deb75443cab3be08945dde1ada]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:17:09.478346  9271 tablet_service.cc:1511] Processing CreateTablet for tablet eb93f7930f19442bbf52f407b7123fe7 (DEFAULT_TABLE table=test-workload [id=3190f7deb75443cab3be08945dde1ada]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:17:09.510983  9272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faaef8ba24094ff399cbfb39f7894125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.512040  9274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41b6746cc1154961b2c27c96e04bbdab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.513640  9271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb93f7930f19442bbf52f407b7123fe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.519073  9273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c0c24e4de70467b86659171853fd6de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.519498  9270 tablet_service.cc:1511] Processing CreateTablet for tablet 5b61ab45e369457b8a3824ee01df4030 (DEFAULT_TABLE table=test-workload [id=3190f7deb75443cab3be08945dde1ada]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:17:09.521040  9270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b61ab45e369457b8a3824ee01df4030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.539489  9402 tablet_bootstrap.cc:492] T a9e2a2f0d5754921996f26c015b13e67 P 6beeb97aa49249eb8aeeaf764cbab2bf: Bootstrap starting.
I20260709 13:17:09.563727  9402 tablet_bootstrap.cc:654] T a9e2a2f0d5754921996f26c015b13e67 P 6beeb97aa49249eb8aeeaf764cbab2bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.577131  9404 tablet_bootstrap.cc:492] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e: Bootstrap starting.
I20260709 13:17:09.607012  9404 tablet_bootstrap.cc:654] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.610148  9402 tablet_bootstrap.cc:492] T a9e2a2f0d5754921996f26c015b13e67 P 6beeb97aa49249eb8aeeaf764cbab2bf: No bootstrap required, opened a new log
I20260709 13:17:09.610975  9402 ts_tablet_manager.cc:1403] T a9e2a2f0d5754921996f26c015b13e67 P 6beeb97aa49249eb8aeeaf764cbab2bf: Time spent bootstrapping tablet: real 0.072s	user 0.016s	sys 0.000s
I20260709 13:17:09.611681  9403 tablet_bootstrap.cc:654] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.614262  9402 raft_consensus.cc:359] T a9e2a2f0d5754921996f26c015b13e67 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:09.615147  9402 raft_consensus.cc:385] T a9e2a2f0d5754921996f26c015b13e67 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.615506  9402 raft_consensus.cc:740] T a9e2a2f0d5754921996f26c015b13e67 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6beeb97aa49249eb8aeeaf764cbab2bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.616734  9402 consensus_queue.cc:260] T a9e2a2f0d5754921996f26c015b13e67 P 6beeb97aa49249eb8aeeaf764cbab2bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:09.619583  9404 tablet_bootstrap.cc:492] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e: No bootstrap required, opened a new log
I20260709 13:17:09.620169  9404 ts_tablet_manager.cc:1403] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.008s
I20260709 13:17:09.625424  9404 raft_consensus.cc:359] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:09.626809  9404 raft_consensus.cc:385] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.627372  9404 raft_consensus.cc:740] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 810aa394d3b24560a5b4dd2b78c8966e, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.629630  9388 heartbeater.cc:499] Master 127.30.63.62:40839 was elected leader, sending a full tablet report...
I20260709 13:17:09.630275  9402 ts_tablet_manager.cc:1434] T a9e2a2f0d5754921996f26c015b13e67 P 6beeb97aa49249eb8aeeaf764cbab2bf: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.004s
I20260709 13:17:09.631399  9403 tablet_bootstrap.cc:492] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16: No bootstrap required, opened a new log
I20260709 13:17:09.631418  9402 tablet_bootstrap.cc:492] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf: Bootstrap starting.
I20260709 13:17:09.632236  9403 ts_tablet_manager.cc:1403] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16: Time spent bootstrapping tablet: real 0.174s	user 0.015s	sys 0.008s
I20260709 13:17:09.629271  9404 consensus_queue.cc:260] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:09.635588  9403 raft_consensus.cc:359] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:09.636406  9403 raft_consensus.cc:385] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.636703  9403 raft_consensus.cc:740] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b853d87511945de82e91ce1e4e13b16, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.637658  9403 consensus_queue.cc:260] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:09.641597  9402 tablet_bootstrap.cc:654] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.656052  9402 tablet_bootstrap.cc:492] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf: No bootstrap required, opened a new log
I20260709 13:17:09.656915  9402 ts_tablet_manager.cc:1403] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.013s
I20260709 13:17:09.657975  9314 heartbeater.cc:499] Master 127.30.63.62:40839 was elected leader, sending a full tablet report...
I20260709 13:17:09.658377  9404 ts_tablet_manager.cc:1434] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.021s
I20260709 13:17:09.659578  9404 tablet_bootstrap.cc:492] T 41b6746cc1154961b2c27c96e04bbdab P 810aa394d3b24560a5b4dd2b78c8966e: Bootstrap starting.
I20260709 13:17:09.659591  9403 ts_tablet_manager.cc:1434] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.014s
I20260709 13:17:09.660928  9403 tablet_bootstrap.cc:492] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16: Bootstrap starting.
I20260709 13:17:09.663460  9239 heartbeater.cc:499] Master 127.30.63.62:40839 was elected leader, sending a full tablet report...
I20260709 13:17:09.666826  9403 tablet_bootstrap.cc:654] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.666972  9404 tablet_bootstrap.cc:654] T 41b6746cc1154961b2c27c96e04bbdab P 810aa394d3b24560a5b4dd2b78c8966e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.672073  9402 raft_consensus.cc:359] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } } peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } }
I20260709 13:17:09.673237  9402 raft_consensus.cc:385] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.673656  9402 raft_consensus.cc:740] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6beeb97aa49249eb8aeeaf764cbab2bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.675046  9402 consensus_queue.cc:260] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } } peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } }
I20260709 13:17:09.678464  9402 ts_tablet_manager.cc:1434] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 13:17:09.680094  9402 tablet_bootstrap.cc:492] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf: Bootstrap starting.
I20260709 13:17:09.691816  9402 tablet_bootstrap.cc:654] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.705878  9402 tablet_bootstrap.cc:492] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf: No bootstrap required, opened a new log
I20260709 13:17:09.706888  9402 ts_tablet_manager.cc:1403] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.011s
I20260709 13:17:09.711196  9402 raft_consensus.cc:359] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
W20260709 13:17:09.712743  9389 tablet.cc:2406] T a9e2a2f0d5754921996f26c015b13e67 P 6beeb97aa49249eb8aeeaf764cbab2bf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:17:09.712940  9402 raft_consensus.cc:385] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.713759  9402 raft_consensus.cc:740] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6beeb97aa49249eb8aeeaf764cbab2bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.715284  9402 consensus_queue.cc:260] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:09.719008  9402 ts_tablet_manager.cc:1434] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.003s
I20260709 13:17:09.720551  9402 tablet_bootstrap.cc:492] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf: Bootstrap starting.
I20260709 13:17:09.730144  9402 tablet_bootstrap.cc:654] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.746309  9402 tablet_bootstrap.cc:492] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf: No bootstrap required, opened a new log
I20260709 13:17:09.747366  9402 ts_tablet_manager.cc:1403] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.004s
I20260709 13:17:09.752948  9404 tablet_bootstrap.cc:492] T 41b6746cc1154961b2c27c96e04bbdab P 810aa394d3b24560a5b4dd2b78c8966e: No bootstrap required, opened a new log
I20260709 13:17:09.753614  9404 ts_tablet_manager.cc:1403] T 41b6746cc1154961b2c27c96e04bbdab P 810aa394d3b24560a5b4dd2b78c8966e: Time spent bootstrapping tablet: real 0.094s	user 0.045s	sys 0.046s
I20260709 13:17:09.754029  9403 tablet_bootstrap.cc:492] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16: No bootstrap required, opened a new log
I20260709 13:17:09.754966  9403 ts_tablet_manager.cc:1403] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16: Time spent bootstrapping tablet: real 0.094s	user 0.036s	sys 0.053s
I20260709 13:17:09.755636  9402 raft_consensus.cc:359] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:09.756691  9402 raft_consensus.cc:385] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.756844  9404 raft_consensus.cc:359] T 41b6746cc1154961b2c27c96e04bbdab P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:09.757709  9404 raft_consensus.cc:385] T 41b6746cc1154961b2c27c96e04bbdab P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.757268  9402 raft_consensus.cc:740] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6beeb97aa49249eb8aeeaf764cbab2bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.758036  9404 raft_consensus.cc:740] T 41b6746cc1154961b2c27c96e04bbdab P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 810aa394d3b24560a5b4dd2b78c8966e, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.758843  9403 raft_consensus.cc:359] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:09.759008  9402 consensus_queue.cc:260] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:09.758947  9404 consensus_queue.cc:260] T 41b6746cc1154961b2c27c96e04bbdab P 810aa394d3b24560a5b4dd2b78c8966e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:09.759735  9403 raft_consensus.cc:385] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.760246  9403 raft_consensus.cc:740] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b853d87511945de82e91ce1e4e13b16, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.761643  9404 ts_tablet_manager.cc:1434] T 41b6746cc1154961b2c27c96e04bbdab P 810aa394d3b24560a5b4dd2b78c8966e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:17:09.761204  9403 consensus_queue.cc:260] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:09.762113  9402 ts_tablet_manager.cc:1434] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf: Time spent starting tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:17:09.762740  9404 tablet_bootstrap.cc:492] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e: Bootstrap starting.
I20260709 13:17:09.763765  9402 tablet_bootstrap.cc:492] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf: Bootstrap starting.
I20260709 13:17:09.764176  9403 ts_tablet_manager.cc:1434] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:17:09.765208  9403 tablet_bootstrap.cc:492] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16: Bootstrap starting.
I20260709 13:17:09.766647  9410 raft_consensus.cc:493] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.767264  9410 raft_consensus.cc:515] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:09.771648  9404 tablet_bootstrap.cc:654] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.771833  9402 tablet_bootstrap.cc:654] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.772047  9403 tablet_bootstrap.cc:654] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.785645  9410 leader_election.cc:290] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969), 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:09.787451  9402 tablet_bootstrap.cc:492] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf: No bootstrap required, opened a new log
I20260709 13:17:09.787547  9403 tablet_bootstrap.cc:492] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16: No bootstrap required, opened a new log
I20260709 13:17:09.788254  9403 ts_tablet_manager.cc:1403] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.003s
I20260709 13:17:09.788256  9402 ts_tablet_manager.cc:1403] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.007s
I20260709 13:17:09.791548  9402 raft_consensus.cc:359] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:09.791697  9403 raft_consensus.cc:359] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } } peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } }
I20260709 13:17:09.792389  9402 raft_consensus.cc:385] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.792430  9403 raft_consensus.cc:385] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.792946  9402 raft_consensus.cc:740] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6beeb97aa49249eb8aeeaf764cbab2bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.793002  9403 raft_consensus.cc:740] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b853d87511945de82e91ce1e4e13b16, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.793994  9402 consensus_queue.cc:260] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:09.793995  9403 consensus_queue.cc:260] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } } peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } }
I20260709 13:17:09.796886  9403 ts_tablet_manager.cc:1434] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:17:09.796907  9402 ts_tablet_manager.cc:1434] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:09.798218  9403 tablet_bootstrap.cc:492] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16: Bootstrap starting.
I20260709 13:17:09.798218  9402 tablet_bootstrap.cc:492] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf: Bootstrap starting.
I20260709 13:17:09.806177  9403 tablet_bootstrap.cc:654] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.806679  9402 tablet_bootstrap.cc:654] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.811173  9409 raft_consensus.cc:493] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:09.814654  9160 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:09.812001  9409 raft_consensus.cc:515] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:09.825387  9408 raft_consensus.cc:493] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.826251  9408 raft_consensus.cc:515] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:09.820940  9409 leader_election.cc:290] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:09.845070  9402 tablet_bootstrap.cc:492] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf: No bootstrap required, opened a new log
I20260709 13:17:09.845701  9402 ts_tablet_manager.cc:1403] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.010s
I20260709 13:17:09.857151  9403 tablet_bootstrap.cc:492] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16: No bootstrap required, opened a new log
I20260709 13:17:09.862037  9408 leader_election.cc:290] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969)
I20260709 13:17:09.876029  9403 ts_tablet_manager.cc:1403] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16: Time spent bootstrapping tablet: real 0.078s	user 0.005s	sys 0.018s
I20260709 13:17:09.884688  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e2a2f0d5754921996f26c015b13e67" candidate_uuid: "8b853d87511945de82e91ce1e4e13b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e" is_pre_election: true
W20260709 13:17:09.890024  9177 leader_election.cc:343] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:09.893211  9403 raft_consensus.cc:359] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:09.889631  9402 raft_consensus.cc:359] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:09.894057  9403 raft_consensus.cc:385] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.894244  9402 raft_consensus.cc:385] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.894447  9403 raft_consensus.cc:740] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b853d87511945de82e91ce1e4e13b16, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.894627  9402 raft_consensus.cc:740] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6beeb97aa49249eb8aeeaf764cbab2bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.895236  9403 consensus_queue.cc:260] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:09.899257  9404 tablet_bootstrap.cc:492] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e: No bootstrap required, opened a new log
I20260709 13:17:09.900111  9404 ts_tablet_manager.cc:1403] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e: Time spent bootstrapping tablet: real 0.138s	user 0.047s	sys 0.033s
I20260709 13:17:09.896449  9402 consensus_queue.cc:260] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:09.904628  9408 raft_consensus.cc:493] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.905136  9408 raft_consensus.cc:515] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:09.905643  9402 ts_tablet_manager.cc:1434] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf: Time spent starting tablet: real 0.060s	user 0.009s	sys 0.002s
I20260709 13:17:09.906556  9404 raft_consensus.cc:359] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } } peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } }
I20260709 13:17:09.908039  9404 raft_consensus.cc:385] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.908360  9404 raft_consensus.cc:740] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 810aa394d3b24560a5b4dd2b78c8966e, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.907019  9408 leader_election.cc:290] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969)
I20260709 13:17:09.908561  9402 tablet_bootstrap.cc:492] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf: Bootstrap starting.
I20260709 13:17:09.909142  9404 consensus_queue.cc:260] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } } peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } }
I20260709 13:17:09.909196  9363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e2a2f0d5754921996f26c015b13e67" candidate_uuid: "8b853d87511945de82e91ce1e4e13b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" is_pre_election: true
I20260709 13:17:09.911245  9363 raft_consensus.cc:2468] T a9e2a2f0d5754921996f26c015b13e67 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b853d87511945de82e91ce1e4e13b16 in term 0.
I20260709 13:17:09.912406  9404 ts_tablet_manager.cc:1434] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:17:09.913475  9404 tablet_bootstrap.cc:492] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e: Bootstrap starting.
I20260709 13:17:09.917380  9402 tablet_bootstrap.cc:654] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.917954  9214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87554f5c20f4f5cb0a2c7deb51eec5b" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b853d87511945de82e91ce1e4e13b16" is_pre_election: true
W20260709 13:17:09.919943  9252 leader_election.cc:343] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:09.920241  9404 tablet_bootstrap.cc:654] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.922102  9178 leader_election.cc:304] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 8b853d87511945de82e91ce1e4e13b16; no voters: 810aa394d3b24560a5b4dd2b78c8966e
I20260709 13:17:09.924870  9403 ts_tablet_manager.cc:1434] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 13:17:09.926787  9403 tablet_bootstrap.cc:492] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16: Bootstrap starting.
I20260709 13:17:09.927140  9410 raft_consensus.cc:2804] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:09.928020  9410 raft_consensus.cc:493] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.928395  9410 raft_consensus.cc:3060] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:09.930083  9402 tablet_bootstrap.cc:492] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf: No bootstrap required, opened a new log
I20260709 13:17:09.932443  9214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a49b7ef53144babd52bc66266d5aa1" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b853d87511945de82e91ce1e4e13b16" is_pre_election: true
I20260709 13:17:09.936472  9214 raft_consensus.cc:2468] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6beeb97aa49249eb8aeeaf764cbab2bf in term 0.
I20260709 13:17:09.938315  9213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faaef8ba24094ff399cbfb39f7894125" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b853d87511945de82e91ce1e4e13b16" is_pre_election: true
I20260709 13:17:09.938282  9326 leader_election.cc:304] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 8b853d87511945de82e91ce1e4e13b16; no voters: 
I20260709 13:17:09.940698  9408 raft_consensus.cc:2804] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:09.941177  9408 raft_consensus.cc:493] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.941608  9408 raft_consensus.cc:3060] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:09.945163  9402 ts_tablet_manager.cc:1403] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.006s
I20260709 13:17:09.953497  9363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87554f5c20f4f5cb0a2c7deb51eec5b" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" is_pre_election: true
W20260709 13:17:09.955415  9253 leader_election.cc:343] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:09.955564  9402 raft_consensus.cc:359] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:09.956072  9253 leader_election.cc:304] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 810aa394d3b24560a5b4dd2b78c8966e; no voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 8b853d87511945de82e91ce1e4e13b16
I20260709 13:17:09.957224  9409 raft_consensus.cc:2749] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:09.956398  9402 raft_consensus.cc:385] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.960541  9408 raft_consensus.cc:515] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:09.962874  9410 raft_consensus.cc:515] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:09.966604  9408 leader_election.cc:290] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 1 election: Requested vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969)
I20260709 13:17:09.967310  9403 tablet_bootstrap.cc:654] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.963799  9402 raft_consensus.cc:740] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6beeb97aa49249eb8aeeaf764cbab2bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.967775  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e2a2f0d5754921996f26c015b13e67" candidate_uuid: "8b853d87511945de82e91ce1e4e13b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
I20260709 13:17:09.968447  9409 raft_consensus.cc:493] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.968972  9409 raft_consensus.cc:515] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } } peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } }
I20260709 13:17:09.969455  9404 tablet_bootstrap.cc:492] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e: No bootstrap required, opened a new log
W20260709 13:17:09.969638  9177 leader_election.cc:343] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:09.970002  9404 ts_tablet_manager.cc:1403] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e: Time spent bootstrapping tablet: real 0.057s	user 0.021s	sys 0.010s
W20260709 13:17:09.961153  9326 leader_election.cc:343] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:09.971225  9409 leader_election.cc:290] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957), 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715)
I20260709 13:17:09.972605  9213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a49b7ef53144babd52bc66266d5aa1" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b853d87511945de82e91ce1e4e13b16"
I20260709 13:17:09.972951  9410 leader_election.cc:290] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16 [CANDIDATE]: Term 1 election: Requested vote from peers 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969), 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:09.973264  9213 raft_consensus.cc:3060] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:09.973450  9404 raft_consensus.cc:359] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:09.974246  9404 raft_consensus.cc:385] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.975072  9363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e2a2f0d5754921996f26c015b13e67" candidate_uuid: "8b853d87511945de82e91ce1e4e13b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
I20260709 13:17:09.974534  9404 raft_consensus.cc:740] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 810aa394d3b24560a5b4dd2b78c8966e, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.975854  9363 raft_consensus.cc:3060] T a9e2a2f0d5754921996f26c015b13e67 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:09.976178  9404 consensus_queue.cc:260] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:09.979591  9362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f0b2f6fc574e328e072a92f5192c79" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" is_pre_election: true
I20260709 13:17:09.980356  9362 raft_consensus.cc:2468] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 810aa394d3b24560a5b4dd2b78c8966e in term 0.
I20260709 13:17:09.964264  9431 raft_consensus.cc:493] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.981870  9431 raft_consensus.cc:515] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } } peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } }
I20260709 13:17:09.984275  9431 leader_election.cc:290] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957), 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969)
I20260709 13:17:09.986470  9213 raft_consensus.cc:2468] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6beeb97aa49249eb8aeeaf764cbab2bf in term 1.
I20260709 13:17:09.986498  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f0b2f6fc574e328e072a92f5192c79" candidate_uuid: "8b853d87511945de82e91ce1e4e13b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e" is_pre_election: true
I20260709 13:17:09.987177  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a49b7ef53144babd52bc66266d5aa1" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e" is_pre_election: true
I20260709 13:17:09.968417  9402 consensus_queue.cc:260] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:09.988981  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faaef8ba24094ff399cbfb39f7894125" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e" is_pre_election: true
I20260709 13:17:09.989234  9362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f0b2f6fc574e328e072a92f5192c79" candidate_uuid: "8b853d87511945de82e91ce1e4e13b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" is_pre_election: true
I20260709 13:17:09.989918  9402 ts_tablet_manager.cc:1434] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.002s
I20260709 13:17:09.990533  9253 leader_election.cc:304] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 810aa394d3b24560a5b4dd2b78c8966e; no voters: 
I20260709 13:17:09.991027  9402 tablet_bootstrap.cc:492] T eb93f7930f19442bbf52f407b7123fe7 P 6beeb97aa49249eb8aeeaf764cbab2bf: Bootstrap starting.
I20260709 13:17:09.992144  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a49b7ef53144babd52bc66266d5aa1" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
I20260709 13:17:09.987653  9289 raft_consensus.cc:2468] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b853d87511945de82e91ce1e4e13b16 in term 0.
I20260709 13:17:09.995200  9409 raft_consensus.cc:2804] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:09.996574  9177 leader_election.cc:304] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 810aa394d3b24560a5b4dd2b78c8966e, 8b853d87511945de82e91ce1e4e13b16; no voters: 
I20260709 13:17:09.997485  9213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f0b2f6fc574e328e072a92f5192c79" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b853d87511945de82e91ce1e4e13b16" is_pre_election: true
I20260709 13:17:09.997649  9409 raft_consensus.cc:493] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.995054  9404 ts_tablet_manager.cc:1434] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:17:09.998169  9409 raft_consensus.cc:3060] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:09.998641  9326 leader_election.cc:343] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.002241  9404 tablet_bootstrap.cc:492] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e: Bootstrap starting.
I20260709 13:17:10.003196  9431 raft_consensus.cc:2804] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:09.990193  9362 raft_consensus.cc:2468] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b853d87511945de82e91ce1e4e13b16 in term 0.
I20260709 13:17:10.003628  9431 raft_consensus.cc:493] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.004405  9431 raft_consensus.cc:3060] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.010221  9404 tablet_bootstrap.cc:654] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:10.000017  9326 leader_election.cc:343] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.012323  9326 leader_election.cc:304] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf; no voters: 810aa394d3b24560a5b4dd2b78c8966e, 8b853d87511945de82e91ce1e4e13b16
W20260709 13:17:10.016017  9326 leader_election.cc:343] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.017290  9326 leader_election.cc:304] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 8b853d87511945de82e91ce1e4e13b16; no voters: 810aa394d3b24560a5b4dd2b78c8966e
I20260709 13:17:10.018685  9409 raft_consensus.cc:515] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } } peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } }
I20260709 13:17:10.020025  9408 raft_consensus.cc:2749] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:10.026749  9431 raft_consensus.cc:515] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } } peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } }
I20260709 13:17:10.028352  9213 raft_consensus.cc:2393] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 810aa394d3b24560a5b4dd2b78c8966e in current term 1: Already voted for candidate 8b853d87511945de82e91ce1e4e13b16 in this term.
I20260709 13:17:10.024652  9402 tablet_bootstrap.cc:654] T eb93f7930f19442bbf52f407b7123fe7 P 6beeb97aa49249eb8aeeaf764cbab2bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.025518  9362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f0b2f6fc574e328e072a92f5192c79" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
I20260709 13:17:10.029191  9362 raft_consensus.cc:3060] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.030544  9404 tablet_bootstrap.cc:492] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e: No bootstrap required, opened a new log
I20260709 13:17:10.031172  9404 ts_tablet_manager.cc:1403] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.005s
I20260709 13:17:10.034966  9213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f0b2f6fc574e328e072a92f5192c79" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b853d87511945de82e91ce1e4e13b16"
I20260709 13:17:10.034814  9404 raft_consensus.cc:359] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.027429  9408 raft_consensus.cc:2804] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:10.038533  9431 leader_election.cc:290] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [CANDIDATE]: Term 1 election: Requested vote from peers 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957), 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969)
I20260709 13:17:10.039894  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f0b2f6fc574e328e072a92f5192c79" candidate_uuid: "8b853d87511945de82e91ce1e4e13b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
I20260709 13:17:10.035687  9404 raft_consensus.cc:385] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.035888  9213 raft_consensus.cc:2393] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 810aa394d3b24560a5b4dd2b78c8966e in current term 1: Already voted for candidate 8b853d87511945de82e91ce1e4e13b16 in this term.
I20260709 13:17:10.040732  9289 raft_consensus.cc:2393] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b853d87511945de82e91ce1e4e13b16 in current term 1: Already voted for candidate 810aa394d3b24560a5b4dd2b78c8966e in this term.
I20260709 13:17:10.036206  9409 leader_election.cc:290] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 1 election: Requested vote from peers 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957), 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715)
I20260709 13:17:10.036603  9403 tablet_bootstrap.cc:492] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16: No bootstrap required, opened a new log
I20260709 13:17:10.041725  9403 ts_tablet_manager.cc:1403] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16: Time spent bootstrapping tablet: real 0.116s	user 0.029s	sys 0.021s
I20260709 13:17:10.036983  9435 raft_consensus.cc:493] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.042423  9404 raft_consensus.cc:740] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 810aa394d3b24560a5b4dd2b78c8966e, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.042675  9435 raft_consensus.cc:515] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.043395  9404 consensus_queue.cc:260] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.045553  9363 raft_consensus.cc:2468] T a9e2a2f0d5754921996f26c015b13e67 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b853d87511945de82e91ce1e4e13b16 in term 1.
I20260709 13:17:10.046629  9404 ts_tablet_manager.cc:1434] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:17:10.046629  9213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b6746cc1154961b2c27c96e04bbdab" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b853d87511945de82e91ce1e4e13b16" is_pre_election: true
I20260709 13:17:10.047923  9404 tablet_bootstrap.cc:492] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e: Bootstrap starting.
I20260709 13:17:10.048419  9402 tablet_bootstrap.cc:492] T eb93f7930f19442bbf52f407b7123fe7 P 6beeb97aa49249eb8aeeaf764cbab2bf: No bootstrap required, opened a new log
W20260709 13:17:10.048573  9326 leader_election.cc:343] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.049052  9402 ts_tablet_manager.cc:1403] T eb93f7930f19442bbf52f407b7123fe7 P 6beeb97aa49249eb8aeeaf764cbab2bf: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.002s
I20260709 13:17:10.051075  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b6746cc1154961b2c27c96e04bbdab" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e" is_pre_election: true
I20260709 13:17:10.051647  9403 raft_consensus.cc:359] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.051862  9289 raft_consensus.cc:2468] T 41b6746cc1154961b2c27c96e04bbdab P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6beeb97aa49249eb8aeeaf764cbab2bf in term 0.
I20260709 13:17:10.052425  9403 raft_consensus.cc:385] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.052817  9403 raft_consensus.cc:740] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b853d87511945de82e91ce1e4e13b16, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.053648  9403 consensus_queue.cc:260] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.055666  9404 tablet_bootstrap.cc:654] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.056432  9403 ts_tablet_manager.cc:1434] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:17:10.058264  9403 tablet_bootstrap.cc:492] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16: Bootstrap starting.
I20260709 13:17:10.059633  9326 leader_election.cc:304] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 810aa394d3b24560a5b4dd2b78c8966e; no voters: 8b853d87511945de82e91ce1e4e13b16
I20260709 13:17:10.061626  9435 leader_election.cc:290] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969)
I20260709 13:17:10.064330  9435 raft_consensus.cc:493] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.065828  9435 raft_consensus.cc:515] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.070360  9435 leader_election.cc:290] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969)
I20260709 13:17:10.077962  9363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f0b2f6fc574e328e072a92f5192c79" candidate_uuid: "8b853d87511945de82e91ce1e4e13b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
I20260709 13:17:10.078096  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b61ab45e369457b8a3824ee01df4030" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e" is_pre_election: true
I20260709 13:17:10.072556  9403 tablet_bootstrap.cc:654] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.074429  9438 raft_consensus.cc:2804] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:10.075003  9408 raft_consensus.cc:697] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 LEADER]: Becoming Leader. State: Replica: 6beeb97aa49249eb8aeeaf764cbab2bf, State: Running, Role: LEADER
I20260709 13:17:10.076049  9213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b61ab45e369457b8a3824ee01df4030" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b853d87511945de82e91ce1e4e13b16" is_pre_election: true
I20260709 13:17:10.079783  9408 consensus_queue.cc:237] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.076558  9178 leader_election.cc:304] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 8b853d87511945de82e91ce1e4e13b16; no voters: 810aa394d3b24560a5b4dd2b78c8966e
I20260709 13:17:10.082052  9431 raft_consensus.cc:2804] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:10.082594  9431 raft_consensus.cc:697] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16 [term 1 LEADER]: Becoming Leader. State: Replica: 8b853d87511945de82e91ce1e4e13b16, State: Running, Role: LEADER
I20260709 13:17:10.082909  9178 leader_election.cc:304] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b853d87511945de82e91ce1e4e13b16; no voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 810aa394d3b24560a5b4dd2b78c8966e
I20260709 13:17:10.083581  9438 raft_consensus.cc:493] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.083454  9431 consensus_queue.cc:237] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.084040  9438 raft_consensus.cc:3060] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.076766  9362 raft_consensus.cc:2468] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810aa394d3b24560a5b4dd2b78c8966e in term 1.
I20260709 13:17:10.087510  9253 leader_election.cc:304] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 810aa394d3b24560a5b4dd2b78c8966e; no voters: 8b853d87511945de82e91ce1e4e13b16
I20260709 13:17:10.087946  9410 raft_consensus.cc:2749] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:10.051945  9402 raft_consensus.cc:359] T eb93f7930f19442bbf52f407b7123fe7 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.088506  9402 raft_consensus.cc:385] T eb93f7930f19442bbf52f407b7123fe7 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.088742  9409 raft_consensus.cc:2804] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:10.088853  9410 raft_consensus.cc:493] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.088891  9402 raft_consensus.cc:740] T eb93f7930f19442bbf52f407b7123fe7 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6beeb97aa49249eb8aeeaf764cbab2bf, State: Initialized, Role: FOLLOWER
W20260709 13:17:10.085323  9326 leader_election.cc:343] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.089545  9410 raft_consensus.cc:515] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.090008  9402 consensus_queue.cc:260] T eb93f7930f19442bbf52f407b7123fe7 P 6beeb97aa49249eb8aeeaf764cbab2bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
W20260709 13:17:10.091355  9326 leader_election.cc:343] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.093268  9326 leader_election.cc:304] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf; no voters: 810aa394d3b24560a5b4dd2b78c8966e, 8b853d87511945de82e91ce1e4e13b16
I20260709 13:17:10.093521  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87554f5c20f4f5cb0a2c7deb51eec5b" candidate_uuid: "8b853d87511945de82e91ce1e4e13b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e" is_pre_election: true
I20260709 13:17:10.094705  9410 leader_election.cc:290] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969), 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:10.095561  9289 raft_consensus.cc:2468] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b853d87511945de82e91ce1e4e13b16 in term 0.
I20260709 13:17:10.097261  9177 leader_election.cc:304] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 810aa394d3b24560a5b4dd2b78c8966e, 8b853d87511945de82e91ce1e4e13b16; no voters: 
I20260709 13:17:10.097563  9440 raft_consensus.cc:2749] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:10.098196  9410 raft_consensus.cc:2804] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:10.098634  9410 raft_consensus.cc:493] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.099005  9410 raft_consensus.cc:3060] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.100271  9402 ts_tablet_manager.cc:1434] T eb93f7930f19442bbf52f407b7123fe7 P 6beeb97aa49249eb8aeeaf764cbab2bf: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 13:17:10.105180  9404 tablet_bootstrap.cc:492] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e: No bootstrap required, opened a new log
I20260709 13:17:10.105883  9402 tablet_bootstrap.cc:492] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf: Bootstrap starting.
I20260709 13:17:10.105846  9404 ts_tablet_manager.cc:1403] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e: Time spent bootstrapping tablet: real 0.058s	user 0.021s	sys 0.024s
I20260709 13:17:10.108457  9362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87554f5c20f4f5cb0a2c7deb51eec5b" candidate_uuid: "8b853d87511945de82e91ce1e4e13b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" is_pre_election: true
W20260709 13:17:10.109915  9178 leader_election.cc:343] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.110034  9404 raft_consensus.cc:359] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.109560  9110 catalog_manager.cc:5697] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "8b853d87511945de82e91ce1e4e13b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:10.112681  9435 raft_consensus.cc:493] T eb93f7930f19442bbf52f407b7123fe7 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.113288  9435 raft_consensus.cc:515] T eb93f7930f19442bbf52f407b7123fe7 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.113453  9438 raft_consensus.cc:515] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.116492  9213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb93f7930f19442bbf52f407b7123fe7" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b853d87511945de82e91ce1e4e13b16" is_pre_election: true
I20260709 13:17:10.115151  9410 raft_consensus.cc:515] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.118438  9438 leader_election.cc:290] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 1 election: Requested vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969)
W20260709 13:17:10.119737  9326 leader_election.cc:343] T eb93f7930f19442bbf52f407b7123fe7 P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.120397  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b6746cc1154961b2c27c96e04bbdab" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
I20260709 13:17:10.120633  9213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b6746cc1154961b2c27c96e04bbdab" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b853d87511945de82e91ce1e4e13b16"
I20260709 13:17:10.121239  9289 raft_consensus.cc:3060] T 41b6746cc1154961b2c27c96e04bbdab P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.121140  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87554f5c20f4f5cb0a2c7deb51eec5b" candidate_uuid: "8b853d87511945de82e91ce1e4e13b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
I20260709 13:17:10.122089  9288 raft_consensus.cc:3060] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:10.122390  9326 leader_election.cc:343] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.122536  9409 raft_consensus.cc:697] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 LEADER]: Becoming Leader. State: Replica: 810aa394d3b24560a5b4dd2b78c8966e, State: Running, Role: LEADER
I20260709 13:17:10.123509  9409 consensus_queue.cc:237] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } } peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } }
I20260709 13:17:10.127177  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb93f7930f19442bbf52f407b7123fe7" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e" is_pre_election: true
W20260709 13:17:10.128873  9326 leader_election.cc:343] T eb93f7930f19442bbf52f407b7123fe7 P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.129347  9326 leader_election.cc:304] T eb93f7930f19442bbf52f407b7123fe7 P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf; no voters: 810aa394d3b24560a5b4dd2b78c8966e, 8b853d87511945de82e91ce1e4e13b16
I20260709 13:17:10.130319  9435 leader_election.cc:290] T eb93f7930f19442bbf52f407b7123fe7 P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969)
I20260709 13:17:10.130221  9438 raft_consensus.cc:2749] T eb93f7930f19442bbf52f407b7123fe7 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:10.130215  9288 raft_consensus.cc:2468] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b853d87511945de82e91ce1e4e13b16 in term 1.
I20260709 13:17:10.131374  9289 raft_consensus.cc:2468] T 41b6746cc1154961b2c27c96e04bbdab P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6beeb97aa49249eb8aeeaf764cbab2bf in term 1.
I20260709 13:17:10.132391  9177 leader_election.cc:304] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 810aa394d3b24560a5b4dd2b78c8966e, 8b853d87511945de82e91ce1e4e13b16; no voters: 
I20260709 13:17:10.132978  9326 leader_election.cc:304] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 810aa394d3b24560a5b4dd2b78c8966e; no voters: 8b853d87511945de82e91ce1e4e13b16
I20260709 13:17:10.134042  9438 raft_consensus.cc:2804] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:10.133126  9404 raft_consensus.cc:385] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.134676  9438 raft_consensus.cc:697] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 LEADER]: Becoming Leader. State: Replica: 6beeb97aa49249eb8aeeaf764cbab2bf, State: Running, Role: LEADER
I20260709 13:17:10.134668  9404 raft_consensus.cc:740] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 810aa394d3b24560a5b4dd2b78c8966e, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.135844  9438 consensus_queue.cc:237] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.135995  9404 consensus_queue.cc:260] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.137645  9109 catalog_manager.cc:5697] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3). New cstate: current_term: 1 leader_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:10.138759  9404 ts_tablet_manager.cc:1434] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:17:10.139847  9404 tablet_bootstrap.cc:492] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e: Bootstrap starting.
I20260709 13:17:10.133298  9431 raft_consensus.cc:2804] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:10.141215  9362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87554f5c20f4f5cb0a2c7deb51eec5b" candidate_uuid: "8b853d87511945de82e91ce1e4e13b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
I20260709 13:17:10.141722  9402 tablet_bootstrap.cc:654] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:10.143065  9178 leader_election.cc:343] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.144186  9431 raft_consensus.cc:697] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [term 1 LEADER]: Becoming Leader. State: Replica: 8b853d87511945de82e91ce1e4e13b16, State: Running, Role: LEADER
I20260709 13:17:10.144901  9410 leader_election.cc:290] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [CANDIDATE]: Term 1 election: Requested vote from peers 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969), 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:10.145216  9431 consensus_queue.cc:237] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.151978  9404 tablet_bootstrap.cc:654] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.156518  9112 catalog_manager.cc:5697] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e reported cstate change: term changed from 0 to 1, leader changed from <none> to 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2). New cstate: current_term: 1 leader_uuid: "810aa394d3b24560a5b4dd2b78c8966e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:10.159642  9403 tablet_bootstrap.cc:492] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16: No bootstrap required, opened a new log
I20260709 13:17:10.160596  9403 ts_tablet_manager.cc:1403] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16: Time spent bootstrapping tablet: real 0.103s	user 0.009s	sys 0.008s
I20260709 13:17:10.168236  9404 tablet_bootstrap.cc:492] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e: No bootstrap required, opened a new log
I20260709 13:17:10.168839  9404 ts_tablet_manager.cc:1403] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e: Time spent bootstrapping tablet: real 0.029s	user 0.006s	sys 0.008s
I20260709 13:17:10.168798  9403 raft_consensus.cc:359] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.172175  9404 raft_consensus.cc:359] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.174700  9404 raft_consensus.cc:385] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.175102  9404 raft_consensus.cc:740] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 810aa394d3b24560a5b4dd2b78c8966e, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.174700  9403 raft_consensus.cc:385] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.176276  9403 raft_consensus.cc:740] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b853d87511945de82e91ce1e4e13b16, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.177341  9403 consensus_queue.cc:260] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.179102  9402 tablet_bootstrap.cc:492] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf: No bootstrap required, opened a new log
I20260709 13:17:10.179639  9402 ts_tablet_manager.cc:1403] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf: Time spent bootstrapping tablet: real 0.074s	user 0.011s	sys 0.000s
I20260709 13:17:10.179523  9403 ts_tablet_manager.cc:1434] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:17:10.180024  9404 consensus_queue.cc:260] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.181828  9403 tablet_bootstrap.cc:492] T 41b6746cc1154961b2c27c96e04bbdab P 8b853d87511945de82e91ce1e4e13b16: Bootstrap starting.
I20260709 13:17:10.182312  9438 raft_consensus.cc:493] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.182910  9404 ts_tablet_manager.cc:1434] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:17:10.182819  9438 raft_consensus.cc:515] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.184020  9404 tablet_bootstrap.cc:492] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e: Bootstrap starting.
I20260709 13:17:10.185119  9438 leader_election.cc:290] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969)
I20260709 13:17:10.186929  9213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc4d66484094db0aae6dfb29587774a" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b853d87511945de82e91ce1e4e13b16" is_pre_election: true
I20260709 13:17:10.187060  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc4d66484094db0aae6dfb29587774a" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e" is_pre_election: true
I20260709 13:17:10.187098  9402 raft_consensus.cc:359] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.187970  9402 raft_consensus.cc:385] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.188265  9402 raft_consensus.cc:740] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6beeb97aa49249eb8aeeaf764cbab2bf, State: Initialized, Role: FOLLOWER
W20260709 13:17:10.188717  9326 leader_election.cc:343] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:10.189493  9326 leader_election.cc:343] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.189167  9402 consensus_queue.cc:260] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.189728  9403 tablet_bootstrap.cc:654] T 41b6746cc1154961b2c27c96e04bbdab P 8b853d87511945de82e91ce1e4e13b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.190016  9326 leader_election.cc:304] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf; no voters: 810aa394d3b24560a5b4dd2b78c8966e, 8b853d87511945de82e91ce1e4e13b16
I20260709 13:17:10.191327  9438 raft_consensus.cc:2749] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:10.191716  9402 ts_tablet_manager.cc:1434] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:17:10.192829  9402 tablet_bootstrap.cc:492] T 7c0c24e4de70467b86659171853fd6de P 6beeb97aa49249eb8aeeaf764cbab2bf: Bootstrap starting.
I20260709 13:17:10.193399  9404 tablet_bootstrap.cc:654] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.199220  9402 tablet_bootstrap.cc:654] T 7c0c24e4de70467b86659171853fd6de P 6beeb97aa49249eb8aeeaf764cbab2bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.212474  9409 raft_consensus.cc:493] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.213420  9409 raft_consensus.cc:515] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.217911  9213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e2a2f0d5754921996f26c015b13e67" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b853d87511945de82e91ce1e4e13b16" is_pre_election: true
I20260709 13:17:10.220741  9362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e2a2f0d5754921996f26c015b13e67" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" is_pre_election: true
I20260709 13:17:10.218819  9409 leader_election.cc:290] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:10.221946  9362 raft_consensus.cc:2393] T a9e2a2f0d5754921996f26c015b13e67 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 810aa394d3b24560a5b4dd2b78c8966e in current term 1: Already voted for candidate 8b853d87511945de82e91ce1e4e13b16 in this term.
I20260709 13:17:10.224973  9404 tablet_bootstrap.cc:492] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e: No bootstrap required, opened a new log
I20260709 13:17:10.224810  9252 leader_election.cc:304] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 810aa394d3b24560a5b4dd2b78c8966e; no voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 8b853d87511945de82e91ce1e4e13b16
I20260709 13:17:10.225662  9404 ts_tablet_manager.cc:1403] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.000s
I20260709 13:17:10.226894  9409 raft_consensus.cc:3060] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.226969  9438 raft_consensus.cc:493] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.227981  9438 raft_consensus.cc:515] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.230485  9438 leader_election.cc:290] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969)
I20260709 13:17:10.232180  9213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87554f5c20f4f5cb0a2c7deb51eec5b" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b853d87511945de82e91ce1e4e13b16" is_pre_election: true
I20260709 13:17:10.232213  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87554f5c20f4f5cb0a2c7deb51eec5b" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e" is_pre_election: true
I20260709 13:17:10.233692  9288 raft_consensus.cc:2393] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6beeb97aa49249eb8aeeaf764cbab2bf in current term 1: Already voted for candidate 8b853d87511945de82e91ce1e4e13b16 in this term.
I20260709 13:17:10.235219  9326 leader_election.cc:304] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf; no voters: 810aa394d3b24560a5b4dd2b78c8966e, 8b853d87511945de82e91ce1e4e13b16
I20260709 13:17:10.236543  9438 raft_consensus.cc:3060] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.239296  9409 raft_consensus.cc:2749] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:10.239470  9109 catalog_manager.cc:5697] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "8b853d87511945de82e91ce1e4e13b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:10.245177  9438 raft_consensus.cc:2749] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:10.249197  9403 tablet_bootstrap.cc:492] T 41b6746cc1154961b2c27c96e04bbdab P 8b853d87511945de82e91ce1e4e13b16: No bootstrap required, opened a new log
I20260709 13:17:10.251561  9403 ts_tablet_manager.cc:1403] T 41b6746cc1154961b2c27c96e04bbdab P 8b853d87511945de82e91ce1e4e13b16: Time spent bootstrapping tablet: real 0.070s	user 0.019s	sys 0.020s
I20260709 13:17:10.253146  9402 tablet_bootstrap.cc:492] T 7c0c24e4de70467b86659171853fd6de P 6beeb97aa49249eb8aeeaf764cbab2bf: No bootstrap required, opened a new log
I20260709 13:17:10.253698  9402 ts_tablet_manager.cc:1403] T 7c0c24e4de70467b86659171853fd6de P 6beeb97aa49249eb8aeeaf764cbab2bf: Time spent bootstrapping tablet: real 0.061s	user 0.027s	sys 0.024s
I20260709 13:17:10.254760  9403 raft_consensus.cc:359] T 41b6746cc1154961b2c27c96e04bbdab P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.255549  9403 raft_consensus.cc:385] T 41b6746cc1154961b2c27c96e04bbdab P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.255860  9403 raft_consensus.cc:740] T 41b6746cc1154961b2c27c96e04bbdab P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b853d87511945de82e91ce1e4e13b16, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.256628  9403 consensus_queue.cc:260] T 41b6746cc1154961b2c27c96e04bbdab P 8b853d87511945de82e91ce1e4e13b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.257119  9110 catalog_manager.cc:5697] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3). New cstate: current_term: 1 leader_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:10.259055  9403 ts_tablet_manager.cc:1434] T 41b6746cc1154961b2c27c96e04bbdab P 8b853d87511945de82e91ce1e4e13b16: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:10.260109  9403 tablet_bootstrap.cc:492] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16: Bootstrap starting.
I20260709 13:17:10.249243  9404 raft_consensus.cc:359] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.261348  9404 raft_consensus.cc:385] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.261619  9404 raft_consensus.cc:740] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 810aa394d3b24560a5b4dd2b78c8966e, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.262378  9404 consensus_queue.cc:260] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.262647  9402 raft_consensus.cc:359] T 7c0c24e4de70467b86659171853fd6de P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.263319  9402 raft_consensus.cc:385] T 7c0c24e4de70467b86659171853fd6de P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.263581  9402 raft_consensus.cc:740] T 7c0c24e4de70467b86659171853fd6de P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6beeb97aa49249eb8aeeaf764cbab2bf, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.264442  9404 ts_tablet_manager.cc:1434] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.001s
I20260709 13:17:10.264392  9402 consensus_queue.cc:260] T 7c0c24e4de70467b86659171853fd6de P 6beeb97aa49249eb8aeeaf764cbab2bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.265482  9404 tablet_bootstrap.cc:492] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e: Bootstrap starting.
I20260709 13:17:10.266559  9402 ts_tablet_manager.cc:1434] T 7c0c24e4de70467b86659171853fd6de P 6beeb97aa49249eb8aeeaf764cbab2bf: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:17:10.276001  9431 raft_consensus.cc:493] T 41b6746cc1154961b2c27c96e04bbdab P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.276649  9431 raft_consensus.cc:515] T 41b6746cc1154961b2c27c96e04bbdab P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.278923  9431 leader_election.cc:290] T 41b6746cc1154961b2c27c96e04bbdab P 8b853d87511945de82e91ce1e4e13b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969), 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:10.279073  9403 tablet_bootstrap.cc:654] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.281010  9404 tablet_bootstrap.cc:654] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.283779  9403 tablet_bootstrap.cc:492] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16: No bootstrap required, opened a new log
I20260709 13:17:10.284322  9403 ts_tablet_manager.cc:1403] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.003s
I20260709 13:17:10.284432  9362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b6746cc1154961b2c27c96e04bbdab" candidate_uuid: "8b853d87511945de82e91ce1e4e13b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" is_pre_election: true
I20260709 13:17:10.285041  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b6746cc1154961b2c27c96e04bbdab" candidate_uuid: "8b853d87511945de82e91ce1e4e13b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e" is_pre_election: true
I20260709 13:17:10.285826  9288 raft_consensus.cc:2393] T 41b6746cc1154961b2c27c96e04bbdab P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b853d87511945de82e91ce1e4e13b16 in current term 1: Already voted for candidate 6beeb97aa49249eb8aeeaf764cbab2bf in this term.
I20260709 13:17:10.286096  9404 tablet_bootstrap.cc:492] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e: No bootstrap required, opened a new log
I20260709 13:17:10.286638  9404 ts_tablet_manager.cc:1403] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e: Time spent bootstrapping tablet: real 0.021s	user 0.003s	sys 0.009s
I20260709 13:17:10.287184  9178 leader_election.cc:304] T 41b6746cc1154961b2c27c96e04bbdab P 8b853d87511945de82e91ce1e4e13b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b853d87511945de82e91ce1e4e13b16; no voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 810aa394d3b24560a5b4dd2b78c8966e
I20260709 13:17:10.287178  9403 raft_consensus.cc:359] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.288005  9403 raft_consensus.cc:385] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.288273  9403 raft_consensus.cc:740] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b853d87511945de82e91ce1e4e13b16, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.289004  9403 consensus_queue.cc:260] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.289422  9431 raft_consensus.cc:3060] T 41b6746cc1154961b2c27c96e04bbdab P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.289603  9404 raft_consensus.cc:359] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.290442  9404 raft_consensus.cc:385] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.290746  9404 raft_consensus.cc:740] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 810aa394d3b24560a5b4dd2b78c8966e, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.291038  9403 ts_tablet_manager.cc:1434] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:10.292052  9403 tablet_bootstrap.cc:492] T 3bc4d66484094db0aae6dfb29587774a P 8b853d87511945de82e91ce1e4e13b16: Bootstrap starting.
I20260709 13:17:10.291756  9404 consensus_queue.cc:260] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.293872  9404 ts_tablet_manager.cc:1434] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:10.294837  9404 tablet_bootstrap.cc:492] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e: Bootstrap starting.
I20260709 13:17:10.297513  9403 tablet_bootstrap.cc:654] T 3bc4d66484094db0aae6dfb29587774a P 8b853d87511945de82e91ce1e4e13b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.303083  9431 raft_consensus.cc:2749] T 41b6746cc1154961b2c27c96e04bbdab P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:10.305971  9404 tablet_bootstrap.cc:654] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.308264  9403 tablet_bootstrap.cc:492] T 3bc4d66484094db0aae6dfb29587774a P 8b853d87511945de82e91ce1e4e13b16: No bootstrap required, opened a new log
I20260709 13:17:10.308802  9403 ts_tablet_manager.cc:1403] T 3bc4d66484094db0aae6dfb29587774a P 8b853d87511945de82e91ce1e4e13b16: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.007s
I20260709 13:17:10.309960  9404 tablet_bootstrap.cc:492] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e: No bootstrap required, opened a new log
I20260709 13:17:10.310380  9404 ts_tablet_manager.cc:1403] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.001s
I20260709 13:17:10.310912  9403 raft_consensus.cc:359] T 3bc4d66484094db0aae6dfb29587774a P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.311443  9403 raft_consensus.cc:385] T 3bc4d66484094db0aae6dfb29587774a P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.311637  9403 raft_consensus.cc:740] T 3bc4d66484094db0aae6dfb29587774a P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b853d87511945de82e91ce1e4e13b16, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.312299  9403 consensus_queue.cc:260] T 3bc4d66484094db0aae6dfb29587774a P 8b853d87511945de82e91ce1e4e13b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.312718  9404 raft_consensus.cc:359] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.313351  9404 raft_consensus.cc:385] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.313602  9404 raft_consensus.cc:740] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 810aa394d3b24560a5b4dd2b78c8966e, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.314041  9403 ts_tablet_manager.cc:1434] T 3bc4d66484094db0aae6dfb29587774a P 8b853d87511945de82e91ce1e4e13b16: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:17:10.314250  9404 consensus_queue.cc:260] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.315155  9403 tablet_bootstrap.cc:492] T faaef8ba24094ff399cbfb39f7894125 P 8b853d87511945de82e91ce1e4e13b16: Bootstrap starting.
I20260709 13:17:10.316318  9404 ts_tablet_manager.cc:1434] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:10.321491  9403 tablet_bootstrap.cc:654] T faaef8ba24094ff399cbfb39f7894125 P 8b853d87511945de82e91ce1e4e13b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.328529  9403 tablet_bootstrap.cc:492] T faaef8ba24094ff399cbfb39f7894125 P 8b853d87511945de82e91ce1e4e13b16: No bootstrap required, opened a new log
I20260709 13:17:10.329061  9403 ts_tablet_manager.cc:1403] T faaef8ba24094ff399cbfb39f7894125 P 8b853d87511945de82e91ce1e4e13b16: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:17:10.330950  9403 raft_consensus.cc:359] T faaef8ba24094ff399cbfb39f7894125 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.331465  9403 raft_consensus.cc:385] T faaef8ba24094ff399cbfb39f7894125 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.331684  9403 raft_consensus.cc:740] T faaef8ba24094ff399cbfb39f7894125 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b853d87511945de82e91ce1e4e13b16, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.332255  9403 consensus_queue.cc:260] T faaef8ba24094ff399cbfb39f7894125 P 8b853d87511945de82e91ce1e4e13b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.333773  9403 ts_tablet_manager.cc:1434] T faaef8ba24094ff399cbfb39f7894125 P 8b853d87511945de82e91ce1e4e13b16: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:17:10.386880  9431 raft_consensus.cc:493] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.387483  9431 raft_consensus.cc:515] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.389047  9410 raft_consensus.cc:493] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.389279  9431 leader_election.cc:290] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969), 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:10.389653  9410 raft_consensus.cc:515] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.390280  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0c24e4de70467b86659171853fd6de" candidate_uuid: "8b853d87511945de82e91ce1e4e13b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e" is_pre_election: true
I20260709 13:17:10.390457  9362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0c24e4de70467b86659171853fd6de" candidate_uuid: "8b853d87511945de82e91ce1e4e13b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" is_pre_election: true
I20260709 13:17:10.390947  9288 raft_consensus.cc:2468] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b853d87511945de82e91ce1e4e13b16 in term 0.
I20260709 13:17:10.391131  9362 raft_consensus.cc:2468] T 7c0c24e4de70467b86659171853fd6de P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b853d87511945de82e91ce1e4e13b16 in term 0.
I20260709 13:17:10.391902  9410 leader_election.cc:290] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969), 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:10.392127  9177 leader_election.cc:304] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 810aa394d3b24560a5b4dd2b78c8966e, 8b853d87511945de82e91ce1e4e13b16; no voters: 
I20260709 13:17:10.392743  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb93f7930f19442bbf52f407b7123fe7" candidate_uuid: "8b853d87511945de82e91ce1e4e13b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e" is_pre_election: true
I20260709 13:17:10.393067  9410 raft_consensus.cc:2804] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:10.393522  9410 raft_consensus.cc:493] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.393389  9288 raft_consensus.cc:2468] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b853d87511945de82e91ce1e4e13b16 in term 0.
I20260709 13:17:10.393301  9362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb93f7930f19442bbf52f407b7123fe7" candidate_uuid: "8b853d87511945de82e91ce1e4e13b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" is_pre_election: true
I20260709 13:17:10.393949  9410 raft_consensus.cc:3060] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.394364  9362 raft_consensus.cc:2468] T eb93f7930f19442bbf52f407b7123fe7 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b853d87511945de82e91ce1e4e13b16 in term 0.
I20260709 13:17:10.394618  9177 leader_election.cc:304] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 810aa394d3b24560a5b4dd2b78c8966e, 8b853d87511945de82e91ce1e4e13b16; no voters: 
I20260709 13:17:10.395525  9431 raft_consensus.cc:2804] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:10.395902  9431 raft_consensus.cc:493] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.396232  9431 raft_consensus.cc:3060] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.401690  9410 raft_consensus.cc:515] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.403599  9431 raft_consensus.cc:515] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.404492  9410 leader_election.cc:290] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16 [CANDIDATE]: Term 1 election: Requested vote from peers 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969), 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:10.405156  9362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0c24e4de70467b86659171853fd6de" candidate_uuid: "8b853d87511945de82e91ce1e4e13b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
I20260709 13:17:10.405504  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0c24e4de70467b86659171853fd6de" candidate_uuid: "8b853d87511945de82e91ce1e4e13b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
I20260709 13:17:10.405810  9362 raft_consensus.cc:3060] T 7c0c24e4de70467b86659171853fd6de P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.406150  9288 raft_consensus.cc:3060] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.406298  9431 leader_election.cc:290] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16 [CANDIDATE]: Term 1 election: Requested vote from peers 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969), 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:10.407172  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb93f7930f19442bbf52f407b7123fe7" candidate_uuid: "8b853d87511945de82e91ce1e4e13b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
I20260709 13:17:10.407805  9289 raft_consensus.cc:3060] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.407810  9363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb93f7930f19442bbf52f407b7123fe7" candidate_uuid: "8b853d87511945de82e91ce1e4e13b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
I20260709 13:17:10.408771  9363 raft_consensus.cc:3060] T eb93f7930f19442bbf52f407b7123fe7 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.414065  9362 raft_consensus.cc:2468] T 7c0c24e4de70467b86659171853fd6de P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b853d87511945de82e91ce1e4e13b16 in term 1.
I20260709 13:17:10.414132  9288 raft_consensus.cc:2468] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b853d87511945de82e91ce1e4e13b16 in term 1.
I20260709 13:17:10.415679  9178 leader_election.cc:304] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 8b853d87511945de82e91ce1e4e13b16; no voters: 
I20260709 13:17:10.416213  9363 raft_consensus.cc:2468] T eb93f7930f19442bbf52f407b7123fe7 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b853d87511945de82e91ce1e4e13b16 in term 1.
I20260709 13:17:10.416657  9431 raft_consensus.cc:2804] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:10.417158  9431 raft_consensus.cc:697] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16 [term 1 LEADER]: Becoming Leader. State: Replica: 8b853d87511945de82e91ce1e4e13b16, State: Running, Role: LEADER
I20260709 13:17:10.417251  9289 raft_consensus.cc:2468] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b853d87511945de82e91ce1e4e13b16 in term 1.
I20260709 13:17:10.417897  9178 leader_election.cc:304] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 8b853d87511945de82e91ce1e4e13b16; no voters: 
I20260709 13:17:10.418071  9431 consensus_queue.cc:237] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.418788  9410 raft_consensus.cc:2804] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:10.419371  9410 raft_consensus.cc:697] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16 [term 1 LEADER]: Becoming Leader. State: Replica: 8b853d87511945de82e91ce1e4e13b16, State: Running, Role: LEADER
I20260709 13:17:10.420127  9410 consensus_queue.cc:237] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.427534  9112 catalog_manager.cc:5697] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "8b853d87511945de82e91ce1e4e13b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:10.440964  9112 catalog_manager.cc:5697] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "8b853d87511945de82e91ce1e4e13b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:10.449086  9409 raft_consensus.cc:493] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.449723  9409 raft_consensus.cc:515] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.451767  9409 leader_election.cc:290] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:10.452702  9213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a49b7ef53144babd52bc66266d5aa1" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b853d87511945de82e91ce1e4e13b16" is_pre_election: true
I20260709 13:17:10.452996  9363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a49b7ef53144babd52bc66266d5aa1" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" is_pre_election: true
I20260709 13:17:10.453486  9213 raft_consensus.cc:2393] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 810aa394d3b24560a5b4dd2b78c8966e in current term 1: Already voted for candidate 6beeb97aa49249eb8aeeaf764cbab2bf in this term.
I20260709 13:17:10.454563  9252 leader_election.cc:304] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 810aa394d3b24560a5b4dd2b78c8966e; no voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 8b853d87511945de82e91ce1e4e13b16
I20260709 13:17:10.455292  9409 raft_consensus.cc:3060] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.460470  9409 raft_consensus.cc:2749] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:10.480962  9410 raft_consensus.cc:493] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.481559  9410 raft_consensus.cc:515] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.483249  9410 leader_election.cc:290] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969), 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:10.484189  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b61ab45e369457b8a3824ee01df4030" candidate_uuid: "8b853d87511945de82e91ce1e4e13b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e" is_pre_election: true
I20260709 13:17:10.484328  9363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b61ab45e369457b8a3824ee01df4030" candidate_uuid: "8b853d87511945de82e91ce1e4e13b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" is_pre_election: true
I20260709 13:17:10.484880  9289 raft_consensus.cc:2468] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b853d87511945de82e91ce1e4e13b16 in term 0.
I20260709 13:17:10.484997  9363 raft_consensus.cc:2468] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b853d87511945de82e91ce1e4e13b16 in term 0.
I20260709 13:17:10.485948  9177 leader_election.cc:304] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 810aa394d3b24560a5b4dd2b78c8966e, 8b853d87511945de82e91ce1e4e13b16; no voters: 
I20260709 13:17:10.486712  9410 raft_consensus.cc:2804] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:10.487048  9410 raft_consensus.cc:493] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.487329  9410 raft_consensus.cc:3060] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.492666  9410 raft_consensus.cc:515] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.494481  9410 leader_election.cc:290] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16 [CANDIDATE]: Term 1 election: Requested vote from peers 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969), 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:10.495434  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b61ab45e369457b8a3824ee01df4030" candidate_uuid: "8b853d87511945de82e91ce1e4e13b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
I20260709 13:17:10.495991  9289 raft_consensus.cc:3060] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.496073  9363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b61ab45e369457b8a3824ee01df4030" candidate_uuid: "8b853d87511945de82e91ce1e4e13b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
I20260709 13:17:10.496814  9363 raft_consensus.cc:3060] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.501595  9289 raft_consensus.cc:2468] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b853d87511945de82e91ce1e4e13b16 in term 1.
I20260709 13:17:10.501870  9363 raft_consensus.cc:2468] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b853d87511945de82e91ce1e4e13b16 in term 1.
I20260709 13:17:10.502822  9177 leader_election.cc:304] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 810aa394d3b24560a5b4dd2b78c8966e, 8b853d87511945de82e91ce1e4e13b16; no voters: 
I20260709 13:17:10.503607  9410 raft_consensus.cc:2804] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:10.504108  9410 raft_consensus.cc:697] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16 [term 1 LEADER]: Becoming Leader. State: Replica: 8b853d87511945de82e91ce1e4e13b16, State: Running, Role: LEADER
I20260709 13:17:10.504927  9410 consensus_queue.cc:237] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.513657  9112 catalog_manager.cc:5697] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "8b853d87511945de82e91ce1e4e13b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:10.539165  9409 raft_consensus.cc:493] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.539703  9409 raft_consensus.cc:515] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.541430  9409 leader_election.cc:290] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:10.542352  9213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faaef8ba24094ff399cbfb39f7894125" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b853d87511945de82e91ce1e4e13b16" is_pre_election: true
I20260709 13:17:10.542534  9363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faaef8ba24094ff399cbfb39f7894125" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" is_pre_election: true
I20260709 13:17:10.543093  9213 raft_consensus.cc:2468] T faaef8ba24094ff399cbfb39f7894125 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 810aa394d3b24560a5b4dd2b78c8966e in term 0.
I20260709 13:17:10.543171  9363 raft_consensus.cc:2468] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 810aa394d3b24560a5b4dd2b78c8966e in term 0.
I20260709 13:17:10.544293  9252 leader_election.cc:304] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 810aa394d3b24560a5b4dd2b78c8966e, 8b853d87511945de82e91ce1e4e13b16; no voters: 
I20260709 13:17:10.545006  9409 raft_consensus.cc:2804] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:10.545353  9409 raft_consensus.cc:493] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.545580  9409 raft_consensus.cc:3060] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.550828  9409 raft_consensus.cc:515] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.552631  9409 leader_election.cc:290] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 1 election: Requested vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:10.553509  9213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faaef8ba24094ff399cbfb39f7894125" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b853d87511945de82e91ce1e4e13b16"
I20260709 13:17:10.553745  9363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faaef8ba24094ff399cbfb39f7894125" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
I20260709 13:17:10.554090  9213 raft_consensus.cc:3060] T faaef8ba24094ff399cbfb39f7894125 P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.554333  9363 raft_consensus.cc:3060] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.559798  9363 raft_consensus.cc:2468] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810aa394d3b24560a5b4dd2b78c8966e in term 1.
I20260709 13:17:10.559957  9213 raft_consensus.cc:2468] T faaef8ba24094ff399cbfb39f7894125 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810aa394d3b24560a5b4dd2b78c8966e in term 1.
I20260709 13:17:10.560962  9253 leader_election.cc:304] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 810aa394d3b24560a5b4dd2b78c8966e; no voters: 
I20260709 13:17:10.561842  9409 raft_consensus.cc:2804] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:10.562327  9409 raft_consensus.cc:697] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 LEADER]: Becoming Leader. State: Replica: 810aa394d3b24560a5b4dd2b78c8966e, State: Running, Role: LEADER
I20260709 13:17:10.563037  9409 consensus_queue.cc:237] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.570802  9112 catalog_manager.cc:5697] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e reported cstate change: term changed from 0 to 1, leader changed from <none> to 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2). New cstate: current_term: 1 leader_uuid: "810aa394d3b24560a5b4dd2b78c8966e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:10.580575  9438 consensus_queue.cc:1048] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:10.588608  9435 consensus_queue.cc:1048] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:10.595604  9435 consensus_queue.cc:1048] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:10.610479  9442 consensus_queue.cc:1048] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:10.620971  9410 consensus_queue.cc:1048] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:10.623157  9438 consensus_queue.cc:1048] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:10.701498  9431 consensus_queue.cc:1048] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:10.705155  9444 consensus_queue.cc:1048] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:10.709183  9445 consensus_queue.cc:1048] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:10.749517  9409 raft_consensus.cc:493] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.750440  9409 raft_consensus.cc:515] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.753883  9409 leader_election.cc:290] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:10.757330  9214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc4d66484094db0aae6dfb29587774a" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b853d87511945de82e91ce1e4e13b16" is_pre_election: true
I20260709 13:17:10.759316  9214 raft_consensus.cc:2468] T 3bc4d66484094db0aae6dfb29587774a P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 810aa394d3b24560a5b4dd2b78c8966e in term 0.
I20260709 13:17:10.760844  9409 consensus_queue.cc:1048] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:10.761533  9252 leader_election.cc:304] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 810aa394d3b24560a5b4dd2b78c8966e, 8b853d87511945de82e91ce1e4e13b16; no voters: 
I20260709 13:17:10.762876  9409 raft_consensus.cc:2804] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:10.763289  9409 raft_consensus.cc:493] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.763908  9409 raft_consensus.cc:3060] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.765082  9362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc4d66484094db0aae6dfb29587774a" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" is_pre_election: true
I20260709 13:17:10.766638  9362 raft_consensus.cc:2468] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 810aa394d3b24560a5b4dd2b78c8966e in term 0.
I20260709 13:17:10.779822  9409 raft_consensus.cc:515] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.783653  9213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc4d66484094db0aae6dfb29587774a" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b853d87511945de82e91ce1e4e13b16"
I20260709 13:17:10.784418  9213 raft_consensus.cc:3060] T 3bc4d66484094db0aae6dfb29587774a P 8b853d87511945de82e91ce1e4e13b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.797683  9409 leader_election.cc:290] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 1 election: Requested vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:10.797923  9362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc4d66484094db0aae6dfb29587774a" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
I20260709 13:17:10.798142  9213 raft_consensus.cc:2468] T 3bc4d66484094db0aae6dfb29587774a P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810aa394d3b24560a5b4dd2b78c8966e in term 1.
I20260709 13:17:10.799037  9362 raft_consensus.cc:3060] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.799913  9252 leader_election.cc:304] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 810aa394d3b24560a5b4dd2b78c8966e, 8b853d87511945de82e91ce1e4e13b16; no voters: 
I20260709 13:17:10.800973  9409 raft_consensus.cc:2804] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:10.801695  9409 raft_consensus.cc:697] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e [term 1 LEADER]: Becoming Leader. State: Replica: 810aa394d3b24560a5b4dd2b78c8966e, State: Running, Role: LEADER
I20260709 13:17:10.803541  9409 consensus_queue.cc:237] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:10.808472  9362 raft_consensus.cc:2468] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810aa394d3b24560a5b4dd2b78c8966e in term 1.
I20260709 13:17:10.816653  9109 catalog_manager.cc:5697] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e reported cstate change: term changed from 0 to 1, leader changed from <none> to 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2). New cstate: current_term: 1 leader_uuid: "810aa394d3b24560a5b4dd2b78c8966e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:10.821826  9160 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:10.838860 30972 ts_manager.cc:295] Set tserver state for 8b853d87511945de82e91ce1e4e13b16 to MAINTENANCE_MODE
I20260709 13:17:10.839903 30972 tablet_server.cc:179] TabletServer@127.30.63.1:0 shutting down...
I20260709 13:17:10.880201 30972 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:10.881165 30972 tablet_replica.cc:333] T faaef8ba24094ff399cbfb39f7894125 P 8b853d87511945de82e91ce1e4e13b16: stopping tablet replica
I20260709 13:17:10.881968 30972 raft_consensus.cc:2243] T faaef8ba24094ff399cbfb39f7894125 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:10.882688 30972 raft_consensus.cc:2272] T faaef8ba24094ff399cbfb39f7894125 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:10.885903 30972 tablet_replica.cc:333] T 3bc4d66484094db0aae6dfb29587774a P 8b853d87511945de82e91ce1e4e13b16: stopping tablet replica
I20260709 13:17:10.886607 30972 raft_consensus.cc:2243] T 3bc4d66484094db0aae6dfb29587774a P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:10.887115 30972 raft_consensus.cc:2272] T 3bc4d66484094db0aae6dfb29587774a P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:10.889849 30972 tablet_replica.cc:333] T 41b6746cc1154961b2c27c96e04bbdab P 8b853d87511945de82e91ce1e4e13b16: stopping tablet replica
I20260709 13:17:10.890504 30972 raft_consensus.cc:2243] T 41b6746cc1154961b2c27c96e04bbdab P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:10.891062 30972 raft_consensus.cc:2272] T 41b6746cc1154961b2c27c96e04bbdab P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:10.894513 30972 tablet_replica.cc:333] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16: stopping tablet replica
I20260709 13:17:10.895270 30972 raft_consensus.cc:2243] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:10.896170 30972 pending_rounds.cc:70] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16: Trying to abort 1 pending ops.
I20260709 13:17:10.896371 30972 pending_rounds.cc:77] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305638012601675776 op_type: NO_OP noop_request { }
I20260709 13:17:10.896757 30972 raft_consensus.cc:2889] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:17:10.897053 30972 raft_consensus.cc:2272] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:10.900390 30972 tablet_replica.cc:333] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16: stopping tablet replica
I20260709 13:17:10.901290 30972 raft_consensus.cc:2243] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:10.902220 30972 raft_consensus.cc:2272] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:10.905311 30972 tablet_replica.cc:333] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16: stopping tablet replica
I20260709 13:17:10.905936 30972 raft_consensus.cc:2243] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:10.906391 30972 raft_consensus.cc:2272] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:10.909390 30972 tablet_replica.cc:333] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16: stopping tablet replica
I20260709 13:17:10.910001 30972 raft_consensus.cc:2243] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:10.910830 30972 pending_rounds.cc:70] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16: Trying to abort 1 pending ops.
I20260709 13:17:10.911018 30972 pending_rounds.cc:77] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305638012957081600 op_type: NO_OP noop_request { }
I20260709 13:17:10.911281 30972 raft_consensus.cc:2889] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:17:10.911573 30972 raft_consensus.cc:2272] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:10.914831 30972 tablet_replica.cc:333] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16: stopping tablet replica
I20260709 13:17:10.915426 30972 raft_consensus.cc:2243] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:10.915944 30972 raft_consensus.cc:2272] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:10.919605 30972 tablet_replica.cc:333] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16: stopping tablet replica
I20260709 13:17:10.920148 30972 raft_consensus.cc:2243] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:10.921070 30972 pending_rounds.cc:70] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16: Trying to abort 1 pending ops.
I20260709 13:17:10.921275 30972 pending_rounds.cc:77] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305638012610789376 op_type: NO_OP noop_request { }
I20260709 13:17:10.921576 30972 raft_consensus.cc:2889] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:17:10.921875 30972 raft_consensus.cc:2272] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:10.924485 30972 tablet_replica.cc:333] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16: stopping tablet replica
I20260709 13:17:10.925073 30972 raft_consensus.cc:2243] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:10.925895 30972 raft_consensus.cc:2272] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:10.968159 30972 tablet_server.cc:196] TabletServer@127.30.63.1:0 shutdown complete.
I20260709 13:17:10.973233  9409 consensus_queue.cc:1048] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:17:11.001153  9252 consensus_peers.cc:597] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e -> Peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Couldn't send request to peer 8b853d87511945de82e91ce1e4e13b16. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:11.072256  9326 consensus_peers.cc:597] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf -> Peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Couldn't send request to peer 8b853d87511945de82e91ce1e4e13b16. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:11.161715  9326 consensus_peers.cc:597] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf -> Peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Couldn't send request to peer 8b853d87511945de82e91ce1e4e13b16. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:11.196128  9252 consensus_peers.cc:597] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e -> Peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Couldn't send request to peer 8b853d87511945de82e91ce1e4e13b16. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:11.265286  9409 consensus_queue.cc:1048] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:11.278887  9252 consensus_peers.cc:597] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e -> Peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Couldn't send request to peer 8b853d87511945de82e91ce1e4e13b16. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:11.396226  9252 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111) [suppressed 175 similar messages]
W20260709 13:17:11.823012  9160 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:17:11.961208  9445 raft_consensus.cc:493] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.962031  9445 raft_consensus.cc:515] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:11.964025  9445 leader_election.cc:290] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:11.965245  9362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb93f7930f19442bbf52f407b7123fe7" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" is_pre_election: true
I20260709 13:17:11.965968  9362 raft_consensus.cc:2468] T eb93f7930f19442bbf52f407b7123fe7 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 810aa394d3b24560a5b4dd2b78c8966e in term 1.
I20260709 13:17:11.967306  9253 leader_election.cc:304] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 810aa394d3b24560a5b4dd2b78c8966e; no voters: 
I20260709 13:17:11.968169  9445 raft_consensus.cc:2804] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:17:11.968251  9252 leader_election.cc:336] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111)
I20260709 13:17:11.968600  9445 raft_consensus.cc:493] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.969094  9445 raft_consensus.cc:3060] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:11.976019  9445 raft_consensus.cc:515] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:11.977924  9445 leader_election.cc:290] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 election: Requested vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:11.979111  9362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb93f7930f19442bbf52f407b7123fe7" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
I20260709 13:17:11.979761  9362 raft_consensus.cc:3060] T eb93f7930f19442bbf52f407b7123fe7 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:11.982122  9252 leader_election.cc:336] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111)
I20260709 13:17:11.986043  9362 raft_consensus.cc:2468] T eb93f7930f19442bbf52f407b7123fe7 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810aa394d3b24560a5b4dd2b78c8966e in term 2.
I20260709 13:17:11.987373  9253 leader_election.cc:304] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 810aa394d3b24560a5b4dd2b78c8966e; no voters: 8b853d87511945de82e91ce1e4e13b16
I20260709 13:17:11.988121  9445 raft_consensus.cc:2804] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:11.988701  9445 raft_consensus.cc:697] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 LEADER]: Becoming Leader. State: Replica: 810aa394d3b24560a5b4dd2b78c8966e, State: Running, Role: LEADER
I20260709 13:17:11.989400  9445 consensus_queue.cc:237] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:11.997123  9109 catalog_manager.cc:5697] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e reported cstate change: term changed from 1 to 2, leader changed from 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1) to 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2). New cstate: current_term: 2 leader_uuid: "810aa394d3b24560a5b4dd2b78c8966e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:12.147868  9445 raft_consensus.cc:493] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.148384  9445 raft_consensus.cc:515] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:12.150151  9445 leader_election.cc:290] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:12.151399  9362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0c24e4de70467b86659171853fd6de" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" is_pre_election: true
I20260709 13:17:12.152208  9362 raft_consensus.cc:2468] T 7c0c24e4de70467b86659171853fd6de P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 810aa394d3b24560a5b4dd2b78c8966e in term 1.
I20260709 13:17:12.153211  9253 leader_election.cc:304] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 810aa394d3b24560a5b4dd2b78c8966e; no voters: 
I20260709 13:17:12.153924  9445 raft_consensus.cc:2804] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:17:12.154096  9252 leader_election.cc:336] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111)
I20260709 13:17:12.154299  9445 raft_consensus.cc:493] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.154676  9445 raft_consensus.cc:3060] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:12.160145  9445 raft_consensus.cc:515] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:12.161793  9445 leader_election.cc:290] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 election: Requested vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:12.163100  9362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0c24e4de70467b86659171853fd6de" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
I20260709 13:17:12.163882  9362 raft_consensus.cc:3060] T 7c0c24e4de70467b86659171853fd6de P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:12.168007  9252 leader_election.cc:336] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111)
I20260709 13:17:12.175450  9362 raft_consensus.cc:2468] T 7c0c24e4de70467b86659171853fd6de P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810aa394d3b24560a5b4dd2b78c8966e in term 2.
I20260709 13:17:12.176836  9253 leader_election.cc:304] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 810aa394d3b24560a5b4dd2b78c8966e; no voters: 8b853d87511945de82e91ce1e4e13b16
I20260709 13:17:12.177587  9445 raft_consensus.cc:2804] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:12.178081  9445 raft_consensus.cc:697] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [term 2 LEADER]: Becoming Leader. State: Replica: 810aa394d3b24560a5b4dd2b78c8966e, State: Running, Role: LEADER
I20260709 13:17:12.179004  9445 consensus_queue.cc:237] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:12.186857  9109 catalog_manager.cc:5697] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e reported cstate change: term changed from 1 to 2, leader changed from 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1) to 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2). New cstate: current_term: 2 leader_uuid: "810aa394d3b24560a5b4dd2b78c8966e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:12.192378  9491 raft_consensus.cc:493] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b853d87511945de82e91ce1e4e13b16)
I20260709 13:17:12.193069  9491 raft_consensus.cc:515] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:12.195712  9491 leader_election.cc:290] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969)
I20260709 13:17:12.197753  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87554f5c20f4f5cb0a2c7deb51eec5b" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e" is_pre_election: true
W20260709 13:17:12.200423  9326 leader_election.cc:336] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111)
I20260709 13:17:12.201033  9326 leader_election.cc:304] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf; no voters: 810aa394d3b24560a5b4dd2b78c8966e, 8b853d87511945de82e91ce1e4e13b16
I20260709 13:17:12.201776  9491 raft_consensus.cc:2749] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:12.209491  9445 raft_consensus.cc:493] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b853d87511945de82e91ce1e4e13b16)
I20260709 13:17:12.210122  9445 raft_consensus.cc:515] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:12.212096  9445 leader_election.cc:290] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:12.213238  9362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87554f5c20f4f5cb0a2c7deb51eec5b" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" is_pre_election: true
I20260709 13:17:12.213843  9362 raft_consensus.cc:2468] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 810aa394d3b24560a5b4dd2b78c8966e in term 1.
I20260709 13:17:12.214792  9253 leader_election.cc:304] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 810aa394d3b24560a5b4dd2b78c8966e; no voters: 
I20260709 13:17:12.215495  9445 raft_consensus.cc:2804] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:12.215921  9445 raft_consensus.cc:493] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8b853d87511945de82e91ce1e4e13b16)
W20260709 13:17:12.216369  9252 leader_election.cc:336] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111)
I20260709 13:17:12.216367  9445 raft_consensus.cc:3060] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:12.217824  9483 raft_consensus.cc:493] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b853d87511945de82e91ce1e4e13b16)
I20260709 13:17:12.218420  9483 raft_consensus.cc:515] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:12.219554  9491 raft_consensus.cc:493] T a9e2a2f0d5754921996f26c015b13e67 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b853d87511945de82e91ce1e4e13b16)
I20260709 13:17:12.220065  9491 raft_consensus.cc:515] T a9e2a2f0d5754921996f26c015b13e67 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:12.221050  9483 leader_election.cc:290] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:12.222162  9491 leader_election.cc:290] T a9e2a2f0d5754921996f26c015b13e67 P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969)
I20260709 13:17:12.222329  9362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e2a2f0d5754921996f26c015b13e67" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" is_pre_election: true
I20260709 13:17:12.223001  9362 raft_consensus.cc:2468] T a9e2a2f0d5754921996f26c015b13e67 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 810aa394d3b24560a5b4dd2b78c8966e in term 1.
I20260709 13:17:12.224464  9253 leader_election.cc:304] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 810aa394d3b24560a5b4dd2b78c8966e; no voters: 
I20260709 13:17:12.225366  9483 raft_consensus.cc:2804] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:12.225733  9483 raft_consensus.cc:493] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8b853d87511945de82e91ce1e4e13b16)
I20260709 13:17:12.226099  9483 raft_consensus.cc:3060] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:12.227108  9326 leader_election.cc:336] T a9e2a2f0d5754921996f26c015b13e67 P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111)
W20260709 13:17:12.228169  9252 leader_election.cc:336] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111)
I20260709 13:17:12.228392  9445 raft_consensus.cc:515] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:12.230744  9445 leader_election.cc:290] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 election: Requested vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:12.233299  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e2a2f0d5754921996f26c015b13e67" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e" is_pre_election: true
I20260709 13:17:12.233834  9483 raft_consensus.cc:515] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:12.234153  9362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87554f5c20f4f5cb0a2c7deb51eec5b" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
I20260709 13:17:12.234849  9362 raft_consensus.cc:3060] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:12.235160  9289 raft_consensus.cc:2393] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6beeb97aa49249eb8aeeaf764cbab2bf in current term 2: Already voted for candidate 810aa394d3b24560a5b4dd2b78c8966e in this term.
W20260709 13:17:12.235478  9252 leader_election.cc:336] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111)
I20260709 13:17:12.236331  9483 leader_election.cc:290] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 election: Requested vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:12.237741  9326 leader_election.cc:304] T a9e2a2f0d5754921996f26c015b13e67 P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf; no voters: 810aa394d3b24560a5b4dd2b78c8966e, 8b853d87511945de82e91ce1e4e13b16
I20260709 13:17:12.238986  9491 raft_consensus.cc:3060] T a9e2a2f0d5754921996f26c015b13e67 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:12.239105  9363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e2a2f0d5754921996f26c015b13e67" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
W20260709 13:17:12.241954  9252 leader_election.cc:336] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111)
I20260709 13:17:12.245831  9362 raft_consensus.cc:2468] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810aa394d3b24560a5b4dd2b78c8966e in term 2.
I20260709 13:17:12.247280  9253 leader_election.cc:304] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 810aa394d3b24560a5b4dd2b78c8966e; no voters: 8b853d87511945de82e91ce1e4e13b16
I20260709 13:17:12.248258  9483 raft_consensus.cc:2804] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:12.248785  9483 raft_consensus.cc:697] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [term 2 LEADER]: Becoming Leader. State: Replica: 810aa394d3b24560a5b4dd2b78c8966e, State: Running, Role: LEADER
I20260709 13:17:12.249204  9491 raft_consensus.cc:2749] T a9e2a2f0d5754921996f26c015b13e67 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:12.249837  9483 consensus_queue.cc:237] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:12.257416  9483 raft_consensus.cc:493] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.258404  9363 raft_consensus.cc:2468] T a9e2a2f0d5754921996f26c015b13e67 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810aa394d3b24560a5b4dd2b78c8966e in term 2.
I20260709 13:17:12.258054  9483 raft_consensus.cc:515] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:12.258059  9109 catalog_manager.cc:5697] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e reported cstate change: term changed from 1 to 2, leader changed from 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1) to 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2). New cstate: current_term: 2 leader_uuid: "810aa394d3b24560a5b4dd2b78c8966e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:12.260474  9253 leader_election.cc:304] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 810aa394d3b24560a5b4dd2b78c8966e; no voters: 8b853d87511945de82e91ce1e4e13b16
I20260709 13:17:12.261322  9445 raft_consensus.cc:2804] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:12.263149  9445 raft_consensus.cc:697] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 LEADER]: Becoming Leader. State: Replica: 810aa394d3b24560a5b4dd2b78c8966e, State: Running, Role: LEADER
I20260709 13:17:12.264083  9445 consensus_queue.cc:237] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:12.264556  9363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b61ab45e369457b8a3824ee01df4030" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" is_pre_election: true
I20260709 13:17:12.265405  9363 raft_consensus.cc:2468] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 810aa394d3b24560a5b4dd2b78c8966e in term 1.
W20260709 13:17:12.268850  9252 leader_election.cc:336] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111)
I20260709 13:17:12.269690  9253 leader_election.cc:304] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 810aa394d3b24560a5b4dd2b78c8966e; no voters: 8b853d87511945de82e91ce1e4e13b16
I20260709 13:17:12.261015  9483 leader_election.cc:290] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:12.270538  9445 raft_consensus.cc:2804] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:12.271127  9445 raft_consensus.cc:493] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.271443  9445 raft_consensus.cc:3060] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:12.276207  9109 catalog_manager.cc:5697] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e reported cstate change: term changed from 1 to 2, leader changed from 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1) to 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2). New cstate: current_term: 2 leader_uuid: "810aa394d3b24560a5b4dd2b78c8966e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:12.278859  9445 raft_consensus.cc:515] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:12.280959  9445 leader_election.cc:290] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 election: Requested vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:12.282759  9363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b61ab45e369457b8a3824ee01df4030" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
I20260709 13:17:12.283375  9363 raft_consensus.cc:3060] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:12.285090  9252 leader_election.cc:336] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111)
I20260709 13:17:12.289734  9363 raft_consensus.cc:2468] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810aa394d3b24560a5b4dd2b78c8966e in term 2.
I20260709 13:17:12.290895  9253 leader_election.cc:304] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 810aa394d3b24560a5b4dd2b78c8966e; no voters: 8b853d87511945de82e91ce1e4e13b16
I20260709 13:17:12.291594  9445 raft_consensus.cc:2804] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:12.292111  9445 raft_consensus.cc:697] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 LEADER]: Becoming Leader. State: Replica: 810aa394d3b24560a5b4dd2b78c8966e, State: Running, Role: LEADER
I20260709 13:17:12.292989  9445 consensus_queue.cc:237] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:12.299983  9109 catalog_manager.cc:5697] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e reported cstate change: term changed from 1 to 2, leader changed from 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1) to 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2). New cstate: current_term: 2 leader_uuid: "810aa394d3b24560a5b4dd2b78c8966e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:12.376241  9363 raft_consensus.cc:1275] T eb93f7930f19442bbf52f407b7123fe7 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Refusing update from remote peer 810aa394d3b24560a5b4dd2b78c8966e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:17:12.377637  9445 consensus_queue.cc:1048] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:12.393595  9252 consensus_peers.cc:597] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e -> Peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Couldn't send request to peer 8b853d87511945de82e91ce1e4e13b16. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:12.640944  9363 raft_consensus.cc:1275] T 7c0c24e4de70467b86659171853fd6de P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Refusing update from remote peer 810aa394d3b24560a5b4dd2b78c8966e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:17:12.642475  9445 consensus_queue.cc:1048] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:12.659576  9252 consensus_peers.cc:597] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e -> Peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Couldn't send request to peer 8b853d87511945de82e91ce1e4e13b16. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:12.685072  9252 consensus_peers.cc:597] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e -> Peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Couldn't send request to peer 8b853d87511945de82e91ce1e4e13b16. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:12.692240  9363 raft_consensus.cc:1275] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Refusing update from remote peer 810aa394d3b24560a5b4dd2b78c8966e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:17:12.693691  9445 consensus_queue.cc:1048] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:12.707365  9252 consensus_peers.cc:597] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e -> Peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Couldn't send request to peer 8b853d87511945de82e91ce1e4e13b16. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:12.726398  9252 consensus_peers.cc:597] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e -> Peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Couldn't send request to peer 8b853d87511945de82e91ce1e4e13b16. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:12.731412  9363 raft_consensus.cc:1275] T a9e2a2f0d5754921996f26c015b13e67 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Refusing update from remote peer 810aa394d3b24560a5b4dd2b78c8966e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:12.732966  9483 consensus_queue.cc:1048] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:12.748238  9363 raft_consensus.cc:1275] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Refusing update from remote peer 810aa394d3b24560a5b4dd2b78c8966e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:12.750097  9445 consensus_queue.cc:1048] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:12.824301  9160 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:17:13.128036  9252 consensus_peers.cc:597] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e -> Peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Couldn't send request to peer 8b853d87511945de82e91ce1e4e13b16. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:13.404315  9252 consensus_peers.cc:597] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e -> Peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Couldn't send request to peer 8b853d87511945de82e91ce1e4e13b16. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:13.492043  9326 consensus_peers.cc:597] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf -> Peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Couldn't send request to peer 8b853d87511945de82e91ce1e4e13b16. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:13.530920  9252 consensus_peers.cc:597] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e -> Peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Couldn't send request to peer 8b853d87511945de82e91ce1e4e13b16. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:13.757377  9326 consensus_peers.cc:597] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf -> Peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Couldn't send request to peer 8b853d87511945de82e91ce1e4e13b16. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:13.825353  9160 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:17:14.826457  9160 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:17:14.885263  9252 consensus_peers.cc:597] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e -> Peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Couldn't send request to peer 8b853d87511945de82e91ce1e4e13b16. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:15.121649  9252 consensus_peers.cc:597] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e -> Peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Couldn't send request to peer 8b853d87511945de82e91ce1e4e13b16. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:15.150342  9252 consensus_peers.cc:597] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e -> Peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Couldn't send request to peer 8b853d87511945de82e91ce1e4e13b16. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:15.395545  9252 consensus_peers.cc:597] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e -> Peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Couldn't send request to peer 8b853d87511945de82e91ce1e4e13b16. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:15.448148  9252 consensus_peers.cc:597] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e -> Peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Couldn't send request to peer 8b853d87511945de82e91ce1e4e13b16. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:15.509332  9252 consensus_peers.cc:597] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e -> Peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Couldn't send request to peer 8b853d87511945de82e91ce1e4e13b16. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:15.827458  9160 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:17:15.943778  9326 consensus_peers.cc:597] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf -> Peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Couldn't send request to peer 8b853d87511945de82e91ce1e4e13b16. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:15.947592  9252 consensus_peers.cc:597] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e -> Peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Couldn't send request to peer 8b853d87511945de82e91ce1e4e13b16. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:17:16.014895 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:16.021947  9514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:16.022730  9515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:16.025761  9517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:16.027057 30972 server_base.cc:1061] running on GCE node
I20260709 13:17:16.029278 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:16.029552 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:16.029809 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783603036029788 us; error 0 us; skew 500 ppm
I20260709 13:17:16.030633 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:16.034670 30972 webserver.cc:533] Webserver started at http://127.30.63.1:43243/ using document root <none> and password file <none>
I20260709 13:17:16.035193 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:16.035372 30972 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:17:16.040031 30972 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.000s	sys 0.005s
I20260709 13:17:16.044414  9522 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:16.045243 30972 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:17:16.045605 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602730526113-30972-0/minicluster-data/ts-0-root
uuid: "8b853d87511945de82e91ce1e4e13b16"
format_stamp: "Formatted at 2026-07-09 13:17:08 on dist-test-slave-c08m"
I20260709 13:17:16.046006 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602730526113-30972-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602730526113-30972-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602730526113-30972-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:16.068064 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:16.069589 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:16.071317 30972 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:16.075726  9529 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:17:16.128351  9252 consensus_peers.cc:597] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e -> Peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Couldn't send request to peer 8b853d87511945de82e91ce1e4e13b16. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:17:16.133319 30972 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:17:16.133698 30972 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.059s	user 0.002s	sys 0.002s
I20260709 13:17:16.134142 30972 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:17:16.139555  9529 tablet_bootstrap.cc:492] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16: Bootstrap starting.
W20260709 13:17:16.154011  9326 consensus_peers.cc:597] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf -> Peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Couldn't send request to peer 8b853d87511945de82e91ce1e4e13b16. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:17:16.159659  9529 tablet_bootstrap.cc:492] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:16.160682  9529 tablet_bootstrap.cc:492] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16: Bootstrap complete.
I20260709 13:17:16.161317  9529 ts_tablet_manager.cc:1403] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.008s
I20260709 13:17:16.163687  9529 raft_consensus.cc:359] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:16.164286  9529 raft_consensus.cc:740] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b853d87511945de82e91ce1e4e13b16, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.165117  9529 consensus_queue.cc:260] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:16.168358  9529 ts_tablet_manager.cc:1434] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:16.169437  9529 tablet_bootstrap.cc:492] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16: Bootstrap starting.
I20260709 13:17:16.184540 30972 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:17:16.184998 30972 ts_tablet_manager.cc:595] Time spent register tablets: real 0.051s	user 0.051s	sys 0.000s
I20260709 13:17:16.186312  9529 tablet_bootstrap.cc:492] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:17:16.187363  9529 tablet_bootstrap.cc:492] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16: Bootstrap complete.
I20260709 13:17:16.188268  9529 ts_tablet_manager.cc:1403] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:17:16.191797  9529 raft_consensus.cc:359] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:16.192700  9529 raft_consensus.cc:740] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b853d87511945de82e91ce1e4e13b16, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.193496  9529 consensus_queue.cc:260] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:16.195940  9529 ts_tablet_manager.cc:1434] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:17:16.197418  9529 tablet_bootstrap.cc:492] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16: Bootstrap starting.
I20260709 13:17:16.213742  9529 tablet_bootstrap.cc:492] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:16.214632  9529 tablet_bootstrap.cc:492] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16: Bootstrap complete.
I20260709 13:17:16.215281  9529 ts_tablet_manager.cc:1403] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 13:17:16.218421  9529 raft_consensus.cc:359] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:16.219249  9529 raft_consensus.cc:740] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b853d87511945de82e91ce1e4e13b16, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.220225  9529 consensus_queue.cc:260] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:16.222113  9529 ts_tablet_manager.cc:1434] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:17:16.222790  9529 tablet_bootstrap.cc:492] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16: Bootstrap starting.
I20260709 13:17:16.234987  9529 tablet_bootstrap.cc:492] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:16.235937  9529 tablet_bootstrap.cc:492] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16: Bootstrap complete.
I20260709 13:17:16.236497  9529 ts_tablet_manager.cc:1403] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:17:16.238656  9529 raft_consensus.cc:359] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:16.239176  9529 raft_consensus.cc:740] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b853d87511945de82e91ce1e4e13b16, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.239954  9529 consensus_queue.cc:260] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:16.241689  9529 ts_tablet_manager.cc:1434] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:17:16.242378  9529 tablet_bootstrap.cc:492] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16: Bootstrap starting.
I20260709 13:17:16.250146 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.1:34715
I20260709 13:17:16.250259  9590 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.1:34715 every 8 connection(s)
I20260709 13:17:16.255546  9529 tablet_bootstrap.cc:492] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:16.256701  9529 tablet_bootstrap.cc:492] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16: Bootstrap complete.
I20260709 13:17:16.257472  9529 ts_tablet_manager.cc:1403] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.003s
I20260709 13:17:16.255095 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:16.260898  9529 raft_consensus.cc:359] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } } peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } }
I20260709 13:17:16.261906  9529 raft_consensus.cc:740] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b853d87511945de82e91ce1e4e13b16, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.262885  9529 consensus_queue.cc:260] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } } peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } }
I20260709 13:17:16.265503  9529 ts_tablet_manager.cc:1434] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:17:16.266284  9529 tablet_bootstrap.cc:492] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16: Bootstrap starting.
I20260709 13:17:16.280522  9529 tablet_bootstrap.cc:492] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:17:16.280994  9592 heartbeater.cc:344] Connected to a master server at 127.30.63.62:40839
I20260709 13:17:16.281473  9592 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:16.281574  9529 tablet_bootstrap.cc:492] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16: Bootstrap complete.
I20260709 13:17:16.282235  9529 ts_tablet_manager.cc:1403] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.003s
I20260709 13:17:16.282398  9592 heartbeater.cc:507] Master 127.30.63.62:40839 requested a full tablet report, sending...
I20260709 13:17:16.284590  9529 raft_consensus.cc:359] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:16.285481  9529 raft_consensus.cc:740] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b853d87511945de82e91ce1e4e13b16, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.286329  9529 consensus_queue.cc:260] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:16.287002  9289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bc4d66484094db0aae6dfb29587774a"
dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
mode: GRACEFUL
new_leader_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
 from {username='slave'} at 127.0.0.1:43762
I20260709 13:17:16.287832  9289 raft_consensus.cc:606] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e [term 1 LEADER]: Received request to transfer leadership to TS 6beeb97aa49249eb8aeeaf764cbab2bf
I20260709 13:17:16.288631  9529 ts_tablet_manager.cc:1434] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:17:16.289357  9109 ts_manager.cc:194] Re-registered known tserver with Master: 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715)
I20260709 13:17:16.289533  9529 tablet_bootstrap.cc:492] T 41b6746cc1154961b2c27c96e04bbdab P 8b853d87511945de82e91ce1e4e13b16: Bootstrap starting.
I20260709 13:17:16.290880  9289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a87554f5c20f4f5cb0a2c7deb51eec5b"
dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
mode: GRACEFUL
new_leader_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
 from {username='slave'} at 127.0.0.1:43762
I20260709 13:17:16.291539  9289 raft_consensus.cc:606] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [term 2 LEADER]: Received request to transfer leadership to TS 6beeb97aa49249eb8aeeaf764cbab2bf
I20260709 13:17:16.294418  9289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8f0b2f6fc574e328e072a92f5192c79"
dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
mode: GRACEFUL
new_leader_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
 from {username='slave'} at 127.0.0.1:43762
I20260709 13:17:16.294971  9289 raft_consensus.cc:606] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 LEADER]: Received request to transfer leadership to TS 6beeb97aa49249eb8aeeaf764cbab2bf
I20260709 13:17:16.297809  9289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "faaef8ba24094ff399cbfb39f7894125"
dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
mode: GRACEFUL
new_leader_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
 from {username='slave'} at 127.0.0.1:43762
I20260709 13:17:16.298431  9289 raft_consensus.cc:606] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 LEADER]: Received request to transfer leadership to TS 6beeb97aa49249eb8aeeaf764cbab2bf
I20260709 13:17:16.299634 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:17:16.300271 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:16.301111  9109 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37174
I20260709 13:17:16.301144 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:16.303902  9529 tablet_bootstrap.cc:492] T 41b6746cc1154961b2c27c96e04bbdab P 8b853d87511945de82e91ce1e4e13b16: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:16.304747  9529 tablet_bootstrap.cc:492] T 41b6746cc1154961b2c27c96e04bbdab P 8b853d87511945de82e91ce1e4e13b16: Bootstrap complete.
I20260709 13:17:16.305089  9592 heartbeater.cc:499] Master 127.30.63.62:40839 was elected leader, sending a full tablet report...
I20260709 13:17:16.305260  9529 ts_tablet_manager.cc:1403] T 41b6746cc1154961b2c27c96e04bbdab P 8b853d87511945de82e91ce1e4e13b16: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.008s
I20260709 13:17:16.307332  9529 raft_consensus.cc:359] T 41b6746cc1154961b2c27c96e04bbdab P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:16.307857  9529 raft_consensus.cc:740] T 41b6746cc1154961b2c27c96e04bbdab P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b853d87511945de82e91ce1e4e13b16, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.308460  9529 consensus_queue.cc:260] T 41b6746cc1154961b2c27c96e04bbdab P 8b853d87511945de82e91ce1e4e13b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:16.310298  9529 ts_tablet_manager.cc:1434] T 41b6746cc1154961b2c27c96e04bbdab P 8b853d87511945de82e91ce1e4e13b16: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:17:16.311065  9529 tablet_bootstrap.cc:492] T faaef8ba24094ff399cbfb39f7894125 P 8b853d87511945de82e91ce1e4e13b16: Bootstrap starting.
I20260709 13:17:16.321260  9529 tablet_bootstrap.cc:492] T faaef8ba24094ff399cbfb39f7894125 P 8b853d87511945de82e91ce1e4e13b16: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:16.321949  9529 tablet_bootstrap.cc:492] T faaef8ba24094ff399cbfb39f7894125 P 8b853d87511945de82e91ce1e4e13b16: Bootstrap complete.
I20260709 13:17:16.322510  9529 ts_tablet_manager.cc:1403] T faaef8ba24094ff399cbfb39f7894125 P 8b853d87511945de82e91ce1e4e13b16: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:17:16.324913  9529 raft_consensus.cc:359] T faaef8ba24094ff399cbfb39f7894125 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:16.325552  9529 raft_consensus.cc:740] T faaef8ba24094ff399cbfb39f7894125 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b853d87511945de82e91ce1e4e13b16, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.326270  9529 consensus_queue.cc:260] T faaef8ba24094ff399cbfb39f7894125 P 8b853d87511945de82e91ce1e4e13b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:16.327987  9529 ts_tablet_manager.cc:1434] T faaef8ba24094ff399cbfb39f7894125 P 8b853d87511945de82e91ce1e4e13b16: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:17:16.328881  9529 tablet_bootstrap.cc:492] T 3bc4d66484094db0aae6dfb29587774a P 8b853d87511945de82e91ce1e4e13b16: Bootstrap starting.
I20260709 13:17:16.340147  9529 tablet_bootstrap.cc:492] T 3bc4d66484094db0aae6dfb29587774a P 8b853d87511945de82e91ce1e4e13b16: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:16.341017  9529 tablet_bootstrap.cc:492] T 3bc4d66484094db0aae6dfb29587774a P 8b853d87511945de82e91ce1e4e13b16: Bootstrap complete.
I20260709 13:17:16.341683  9529 ts_tablet_manager.cc:1403] T 3bc4d66484094db0aae6dfb29587774a P 8b853d87511945de82e91ce1e4e13b16: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:17:16.343487  9529 raft_consensus.cc:359] T 3bc4d66484094db0aae6dfb29587774a P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:16.344060  9529 raft_consensus.cc:740] T 3bc4d66484094db0aae6dfb29587774a P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b853d87511945de82e91ce1e4e13b16, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.344694  9529 consensus_queue.cc:260] T 3bc4d66484094db0aae6dfb29587774a P 8b853d87511945de82e91ce1e4e13b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:16.346879  9529 ts_tablet_manager.cc:1434] T 3bc4d66484094db0aae6dfb29587774a P 8b853d87511945de82e91ce1e4e13b16: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:17:16.347932  9529 tablet_bootstrap.cc:492] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16: Bootstrap starting.
I20260709 13:17:16.350692  9565 raft_consensus.cc:3060] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:16.355676  9564 raft_consensus.cc:3060] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:16.359176  9565 pending_rounds.cc:85] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16: Aborting all ops after (but not including) 0
I20260709 13:17:16.359619  9565 pending_rounds.cc:107] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:17:16.359999  9565 raft_consensus.cc:2889] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:16.363610  9529 tablet_bootstrap.cc:492] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:17:16.364670  9529 tablet_bootstrap.cc:492] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16: Bootstrap complete.
I20260709 13:17:16.365345  9529 ts_tablet_manager.cc:1403] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 13:17:16.366029  9562 raft_consensus.cc:3060] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:16.368302  9529 raft_consensus.cc:359] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:16.369901  9529 raft_consensus.cc:740] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b853d87511945de82e91ce1e4e13b16, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.370715  9529 consensus_queue.cc:260] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:16.373044  9529 ts_tablet_manager.cc:1434] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:16.376142  9562 pending_rounds.cc:85] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16: Aborting all ops after (but not including) 0
I20260709 13:17:16.376664  9562 pending_rounds.cc:107] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:17:16.376989  9562 raft_consensus.cc:2889] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:16.389161  9564 raft_consensus.cc:3060] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:16.397070  9564 pending_rounds.cc:85] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16: Aborting all ops after (but not including) 0
I20260709 13:17:16.397393  9564 pending_rounds.cc:107] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:17:16.397660  9564 raft_consensus.cc:2889] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:16.486661  9513 raft_consensus.cc:993] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e: : Instructing follower 6beeb97aa49249eb8aeeaf764cbab2bf to start an election
I20260709 13:17:16.487196  9512 raft_consensus.cc:1081] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 LEADER]: Signalling peer 6beeb97aa49249eb8aeeaf764cbab2bf to start an election
I20260709 13:17:16.488875  9362 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "faaef8ba24094ff399cbfb39f7894125"
dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
 from {username='slave'} at 127.0.0.1:60574
I20260709 13:17:16.489363  9362 raft_consensus.cc:493] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:16.489655  9362 raft_consensus.cc:3060] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:16.494917  9362 raft_consensus.cc:515] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:16.496498  9362 leader_election.cc:290] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 2 election: Requested vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969)
I20260709 13:17:16.497716  9564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faaef8ba24094ff399cbfb39f7894125" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b853d87511945de82e91ce1e4e13b16"
I20260709 13:17:16.498121  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faaef8ba24094ff399cbfb39f7894125" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
I20260709 13:17:16.498461  9564 raft_consensus.cc:3060] T faaef8ba24094ff399cbfb39f7894125 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:16.498729  9289 raft_consensus.cc:3055] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:16.499070  9289 raft_consensus.cc:740] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 810aa394d3b24560a5b4dd2b78c8966e, State: Running, Role: LEADER
I20260709 13:17:16.499897  9289 consensus_queue.cc:260] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:16.501351  9289 raft_consensus.cc:3060] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:16.506217  9564 raft_consensus.cc:2468] T faaef8ba24094ff399cbfb39f7894125 P 8b853d87511945de82e91ce1e4e13b16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6beeb97aa49249eb8aeeaf764cbab2bf in term 2.
I20260709 13:17:16.507718  9326 leader_election.cc:304] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 8b853d87511945de82e91ce1e4e13b16; no voters: 
I20260709 13:17:16.508562  9491 raft_consensus.cc:2804] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:16.509099  9289 raft_consensus.cc:2468] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6beeb97aa49249eb8aeeaf764cbab2bf in term 2.
I20260709 13:17:16.510329  9491 raft_consensus.cc:697] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 LEADER]: Becoming Leader. State: Replica: 6beeb97aa49249eb8aeeaf764cbab2bf, State: Running, Role: LEADER
I20260709 13:17:16.511464  9491 consensus_queue.cc:237] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:16.519608  9109 catalog_manager.cc:5697] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf reported cstate change: term changed from 1 to 2, leader changed from 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2) to 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3). New cstate: current_term: 2 leader_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:16.566730  9564 raft_consensus.cc:3060] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:16.633226  9512 raft_consensus.cc:993] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e: : Instructing follower 6beeb97aa49249eb8aeeaf764cbab2bf to start an election
I20260709 13:17:16.633665  9513 raft_consensus.cc:1081] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e [term 1 LEADER]: Signalling peer 6beeb97aa49249eb8aeeaf764cbab2bf to start an election
I20260709 13:17:16.635224  9362 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3bc4d66484094db0aae6dfb29587774a"
dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
 from {username='slave'} at 127.0.0.1:60574
I20260709 13:17:16.635855  9362 raft_consensus.cc:493] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:16.636121  9362 raft_consensus.cc:3060] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:16.641842  9362 raft_consensus.cc:515] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:16.643415  9362 leader_election.cc:290] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 2 election: Requested vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969)
I20260709 13:17:16.644173  9564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc4d66484094db0aae6dfb29587774a" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b853d87511945de82e91ce1e4e13b16"
I20260709 13:17:16.644495  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc4d66484094db0aae6dfb29587774a" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
I20260709 13:17:16.644917  9564 raft_consensus.cc:3060] T 3bc4d66484094db0aae6dfb29587774a P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:16.645133  9289 raft_consensus.cc:3055] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:16.645526  9289 raft_consensus.cc:740] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 810aa394d3b24560a5b4dd2b78c8966e, State: Running, Role: LEADER
I20260709 13:17:16.646184  9289 consensus_queue.cc:260] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:16.647153  9289 raft_consensus.cc:3060] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:16.650422  9564 raft_consensus.cc:2468] T 3bc4d66484094db0aae6dfb29587774a P 8b853d87511945de82e91ce1e4e13b16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6beeb97aa49249eb8aeeaf764cbab2bf in term 2.
I20260709 13:17:16.651515  9326 leader_election.cc:304] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 8b853d87511945de82e91ce1e4e13b16; no voters: 
I20260709 13:17:16.652223  9491 raft_consensus.cc:2804] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:16.652549  9289 raft_consensus.cc:2468] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6beeb97aa49249eb8aeeaf764cbab2bf in term 2.
I20260709 13:17:16.652793  9491 raft_consensus.cc:697] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 LEADER]: Becoming Leader. State: Replica: 6beeb97aa49249eb8aeeaf764cbab2bf, State: Running, Role: LEADER
I20260709 13:17:16.653813  9491 consensus_queue.cc:237] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:16.661067  9109 catalog_manager.cc:5697] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf reported cstate change: term changed from 1 to 2, leader changed from 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2) to 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3). New cstate: current_term: 2 leader_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:16.696671  9512 raft_consensus.cc:993] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e: : Instructing follower 6beeb97aa49249eb8aeeaf764cbab2bf to start an election
I20260709 13:17:16.697216  9513 raft_consensus.cc:1081] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 LEADER]: Signalling peer 6beeb97aa49249eb8aeeaf764cbab2bf to start an election
I20260709 13:17:16.698819  9362 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8f0b2f6fc574e328e072a92f5192c79"
dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
 from {username='slave'} at 127.0.0.1:60574
I20260709 13:17:16.699466  9362 raft_consensus.cc:493] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:16.699800  9362 raft_consensus.cc:3060] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:16.701360  9512 raft_consensus.cc:993] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e: : Instructing follower 6beeb97aa49249eb8aeeaf764cbab2bf to start an election
I20260709 13:17:16.701897  9513 raft_consensus.cc:1081] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [term 2 LEADER]: Signalling peer 6beeb97aa49249eb8aeeaf764cbab2bf to start an election
I20260709 13:17:16.703341  9363 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a87554f5c20f4f5cb0a2c7deb51eec5b"
dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
 from {username='slave'} at 127.0.0.1:60574
I20260709 13:17:16.703858  9363 raft_consensus.cc:493] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:16.704228  9363 raft_consensus.cc:3060] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:16.705905  9362 raft_consensus.cc:515] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } } peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } }
I20260709 13:17:16.707655  9362 leader_election.cc:290] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 2 election: Requested vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969)
I20260709 13:17:16.708689  9564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f0b2f6fc574e328e072a92f5192c79" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b853d87511945de82e91ce1e4e13b16"
I20260709 13:17:16.708936  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f0b2f6fc574e328e072a92f5192c79" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
I20260709 13:17:16.709306  9564 raft_consensus.cc:3060] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:16.709582  9289 raft_consensus.cc:3055] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:16.709961  9289 raft_consensus.cc:740] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 810aa394d3b24560a5b4dd2b78c8966e, State: Running, Role: LEADER
I20260709 13:17:16.710693  9363 raft_consensus.cc:515] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:16.710891  9289 consensus_queue.cc:260] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } } peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } }
I20260709 13:17:16.712172  9289 raft_consensus.cc:3060] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:16.713078  9363 leader_election.cc:290] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 3 election: Requested vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969)
I20260709 13:17:16.715521  9563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87554f5c20f4f5cb0a2c7deb51eec5b" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8b853d87511945de82e91ce1e4e13b16"
I20260709 13:17:16.715523  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87554f5c20f4f5cb0a2c7deb51eec5b" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
I20260709 13:17:16.715811  9564 raft_consensus.cc:2468] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6beeb97aa49249eb8aeeaf764cbab2bf in term 2.
I20260709 13:17:16.716270  9563 raft_consensus.cc:3060] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:16.716373  9288 raft_consensus.cc:3055] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:16.716858  9288 raft_consensus.cc:740] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 810aa394d3b24560a5b4dd2b78c8966e, State: Running, Role: LEADER
I20260709 13:17:16.717265  9326 leader_election.cc:304] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 8b853d87511945de82e91ce1e4e13b16; no voters: 
I20260709 13:17:16.717721  9288 consensus_queue.cc:260] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:16.718286  9491 raft_consensus.cc:2804] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:16.718873  9491 raft_consensus.cc:697] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 LEADER]: Becoming Leader. State: Replica: 6beeb97aa49249eb8aeeaf764cbab2bf, State: Running, Role: LEADER
I20260709 13:17:16.719501  9288 raft_consensus.cc:3060] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:16.719794  9491 consensus_queue.cc:237] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } } peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } }
I20260709 13:17:16.720479  9289 raft_consensus.cc:2468] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6beeb97aa49249eb8aeeaf764cbab2bf in term 2.
I20260709 13:17:16.724280  9563 raft_consensus.cc:2468] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6beeb97aa49249eb8aeeaf764cbab2bf in term 3.
I20260709 13:17:16.725679  9326 leader_election.cc:304] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 8b853d87511945de82e91ce1e4e13b16; no voters: 
I20260709 13:17:16.726543  9491 raft_consensus.cc:2804] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:16.726996  9491 raft_consensus.cc:697] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [term 3 LEADER]: Becoming Leader. State: Replica: 6beeb97aa49249eb8aeeaf764cbab2bf, State: Running, Role: LEADER
I20260709 13:17:16.727875  9288 raft_consensus.cc:2468] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6beeb97aa49249eb8aeeaf764cbab2bf in term 3.
I20260709 13:17:16.727823  9491 consensus_queue.cc:237] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:16.728905  9109 catalog_manager.cc:5697] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf reported cstate change: term changed from 1 to 2, leader changed from 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2) to 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3). New cstate: current_term: 2 leader_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:16.741534  9109 catalog_manager.cc:5697] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf reported cstate change: term changed from 2 to 3, leader changed from 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2) to 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3). New cstate: current_term: 3 leader_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:16.828510  9160 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:17:16.944221  9288 raft_consensus.cc:1275] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Refusing update from remote peer 6beeb97aa49249eb8aeeaf764cbab2bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:16.946161  9622 consensus_queue.cc:1048] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:16.950774  9563 raft_consensus.cc:1275] T faaef8ba24094ff399cbfb39f7894125 P 8b853d87511945de82e91ce1e4e13b16 [term 2 FOLLOWER]: Refusing update from remote peer 6beeb97aa49249eb8aeeaf764cbab2bf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:16.953943  9622 consensus_queue.cc:1048] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:17:17.138432  9288 raft_consensus.cc:1275] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Refusing update from remote peer 6beeb97aa49249eb8aeeaf764cbab2bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:17.139890  9563 raft_consensus.cc:1275] T 3bc4d66484094db0aae6dfb29587774a P 8b853d87511945de82e91ce1e4e13b16 [term 2 FOLLOWER]: Refusing update from remote peer 6beeb97aa49249eb8aeeaf764cbab2bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:17.141064  9622 consensus_queue.cc:1048] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:17.141724  9611 consensus_queue.cc:1048] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:17.157438  9289 raft_consensus.cc:1275] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Refusing update from remote peer 6beeb97aa49249eb8aeeaf764cbab2bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:17.159058  9611 consensus_queue.cc:1048] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:17.189020  9288 raft_consensus.cc:1275] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [term 3 FOLLOWER]: Refusing update from remote peer 6beeb97aa49249eb8aeeaf764cbab2bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:17.190912  9630 consensus_queue.cc:1048] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:17.241706  9562 raft_consensus.cc:1275] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [term 3 FOLLOWER]: Refusing update from remote peer 6beeb97aa49249eb8aeeaf764cbab2bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:17.246013  9630 consensus_queue.cc:1048] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:17.248523  9564 raft_consensus.cc:1275] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [term 2 FOLLOWER]: Refusing update from remote peer 6beeb97aa49249eb8aeeaf764cbab2bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:17.252733  9630 consensus_queue.cc:1048] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:17.389099 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:17.408718  9363 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69a49b7ef53144babd52bc66266d5aa1"
dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
mode: GRACEFUL
new_leader_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
 from {username='slave'} at 127.0.0.1:60588
I20260709 13:17:17.409188  9363 raft_consensus.cc:606] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 LEADER]: Received request to transfer leadership to TS 810aa394d3b24560a5b4dd2b78c8966e
I20260709 13:17:17.411831  9363 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8f0b2f6fc574e328e072a92f5192c79"
dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
mode: GRACEFUL
new_leader_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
 from {username='slave'} at 127.0.0.1:60588
I20260709 13:17:17.412422  9363 raft_consensus.cc:606] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 LEADER]: Received request to transfer leadership to TS 810aa394d3b24560a5b4dd2b78c8966e
I20260709 13:17:17.413614 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:17.414220 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:17.414862 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:17.826236  9622 raft_consensus.cc:993] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf: : Instructing follower 810aa394d3b24560a5b4dd2b78c8966e to start an election
I20260709 13:17:17.826768  9611 raft_consensus.cc:1081] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 LEADER]: Signalling peer 810aa394d3b24560a5b4dd2b78c8966e to start an election
I20260709 13:17:17.828500  9289 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69a49b7ef53144babd52bc66266d5aa1"
dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
 from {username='slave'} at 127.0.0.1:43746
I20260709 13:17:17.829095  9289 raft_consensus.cc:493] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:17:17.829628  9160 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:17:17.829468  9289 raft_consensus.cc:3060] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:17.837713  9289 raft_consensus.cc:515] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:17.839965  9622 raft_consensus.cc:993] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf: : Instructing follower 810aa394d3b24560a5b4dd2b78c8966e to start an election
I20260709 13:17:17.840137  9289 leader_election.cc:290] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 election: Requested vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:17.840775  9611 raft_consensus.cc:1081] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 LEADER]: Signalling peer 810aa394d3b24560a5b4dd2b78c8966e to start an election
I20260709 13:17:17.841216  9363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a49b7ef53144babd52bc66266d5aa1" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
I20260709 13:17:17.841259  9564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a49b7ef53144babd52bc66266d5aa1" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b853d87511945de82e91ce1e4e13b16"
I20260709 13:17:17.842000  9363 raft_consensus.cc:3055] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:17.842084  9564 raft_consensus.cc:3060] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:17.842357  9363 raft_consensus.cc:740] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6beeb97aa49249eb8aeeaf764cbab2bf, State: Running, Role: LEADER
I20260709 13:17:17.843025  9289 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8f0b2f6fc574e328e072a92f5192c79"
dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
 from {username='slave'} at 127.0.0.1:43746
I20260709 13:17:17.843211  9363 consensus_queue.cc:260] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:17.843644  9289 raft_consensus.cc:493] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:17.844036  9289 raft_consensus.cc:3060] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:17.844519  9363 raft_consensus.cc:3060] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:17.848574  9564 raft_consensus.cc:2468] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810aa394d3b24560a5b4dd2b78c8966e in term 2.
I20260709 13:17:17.849879  9252 leader_election.cc:304] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 810aa394d3b24560a5b4dd2b78c8966e, 8b853d87511945de82e91ce1e4e13b16; no voters: 
I20260709 13:17:17.850593  9513 raft_consensus.cc:2804] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:17.851256  9363 raft_consensus.cc:2468] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810aa394d3b24560a5b4dd2b78c8966e in term 2.
I20260709 13:17:17.851300  9289 raft_consensus.cc:515] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } } peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } }
I20260709 13:17:17.852741  9513 raft_consensus.cc:697] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 LEADER]: Becoming Leader. State: Replica: 810aa394d3b24560a5b4dd2b78c8966e, State: Running, Role: LEADER
I20260709 13:17:17.854146  9289 leader_election.cc:290] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 3 election: Requested vote from peers 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957), 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715)
I20260709 13:17:17.854442  9363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f0b2f6fc574e328e072a92f5192c79" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
I20260709 13:17:17.854789  9564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f0b2f6fc574e328e072a92f5192c79" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8b853d87511945de82e91ce1e4e13b16"
I20260709 13:17:17.855127  9363 raft_consensus.cc:3055] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:17.855458  9363 raft_consensus.cc:740] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6beeb97aa49249eb8aeeaf764cbab2bf, State: Running, Role: LEADER
I20260709 13:17:17.855463  9564 raft_consensus.cc:3060] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:17.856292  9363 consensus_queue.cc:260] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } } peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } }
I20260709 13:17:17.854445  9513 consensus_queue.cc:237] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:17.857498  9363 raft_consensus.cc:3060] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:17.862881  9564 raft_consensus.cc:2468] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810aa394d3b24560a5b4dd2b78c8966e in term 3.
I20260709 13:17:17.864291  9252 leader_election.cc:304] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 810aa394d3b24560a5b4dd2b78c8966e, 8b853d87511945de82e91ce1e4e13b16; no voters: 
I20260709 13:17:17.865175  9513 raft_consensus.cc:2804] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:17.865644  9513 raft_consensus.cc:697] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 3 LEADER]: Becoming Leader. State: Replica: 810aa394d3b24560a5b4dd2b78c8966e, State: Running, Role: LEADER
I20260709 13:17:17.866115  9363 raft_consensus.cc:2468] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810aa394d3b24560a5b4dd2b78c8966e in term 3.
I20260709 13:17:17.866462  9513 consensus_queue.cc:237] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } } peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } }
I20260709 13:17:17.868785  9109 catalog_manager.cc:5697] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e reported cstate change: term changed from 1 to 2, leader changed from 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3) to 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2). New cstate: current_term: 2 leader_uuid: "810aa394d3b24560a5b4dd2b78c8966e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:17.887121  9109 catalog_manager.cc:5697] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e reported cstate change: term changed from 2 to 3, leader changed from 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3) to 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2). New cstate: current_term: 3 leader_uuid: "810aa394d3b24560a5b4dd2b78c8966e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:18.174537  9384 debug-util.cc:398] Leaking SignalData structure 0x7b08002fa7a0 after lost signal to thread 30975
W20260709 13:17:18.175546  9384 debug-util.cc:398] Leaking SignalData structure 0x7b0800137c20 after lost signal to thread 9146
W20260709 13:17:18.176651  9384 debug-util.cc:398] Leaking SignalData structure 0x7b0800140160 after lost signal to thread 9313
W20260709 13:17:18.178341  9384 debug-util.cc:398] Leaking SignalData structure 0x7b08001c70a0 after lost signal to thread 9590
I20260709 13:17:18.270144  9564 raft_consensus.cc:1275] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [term 3 FOLLOWER]: Refusing update from remote peer 810aa394d3b24560a5b4dd2b78c8966e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:18.271870  9513 consensus_queue.cc:1048] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:18.293736  9363 raft_consensus.cc:1275] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 3 FOLLOWER]: Refusing update from remote peer 810aa394d3b24560a5b4dd2b78c8966e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:18.296562  9637 consensus_queue.cc:1048] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:18.421499 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:18.425263  9564 raft_consensus.cc:1275] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16 [term 2 FOLLOWER]: Refusing update from remote peer 810aa394d3b24560a5b4dd2b78c8966e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:18.426854  9637 consensus_queue.cc:1048] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:18.431005  9289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69a49b7ef53144babd52bc66266d5aa1"
dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
mode: GRACEFUL
new_leader_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
 from {username='slave'} at 127.0.0.1:43762
I20260709 13:17:18.431833  9289 raft_consensus.cc:606] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 LEADER]: Received request to transfer leadership to TS 6beeb97aa49249eb8aeeaf764cbab2bf
I20260709 13:17:18.438210  9289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8f0b2f6fc574e328e072a92f5192c79"
dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
mode: GRACEFUL
new_leader_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
 from {username='slave'} at 127.0.0.1:43762
I20260709 13:17:18.438885  9289 raft_consensus.cc:606] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 3 LEADER]: Received request to transfer leadership to TS 6beeb97aa49249eb8aeeaf764cbab2bf
I20260709 13:17:18.440423 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:18.441073 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:18.441825 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:18.450284  9363 raft_consensus.cc:1275] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Refusing update from remote peer 810aa394d3b24560a5b4dd2b78c8966e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:18.452730  9513 consensus_queue.cc:1048] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:18.468127  9651 raft_consensus.cc:993] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e: : Instructing follower 6beeb97aa49249eb8aeeaf764cbab2bf to start an election
I20260709 13:17:18.468658  9651 raft_consensus.cc:1081] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 LEADER]: Signalling peer 6beeb97aa49249eb8aeeaf764cbab2bf to start an election
I20260709 13:17:18.470299  9363 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69a49b7ef53144babd52bc66266d5aa1"
dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
 from {username='slave'} at 127.0.0.1:60574
I20260709 13:17:18.470871  9363 raft_consensus.cc:493] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:18.471230  9363 raft_consensus.cc:3060] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:18.478607  9363 raft_consensus.cc:515] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:18.480736  9363 leader_election.cc:290] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 3 election: Requested vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969)
I20260709 13:17:18.482023  9564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a49b7ef53144babd52bc66266d5aa1" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8b853d87511945de82e91ce1e4e13b16"
I20260709 13:17:18.482151  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a49b7ef53144babd52bc66266d5aa1" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
I20260709 13:17:18.482818  9564 raft_consensus.cc:3060] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:18.482944  9289 raft_consensus.cc:3055] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:18.483429  9289 raft_consensus.cc:740] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 810aa394d3b24560a5b4dd2b78c8966e, State: Running, Role: LEADER
I20260709 13:17:18.484247  9289 consensus_queue.cc:260] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:18.485466  9289 raft_consensus.cc:3060] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:18.491037  9564 raft_consensus.cc:2468] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6beeb97aa49249eb8aeeaf764cbab2bf in term 3.
I20260709 13:17:18.493077  9326 leader_election.cc:304] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 8b853d87511945de82e91ce1e4e13b16; no voters: 
I20260709 13:17:18.493909  9622 raft_consensus.cc:2804] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:18.494519  9289 raft_consensus.cc:2468] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6beeb97aa49249eb8aeeaf764cbab2bf in term 3.
I20260709 13:17:18.495234  9622 raft_consensus.cc:697] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 3 LEADER]: Becoming Leader. State: Replica: 6beeb97aa49249eb8aeeaf764cbab2bf, State: Running, Role: LEADER
I20260709 13:17:18.496619  9622 consensus_queue.cc:237] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:18.503386  9112 catalog_manager.cc:5697] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf reported cstate change: term changed from 2 to 3, leader changed from 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2) to 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3). New cstate: current_term: 3 leader_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:18.830767  9160 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:17:18.900429  9650 raft_consensus.cc:993] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e: : Instructing follower 6beeb97aa49249eb8aeeaf764cbab2bf to start an election
I20260709 13:17:18.901046  9650 raft_consensus.cc:1081] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 3 LEADER]: Signalling peer 6beeb97aa49249eb8aeeaf764cbab2bf to start an election
I20260709 13:17:18.902835  9363 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8f0b2f6fc574e328e072a92f5192c79"
dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
 from {username='slave'} at 127.0.0.1:60574
I20260709 13:17:18.903363  9363 raft_consensus.cc:493] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:18.903707  9363 raft_consensus.cc:3060] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:18.908396  9363 raft_consensus.cc:515] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } } peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } }
I20260709 13:17:18.909862  9363 leader_election.cc:290] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 4 election: Requested vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969)
I20260709 13:17:18.910845  9564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f0b2f6fc574e328e072a92f5192c79" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8b853d87511945de82e91ce1e4e13b16"
I20260709 13:17:18.911442  9564 raft_consensus.cc:3060] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:18.911391  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f0b2f6fc574e328e072a92f5192c79" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
I20260709 13:17:18.912225  9289 raft_consensus.cc:3055] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:18.912614  9289 raft_consensus.cc:740] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 810aa394d3b24560a5b4dd2b78c8966e, State: Running, Role: LEADER
I20260709 13:17:18.913412  9289 consensus_queue.cc:260] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } } peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } }
I20260709 13:17:18.914685  9289 raft_consensus.cc:3060] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:18.918635  9564 raft_consensus.cc:2468] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6beeb97aa49249eb8aeeaf764cbab2bf in term 4.
I20260709 13:17:18.921196  9326 leader_election.cc:304] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 8b853d87511945de82e91ce1e4e13b16; no voters: 
I20260709 13:17:18.921864  9622 raft_consensus.cc:2804] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:18.922044  9289 raft_consensus.cc:2468] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6beeb97aa49249eb8aeeaf764cbab2bf in term 4.
I20260709 13:17:18.922348  9622 raft_consensus.cc:697] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 4 LEADER]: Becoming Leader. State: Replica: 6beeb97aa49249eb8aeeaf764cbab2bf, State: Running, Role: LEADER
I20260709 13:17:18.923282  9622 consensus_queue.cc:237] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } } peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } }
I20260709 13:17:18.931843  9112 catalog_manager.cc:5697] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf reported cstate change: term changed from 3 to 4, leader changed from 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2) to 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3). New cstate: current_term: 4 leader_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:18.948433  9289 raft_consensus.cc:1275] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [term 3 FOLLOWER]: Refusing update from remote peer 6beeb97aa49249eb8aeeaf764cbab2bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:18.949968  9653 consensus_queue.cc:1048] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:18.960783  9564 raft_consensus.cc:1275] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16 [term 3 FOLLOWER]: Refusing update from remote peer 6beeb97aa49249eb8aeeaf764cbab2bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:18.964330  9653 consensus_queue.cc:1048] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:19.455565 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:19.461745  9289 raft_consensus.cc:1275] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 4 FOLLOWER]: Refusing update from remote peer 6beeb97aa49249eb8aeeaf764cbab2bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:19.463204  9653 consensus_queue.cc:1048] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:19.464468  9363 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41b6746cc1154961b2c27c96e04bbdab"
dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
mode: GRACEFUL
new_leader_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
 from {username='slave'} at 127.0.0.1:60588
I20260709 13:17:19.465121  9363 raft_consensus.cc:606] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 LEADER]: Received request to transfer leadership to TS 810aa394d3b24560a5b4dd2b78c8966e
I20260709 13:17:19.467958  9363 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69a49b7ef53144babd52bc66266d5aa1"
dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
mode: GRACEFUL
new_leader_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
 from {username='slave'} at 127.0.0.1:60588
I20260709 13:17:19.468515  9363 raft_consensus.cc:606] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 3 LEADER]: Received request to transfer leadership to TS 810aa394d3b24560a5b4dd2b78c8966e
I20260709 13:17:19.477221 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:19.478058  9564 raft_consensus.cc:1275] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [term 4 FOLLOWER]: Refusing update from remote peer 6beeb97aa49249eb8aeeaf764cbab2bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:19.482052 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:19.482918 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:19.483235  9653 consensus_queue.cc:1048] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:19.723855  9657 raft_consensus.cc:993] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf: : Instructing follower 810aa394d3b24560a5b4dd2b78c8966e to start an election
I20260709 13:17:19.724391  9653 raft_consensus.cc:1081] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 LEADER]: Signalling peer 810aa394d3b24560a5b4dd2b78c8966e to start an election
I20260709 13:17:19.726161  9289 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41b6746cc1154961b2c27c96e04bbdab"
dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
 from {username='slave'} at 127.0.0.1:43746
I20260709 13:17:19.726680  9289 raft_consensus.cc:493] T 41b6746cc1154961b2c27c96e04bbdab P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:19.726994  9289 raft_consensus.cc:3060] T 41b6746cc1154961b2c27c96e04bbdab P 810aa394d3b24560a5b4dd2b78c8966e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.731752  9289 raft_consensus.cc:515] T 41b6746cc1154961b2c27c96e04bbdab P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:19.733462  9289 leader_election.cc:290] T 41b6746cc1154961b2c27c96e04bbdab P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 election: Requested vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:19.734319  9564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b6746cc1154961b2c27c96e04bbdab" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b853d87511945de82e91ce1e4e13b16"
I20260709 13:17:19.734586  9363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b6746cc1154961b2c27c96e04bbdab" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
I20260709 13:17:19.735046  9564 raft_consensus.cc:3060] T 41b6746cc1154961b2c27c96e04bbdab P 8b853d87511945de82e91ce1e4e13b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.735183  9363 raft_consensus.cc:3055] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:19.735637  9363 raft_consensus.cc:740] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6beeb97aa49249eb8aeeaf764cbab2bf, State: Running, Role: LEADER
I20260709 13:17:19.736320  9363 consensus_queue.cc:260] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:19.737321  9363 raft_consensus.cc:3060] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.742044  9363 raft_consensus.cc:2468] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810aa394d3b24560a5b4dd2b78c8966e in term 2.
I20260709 13:17:19.742725  9564 raft_consensus.cc:2468] T 41b6746cc1154961b2c27c96e04bbdab P 8b853d87511945de82e91ce1e4e13b16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810aa394d3b24560a5b4dd2b78c8966e in term 2.
I20260709 13:17:19.743117  9253 leader_election.cc:304] T 41b6746cc1154961b2c27c96e04bbdab P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 810aa394d3b24560a5b4dd2b78c8966e; no voters: 
I20260709 13:17:19.744117  9650 raft_consensus.cc:2804] T 41b6746cc1154961b2c27c96e04bbdab P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:19.745613  9650 raft_consensus.cc:697] T 41b6746cc1154961b2c27c96e04bbdab P 810aa394d3b24560a5b4dd2b78c8966e [term 2 LEADER]: Becoming Leader. State: Replica: 810aa394d3b24560a5b4dd2b78c8966e, State: Running, Role: LEADER
I20260709 13:17:19.746723  9650 consensus_queue.cc:237] T 41b6746cc1154961b2c27c96e04bbdab P 810aa394d3b24560a5b4dd2b78c8966e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:19.756944  9109 catalog_manager.cc:5697] T 41b6746cc1154961b2c27c96e04bbdab P 810aa394d3b24560a5b4dd2b78c8966e reported cstate change: term changed from 1 to 2, leader changed from 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3) to 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2). New cstate: current_term: 2 leader_uuid: "810aa394d3b24560a5b4dd2b78c8966e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:19.831773  9160 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:17:19.937253  9657 raft_consensus.cc:993] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf: : Instructing follower 810aa394d3b24560a5b4dd2b78c8966e to start an election
I20260709 13:17:19.937927  9653 raft_consensus.cc:1081] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 3 LEADER]: Signalling peer 810aa394d3b24560a5b4dd2b78c8966e to start an election
I20260709 13:17:19.939568  9289 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69a49b7ef53144babd52bc66266d5aa1"
dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
 from {username='slave'} at 127.0.0.1:43746
I20260709 13:17:19.940238  9289 raft_consensus.cc:493] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:19.940588  9289 raft_consensus.cc:3060] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:19.945768  9289 raft_consensus.cc:515] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:19.947621  9289 leader_election.cc:290] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 4 election: Requested vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3:35957)
I20260709 13:17:19.948788  9564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a49b7ef53144babd52bc66266d5aa1" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8b853d87511945de82e91ce1e4e13b16"
I20260709 13:17:19.948817  9363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a49b7ef53144babd52bc66266d5aa1" candidate_uuid: "810aa394d3b24560a5b4dd2b78c8966e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
I20260709 13:17:19.949683  9564 raft_consensus.cc:3060] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:19.949777  9363 raft_consensus.cc:3055] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:19.950165  9363 raft_consensus.cc:740] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6beeb97aa49249eb8aeeaf764cbab2bf, State: Running, Role: LEADER
I20260709 13:17:19.950951  9363 consensus_queue.cc:260] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:19.952145  9363 raft_consensus.cc:3060] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:19.956899  9564 raft_consensus.cc:2468] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810aa394d3b24560a5b4dd2b78c8966e in term 4.
I20260709 13:17:19.958424  9252 leader_election.cc:304] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 810aa394d3b24560a5b4dd2b78c8966e, 8b853d87511945de82e91ce1e4e13b16; no voters: 
I20260709 13:17:19.959111  9363 raft_consensus.cc:2468] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810aa394d3b24560a5b4dd2b78c8966e in term 4.
I20260709 13:17:19.959339  9650 raft_consensus.cc:2804] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:19.959858  9650 raft_consensus.cc:697] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [term 4 LEADER]: Becoming Leader. State: Replica: 810aa394d3b24560a5b4dd2b78c8966e, State: Running, Role: LEADER
I20260709 13:17:19.960741  9650 consensus_queue.cc:237] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:19.971356  9109 catalog_manager.cc:5697] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e reported cstate change: term changed from 3 to 4, leader changed from 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3) to 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2). New cstate: current_term: 4 leader_uuid: "810aa394d3b24560a5b4dd2b78c8966e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:20.262799  9363 raft_consensus.cc:1275] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Refusing update from remote peer 810aa394d3b24560a5b4dd2b78c8966e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:20.264077  9650 consensus_queue.cc:1048] T 41b6746cc1154961b2c27c96e04bbdab P 810aa394d3b24560a5b4dd2b78c8966e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:20.281021  9563 raft_consensus.cc:1275] T 41b6746cc1154961b2c27c96e04bbdab P 8b853d87511945de82e91ce1e4e13b16 [term 2 FOLLOWER]: Refusing update from remote peer 810aa394d3b24560a5b4dd2b78c8966e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:20.284483  9650 consensus_queue.cc:1048] T 41b6746cc1154961b2c27c96e04bbdab P 810aa394d3b24560a5b4dd2b78c8966e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:20.496030 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:20.504871  9289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b61ab45e369457b8a3824ee01df4030"
dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
mode: GRACEFUL
new_leader_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
 from {username='slave'} at 127.0.0.1:43762
I20260709 13:17:20.505437  9289 raft_consensus.cc:606] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 LEADER]: Received request to transfer leadership to TS 6beeb97aa49249eb8aeeaf764cbab2bf
I20260709 13:17:20.508002  9289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c0c24e4de70467b86659171853fd6de"
dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
mode: GRACEFUL
new_leader_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
 from {username='slave'} at 127.0.0.1:43762
I20260709 13:17:20.508499  9289 raft_consensus.cc:606] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [term 2 LEADER]: Received request to transfer leadership to TS 6beeb97aa49249eb8aeeaf764cbab2bf
I20260709 13:17:20.509694 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:20.510214 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:20.510762 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:20.532712  9564 raft_consensus.cc:1275] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16 [term 4 FOLLOWER]: Refusing update from remote peer 810aa394d3b24560a5b4dd2b78c8966e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:20.534144  9669 consensus_queue.cc:1048] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:20.542500  9363 raft_consensus.cc:1275] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 4 FOLLOWER]: Refusing update from remote peer 810aa394d3b24560a5b4dd2b78c8966e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:20.543890  9678 consensus_queue.cc:1048] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:20.606662  9678 raft_consensus.cc:993] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e: : Instructing follower 6beeb97aa49249eb8aeeaf764cbab2bf to start an election
I20260709 13:17:20.607167  9650 raft_consensus.cc:1081] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 LEADER]: Signalling peer 6beeb97aa49249eb8aeeaf764cbab2bf to start an election
I20260709 13:17:20.608736  9363 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b61ab45e369457b8a3824ee01df4030"
dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
 from {username='slave'} at 127.0.0.1:60574
I20260709 13:17:20.609297  9363 raft_consensus.cc:493] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:20.609611  9363 raft_consensus.cc:3060] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:20.614511  9363 raft_consensus.cc:515] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:20.616214  9363 leader_election.cc:290] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 3 election: Requested vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969)
I20260709 13:17:20.617759  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b61ab45e369457b8a3824ee01df4030" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
I20260709 13:17:20.618502  9289 raft_consensus.cc:3055] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:20.618808  9289 raft_consensus.cc:740] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 810aa394d3b24560a5b4dd2b78c8966e, State: Running, Role: LEADER
I20260709 13:17:20.619022  9564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b61ab45e369457b8a3824ee01df4030" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "8b853d87511945de82e91ce1e4e13b16"
I20260709 13:17:20.619585  9289 consensus_queue.cc:260] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:20.619577  9564 raft_consensus.cc:3060] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:20.620831  9289 raft_consensus.cc:3060] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:20.625370  9289 raft_consensus.cc:2468] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6beeb97aa49249eb8aeeaf764cbab2bf in term 3.
I20260709 13:17:20.626543  9326 leader_election.cc:304] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 810aa394d3b24560a5b4dd2b78c8966e; no voters: 
I20260709 13:17:20.627246  9653 raft_consensus.cc:2804] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:20.627738  9564 raft_consensus.cc:2468] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6beeb97aa49249eb8aeeaf764cbab2bf in term 3.
I20260709 13:17:20.628305  9653 raft_consensus.cc:697] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 3 LEADER]: Becoming Leader. State: Replica: 6beeb97aa49249eb8aeeaf764cbab2bf, State: Running, Role: LEADER
I20260709 13:17:20.629256  9653 consensus_queue.cc:237] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:20.637596  9109 catalog_manager.cc:5697] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf reported cstate change: term changed from 2 to 3, leader changed from 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2) to 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3). New cstate: current_term: 3 leader_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:20.834177  9160 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:17:20.868484  9650 raft_consensus.cc:993] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e: : Instructing follower 6beeb97aa49249eb8aeeaf764cbab2bf to start an election
I20260709 13:17:20.869417  9678 raft_consensus.cc:1081] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [term 2 LEADER]: Signalling peer 6beeb97aa49249eb8aeeaf764cbab2bf to start an election
I20260709 13:17:20.872187  9363 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c0c24e4de70467b86659171853fd6de"
dest_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf"
 from {username='slave'} at 127.0.0.1:60574
I20260709 13:17:20.873299  9363 raft_consensus.cc:493] T 7c0c24e4de70467b86659171853fd6de P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:20.873823  9363 raft_consensus.cc:3060] T 7c0c24e4de70467b86659171853fd6de P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:20.887897  9363 raft_consensus.cc:515] T 7c0c24e4de70467b86659171853fd6de P 6beeb97aa49249eb8aeeaf764cbab2bf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:20.890329  9363 leader_election.cc:290] T 7c0c24e4de70467b86659171853fd6de P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 3 election: Requested vote from peers 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715), 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969)
I20260709 13:17:20.892118  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0c24e4de70467b86659171853fd6de" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "810aa394d3b24560a5b4dd2b78c8966e"
I20260709 13:17:20.892194  9564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0c24e4de70467b86659171853fd6de" candidate_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "8b853d87511945de82e91ce1e4e13b16"
I20260709 13:17:20.893193  9289 raft_consensus.cc:3055] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:20.893586  9289 raft_consensus.cc:740] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 810aa394d3b24560a5b4dd2b78c8966e, State: Running, Role: LEADER
I20260709 13:17:20.893616  9564 raft_consensus.cc:3060] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:20.894881  9289 consensus_queue.cc:260] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:20.896082  9289 raft_consensus.cc:3060] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:20.903175  9289 raft_consensus.cc:2468] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6beeb97aa49249eb8aeeaf764cbab2bf in term 3.
I20260709 13:17:20.904690  9326 leader_election.cc:304] T 7c0c24e4de70467b86659171853fd6de P 6beeb97aa49249eb8aeeaf764cbab2bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6beeb97aa49249eb8aeeaf764cbab2bf, 810aa394d3b24560a5b4dd2b78c8966e; no voters: 
I20260709 13:17:20.905257  9564 raft_consensus.cc:2468] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6beeb97aa49249eb8aeeaf764cbab2bf in term 3.
I20260709 13:17:20.905593  9684 raft_consensus.cc:2804] T 7c0c24e4de70467b86659171853fd6de P 6beeb97aa49249eb8aeeaf764cbab2bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:20.906212  9684 raft_consensus.cc:697] T 7c0c24e4de70467b86659171853fd6de P 6beeb97aa49249eb8aeeaf764cbab2bf [term 3 LEADER]: Becoming Leader. State: Replica: 6beeb97aa49249eb8aeeaf764cbab2bf, State: Running, Role: LEADER
I20260709 13:17:20.907480  9684 consensus_queue.cc:237] T 7c0c24e4de70467b86659171853fd6de P 6beeb97aa49249eb8aeeaf764cbab2bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } }
I20260709 13:17:20.918159  9109 catalog_manager.cc:5697] T 7c0c24e4de70467b86659171853fd6de P 6beeb97aa49249eb8aeeaf764cbab2bf reported cstate change: term changed from 2 to 3, leader changed from 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2) to 6beeb97aa49249eb8aeeaf764cbab2bf (127.30.63.3). New cstate: current_term: 3 leader_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6beeb97aa49249eb8aeeaf764cbab2bf" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 35957 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:21.022850  9289 raft_consensus.cc:1275] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [term 3 FOLLOWER]: Refusing update from remote peer 6beeb97aa49249eb8aeeaf764cbab2bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:21.024185  9684 consensus_queue.cc:1048] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:21.038780  9564 raft_consensus.cc:1275] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16 [term 3 FOLLOWER]: Refusing update from remote peer 6beeb97aa49249eb8aeeaf764cbab2bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:21.040980  9684 consensus_queue.cc:1048] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:21.355535  9563 raft_consensus.cc:1275] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16 [term 3 FOLLOWER]: Refusing update from remote peer 6beeb97aa49249eb8aeeaf764cbab2bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:21.357191  9653 consensus_queue.cc:1048] T 7c0c24e4de70467b86659171853fd6de P 6beeb97aa49249eb8aeeaf764cbab2bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b853d87511945de82e91ce1e4e13b16" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 34715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:21.373345  9289 raft_consensus.cc:1275] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [term 3 FOLLOWER]: Refusing update from remote peer 6beeb97aa49249eb8aeeaf764cbab2bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:21.375325  9684 consensus_queue.cc:1048] T 7c0c24e4de70467b86659171853fd6de P 6beeb97aa49249eb8aeeaf764cbab2bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "810aa394d3b24560a5b4dd2b78c8966e" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:21.518545 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:21.559747 30972 tablet_server.cc:179] TabletServer@127.30.63.1:34715 shutting down...
I20260709 13:17:21.606539 30972 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:21.607570 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:21.608991 30972 raft_consensus.cc:2243] T 3bc4d66484094db0aae6dfb29587774a P 8b853d87511945de82e91ce1e4e13b16 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.609678 30972 raft_consensus.cc:2272] T 3bc4d66484094db0aae6dfb29587774a P 8b853d87511945de82e91ce1e4e13b16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.612884 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:21.613658 30972 raft_consensus.cc:2243] T faaef8ba24094ff399cbfb39f7894125 P 8b853d87511945de82e91ce1e4e13b16 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.614250 30972 raft_consensus.cc:2272] T faaef8ba24094ff399cbfb39f7894125 P 8b853d87511945de82e91ce1e4e13b16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.617188 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:21.618000 30972 raft_consensus.cc:2243] T 41b6746cc1154961b2c27c96e04bbdab P 8b853d87511945de82e91ce1e4e13b16 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.618731 30972 raft_consensus.cc:2272] T 41b6746cc1154961b2c27c96e04bbdab P 8b853d87511945de82e91ce1e4e13b16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.621742 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:21.622545 30972 raft_consensus.cc:2243] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.623037 30972 raft_consensus.cc:2272] T 7c0c24e4de70467b86659171853fd6de P 8b853d87511945de82e91ce1e4e13b16 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.626863 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:21.627558 30972 raft_consensus.cc:2243] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.628158 30972 raft_consensus.cc:2272] T a87554f5c20f4f5cb0a2c7deb51eec5b P 8b853d87511945de82e91ce1e4e13b16 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.631285 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:21.631920 30972 raft_consensus.cc:2243] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.632573 30972 raft_consensus.cc:2272] T e8f0b2f6fc574e328e072a92f5192c79 P 8b853d87511945de82e91ce1e4e13b16 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:21.635859  9252 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 100 similar messages]
I20260709 13:17:21.636231 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:21.637140 30972 raft_consensus.cc:2243] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.638218 30972 raft_consensus.cc:2272] T 69a49b7ef53144babd52bc66266d5aa1 P 8b853d87511945de82e91ce1e4e13b16 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:21.640193  9252 consensus_peers.cc:597] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e -> Peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Couldn't send request to peer 8b853d87511945de82e91ce1e4e13b16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:21.641749 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:21.642396 30972 raft_consensus.cc:2243] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.642910 30972 raft_consensus.cc:2272] T 5b61ab45e369457b8a3824ee01df4030 P 8b853d87511945de82e91ce1e4e13b16 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.646179 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:21.646756 30972 raft_consensus.cc:2243] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.647387 30972 raft_consensus.cc:2272] T eb93f7930f19442bbf52f407b7123fe7 P 8b853d87511945de82e91ce1e4e13b16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.650151 30972 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:21.650619 30972 raft_consensus.cc:2243] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.651118 30972 raft_consensus.cc:2272] T a9e2a2f0d5754921996f26c015b13e67 P 8b853d87511945de82e91ce1e4e13b16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.677968 30972 tablet_server.cc:196] TabletServer@127.30.63.1:34715 shutdown complete.
W20260709 13:17:21.694773  9252 consensus_peers.cc:597] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e -> Peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Couldn't send request to peer 8b853d87511945de82e91ce1e4e13b16. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:21.725790 30972 tablet_server.cc:179] TabletServer@127.30.63.2:0 shutting down...
I20260709 13:17:21.760535 30972 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:21.761564 30972 tablet_replica.cc:333] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e: stopping tablet replica
I20260709 13:17:21.762686 30972 raft_consensus.cc:2243] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.763286 30972 raft_consensus.cc:2272] T 3bc4d66484094db0aae6dfb29587774a P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.767115 30972 tablet_replica.cc:333] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e: stopping tablet replica
I20260709 13:17:21.767887 30972 raft_consensus.cc:2243] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:17:21.768854 30972 raft_consensus.cc:2272] T 69a49b7ef53144babd52bc66266d5aa1 P 810aa394d3b24560a5b4dd2b78c8966e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.771739 30972 tablet_replica.cc:333] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e: stopping tablet replica
I20260709 13:17:21.772401 30972 raft_consensus.cc:2243] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.772938 30972 raft_consensus.cc:2272] T 5b61ab45e369457b8a3824ee01df4030 P 810aa394d3b24560a5b4dd2b78c8966e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.776146 30972 tablet_replica.cc:333] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e: stopping tablet replica
I20260709 13:17:21.776793 30972 raft_consensus.cc:2243] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.777387 30972 raft_consensus.cc:2272] T faaef8ba24094ff399cbfb39f7894125 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.780400 30972 tablet_replica.cc:333] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e: stopping tablet replica
I20260709 13:17:21.780994 30972 raft_consensus.cc:2243] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.781402 30972 raft_consensus.cc:2272] T 7c0c24e4de70467b86659171853fd6de P 810aa394d3b24560a5b4dd2b78c8966e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.785055 30972 tablet_replica.cc:333] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e: stopping tablet replica
I20260709 13:17:21.785661 30972 raft_consensus.cc:2243] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.786254 30972 raft_consensus.cc:2272] T a87554f5c20f4f5cb0a2c7deb51eec5b P 810aa394d3b24560a5b4dd2b78c8966e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.789093 30972 tablet_replica.cc:333] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e: stopping tablet replica
I20260709 13:17:21.789638 30972 raft_consensus.cc:2243] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.790323 30972 raft_consensus.cc:2272] T e8f0b2f6fc574e328e072a92f5192c79 P 810aa394d3b24560a5b4dd2b78c8966e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.792853 30972 tablet_replica.cc:333] T 41b6746cc1154961b2c27c96e04bbdab P 810aa394d3b24560a5b4dd2b78c8966e: stopping tablet replica
I20260709 13:17:21.793392 30972 raft_consensus.cc:2243] T 41b6746cc1154961b2c27c96e04bbdab P 810aa394d3b24560a5b4dd2b78c8966e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:21.794315 30972 raft_consensus.cc:2272] T 41b6746cc1154961b2c27c96e04bbdab P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.796995 30972 tablet_replica.cc:333] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e: stopping tablet replica
I20260709 13:17:21.797523 30972 raft_consensus.cc:2243] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:21.798368 30972 raft_consensus.cc:2272] T eb93f7930f19442bbf52f407b7123fe7 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.800895 30972 tablet_replica.cc:333] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e: stopping tablet replica
I20260709 13:17:21.801453 30972 raft_consensus.cc:2243] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:21.802435 30972 raft_consensus.cc:2272] T a9e2a2f0d5754921996f26c015b13e67 P 810aa394d3b24560a5b4dd2b78c8966e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.834147 30972 tablet_server.cc:196] TabletServer@127.30.63.2:0 shutdown complete.
W20260709 13:17:21.835764  9160 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:17:21.840911  9326 consensus_peers.cc:597] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf -> Peer 810aa394d3b24560a5b4dd2b78c8966e (127.30.63.2:39969): Couldn't send request to peer 810aa394d3b24560a5b4dd2b78c8966e. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:39969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:21.841791  9326 consensus_peers.cc:597] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf -> Peer 8b853d87511945de82e91ce1e4e13b16 (127.30.63.1:34715): Couldn't send request to peer 8b853d87511945de82e91ce1e4e13b16. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:34715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:21.872258 30972 tablet_server.cc:179] TabletServer@127.30.63.3:0 shutting down...
I20260709 13:17:21.909659 30972 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:21.910745 30972 tablet_replica.cc:333] T 7c0c24e4de70467b86659171853fd6de P 6beeb97aa49249eb8aeeaf764cbab2bf: stopping tablet replica
I20260709 13:17:21.911722 30972 raft_consensus.cc:2243] T 7c0c24e4de70467b86659171853fd6de P 6beeb97aa49249eb8aeeaf764cbab2bf [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:21.912910 30972 raft_consensus.cc:2272] T 7c0c24e4de70467b86659171853fd6de P 6beeb97aa49249eb8aeeaf764cbab2bf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.916817 30972 tablet_replica.cc:333] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf: stopping tablet replica
I20260709 13:17:21.918057 30972 raft_consensus.cc:2243] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:21.919587 30972 raft_consensus.cc:2272] T 3bc4d66484094db0aae6dfb29587774a P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.923236 30972 tablet_replica.cc:333] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf: stopping tablet replica
I20260709 13:17:21.924299 30972 raft_consensus.cc:2243] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:21.925843 30972 raft_consensus.cc:2272] T faaef8ba24094ff399cbfb39f7894125 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.929829 30972 tablet_replica.cc:333] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf: stopping tablet replica
I20260709 13:17:21.930835 30972 raft_consensus.cc:2243] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.931692 30972 raft_consensus.cc:2272] T 41b6746cc1154961b2c27c96e04bbdab P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.935349 30972 tablet_replica.cc:333] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf: stopping tablet replica
I20260709 13:17:21.936232 30972 raft_consensus.cc:2243] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:21.937472 30972 raft_consensus.cc:2272] T 5b61ab45e369457b8a3824ee01df4030 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.941604 30972 tablet_replica.cc:333] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf: stopping tablet replica
I20260709 13:17:21.942658 30972 raft_consensus.cc:2243] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.943356 30972 raft_consensus.cc:2272] T 69a49b7ef53144babd52bc66266d5aa1 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.946996 30972 tablet_replica.cc:333] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf: stopping tablet replica
I20260709 13:17:21.947965 30972 raft_consensus.cc:2243] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:21.949414 30972 raft_consensus.cc:2272] T a87554f5c20f4f5cb0a2c7deb51eec5b P 6beeb97aa49249eb8aeeaf764cbab2bf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.953035 30972 tablet_replica.cc:333] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf: stopping tablet replica
I20260709 13:17:21.953935 30972 raft_consensus.cc:2243] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:17:21.955467 30972 raft_consensus.cc:2272] T e8f0b2f6fc574e328e072a92f5192c79 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.958896 30972 tablet_replica.cc:333] T eb93f7930f19442bbf52f407b7123fe7 P 6beeb97aa49249eb8aeeaf764cbab2bf: stopping tablet replica
I20260709 13:17:21.959671 30972 raft_consensus.cc:2243] T eb93f7930f19442bbf52f407b7123fe7 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.960326 30972 raft_consensus.cc:2272] T eb93f7930f19442bbf52f407b7123fe7 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.963536 30972 tablet_replica.cc:333] T a9e2a2f0d5754921996f26c015b13e67 P 6beeb97aa49249eb8aeeaf764cbab2bf: stopping tablet replica
I20260709 13:17:21.964207 30972 raft_consensus.cc:2243] T a9e2a2f0d5754921996f26c015b13e67 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.964891 30972 raft_consensus.cc:2272] T a9e2a2f0d5754921996f26c015b13e67 P 6beeb97aa49249eb8aeeaf764cbab2bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:22.019209 30972 tablet_server.cc:196] TabletServer@127.30.63.3:0 shutdown complete.
I20260709 13:17:22.044876 30972 master.cc:562] Master@127.30.63.62:40839 shutting down...
I20260709 13:17:22.069525 30972 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b4f0cf888beb46b2bf86593bf41d0e86 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:22.070149 30972 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b4f0cf888beb46b2bf86593bf41d0e86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:22.070684 30972 tablet_replica.cc:333] T 00000000000000000000000000000000 P b4f0cf888beb46b2bf86593bf41d0e86: stopping tablet replica
I20260709 13:17:22.092983 30972 master.cc:584] Master@127.30.63.62:40839 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13467 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:17:22.138123 30972 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.30.63.62:34773
I20260709 13:17:22.139329 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:22.146095  9703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:22.146157  9705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:22.146204  9702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:22.146727 30972 server_base.cc:1061] running on GCE node
I20260709 13:17:22.148129 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:22.148344 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:22.148515 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783603042148499 us; error 0 us; skew 500 ppm
I20260709 13:17:22.149132 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:22.151697 30972 webserver.cc:533] Webserver started at http://127.30.63.62:39633/ using document root <none> and password file <none>
I20260709 13:17:22.152230 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:22.152439 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:22.152781 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:22.153995 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602730526113-30972-0/minicluster-data/master-0-root/instance:
uuid: "c7367ee7a4e3453b86785eca97aa8e2e"
format_stamp: "Formatted at 2026-07-09 13:17:22 on dist-test-slave-c08m"
I20260709 13:17:22.158505 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:17:22.162026  9710 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:22.162925 30972 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:17:22.163173 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602730526113-30972-0/minicluster-data/master-0-root
uuid: "c7367ee7a4e3453b86785eca97aa8e2e"
format_stamp: "Formatted at 2026-07-09 13:17:22 on dist-test-slave-c08m"
I20260709 13:17:22.163420 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602730526113-30972-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602730526113-30972-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602730526113-30972-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:22.182833 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:22.184119 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:22.227104 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.62:34773
I20260709 13:17:22.227248  9761 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.62:34773 every 8 connection(s)
I20260709 13:17:22.231608  9762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.245240  9762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7367ee7a4e3453b86785eca97aa8e2e: Bootstrap starting.
I20260709 13:17:22.251024  9762 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7367ee7a4e3453b86785eca97aa8e2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:22.255966  9762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7367ee7a4e3453b86785eca97aa8e2e: No bootstrap required, opened a new log
I20260709 13:17:22.258867  9762 raft_consensus.cc:359] T 00000000000000000000000000000000 P c7367ee7a4e3453b86785eca97aa8e2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7367ee7a4e3453b86785eca97aa8e2e" member_type: VOTER }
I20260709 13:17:22.259291  9762 raft_consensus.cc:385] T 00000000000000000000000000000000 P c7367ee7a4e3453b86785eca97aa8e2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:22.259584  9762 raft_consensus.cc:740] T 00000000000000000000000000000000 P c7367ee7a4e3453b86785eca97aa8e2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7367ee7a4e3453b86785eca97aa8e2e, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.260303  9762 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7367ee7a4e3453b86785eca97aa8e2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7367ee7a4e3453b86785eca97aa8e2e" member_type: VOTER }
I20260709 13:17:22.260891  9762 raft_consensus.cc:399] T 00000000000000000000000000000000 P c7367ee7a4e3453b86785eca97aa8e2e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:17:22.261291  9762 raft_consensus.cc:493] T 00000000000000000000000000000000 P c7367ee7a4e3453b86785eca97aa8e2e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:17:22.261606  9762 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c7367ee7a4e3453b86785eca97aa8e2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:22.267436  9762 raft_consensus.cc:515] T 00000000000000000000000000000000 P c7367ee7a4e3453b86785eca97aa8e2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7367ee7a4e3453b86785eca97aa8e2e" member_type: VOTER }
I20260709 13:17:22.268079  9762 leader_election.cc:304] T 00000000000000000000000000000000 P c7367ee7a4e3453b86785eca97aa8e2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c7367ee7a4e3453b86785eca97aa8e2e; no voters: 
I20260709 13:17:22.269439  9762 leader_election.cc:290] T 00000000000000000000000000000000 P c7367ee7a4e3453b86785eca97aa8e2e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:17:22.269845  9765 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c7367ee7a4e3453b86785eca97aa8e2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:22.271588  9765 raft_consensus.cc:697] T 00000000000000000000000000000000 P c7367ee7a4e3453b86785eca97aa8e2e [term 1 LEADER]: Becoming Leader. State: Replica: c7367ee7a4e3453b86785eca97aa8e2e, State: Running, Role: LEADER
I20260709 13:17:22.272308  9765 consensus_queue.cc:237] T 00000000000000000000000000000000 P c7367ee7a4e3453b86785eca97aa8e2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7367ee7a4e3453b86785eca97aa8e2e" member_type: VOTER }
I20260709 13:17:22.272692  9762 sys_catalog.cc:565] T 00000000000000000000000000000000 P c7367ee7a4e3453b86785eca97aa8e2e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:17:22.277812  9766 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7367ee7a4e3453b86785eca97aa8e2e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c7367ee7a4e3453b86785eca97aa8e2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7367ee7a4e3453b86785eca97aa8e2e" member_type: VOTER } }
I20260709 13:17:22.278326  9767 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7367ee7a4e3453b86785eca97aa8e2e [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7367ee7a4e3453b86785eca97aa8e2e. Latest consensus state: current_term: 1 leader_uuid: "c7367ee7a4e3453b86785eca97aa8e2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7367ee7a4e3453b86785eca97aa8e2e" member_type: VOTER } }
I20260709 13:17:22.278512  9766 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7367ee7a4e3453b86785eca97aa8e2e [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:22.279088  9767 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7367ee7a4e3453b86785eca97aa8e2e [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:22.280931  9771 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:17:22.286041  9771 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:17:22.292301 30972 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:17:22.297004  9771 catalog_manager.cc:1383] Generated new cluster ID: 85f692413539429aba1fd9be618a6c2e
I20260709 13:17:22.297420  9771 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:17:22.313868  9771 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:17:22.315248  9771 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:17:22.329277  9771 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c7367ee7a4e3453b86785eca97aa8e2e: Generated new TSK 0
I20260709 13:17:22.329890  9771 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:17:22.362861 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:22.369724  9783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:22.371058  9784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:22.377509 30972 server_base.cc:1061] running on GCE node
W20260709 13:17:22.376123  9786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:22.382357 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:22.382568 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:22.382702 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783603042382691 us; error 0 us; skew 500 ppm
I20260709 13:17:22.383213 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:22.386034 30972 webserver.cc:533] Webserver started at http://127.30.63.1:38431/ using document root <none> and password file <none>
I20260709 13:17:22.386471 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:22.386641 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:22.386868 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:22.387998 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602730526113-30972-0/minicluster-data/ts-0-root/instance:
uuid: "2680c6c6ee174bdf8a79b47c89889c1a"
format_stamp: "Formatted at 2026-07-09 13:17:22 on dist-test-slave-c08m"
I20260709 13:17:22.392510 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:17:22.395973  9791 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:22.397010 30972 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:17:22.397320 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602730526113-30972-0/minicluster-data/ts-0-root
uuid: "2680c6c6ee174bdf8a79b47c89889c1a"
format_stamp: "Formatted at 2026-07-09 13:17:22 on dist-test-slave-c08m"
I20260709 13:17:22.397632 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602730526113-30972-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602730526113-30972-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602730526113-30972-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:22.424252 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:22.425549 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:22.427078 30972 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:22.429461 30972 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:22.429675 30972 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:22.429925 30972 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:22.430120 30972 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:22.474166 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.1:43679
I20260709 13:17:22.474304  9853 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.1:43679 every 8 connection(s)
I20260709 13:17:22.479533 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:22.487344  9858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:22.489099  9859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:22.491039 30972 server_base.cc:1061] running on GCE node
W20260709 13:17:22.492350  9861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:22.493497 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:17:22.493702  9854 heartbeater.cc:344] Connected to a master server at 127.30.63.62:34773
W20260709 13:17:22.493739 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:22.494148 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783603042494129 us; error 0 us; skew 500 ppm
I20260709 13:17:22.494205  9854 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:22.494784 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:22.495210  9854 heartbeater.cc:507] Master 127.30.63.62:34773 requested a full tablet report, sending...
I20260709 13:17:22.497774  9727 ts_manager.cc:194] Registered new tserver with Master: 2680c6c6ee174bdf8a79b47c89889c1a (127.30.63.1:43679)
I20260709 13:17:22.497895 30972 webserver.cc:533] Webserver started at http://127.30.63.2:35195/ using document root <none> and password file <none>
I20260709 13:17:22.498507 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:22.498723 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:22.498986 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:22.500093  9727 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49902
I20260709 13:17:22.500204 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602730526113-30972-0/minicluster-data/ts-1-root/instance:
uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8"
format_stamp: "Formatted at 2026-07-09 13:17:22 on dist-test-slave-c08m"
I20260709 13:17:22.505255 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:17:22.509279  9866 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:22.510293 30972 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:17:22.510768 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602730526113-30972-0/minicluster-data/ts-1-root
uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8"
format_stamp: "Formatted at 2026-07-09 13:17:22 on dist-test-slave-c08m"
I20260709 13:17:22.511127 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602730526113-30972-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602730526113-30972-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602730526113-30972-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:22.552703 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:22.554041 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:22.555722 30972 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:22.558531 30972 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:22.558791 30972 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:22.559056 30972 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:22.559228 30972 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:22.605633 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.2:41011
I20260709 13:17:22.605788  9928 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.2:41011 every 8 connection(s)
I20260709 13:17:22.611281 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:22.620373  9932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:22.621034  9933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:22.624749  9936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:22.625483 30972 server_base.cc:1061] running on GCE node
I20260709 13:17:22.626572 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:22.626837 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:22.626801  9929 heartbeater.cc:344] Connected to a master server at 127.30.63.62:34773
I20260709 13:17:22.627326 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783603042627304 us; error 0 us; skew 500 ppm
I20260709 13:17:22.627493  9929 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:22.628161 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:22.628481  9929 heartbeater.cc:507] Master 127.30.63.62:34773 requested a full tablet report, sending...
I20260709 13:17:22.631603  9727 ts_manager.cc:194] Registered new tserver with Master: ad8fa519bb8e44a2a4d2d61ee4848fc8 (127.30.63.2:41011)
I20260709 13:17:22.632186 30972 webserver.cc:533] Webserver started at http://127.30.63.3:46871/ using document root <none> and password file <none>
I20260709 13:17:22.632879 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:22.633100 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:22.633369 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:22.633471  9727 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49916
I20260709 13:17:22.635227 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602730526113-30972-0/minicluster-data/ts-2-root/instance:
uuid: "3eb5be965fde4d5881a7b497c7d2e8a3"
format_stamp: "Formatted at 2026-07-09 13:17:22 on dist-test-slave-c08m"
I20260709 13:17:22.640964 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:17:22.644500  9940 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:22.645390 30972 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:17:22.645715 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602730526113-30972-0/minicluster-data/ts-2-root
uuid: "3eb5be965fde4d5881a7b497c7d2e8a3"
format_stamp: "Formatted at 2026-07-09 13:17:22 on dist-test-slave-c08m"
I20260709 13:17:22.646023 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602730526113-30972-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602730526113-30972-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602730526113-30972-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:22.664409 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:22.665759 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:22.667105 30972 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:22.669423 30972 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:22.669656 30972 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:22.669898 30972 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:22.670082 30972 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:22.713995 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.3:45433
I20260709 13:17:22.714097 10002 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.3:45433 every 8 connection(s)
I20260709 13:17:22.729290 10003 heartbeater.cc:344] Connected to a master server at 127.30.63.62:34773
I20260709 13:17:22.729702 10003 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:22.730464 10003 heartbeater.cc:507] Master 127.30.63.62:34773 requested a full tablet report, sending...
I20260709 13:17:22.732697  9727 ts_manager.cc:194] Registered new tserver with Master: 3eb5be965fde4d5881a7b497c7d2e8a3 (127.30.63.3:45433)
I20260709 13:17:22.732827 30972 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015613614s
I20260709 13:17:22.734179  9727 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49928
I20260709 13:17:22.762369  9727 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49938:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:22.765348  9727 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:22.816926  9968 tablet_service.cc:1511] Processing CreateTablet for tablet 32906bbb352b42d28812e9553e9eaccb (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=09b16e30725943b8afe72b07a282ced8]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:17:22.817027  9819 tablet_service.cc:1511] Processing CreateTablet for tablet 32906bbb352b42d28812e9553e9eaccb (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=09b16e30725943b8afe72b07a282ced8]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:17:22.818262  9968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32906bbb352b42d28812e9553e9eaccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.818005  9818 tablet_service.cc:1511] Processing CreateTablet for tablet 0686e80cc91e4bdaa9a5ec7fb02d3ee8 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=09b16e30725943b8afe72b07a282ced8]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:17:22.818512  9819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32906bbb352b42d28812e9553e9eaccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.819394  9818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0686e80cc91e4bdaa9a5ec7fb02d3ee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.828308  9967 tablet_service.cc:1511] Processing CreateTablet for tablet 0686e80cc91e4bdaa9a5ec7fb02d3ee8 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=09b16e30725943b8afe72b07a282ced8]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:17:22.829841  9967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0686e80cc91e4bdaa9a5ec7fb02d3ee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.841060 10018 tablet_bootstrap.cc:492] T 32906bbb352b42d28812e9553e9eaccb P 3eb5be965fde4d5881a7b497c7d2e8a3: Bootstrap starting.
I20260709 13:17:22.850183 10019 tablet_bootstrap.cc:492] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 2680c6c6ee174bdf8a79b47c89889c1a: Bootstrap starting.
I20260709 13:17:22.852651 10018 tablet_bootstrap.cc:654] T 32906bbb352b42d28812e9553e9eaccb P 3eb5be965fde4d5881a7b497c7d2e8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:22.858935  9894 tablet_service.cc:1511] Processing CreateTablet for tablet 32906bbb352b42d28812e9553e9eaccb (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=09b16e30725943b8afe72b07a282ced8]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:17:22.859520  9893 tablet_service.cc:1511] Processing CreateTablet for tablet 0686e80cc91e4bdaa9a5ec7fb02d3ee8 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=09b16e30725943b8afe72b07a282ced8]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:17:22.860670  9894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32906bbb352b42d28812e9553e9eaccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.862069  9893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0686e80cc91e4bdaa9a5ec7fb02d3ee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.864302 10019 tablet_bootstrap.cc:654] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 2680c6c6ee174bdf8a79b47c89889c1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:22.868857 10018 tablet_bootstrap.cc:492] T 32906bbb352b42d28812e9553e9eaccb P 3eb5be965fde4d5881a7b497c7d2e8a3: No bootstrap required, opened a new log
I20260709 13:17:22.869822 10018 ts_tablet_manager.cc:1403] T 32906bbb352b42d28812e9553e9eaccb P 3eb5be965fde4d5881a7b497c7d2e8a3: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.014s
I20260709 13:17:22.872833 10018 raft_consensus.cc:359] T 32906bbb352b42d28812e9553e9eaccb P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } } peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } }
I20260709 13:17:22.873661 10018 raft_consensus.cc:385] T 32906bbb352b42d28812e9553e9eaccb P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:22.874119 10018 raft_consensus.cc:740] T 32906bbb352b42d28812e9553e9eaccb P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eb5be965fde4d5881a7b497c7d2e8a3, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.874961 10018 consensus_queue.cc:260] T 32906bbb352b42d28812e9553e9eaccb P 3eb5be965fde4d5881a7b497c7d2e8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } } peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } }
I20260709 13:17:22.883510 10019 tablet_bootstrap.cc:492] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 2680c6c6ee174bdf8a79b47c89889c1a: No bootstrap required, opened a new log
I20260709 13:17:22.884195 10019 ts_tablet_manager.cc:1403] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 2680c6c6ee174bdf8a79b47c89889c1a: Time spent bootstrapping tablet: real 0.034s	user 0.020s	sys 0.004s
I20260709 13:17:22.887899 10003 heartbeater.cc:499] Master 127.30.63.62:34773 was elected leader, sending a full tablet report...
I20260709 13:17:22.888445 10018 ts_tablet_manager.cc:1434] T 32906bbb352b42d28812e9553e9eaccb P 3eb5be965fde4d5881a7b497c7d2e8a3: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.009s
I20260709 13:17:22.889616 10023 tablet_bootstrap.cc:492] T 32906bbb352b42d28812e9553e9eaccb P ad8fa519bb8e44a2a4d2d61ee4848fc8: Bootstrap starting.
I20260709 13:17:22.889796 10018 tablet_bootstrap.cc:492] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 3eb5be965fde4d5881a7b497c7d2e8a3: Bootstrap starting.
I20260709 13:17:22.890385 10019 raft_consensus.cc:359] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 2680c6c6ee174bdf8a79b47c89889c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:22.891467 10019 raft_consensus.cc:385] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 2680c6c6ee174bdf8a79b47c89889c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:22.891846 10019 raft_consensus.cc:740] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 2680c6c6ee174bdf8a79b47c89889c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2680c6c6ee174bdf8a79b47c89889c1a, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.893074 10019 consensus_queue.cc:260] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 2680c6c6ee174bdf8a79b47c89889c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:22.897691 10018 tablet_bootstrap.cc:654] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 3eb5be965fde4d5881a7b497c7d2e8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:22.898819 10023 tablet_bootstrap.cc:654] T 32906bbb352b42d28812e9553e9eaccb P ad8fa519bb8e44a2a4d2d61ee4848fc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:22.909897 10019 ts_tablet_manager.cc:1434] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 2680c6c6ee174bdf8a79b47c89889c1a: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.007s
I20260709 13:17:22.911012  9854 heartbeater.cc:499] Master 127.30.63.62:34773 was elected leader, sending a full tablet report...
I20260709 13:17:22.912389 10019 tablet_bootstrap.cc:492] T 32906bbb352b42d28812e9553e9eaccb P 2680c6c6ee174bdf8a79b47c89889c1a: Bootstrap starting.
I20260709 13:17:22.914462 10018 tablet_bootstrap.cc:492] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 3eb5be965fde4d5881a7b497c7d2e8a3: No bootstrap required, opened a new log
I20260709 13:17:22.915035 10018 ts_tablet_manager.cc:1403] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 3eb5be965fde4d5881a7b497c7d2e8a3: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.016s
I20260709 13:17:22.917451 10018 raft_consensus.cc:359] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:22.918025 10018 raft_consensus.cc:385] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:22.918367 10018 raft_consensus.cc:740] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eb5be965fde4d5881a7b497c7d2e8a3, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.919636 10019 tablet_bootstrap.cc:654] T 32906bbb352b42d28812e9553e9eaccb P 2680c6c6ee174bdf8a79b47c89889c1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:22.919332 10018 consensus_queue.cc:260] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 3eb5be965fde4d5881a7b497c7d2e8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:22.921749 10018 ts_tablet_manager.cc:1434] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 3eb5be965fde4d5881a7b497c7d2e8a3: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:17:22.924505 10023 tablet_bootstrap.cc:492] T 32906bbb352b42d28812e9553e9eaccb P ad8fa519bb8e44a2a4d2d61ee4848fc8: No bootstrap required, opened a new log
I20260709 13:17:22.925325 10023 ts_tablet_manager.cc:1403] T 32906bbb352b42d28812e9553e9eaccb P ad8fa519bb8e44a2a4d2d61ee4848fc8: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.015s
I20260709 13:17:22.927843 10023 raft_consensus.cc:359] T 32906bbb352b42d28812e9553e9eaccb P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } } peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } }
I20260709 13:17:22.929131 10023 raft_consensus.cc:385] T 32906bbb352b42d28812e9553e9eaccb P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:22.930606 10023 raft_consensus.cc:740] T 32906bbb352b42d28812e9553e9eaccb P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad8fa519bb8e44a2a4d2d61ee4848fc8, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.931777 10019 tablet_bootstrap.cc:492] T 32906bbb352b42d28812e9553e9eaccb P 2680c6c6ee174bdf8a79b47c89889c1a: No bootstrap required, opened a new log
I20260709 13:17:22.932662 10019 ts_tablet_manager.cc:1403] T 32906bbb352b42d28812e9553e9eaccb P 2680c6c6ee174bdf8a79b47c89889c1a: Time spent bootstrapping tablet: real 0.020s	user 0.019s	sys 0.000s
I20260709 13:17:22.931924 10023 consensus_queue.cc:260] T 32906bbb352b42d28812e9553e9eaccb P ad8fa519bb8e44a2a4d2d61ee4848fc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } } peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } }
I20260709 13:17:22.935484  9929 heartbeater.cc:499] Master 127.30.63.62:34773 was elected leader, sending a full tablet report...
I20260709 13:17:22.935724 10023 ts_tablet_manager.cc:1434] T 32906bbb352b42d28812e9553e9eaccb P ad8fa519bb8e44a2a4d2d61ee4848fc8: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 13:17:22.936278 10019 raft_consensus.cc:359] T 32906bbb352b42d28812e9553e9eaccb P 2680c6c6ee174bdf8a79b47c89889c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } } peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } }
I20260709 13:17:22.936887 10023 tablet_bootstrap.cc:492] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P ad8fa519bb8e44a2a4d2d61ee4848fc8: Bootstrap starting.
I20260709 13:17:22.937098 10019 raft_consensus.cc:385] T 32906bbb352b42d28812e9553e9eaccb P 2680c6c6ee174bdf8a79b47c89889c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:22.937475 10019 raft_consensus.cc:740] T 32906bbb352b42d28812e9553e9eaccb P 2680c6c6ee174bdf8a79b47c89889c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2680c6c6ee174bdf8a79b47c89889c1a, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.938262 10019 consensus_queue.cc:260] T 32906bbb352b42d28812e9553e9eaccb P 2680c6c6ee174bdf8a79b47c89889c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } } peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } }
I20260709 13:17:22.940907 10019 ts_tablet_manager.cc:1434] T 32906bbb352b42d28812e9553e9eaccb P 2680c6c6ee174bdf8a79b47c89889c1a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:17:22.944903 10023 tablet_bootstrap.cc:654] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P ad8fa519bb8e44a2a4d2d61ee4848fc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:22.951686 10023 tablet_bootstrap.cc:492] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P ad8fa519bb8e44a2a4d2d61ee4848fc8: No bootstrap required, opened a new log
I20260709 13:17:22.952262 10023 ts_tablet_manager.cc:1403] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P ad8fa519bb8e44a2a4d2d61ee4848fc8: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.003s
I20260709 13:17:22.954818 10023 raft_consensus.cc:359] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:22.955483 10023 raft_consensus.cc:385] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:22.955787 10023 raft_consensus.cc:740] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad8fa519bb8e44a2a4d2d61ee4848fc8, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.956549 10023 consensus_queue.cc:260] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P ad8fa519bb8e44a2a4d2d61ee4848fc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:22.958704 10023 ts_tablet_manager.cc:1434] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P ad8fa519bb8e44a2a4d2d61ee4848fc8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:17:22.970890 10024 raft_consensus.cc:493] T 32906bbb352b42d28812e9553e9eaccb P 2680c6c6ee174bdf8a79b47c89889c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.971608 10024 raft_consensus.cc:515] T 32906bbb352b42d28812e9553e9eaccb P 2680c6c6ee174bdf8a79b47c89889c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } } peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } }
I20260709 13:17:22.974803 10024 leader_election.cc:290] T 32906bbb352b42d28812e9553e9eaccb P 2680c6c6ee174bdf8a79b47c89889c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3eb5be965fde4d5881a7b497c7d2e8a3 (127.30.63.3:45433), ad8fa519bb8e44a2a4d2d61ee4848fc8 (127.30.63.2:41011)
I20260709 13:17:22.987255  9978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32906bbb352b42d28812e9553e9eaccb" candidate_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" is_pre_election: true
I20260709 13:17:22.988749  9978 raft_consensus.cc:2468] T 32906bbb352b42d28812e9553e9eaccb P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2680c6c6ee174bdf8a79b47c89889c1a in term 0.
I20260709 13:17:22.988992  9904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32906bbb352b42d28812e9553e9eaccb" candidate_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" is_pre_election: true
I20260709 13:17:22.990276  9904 raft_consensus.cc:2468] T 32906bbb352b42d28812e9553e9eaccb P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2680c6c6ee174bdf8a79b47c89889c1a in term 0.
I20260709 13:17:22.990593  9792 leader_election.cc:304] T 32906bbb352b42d28812e9553e9eaccb P 2680c6c6ee174bdf8a79b47c89889c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2680c6c6ee174bdf8a79b47c89889c1a, 3eb5be965fde4d5881a7b497c7d2e8a3; no voters: 
I20260709 13:17:22.992233 10024 raft_consensus.cc:2804] T 32906bbb352b42d28812e9553e9eaccb P 2680c6c6ee174bdf8a79b47c89889c1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:22.992822 10024 raft_consensus.cc:493] T 32906bbb352b42d28812e9553e9eaccb P 2680c6c6ee174bdf8a79b47c89889c1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.993242 10024 raft_consensus.cc:3060] T 32906bbb352b42d28812e9553e9eaccb P 2680c6c6ee174bdf8a79b47c89889c1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:22.999366 10024 raft_consensus.cc:515] T 32906bbb352b42d28812e9553e9eaccb P 2680c6c6ee174bdf8a79b47c89889c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } } peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } }
I20260709 13:17:23.001417 10024 leader_election.cc:290] T 32906bbb352b42d28812e9553e9eaccb P 2680c6c6ee174bdf8a79b47c89889c1a [CANDIDATE]: Term 1 election: Requested vote from peers 3eb5be965fde4d5881a7b497c7d2e8a3 (127.30.63.3:45433), ad8fa519bb8e44a2a4d2d61ee4848fc8 (127.30.63.2:41011)
I20260709 13:17:23.002509  9978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32906bbb352b42d28812e9553e9eaccb" candidate_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3"
I20260709 13:17:23.002525  9904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32906bbb352b42d28812e9553e9eaccb" candidate_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8"
I20260709 13:17:23.003089  9978 raft_consensus.cc:3060] T 32906bbb352b42d28812e9553e9eaccb P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:23.003423  9904 raft_consensus.cc:3060] T 32906bbb352b42d28812e9553e9eaccb P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:23.010488  9904 raft_consensus.cc:2468] T 32906bbb352b42d28812e9553e9eaccb P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2680c6c6ee174bdf8a79b47c89889c1a in term 1.
I20260709 13:17:23.010568  9978 raft_consensus.cc:2468] T 32906bbb352b42d28812e9553e9eaccb P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2680c6c6ee174bdf8a79b47c89889c1a in term 1.
I20260709 13:17:23.011875  9792 leader_election.cc:304] T 32906bbb352b42d28812e9553e9eaccb P 2680c6c6ee174bdf8a79b47c89889c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2680c6c6ee174bdf8a79b47c89889c1a, 3eb5be965fde4d5881a7b497c7d2e8a3, ad8fa519bb8e44a2a4d2d61ee4848fc8; no voters: 
I20260709 13:17:23.012912 10024 raft_consensus.cc:2804] T 32906bbb352b42d28812e9553e9eaccb P 2680c6c6ee174bdf8a79b47c89889c1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:23.014293 10024 raft_consensus.cc:697] T 32906bbb352b42d28812e9553e9eaccb P 2680c6c6ee174bdf8a79b47c89889c1a [term 1 LEADER]: Becoming Leader. State: Replica: 2680c6c6ee174bdf8a79b47c89889c1a, State: Running, Role: LEADER
I20260709 13:17:23.015210 10024 consensus_queue.cc:237] T 32906bbb352b42d28812e9553e9eaccb P 2680c6c6ee174bdf8a79b47c89889c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } } peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } }
I20260709 13:17:23.024212  9725 catalog_manager.cc:5697] T 32906bbb352b42d28812e9553e9eaccb P 2680c6c6ee174bdf8a79b47c89889c1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 2680c6c6ee174bdf8a79b47c89889c1a (127.30.63.1). New cstate: current_term: 1 leader_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:23.256729 10022 raft_consensus.cc:493] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.257305 10022 raft_consensus.cc:515] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:23.259369 10022 leader_election.cc:290] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 3eb5be965fde4d5881a7b497c7d2e8a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2680c6c6ee174bdf8a79b47c89889c1a (127.30.63.1:43679), ad8fa519bb8e44a2a4d2d61ee4848fc8 (127.30.63.2:41011)
I20260709 13:17:23.271591  9829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0686e80cc91e4bdaa9a5ec7fb02d3ee8" candidate_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" is_pre_election: true
I20260709 13:17:23.271620  9904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0686e80cc91e4bdaa9a5ec7fb02d3ee8" candidate_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" is_pre_election: true
I20260709 13:17:23.272497  9829 raft_consensus.cc:2468] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 2680c6c6ee174bdf8a79b47c89889c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3eb5be965fde4d5881a7b497c7d2e8a3 in term 0.
I20260709 13:17:23.272528  9904 raft_consensus.cc:2468] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3eb5be965fde4d5881a7b497c7d2e8a3 in term 0.
I20260709 13:17:23.273876  9943 leader_election.cc:304] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 3eb5be965fde4d5881a7b497c7d2e8a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eb5be965fde4d5881a7b497c7d2e8a3, ad8fa519bb8e44a2a4d2d61ee4848fc8; no voters: 
I20260709 13:17:23.274847 10022 raft_consensus.cc:2804] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:23.275280 10022 raft_consensus.cc:493] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.275547 10022 raft_consensus.cc:3060] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:23.281493 10022 raft_consensus.cc:515] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:23.283367 10022 leader_election.cc:290] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 3eb5be965fde4d5881a7b497c7d2e8a3 [CANDIDATE]: Term 1 election: Requested vote from peers 2680c6c6ee174bdf8a79b47c89889c1a (127.30.63.1:43679), ad8fa519bb8e44a2a4d2d61ee4848fc8 (127.30.63.2:41011)
I20260709 13:17:23.284294  9829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0686e80cc91e4bdaa9a5ec7fb02d3ee8" candidate_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2680c6c6ee174bdf8a79b47c89889c1a"
I20260709 13:17:23.284569  9904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0686e80cc91e4bdaa9a5ec7fb02d3ee8" candidate_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8"
I20260709 13:17:23.284992  9829 raft_consensus.cc:3060] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 2680c6c6ee174bdf8a79b47c89889c1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:23.285313  9904 raft_consensus.cc:3060] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:23.287290  9775 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:23.290844  9904 raft_consensus.cc:2468] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eb5be965fde4d5881a7b497c7d2e8a3 in term 1.
I20260709 13:17:23.291175  9829 raft_consensus.cc:2468] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 2680c6c6ee174bdf8a79b47c89889c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eb5be965fde4d5881a7b497c7d2e8a3 in term 1.
I20260709 13:17:23.292026  9943 leader_election.cc:304] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 3eb5be965fde4d5881a7b497c7d2e8a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eb5be965fde4d5881a7b497c7d2e8a3, ad8fa519bb8e44a2a4d2d61ee4848fc8; no voters: 
I20260709 13:17:23.292860 10022 raft_consensus.cc:2804] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:23.294627 10022 raft_consensus.cc:697] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3eb5be965fde4d5881a7b497c7d2e8a3, State: Running, Role: LEADER
I20260709 13:17:23.295507 10022 consensus_queue.cc:237] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 3eb5be965fde4d5881a7b497c7d2e8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:23.302628  9725 catalog_manager.cc:5697] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 3eb5be965fde4d5881a7b497c7d2e8a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3eb5be965fde4d5881a7b497c7d2e8a3 (127.30.63.3). New cstate: current_term: 1 leader_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:23.434397  9725 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49942:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:23.436385  9725 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:23.466845  9819 tablet_service.cc:1511] Processing CreateTablet for tablet 68616a5e077f4bc78bd44954d00cefdf (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=6bc337c2bc094cac92c6f85a359e46dd]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:17:23.468084  9819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68616a5e077f4bc78bd44954d00cefdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.468037  9894 tablet_service.cc:1511] Processing CreateTablet for tablet 68616a5e077f4bc78bd44954d00cefdf (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=6bc337c2bc094cac92c6f85a359e46dd]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:17:23.469471  9894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68616a5e077f4bc78bd44954d00cefdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.469535  9967 tablet_service.cc:1511] Processing CreateTablet for tablet 68616a5e077f4bc78bd44954d00cefdf (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=6bc337c2bc094cac92c6f85a359e46dd]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:17:23.470801  9967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68616a5e077f4bc78bd44954d00cefdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.479046  9818 tablet_service.cc:1511] Processing CreateTablet for tablet 5c6d35587cf24c8c9590018164614fbf (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=6bc337c2bc094cac92c6f85a359e46dd]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:17:23.480429  9818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c6d35587cf24c8c9590018164614fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.484364  9893 tablet_service.cc:1511] Processing CreateTablet for tablet 5c6d35587cf24c8c9590018164614fbf (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=6bc337c2bc094cac92c6f85a359e46dd]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:17:23.485760  9893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c6d35587cf24c8c9590018164614fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.490836  9968 tablet_service.cc:1511] Processing CreateTablet for tablet 5c6d35587cf24c8c9590018164614fbf (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=6bc337c2bc094cac92c6f85a359e46dd]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:17:23.492200  9968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c6d35587cf24c8c9590018164614fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.507123 10044 tablet_bootstrap.cc:492] T 68616a5e077f4bc78bd44954d00cefdf P 2680c6c6ee174bdf8a79b47c89889c1a: Bootstrap starting.
I20260709 13:17:23.512243 10045 tablet_bootstrap.cc:492] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8: Bootstrap starting.
I20260709 13:17:23.514858 10044 tablet_bootstrap.cc:654] T 68616a5e077f4bc78bd44954d00cefdf P 2680c6c6ee174bdf8a79b47c89889c1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:23.518965 10043 tablet_bootstrap.cc:492] T 68616a5e077f4bc78bd44954d00cefdf P 3eb5be965fde4d5881a7b497c7d2e8a3: Bootstrap starting.
I20260709 13:17:23.519549 10045 tablet_bootstrap.cc:654] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:23.522218 10024 consensus_queue.cc:1048] T 32906bbb352b42d28812e9553e9eaccb P 2680c6c6ee174bdf8a79b47c89889c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:23.526134 10044 tablet_bootstrap.cc:492] T 68616a5e077f4bc78bd44954d00cefdf P 2680c6c6ee174bdf8a79b47c89889c1a: No bootstrap required, opened a new log
I20260709 13:17:23.526149 10045 tablet_bootstrap.cc:492] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8: No bootstrap required, opened a new log
I20260709 13:17:23.526400 10043 tablet_bootstrap.cc:654] T 68616a5e077f4bc78bd44954d00cefdf P 3eb5be965fde4d5881a7b497c7d2e8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:23.527053 10045 ts_tablet_manager.cc:1403] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.000s
I20260709 13:17:23.527064 10044 ts_tablet_manager.cc:1403] T 68616a5e077f4bc78bd44954d00cefdf P 2680c6c6ee174bdf8a79b47c89889c1a: Time spent bootstrapping tablet: real 0.020s	user 0.000s	sys 0.012s
I20260709 13:17:23.530628 10045 raft_consensus.cc:359] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:23.531467 10045 raft_consensus.cc:385] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:23.531080 10044 raft_consensus.cc:359] T 68616a5e077f4bc78bd44954d00cefdf P 2680c6c6ee174bdf8a79b47c89889c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:23.531809 10045 raft_consensus.cc:740] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad8fa519bb8e44a2a4d2d61ee4848fc8, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.532073 10044 raft_consensus.cc:385] T 68616a5e077f4bc78bd44954d00cefdf P 2680c6c6ee174bdf8a79b47c89889c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:23.533849 10044 raft_consensus.cc:740] T 68616a5e077f4bc78bd44954d00cefdf P 2680c6c6ee174bdf8a79b47c89889c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2680c6c6ee174bdf8a79b47c89889c1a, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.534646 10044 consensus_queue.cc:260] T 68616a5e077f4bc78bd44954d00cefdf P 2680c6c6ee174bdf8a79b47c89889c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:23.532961 10045 consensus_queue.cc:260] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:23.541036 10043 tablet_bootstrap.cc:492] T 68616a5e077f4bc78bd44954d00cefdf P 3eb5be965fde4d5881a7b497c7d2e8a3: No bootstrap required, opened a new log
I20260709 13:17:23.541640 10043 ts_tablet_manager.cc:1403] T 68616a5e077f4bc78bd44954d00cefdf P 3eb5be965fde4d5881a7b497c7d2e8a3: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.005s
I20260709 13:17:23.545706 10043 raft_consensus.cc:359] T 68616a5e077f4bc78bd44954d00cefdf P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:23.546550 10043 raft_consensus.cc:385] T 68616a5e077f4bc78bd44954d00cefdf P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:23.546964 10043 raft_consensus.cc:740] T 68616a5e077f4bc78bd44954d00cefdf P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eb5be965fde4d5881a7b497c7d2e8a3, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.548246 10043 consensus_queue.cc:260] T 68616a5e077f4bc78bd44954d00cefdf P 3eb5be965fde4d5881a7b497c7d2e8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:23.559983 10043 ts_tablet_manager.cc:1434] T 68616a5e077f4bc78bd44954d00cefdf P 3eb5be965fde4d5881a7b497c7d2e8a3: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:17:23.566920 10024 consensus_queue.cc:1048] T 32906bbb352b42d28812e9553e9eaccb P 2680c6c6ee174bdf8a79b47c89889c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:23.570263 10043 tablet_bootstrap.cc:492] T 5c6d35587cf24c8c9590018164614fbf P 3eb5be965fde4d5881a7b497c7d2e8a3: Bootstrap starting.
I20260709 13:17:23.576179 10054 raft_consensus.cc:493] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.576519 10045 ts_tablet_manager.cc:1434] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.012s
I20260709 13:17:23.577558 10054 raft_consensus.cc:515] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:23.578637 10045 tablet_bootstrap.cc:492] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8: Bootstrap starting.
I20260709 13:17:23.580623 10054 leader_election.cc:290] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2680c6c6ee174bdf8a79b47c89889c1a (127.30.63.1:43679), 3eb5be965fde4d5881a7b497c7d2e8a3 (127.30.63.3:45433)
I20260709 13:17:23.586907 10043 tablet_bootstrap.cc:654] T 5c6d35587cf24c8c9590018164614fbf P 3eb5be965fde4d5881a7b497c7d2e8a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:23.609732 10043 tablet_bootstrap.cc:492] T 5c6d35587cf24c8c9590018164614fbf P 3eb5be965fde4d5881a7b497c7d2e8a3: No bootstrap required, opened a new log
I20260709 13:17:23.610697 10043 ts_tablet_manager.cc:1403] T 5c6d35587cf24c8c9590018164614fbf P 3eb5be965fde4d5881a7b497c7d2e8a3: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.008s
I20260709 13:17:23.614704 10043 raft_consensus.cc:359] T 5c6d35587cf24c8c9590018164614fbf P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:23.615587 10043 raft_consensus.cc:385] T 5c6d35587cf24c8c9590018164614fbf P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:23.615952 10043 raft_consensus.cc:740] T 5c6d35587cf24c8c9590018164614fbf P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eb5be965fde4d5881a7b497c7d2e8a3, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.617269 10044 ts_tablet_manager.cc:1434] T 68616a5e077f4bc78bd44954d00cefdf P 2680c6c6ee174bdf8a79b47c89889c1a: Time spent starting tablet: real 0.090s	user 0.032s	sys 0.051s
I20260709 13:17:23.616910 10043 consensus_queue.cc:260] T 5c6d35587cf24c8c9590018164614fbf P 3eb5be965fde4d5881a7b497c7d2e8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:23.621032 10044 tablet_bootstrap.cc:492] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a: Bootstrap starting.
I20260709 13:17:23.628226 10044 tablet_bootstrap.cc:654] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:23.599140 10045 tablet_bootstrap.cc:654] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:23.631172  9829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6d35587cf24c8c9590018164614fbf" candidate_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" is_pre_election: true
W20260709 13:17:23.633560  9867 leader_election.cc:343] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2680c6c6ee174bdf8a79b47c89889c1a (127.30.63.1:43679): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:23.635382 10043 ts_tablet_manager.cc:1434] T 5c6d35587cf24c8c9590018164614fbf P 3eb5be965fde4d5881a7b497c7d2e8a3: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 13:17:23.639904 10044 tablet_bootstrap.cc:492] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a: No bootstrap required, opened a new log
I20260709 13:17:23.640560 10044 ts_tablet_manager.cc:1403] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.001s
I20260709 13:17:23.643011 10044 raft_consensus.cc:359] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:23.643563 10044 raft_consensus.cc:385] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:23.643922 10044 raft_consensus.cc:740] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2680c6c6ee174bdf8a79b47c89889c1a, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.644714 10044 consensus_queue.cc:260] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:23.646240 10045 tablet_bootstrap.cc:492] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8: No bootstrap required, opened a new log
I20260709 13:17:23.646833 10045 ts_tablet_manager.cc:1403] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.005s
I20260709 13:17:23.649122 10044 ts_tablet_manager.cc:1434] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:17:23.649919 10045 raft_consensus.cc:359] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:23.650614 10045 raft_consensus.cc:385] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:23.650913 10045 raft_consensus.cc:740] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad8fa519bb8e44a2a4d2d61ee4848fc8, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.651361  9978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6d35587cf24c8c9590018164614fbf" candidate_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" is_pre_election: true
I20260709 13:17:23.651993  9978 raft_consensus.cc:2468] T 5c6d35587cf24c8c9590018164614fbf P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad8fa519bb8e44a2a4d2d61ee4848fc8 in term 0.
I20260709 13:17:23.651676 10045 consensus_queue.cc:260] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:23.653257  9867 leader_election.cc:304] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3eb5be965fde4d5881a7b497c7d2e8a3, ad8fa519bb8e44a2a4d2d61ee4848fc8; no voters: 2680c6c6ee174bdf8a79b47c89889c1a
I20260709 13:17:23.654057 10045 ts_tablet_manager.cc:1434] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:17:23.654860 10054 raft_consensus.cc:2804] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:23.655263 10054 raft_consensus.cc:493] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.655592 10054 raft_consensus.cc:3060] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:23.662230 10054 raft_consensus.cc:515] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:23.664028 10054 leader_election.cc:290] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [CANDIDATE]: Term 1 election: Requested vote from peers 2680c6c6ee174bdf8a79b47c89889c1a (127.30.63.1:43679), 3eb5be965fde4d5881a7b497c7d2e8a3 (127.30.63.3:45433)
I20260709 13:17:23.664757  9829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6d35587cf24c8c9590018164614fbf" candidate_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2680c6c6ee174bdf8a79b47c89889c1a"
I20260709 13:17:23.665010  9978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6d35587cf24c8c9590018164614fbf" candidate_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3"
I20260709 13:17:23.665441  9829 raft_consensus.cc:3060] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:23.665575  9978 raft_consensus.cc:3060] T 5c6d35587cf24c8c9590018164614fbf P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:23.671051  9978 raft_consensus.cc:2468] T 5c6d35587cf24c8c9590018164614fbf P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad8fa519bb8e44a2a4d2d61ee4848fc8 in term 1.
I20260709 13:17:23.671193  9829 raft_consensus.cc:2468] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad8fa519bb8e44a2a4d2d61ee4848fc8 in term 1.
I20260709 13:17:23.672137  9867 leader_election.cc:304] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eb5be965fde4d5881a7b497c7d2e8a3, ad8fa519bb8e44a2a4d2d61ee4848fc8; no voters: 
I20260709 13:17:23.672957 10054 raft_consensus.cc:2804] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:23.673532 10054 raft_consensus.cc:697] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 1 LEADER]: Becoming Leader. State: Replica: ad8fa519bb8e44a2a4d2d61ee4848fc8, State: Running, Role: LEADER
I20260709 13:17:23.674038 10052 raft_consensus.cc:493] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.674288 10054 consensus_queue.cc:237] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:23.674584 10052 raft_consensus.cc:515] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:23.676928 10052 leader_election.cc:290] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2680c6c6ee174bdf8a79b47c89889c1a (127.30.63.1:43679), 3eb5be965fde4d5881a7b497c7d2e8a3 (127.30.63.3:45433)
I20260709 13:17:23.677629  9829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68616a5e077f4bc78bd44954d00cefdf" candidate_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" is_pre_election: true
I20260709 13:17:23.677913  9978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68616a5e077f4bc78bd44954d00cefdf" candidate_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" is_pre_election: true
I20260709 13:17:23.678571  9829 raft_consensus.cc:2468] T 68616a5e077f4bc78bd44954d00cefdf P 2680c6c6ee174bdf8a79b47c89889c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad8fa519bb8e44a2a4d2d61ee4848fc8 in term 0.
I20260709 13:17:23.678740  9978 raft_consensus.cc:2468] T 68616a5e077f4bc78bd44954d00cefdf P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad8fa519bb8e44a2a4d2d61ee4848fc8 in term 0.
I20260709 13:17:23.679889  9867 leader_election.cc:304] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2680c6c6ee174bdf8a79b47c89889c1a, ad8fa519bb8e44a2a4d2d61ee4848fc8; no voters: 
I20260709 13:17:23.680721 10052 raft_consensus.cc:2804] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:23.681092 10052 raft_consensus.cc:493] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.682935  9725 catalog_manager.cc:5697] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad8fa519bb8e44a2a4d2d61ee4848fc8 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:23.683992 10052 raft_consensus.cc:3060] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:23.688741 10022 consensus_queue.cc:1048] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 3eb5be965fde4d5881a7b497c7d2e8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:23.692003 10052 raft_consensus.cc:515] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:23.694691 10052 leader_election.cc:290] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [CANDIDATE]: Term 1 election: Requested vote from peers 2680c6c6ee174bdf8a79b47c89889c1a (127.30.63.1:43679), 3eb5be965fde4d5881a7b497c7d2e8a3 (127.30.63.3:45433)
I20260709 13:17:23.695640  9829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68616a5e077f4bc78bd44954d00cefdf" candidate_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2680c6c6ee174bdf8a79b47c89889c1a"
I20260709 13:17:23.696321  9829 raft_consensus.cc:3060] T 68616a5e077f4bc78bd44954d00cefdf P 2680c6c6ee174bdf8a79b47c89889c1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:23.704005  9829 raft_consensus.cc:2468] T 68616a5e077f4bc78bd44954d00cefdf P 2680c6c6ee174bdf8a79b47c89889c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad8fa519bb8e44a2a4d2d61ee4848fc8 in term 1.
I20260709 13:17:23.705224 10022 consensus_queue.cc:1048] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 3eb5be965fde4d5881a7b497c7d2e8a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:23.705636  9867 leader_election.cc:304] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2680c6c6ee174bdf8a79b47c89889c1a, ad8fa519bb8e44a2a4d2d61ee4848fc8; no voters: 
I20260709 13:17:23.706509 10052 raft_consensus.cc:2804] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:23.706568  9978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68616a5e077f4bc78bd44954d00cefdf" candidate_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3"
I20260709 13:17:23.707175 10052 raft_consensus.cc:697] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 1 LEADER]: Becoming Leader. State: Replica: ad8fa519bb8e44a2a4d2d61ee4848fc8, State: Running, Role: LEADER
I20260709 13:17:23.707327  9978 raft_consensus.cc:3060] T 68616a5e077f4bc78bd44954d00cefdf P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:23.708196 10052 consensus_queue.cc:237] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:23.716050  9978 raft_consensus.cc:2468] T 68616a5e077f4bc78bd44954d00cefdf P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad8fa519bb8e44a2a4d2d61ee4848fc8 in term 1.
I20260709 13:17:23.725349  9725 catalog_manager.cc:5697] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad8fa519bb8e44a2a4d2d61ee4848fc8 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:23.773272  9904 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68616a5e077f4bc78bd44954d00cefdf"
dest_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8"
mode: GRACEFUL
new_leader_uuid: "2680c6c6ee174bdf8a79b47c89889c1a"
 from {username='slave'} at 127.0.0.1:57830
I20260709 13:17:23.773901  9904 raft_consensus.cc:606] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 1 LEADER]: Received request to transfer leadership to TS 2680c6c6ee174bdf8a79b47c89889c1a
I20260709 13:17:23.779311  9904 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c6d35587cf24c8c9590018164614fbf"
dest_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8"
mode: GRACEFUL
new_leader_uuid: "2680c6c6ee174bdf8a79b47c89889c1a"
 from {username='slave'} at 127.0.0.1:57830
I20260709 13:17:23.779843  9904 raft_consensus.cc:606] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 1 LEADER]: Received request to transfer leadership to TS 2680c6c6ee174bdf8a79b47c89889c1a
I20260709 13:17:24.091238 10052 consensus_queue.cc:1048] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:24.097934 10054 raft_consensus.cc:993] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8: : Instructing follower 2680c6c6ee174bdf8a79b47c89889c1a to start an election
I20260709 13:17:24.098495 10056 raft_consensus.cc:1081] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 1 LEADER]: Signalling peer 2680c6c6ee174bdf8a79b47c89889c1a to start an election
I20260709 13:17:24.100958  9829 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68616a5e077f4bc78bd44954d00cefdf"
dest_uuid: "2680c6c6ee174bdf8a79b47c89889c1a"
 from {username='slave'} at 127.0.0.1:59780
I20260709 13:17:24.102562  9829 raft_consensus.cc:493] T 68616a5e077f4bc78bd44954d00cefdf P 2680c6c6ee174bdf8a79b47c89889c1a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:24.102974  9829 raft_consensus.cc:3060] T 68616a5e077f4bc78bd44954d00cefdf P 2680c6c6ee174bdf8a79b47c89889c1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:24.104007 10056 consensus_queue.cc:1048] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:24.109643  9829 raft_consensus.cc:515] T 68616a5e077f4bc78bd44954d00cefdf P 2680c6c6ee174bdf8a79b47c89889c1a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:24.114841  9829 leader_election.cc:290] T 68616a5e077f4bc78bd44954d00cefdf P 2680c6c6ee174bdf8a79b47c89889c1a [CANDIDATE]: Term 2 election: Requested vote from peers ad8fa519bb8e44a2a4d2d61ee4848fc8 (127.30.63.2:41011), 3eb5be965fde4d5881a7b497c7d2e8a3 (127.30.63.3:45433)
I20260709 13:17:24.115111  9904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68616a5e077f4bc78bd44954d00cefdf" candidate_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8"
I20260709 13:17:24.115816  9904 raft_consensus.cc:3055] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:24.116158  9904 raft_consensus.cc:740] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad8fa519bb8e44a2a4d2d61ee4848fc8, State: Running, Role: LEADER
I20260709 13:17:24.116988  9904 consensus_queue.cc:260] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:24.117638  9978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68616a5e077f4bc78bd44954d00cefdf" candidate_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3"
I20260709 13:17:24.118301  9904 raft_consensus.cc:3060] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:24.119102  9978 raft_consensus.cc:3060] T 68616a5e077f4bc78bd44954d00cefdf P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:24.125782  9904 raft_consensus.cc:2468] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2680c6c6ee174bdf8a79b47c89889c1a in term 2.
I20260709 13:17:24.125979  9978 raft_consensus.cc:2468] T 68616a5e077f4bc78bd44954d00cefdf P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2680c6c6ee174bdf8a79b47c89889c1a in term 2.
I20260709 13:17:24.127094  9794 leader_election.cc:304] T 68616a5e077f4bc78bd44954d00cefdf P 2680c6c6ee174bdf8a79b47c89889c1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2680c6c6ee174bdf8a79b47c89889c1a, ad8fa519bb8e44a2a4d2d61ee4848fc8; no voters: 
I20260709 13:17:24.127943 10051 raft_consensus.cc:2804] T 68616a5e077f4bc78bd44954d00cefdf P 2680c6c6ee174bdf8a79b47c89889c1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:24.128938 10051 raft_consensus.cc:697] T 68616a5e077f4bc78bd44954d00cefdf P 2680c6c6ee174bdf8a79b47c89889c1a [term 2 LEADER]: Becoming Leader. State: Replica: 2680c6c6ee174bdf8a79b47c89889c1a, State: Running, Role: LEADER
I20260709 13:17:24.129604 10051 consensus_queue.cc:237] T 68616a5e077f4bc78bd44954d00cefdf P 2680c6c6ee174bdf8a79b47c89889c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:24.135485  9725 catalog_manager.cc:5697] T 68616a5e077f4bc78bd44954d00cefdf P 2680c6c6ee174bdf8a79b47c89889c1a reported cstate change: term changed from 1 to 2, leader changed from ad8fa519bb8e44a2a4d2d61ee4848fc8 (127.30.63.2) to 2680c6c6ee174bdf8a79b47c89889c1a (127.30.63.1). New cstate: current_term: 2 leader_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:24.257966 10056 consensus_queue.cc:1048] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:24.264789 10052 raft_consensus.cc:993] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8: : Instructing follower 2680c6c6ee174bdf8a79b47c89889c1a to start an election
I20260709 13:17:24.265308 10052 raft_consensus.cc:1081] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 1 LEADER]: Signalling peer 2680c6c6ee174bdf8a79b47c89889c1a to start an election
I20260709 13:17:24.267153  9828 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c6d35587cf24c8c9590018164614fbf"
dest_uuid: "2680c6c6ee174bdf8a79b47c89889c1a"
 from {username='slave'} at 127.0.0.1:59780
I20260709 13:17:24.267732  9828 raft_consensus.cc:493] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:24.268141  9828 raft_consensus.cc:3060] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:24.270619 10056 consensus_queue.cc:1048] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:24.276770  9828 raft_consensus.cc:515] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:24.277980  9829 raft_consensus.cc:1240] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a [term 2 FOLLOWER]: Rejecting Update request from peer ad8fa519bb8e44a2a4d2d61ee4848fc8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:24.279681  9904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6d35587cf24c8c9590018164614fbf" candidate_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8"
I20260709 13:17:24.280440  9904 raft_consensus.cc:3055] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:24.280759  9828 leader_election.cc:290] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a [CANDIDATE]: Term 2 election: Requested vote from peers ad8fa519bb8e44a2a4d2d61ee4848fc8 (127.30.63.2:41011), 3eb5be965fde4d5881a7b497c7d2e8a3 (127.30.63.3:45433)
I20260709 13:17:24.280978  9978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6d35587cf24c8c9590018164614fbf" candidate_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3"
I20260709 13:17:24.281076  9904 raft_consensus.cc:740] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad8fa519bb8e44a2a4d2d61ee4848fc8, State: Running, Role: LEADER
I20260709 13:17:24.281630  9978 raft_consensus.cc:3060] T 5c6d35587cf24c8c9590018164614fbf P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:24.282068  9904 consensus_queue.cc:260] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:24.282981  9904 raft_consensus.cc:3060] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:24.288470  9978 raft_consensus.cc:2468] T 5c6d35587cf24c8c9590018164614fbf P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2680c6c6ee174bdf8a79b47c89889c1a in term 2.
I20260709 13:17:24.289008  9904 raft_consensus.cc:2468] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2680c6c6ee174bdf8a79b47c89889c1a in term 2.
I20260709 13:17:24.290083  9792 leader_election.cc:304] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2680c6c6ee174bdf8a79b47c89889c1a, 3eb5be965fde4d5881a7b497c7d2e8a3; no voters: 
I20260709 13:17:24.290910 10074 raft_consensus.cc:2804] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:24.291389 10074 raft_consensus.cc:697] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a [term 2 LEADER]: Becoming Leader. State: Replica: 2680c6c6ee174bdf8a79b47c89889c1a, State: Running, Role: LEADER
I20260709 13:17:24.292194 10074 consensus_queue.cc:237] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:24.299321  9725 catalog_manager.cc:5697] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a reported cstate change: term changed from 1 to 2, leader changed from ad8fa519bb8e44a2a4d2d61ee4848fc8 (127.30.63.2) to 2680c6c6ee174bdf8a79b47c89889c1a (127.30.63.1). New cstate: current_term: 2 leader_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:24.500036 30972 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:17:24.501647 30972 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:17:24.502050 30972 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:17:24.514041  9828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c6d35587cf24c8c9590018164614fbf"
dest_uuid: "2680c6c6ee174bdf8a79b47c89889c1a"
mode: GRACEFUL
new_leader_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8"
 from {username='slave'} at 127.0.0.1:59790
I20260709 13:17:24.514567  9828 raft_consensus.cc:606] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a [term 2 LEADER]: Received request to transfer leadership to TS ad8fa519bb8e44a2a4d2d61ee4848fc8
I20260709 13:17:24.515779 30972 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:17:24.541968  9904 raft_consensus.cc:1275] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 2 FOLLOWER]: Refusing update from remote peer 2680c6c6ee174bdf8a79b47c89889c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:24.543406 10073 consensus_queue.cc:1048] T 68616a5e077f4bc78bd44954d00cefdf P 2680c6c6ee174bdf8a79b47c89889c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:24.552258  9978 raft_consensus.cc:1275] T 68616a5e077f4bc78bd44954d00cefdf P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 2 FOLLOWER]: Refusing update from remote peer 2680c6c6ee174bdf8a79b47c89889c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:24.553759 10073 consensus_queue.cc:1048] T 68616a5e077f4bc78bd44954d00cefdf P 2680c6c6ee174bdf8a79b47c89889c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:24.740979  9904 raft_consensus.cc:1275] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 2 FOLLOWER]: Refusing update from remote peer 2680c6c6ee174bdf8a79b47c89889c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:24.742763 10073 consensus_queue.cc:1048] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:24.748289 10051 raft_consensus.cc:993] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a: : Instructing follower ad8fa519bb8e44a2a4d2d61ee4848fc8 to start an election
I20260709 13:17:24.748840 10074 raft_consensus.cc:1081] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a [term 2 LEADER]: Signalling peer ad8fa519bb8e44a2a4d2d61ee4848fc8 to start an election
I20260709 13:17:24.750797  9903 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c6d35587cf24c8c9590018164614fbf"
dest_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8"
 from {username='slave'} at 127.0.0.1:57812
I20260709 13:17:24.751526  9903 raft_consensus.cc:493] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:24.751916  9903 raft_consensus.cc:3060] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:24.757001  9978 raft_consensus.cc:1275] T 5c6d35587cf24c8c9590018164614fbf P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 2 FOLLOWER]: Refusing update from remote peer 2680c6c6ee174bdf8a79b47c89889c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:24.759285 10079 consensus_queue.cc:1048] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:24.763695  9903 raft_consensus.cc:515] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:24.769196  9977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6d35587cf24c8c9590018164614fbf" candidate_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3"
I20260709 13:17:24.769986  9903 leader_election.cc:290] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [CANDIDATE]: Term 3 election: Requested vote from peers 2680c6c6ee174bdf8a79b47c89889c1a (127.30.63.1:43679), 3eb5be965fde4d5881a7b497c7d2e8a3 (127.30.63.3:45433)
I20260709 13:17:24.769234  9828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6d35587cf24c8c9590018164614fbf" candidate_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2680c6c6ee174bdf8a79b47c89889c1a"
I20260709 13:17:24.771061  9828 raft_consensus.cc:3055] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:24.771380  9828 raft_consensus.cc:740] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2680c6c6ee174bdf8a79b47c89889c1a, State: Running, Role: LEADER
I20260709 13:17:24.772228  9828 consensus_queue.cc:260] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
W20260709 13:17:24.773275 10051 consensus_queue.cc:1175] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 13:17:24.774351  9828 raft_consensus.cc:3060] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:24.782253  9828 raft_consensus.cc:2468] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad8fa519bb8e44a2a4d2d61ee4848fc8 in term 3.
I20260709 13:17:24.783367  9867 leader_election.cc:304] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2680c6c6ee174bdf8a79b47c89889c1a, ad8fa519bb8e44a2a4d2d61ee4848fc8; no voters: 3eb5be965fde4d5881a7b497c7d2e8a3
I20260709 13:17:24.784139 10056 raft_consensus.cc:2804] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:24.785038 10056 raft_consensus.cc:697] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 3 LEADER]: Becoming Leader. State: Replica: ad8fa519bb8e44a2a4d2d61ee4848fc8, State: Running, Role: LEADER
I20260709 13:17:24.785800 10056 consensus_queue.cc:237] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } }
I20260709 13:17:24.792780  9726 catalog_manager.cc:5697] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 reported cstate change: term changed from 2 to 3, leader changed from 2680c6c6ee174bdf8a79b47c89889c1a (127.30.63.1) to ad8fa519bb8e44a2a4d2d61ee4848fc8 (127.30.63.2). New cstate: current_term: 3 leader_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2680c6c6ee174bdf8a79b47c89889c1a" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad8fa519bb8e44a2a4d2d61ee4848fc8" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 41011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3eb5be965fde4d5881a7b497c7d2e8a3" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 45433 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:24.868530 30972 tablet_server.cc:179] TabletServer@127.30.63.1:0 shutting down...
I20260709 13:17:24.888286 30972 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:24.888965 30972 tablet_replica.cc:333] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a: stopping tablet replica
I20260709 13:17:24.889542 30972 raft_consensus.cc:2243] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:24.890033 30972 raft_consensus.cc:2272] T 5c6d35587cf24c8c9590018164614fbf P 2680c6c6ee174bdf8a79b47c89889c1a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:24.892333 30972 tablet_replica.cc:333] T 68616a5e077f4bc78bd44954d00cefdf P 2680c6c6ee174bdf8a79b47c89889c1a: stopping tablet replica
I20260709 13:17:24.892932 30972 raft_consensus.cc:2243] T 68616a5e077f4bc78bd44954d00cefdf P 2680c6c6ee174bdf8a79b47c89889c1a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:24.893723 30972 raft_consensus.cc:2272] T 68616a5e077f4bc78bd44954d00cefdf P 2680c6c6ee174bdf8a79b47c89889c1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:24.895876 30972 tablet_replica.cc:333] T 32906bbb352b42d28812e9553e9eaccb P 2680c6c6ee174bdf8a79b47c89889c1a: stopping tablet replica
I20260709 13:17:24.896407 30972 raft_consensus.cc:2243] T 32906bbb352b42d28812e9553e9eaccb P 2680c6c6ee174bdf8a79b47c89889c1a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:24.897233 30972 raft_consensus.cc:2272] T 32906bbb352b42d28812e9553e9eaccb P 2680c6c6ee174bdf8a79b47c89889c1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:24.899078 30972 tablet_replica.cc:333] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 2680c6c6ee174bdf8a79b47c89889c1a: stopping tablet replica
I20260709 13:17:24.899685 30972 raft_consensus.cc:2243] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 2680c6c6ee174bdf8a79b47c89889c1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:24.900091 30972 raft_consensus.cc:2272] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 2680c6c6ee174bdf8a79b47c89889c1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:24.923273 30972 tablet_server.cc:196] TabletServer@127.30.63.1:0 shutdown complete.
I20260709 13:17:24.935169 30972 tablet_server.cc:179] TabletServer@127.30.63.2:0 shutting down...
I20260709 13:17:24.952637 30972 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:24.953321 30972 tablet_replica.cc:333] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8: stopping tablet replica
I20260709 13:17:24.953891 30972 raft_consensus.cc:2243] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:24.954310 30972 raft_consensus.cc:2272] T 68616a5e077f4bc78bd44954d00cefdf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:24.956866 30972 tablet_replica.cc:333] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8: stopping tablet replica
I20260709 13:17:24.957450 30972 raft_consensus.cc:2243] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:24.958071 30972 pending_rounds.cc:70] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8: Trying to abort 1 pending ops.
I20260709 13:17:24.958261 30972 pending_rounds.cc:77] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305638071450480640 op_type: NO_OP noop_request { }
I20260709 13:17:24.958552 30972 raft_consensus.cc:2889] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:17:24.958863 30972 raft_consensus.cc:2272] T 5c6d35587cf24c8c9590018164614fbf P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:24.961287 30972 tablet_replica.cc:333] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P ad8fa519bb8e44a2a4d2d61ee4848fc8: stopping tablet replica
I20260709 13:17:24.961829 30972 raft_consensus.cc:2243] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:24.962248 30972 raft_consensus.cc:2272] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:24.963935 30972 tablet_replica.cc:333] T 32906bbb352b42d28812e9553e9eaccb P ad8fa519bb8e44a2a4d2d61ee4848fc8: stopping tablet replica
I20260709 13:17:24.964386 30972 raft_consensus.cc:2243] T 32906bbb352b42d28812e9553e9eaccb P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:24.964839 30972 raft_consensus.cc:2272] T 32906bbb352b42d28812e9553e9eaccb P ad8fa519bb8e44a2a4d2d61ee4848fc8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:24.987563 30972 tablet_server.cc:196] TabletServer@127.30.63.2:0 shutdown complete.
I20260709 13:17:25.000365 30972 tablet_server.cc:179] TabletServer@127.30.63.3:0 shutting down...
I20260709 13:17:25.022294 30972 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:25.023021 30972 tablet_replica.cc:333] T 5c6d35587cf24c8c9590018164614fbf P 3eb5be965fde4d5881a7b497c7d2e8a3: stopping tablet replica
I20260709 13:17:25.023607 30972 raft_consensus.cc:2243] T 5c6d35587cf24c8c9590018164614fbf P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:25.024071 30972 raft_consensus.cc:2272] T 5c6d35587cf24c8c9590018164614fbf P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:25.026602 30972 tablet_replica.cc:333] T 68616a5e077f4bc78bd44954d00cefdf P 3eb5be965fde4d5881a7b497c7d2e8a3: stopping tablet replica
I20260709 13:17:25.027217 30972 raft_consensus.cc:2243] T 68616a5e077f4bc78bd44954d00cefdf P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:25.027711 30972 raft_consensus.cc:2272] T 68616a5e077f4bc78bd44954d00cefdf P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:25.030133 30972 tablet_replica.cc:333] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 3eb5be965fde4d5881a7b497c7d2e8a3: stopping tablet replica
I20260709 13:17:25.030694 30972 raft_consensus.cc:2243] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:25.031492 30972 raft_consensus.cc:2272] T 0686e80cc91e4bdaa9a5ec7fb02d3ee8 P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:25.033526 30972 tablet_replica.cc:333] T 32906bbb352b42d28812e9553e9eaccb P 3eb5be965fde4d5881a7b497c7d2e8a3: stopping tablet replica
I20260709 13:17:25.034049 30972 raft_consensus.cc:2243] T 32906bbb352b42d28812e9553e9eaccb P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:25.034463 30972 raft_consensus.cc:2272] T 32906bbb352b42d28812e9553e9eaccb P 3eb5be965fde4d5881a7b497c7d2e8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:25.057376 30972 tablet_server.cc:196] TabletServer@127.30.63.3:0 shutdown complete.
I20260709 13:17:25.069694 30972 master.cc:562] Master@127.30.63.62:34773 shutting down...
I20260709 13:17:25.085510 30972 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c7367ee7a4e3453b86785eca97aa8e2e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:25.086038 30972 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c7367ee7a4e3453b86785eca97aa8e2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:25.086297 30972 tablet_replica.cc:333] T 00000000000000000000000000000000 P c7367ee7a4e3453b86785eca97aa8e2e: stopping tablet replica
I20260709 13:17:25.105001 30972 master.cc:584] Master@127.30.63.62:34773 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2995 ms)
[----------] 6 tests from LeaderRebalancerTest (314436 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:17:25.134289 30972 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.30.63.62:39875
I20260709 13:17:25.135453 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:25.140728 10081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:25.140974 10082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:25.143868 30972 server_base.cc:1061] running on GCE node
W20260709 13:17:25.143786 10084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:25.145047 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:25.145226 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:25.145419 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783603045145386 us; error 0 us; skew 500 ppm
I20260709 13:17:25.146004 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:25.148737 30972 webserver.cc:533] Webserver started at http://127.30.63.62:41985/ using document root <none> and password file <none>
I20260709 13:17:25.149286 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:25.149463 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:25.149801 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:25.151015 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602730526113-30972-0/minicluster-data/master-0-root/instance:
uuid: "52a24134fe5047e4bfaf109513392281"
format_stamp: "Formatted at 2026-07-09 13:17:25 on dist-test-slave-c08m"
I20260709 13:17:25.156014 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 13:17:25.159826 10089 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:25.160748 30972 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:17:25.161001 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602730526113-30972-0/minicluster-data/master-0-root
uuid: "52a24134fe5047e4bfaf109513392281"
format_stamp: "Formatted at 2026-07-09 13:17:25 on dist-test-slave-c08m"
I20260709 13:17:25.161295 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602730526113-30972-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602730526113-30972-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602730526113-30972-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:25.177827 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:25.178817 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:25.217458 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.62:39875
I20260709 13:17:25.217626 10140 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.62:39875 every 8 connection(s)
I20260709 13:17:25.221558 10141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:25.235369 10141 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52a24134fe5047e4bfaf109513392281: Bootstrap starting.
I20260709 13:17:25.240309 10141 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 52a24134fe5047e4bfaf109513392281: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.244951 10141 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52a24134fe5047e4bfaf109513392281: No bootstrap required, opened a new log
I20260709 13:17:25.247597 10141 raft_consensus.cc:359] T 00000000000000000000000000000000 P 52a24134fe5047e4bfaf109513392281 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52a24134fe5047e4bfaf109513392281" member_type: VOTER }
I20260709 13:17:25.248054 10141 raft_consensus.cc:385] T 00000000000000000000000000000000 P 52a24134fe5047e4bfaf109513392281 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.248273 10141 raft_consensus.cc:740] T 00000000000000000000000000000000 P 52a24134fe5047e4bfaf109513392281 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52a24134fe5047e4bfaf109513392281, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.248905 10141 consensus_queue.cc:260] T 00000000000000000000000000000000 P 52a24134fe5047e4bfaf109513392281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52a24134fe5047e4bfaf109513392281" member_type: VOTER }
I20260709 13:17:25.249366 10141 raft_consensus.cc:399] T 00000000000000000000000000000000 P 52a24134fe5047e4bfaf109513392281 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:17:25.249589 10141 raft_consensus.cc:493] T 00000000000000000000000000000000 P 52a24134fe5047e4bfaf109513392281 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:17:25.249823 10141 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 52a24134fe5047e4bfaf109513392281 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.257607 10141 raft_consensus.cc:515] T 00000000000000000000000000000000 P 52a24134fe5047e4bfaf109513392281 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52a24134fe5047e4bfaf109513392281" member_type: VOTER }
I20260709 13:17:25.258147 10141 leader_election.cc:304] T 00000000000000000000000000000000 P 52a24134fe5047e4bfaf109513392281 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 52a24134fe5047e4bfaf109513392281; no voters: 
I20260709 13:17:25.259298 10141 leader_election.cc:290] T 00000000000000000000000000000000 P 52a24134fe5047e4bfaf109513392281 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:17:25.259785 10144 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 52a24134fe5047e4bfaf109513392281 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:25.261278 10144 raft_consensus.cc:697] T 00000000000000000000000000000000 P 52a24134fe5047e4bfaf109513392281 [term 1 LEADER]: Becoming Leader. State: Replica: 52a24134fe5047e4bfaf109513392281, State: Running, Role: LEADER
I20260709 13:17:25.261984 10144 consensus_queue.cc:237] T 00000000000000000000000000000000 P 52a24134fe5047e4bfaf109513392281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52a24134fe5047e4bfaf109513392281" member_type: VOTER }
I20260709 13:17:25.262218 10141 sys_catalog.cc:565] T 00000000000000000000000000000000 P 52a24134fe5047e4bfaf109513392281 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:17:25.265091 10145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52a24134fe5047e4bfaf109513392281 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "52a24134fe5047e4bfaf109513392281" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52a24134fe5047e4bfaf109513392281" member_type: VOTER } }
I20260709 13:17:25.265094 10146 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52a24134fe5047e4bfaf109513392281 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 52a24134fe5047e4bfaf109513392281. Latest consensus state: current_term: 1 leader_uuid: "52a24134fe5047e4bfaf109513392281" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52a24134fe5047e4bfaf109513392281" member_type: VOTER } }
I20260709 13:17:25.265877 10145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52a24134fe5047e4bfaf109513392281 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:25.265956 10146 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52a24134fe5047e4bfaf109513392281 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:25.270053 10149 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:17:25.275588 10149 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:17:25.281679 30972 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:17:25.286207 10149 catalog_manager.cc:1383] Generated new cluster ID: c616c9a87be34a6a893c3b1b19ccab93
I20260709 13:17:25.286696 10149 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:17:25.305220 10149 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:17:25.306587 10149 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:17:25.319778 10149 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 52a24134fe5047e4bfaf109513392281: Generated new TSK 0
I20260709 13:17:25.320420 10149 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:17:25.350613 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:25.357942 10162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:25.358844 10163 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:25.360991 10165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:25.361285 30972 server_base.cc:1061] running on GCE node
I20260709 13:17:25.362228 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:25.362404 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:25.362591 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783603045362573 us; error 0 us; skew 500 ppm
I20260709 13:17:25.363303 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:25.366142 30972 webserver.cc:533] Webserver started at http://127.30.63.1:40181/ using document root <none> and password file <none>
I20260709 13:17:25.366670 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:25.366869 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:25.367161 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:25.368254 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602730526113-30972-0/minicluster-data/ts-0-root/instance:
uuid: "21a517d52d81404f9ae245428d42fed8"
format_stamp: "Formatted at 2026-07-09 13:17:25 on dist-test-slave-c08m"
I20260709 13:17:25.373078 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:17:25.376734 10170 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:25.377569 30972 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:17:25.377918 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602730526113-30972-0/minicluster-data/ts-0-root
uuid: "21a517d52d81404f9ae245428d42fed8"
format_stamp: "Formatted at 2026-07-09 13:17:25 on dist-test-slave-c08m"
I20260709 13:17:25.378276 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602730526113-30972-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602730526113-30972-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602730526113-30972-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:25.392180 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:25.393417 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:25.394869 30972 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:25.397212 30972 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:25.397428 30972 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:25.397675 30972 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:25.397840 30972 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:25.441722 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.1:38989
I20260709 13:17:25.441856 10232 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.1:38989 every 8 connection(s)
I20260709 13:17:25.447888 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:25.457111 10237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:25.459084 10238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:25.462447 10240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:25.463472 30972 server_base.cc:1061] running on GCE node
I20260709 13:17:25.465456 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:25.465718 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:25.465932 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783603045465912 us; error 0 us; skew 500 ppm
I20260709 13:17:25.466069 10233 heartbeater.cc:344] Connected to a master server at 127.30.63.62:39875
I20260709 13:17:25.466518 10233 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:25.466943 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:25.467643 10233 heartbeater.cc:507] Master 127.30.63.62:39875 requested a full tablet report, sending...
I20260709 13:17:25.470202 30972 webserver.cc:533] Webserver started at http://127.30.63.2:45387/ using document root <none> and password file <none>
I20260709 13:17:25.470453 10106 ts_manager.cc:194] Registered new tserver with Master: 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989)
I20260709 13:17:25.470731 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:25.470978 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:25.471189 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:25.472257 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602730526113-30972-0/minicluster-data/ts-1-root/instance:
uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
format_stamp: "Formatted at 2026-07-09 13:17:25 on dist-test-slave-c08m"
I20260709 13:17:25.472525 10106 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:32842
I20260709 13:17:25.477811 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:17:25.481931 10245 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:25.482865 30972 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:17:25.483147 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602730526113-30972-0/minicluster-data/ts-1-root
uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
format_stamp: "Formatted at 2026-07-09 13:17:25 on dist-test-slave-c08m"
I20260709 13:17:25.483393 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602730526113-30972-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602730526113-30972-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602730526113-30972-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:25.510378 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:25.511716 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:25.513315 30972 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:25.515554 30972 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:25.515743 30972 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:25.516080 30972 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:25.516223 30972 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:25.559286 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.2:46427
I20260709 13:17:25.559407 10307 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.2:46427 every 8 connection(s)
I20260709 13:17:25.564872 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:25.572263 10311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:25.573441 10312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:25.578565 10314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:25.578608 30972 server_base.cc:1061] running on GCE node
I20260709 13:17:25.579202 10308 heartbeater.cc:344] Connected to a master server at 127.30.63.62:39875
I20260709 13:17:25.580358 10308 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:25.581061 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:25.581311 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:25.581203 10308 heartbeater.cc:507] Master 127.30.63.62:39875 requested a full tablet report, sending...
I20260709 13:17:25.581627 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783603045581606 us; error 0 us; skew 500 ppm
I20260709 13:17:25.582275 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:25.583660 10106 ts_manager.cc:194] Registered new tserver with Master: e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427)
I20260709 13:17:25.585327 10106 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:32852
I20260709 13:17:25.585475 30972 webserver.cc:533] Webserver started at http://127.30.63.3:35867/ using document root <none> and password file <none>
I20260709 13:17:25.586171 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:25.586417 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:25.586745 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:25.587858 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602730526113-30972-0/minicluster-data/ts-2-root/instance:
uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
format_stamp: "Formatted at 2026-07-09 13:17:25 on dist-test-slave-c08m"
I20260709 13:17:25.592492 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:17:25.596983 10319 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:25.598263 30972 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:17:25.598652 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602730526113-30972-0/minicluster-data/ts-2-root
uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
format_stamp: "Formatted at 2026-07-09 13:17:25 on dist-test-slave-c08m"
I20260709 13:17:25.598971 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602730526113-30972-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602730526113-30972-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602730526113-30972-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:25.617363 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:25.618494 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:25.620209 30972 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:25.622869 30972 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:25.623162 30972 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:25.623438 30972 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:25.623629 30972 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:25.669031 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.3:41719
I20260709 13:17:25.669175 10381 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.3:41719 every 8 connection(s)
I20260709 13:17:25.684315 10382 heartbeater.cc:344] Connected to a master server at 127.30.63.62:39875
I20260709 13:17:25.685372 10382 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:25.686369 10382 heartbeater.cc:507] Master 127.30.63.62:39875 requested a full tablet report, sending...
I20260709 13:17:25.688762 10106 ts_manager.cc:194] Registered new tserver with Master: 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:25.689263 30972 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016878702s
I20260709 13:17:25.690537 10106 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:32856
I20260709 13:17:25.718830 10106 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32858:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:25.721712 10106 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:25.795145 10273 tablet_service.cc:1511] Processing CreateTablet for tablet fc68869777e04563a9a887134320adf6 (DEFAULT_TABLE table=test-workload [id=00a37b20853443d8acaba8cf801b0476]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:25.795454 10271 tablet_service.cc:1511] Processing CreateTablet for tablet c1cf62842a6e4d3e8aba94cd94afb57b (DEFAULT_TABLE table=test-workload [id=00a37b20853443d8acaba8cf801b0476]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:25.796693 10273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc68869777e04563a9a887134320adf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:25.796818 10272 tablet_service.cc:1511] Processing CreateTablet for tablet 7ce9af49a9d94f40bffa2d91089a906e (DEFAULT_TABLE table=test-workload [id=00a37b20853443d8acaba8cf801b0476]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:25.797423 10271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1cf62842a6e4d3e8aba94cd94afb57b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:25.798430 10272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ce9af49a9d94f40bffa2d91089a906e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:25.816489 10270 tablet_service.cc:1511] Processing CreateTablet for tablet 1fb9419407b247db8c0d9010e24e40e1 (DEFAULT_TABLE table=test-workload [id=00a37b20853443d8acaba8cf801b0476]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:25.818022 10270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fb9419407b247db8c0d9010e24e40e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:25.828230 10272 tablet_service.cc:1511] Processing CreateTablet for tablet a61096290231466cb5e7956f243a99a8 (DEFAULT_TABLE table=test-workload [id=00a37b20853443d8acaba8cf801b0476]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:25.829798 10272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a61096290231466cb5e7956f243a99a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:25.834895 10269 tablet_service.cc:1511] Processing CreateTablet for tablet e35ad6dabd174fe29b0be23dbf63d97f (DEFAULT_TABLE table=test-workload [id=00a37b20853443d8acaba8cf801b0476]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:25.836408 10269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e35ad6dabd174fe29b0be23dbf63d97f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:25.844724 10198 tablet_service.cc:1511] Processing CreateTablet for tablet fc68869777e04563a9a887134320adf6 (DEFAULT_TABLE table=test-workload [id=00a37b20853443d8acaba8cf801b0476]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:25.845434 10197 tablet_service.cc:1511] Processing CreateTablet for tablet 7ce9af49a9d94f40bffa2d91089a906e (DEFAULT_TABLE table=test-workload [id=00a37b20853443d8acaba8cf801b0476]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:25.846356 10198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc68869777e04563a9a887134320adf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:25.846984 10197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ce9af49a9d94f40bffa2d91089a906e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:25.848500 10196 tablet_service.cc:1511] Processing CreateTablet for tablet c1cf62842a6e4d3e8aba94cd94afb57b (DEFAULT_TABLE table=test-workload [id=00a37b20853443d8acaba8cf801b0476]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:25.849946 10196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1cf62842a6e4d3e8aba94cd94afb57b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:25.850973 10346 tablet_service.cc:1511] Processing CreateTablet for tablet 7ce9af49a9d94f40bffa2d91089a906e (DEFAULT_TABLE table=test-workload [id=00a37b20853443d8acaba8cf801b0476]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:25.851681 10344 tablet_service.cc:1511] Processing CreateTablet for tablet 1fb9419407b247db8c0d9010e24e40e1 (DEFAULT_TABLE table=test-workload [id=00a37b20853443d8acaba8cf801b0476]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:25.852787 10346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ce9af49a9d94f40bffa2d91089a906e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:25.852222 10343 tablet_service.cc:1511] Processing CreateTablet for tablet a61096290231466cb5e7956f243a99a8 (DEFAULT_TABLE table=test-workload [id=00a37b20853443d8acaba8cf801b0476]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:25.853893 10343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a61096290231466cb5e7956f243a99a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:25.854161 10195 tablet_service.cc:1511] Processing CreateTablet for tablet 1fb9419407b247db8c0d9010e24e40e1 (DEFAULT_TABLE table=test-workload [id=00a37b20853443d8acaba8cf801b0476]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:25.855489 10195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fb9419407b247db8c0d9010e24e40e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:25.858039 10194 tablet_service.cc:1511] Processing CreateTablet for tablet a61096290231466cb5e7956f243a99a8 (DEFAULT_TABLE table=test-workload [id=00a37b20853443d8acaba8cf801b0476]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:25.859486 10194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a61096290231466cb5e7956f243a99a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:25.862527 10193 tablet_service.cc:1511] Processing CreateTablet for tablet e35ad6dabd174fe29b0be23dbf63d97f (DEFAULT_TABLE table=test-workload [id=00a37b20853443d8acaba8cf801b0476]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:25.865726 10347 tablet_service.cc:1511] Processing CreateTablet for tablet fc68869777e04563a9a887134320adf6 (DEFAULT_TABLE table=test-workload [id=00a37b20853443d8acaba8cf801b0476]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:25.867920 10347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc68869777e04563a9a887134320adf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:25.870276 10345 tablet_service.cc:1511] Processing CreateTablet for tablet c1cf62842a6e4d3e8aba94cd94afb57b (DEFAULT_TABLE table=test-workload [id=00a37b20853443d8acaba8cf801b0476]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:25.885957 10345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1cf62842a6e4d3e8aba94cd94afb57b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:25.889258 10344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fb9419407b247db8c0d9010e24e40e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:25.872956 10193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e35ad6dabd174fe29b0be23dbf63d97f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:25.937602 10399 tablet_bootstrap.cc:492] T 7ce9af49a9d94f40bffa2d91089a906e P 9d6c512cfc2248c28e5ff72bf0fc06df: Bootstrap starting.
I20260709 13:17:25.947611 10399 tablet_bootstrap.cc:654] T 7ce9af49a9d94f40bffa2d91089a906e P 9d6c512cfc2248c28e5ff72bf0fc06df: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.971760 10343 tablet_service.cc:1511] Processing CreateTablet for tablet e35ad6dabd174fe29b0be23dbf63d97f (DEFAULT_TABLE table=test-workload [id=00a37b20853443d8acaba8cf801b0476]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:25.977890 10343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e35ad6dabd174fe29b0be23dbf63d97f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:25.981432 10197 tablet_service.cc:1511] Processing CreateTablet for tablet 01f1cef511614c43ae422c6fb06be9c4 (DEFAULT_TABLE table=test-workload [id=00a37b20853443d8acaba8cf801b0476]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:25.983594 10197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f1cef511614c43ae422c6fb06be9c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:25.989651 10270 tablet_service.cc:1511] Processing CreateTablet for tablet 01f1cef511614c43ae422c6fb06be9c4 (DEFAULT_TABLE table=test-workload [id=00a37b20853443d8acaba8cf801b0476]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:25.991068 10270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f1cef511614c43ae422c6fb06be9c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:25.998553 10346 tablet_service.cc:1511] Processing CreateTablet for tablet 01f1cef511614c43ae422c6fb06be9c4 (DEFAULT_TABLE table=test-workload [id=00a37b20853443d8acaba8cf801b0476]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:26.000276 10346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f1cef511614c43ae422c6fb06be9c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:26.011816 10192 tablet_service.cc:1511] Processing CreateTablet for tablet 6f703c5bc8da416e9447e3c8d238725e (DEFAULT_TABLE table=test-workload [id=00a37b20853443d8acaba8cf801b0476]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:26.013346 10192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f703c5bc8da416e9447e3c8d238725e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:26.021320 10397 tablet_bootstrap.cc:492] T fc68869777e04563a9a887134320adf6 P e7f9e723f3f54a4bb5e4c57869f40d7a: Bootstrap starting.
I20260709 13:17:26.043336 10399 tablet_bootstrap.cc:492] T 7ce9af49a9d94f40bffa2d91089a906e P 9d6c512cfc2248c28e5ff72bf0fc06df: No bootstrap required, opened a new log
I20260709 13:17:26.044406 10399 ts_tablet_manager.cc:1403] T 7ce9af49a9d94f40bffa2d91089a906e P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent bootstrapping tablet: real 0.107s	user 0.010s	sys 0.013s
I20260709 13:17:26.044265 10273 tablet_service.cc:1511] Processing CreateTablet for tablet 6f703c5bc8da416e9447e3c8d238725e (DEFAULT_TABLE table=test-workload [id=00a37b20853443d8acaba8cf801b0476]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:26.057516 10273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f703c5bc8da416e9447e3c8d238725e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:26.059765 10399 raft_consensus.cc:359] T 7ce9af49a9d94f40bffa2d91089a906e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.060627 10399 raft_consensus.cc:385] T 7ce9af49a9d94f40bffa2d91089a906e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.060961 10399 raft_consensus.cc:740] T 7ce9af49a9d94f40bffa2d91089a906e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.060993 10270 tablet_service.cc:1511] Processing CreateTablet for tablet 86413c90120d4fae863df0ece3bebb3d (DEFAULT_TABLE table=test-workload [id=00a37b20853443d8acaba8cf801b0476]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:26.045022 10397 tablet_bootstrap.cc:654] T fc68869777e04563a9a887134320adf6 P e7f9e723f3f54a4bb5e4c57869f40d7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.061872 10399 consensus_queue.cc:260] T 7ce9af49a9d94f40bffa2d91089a906e P 9d6c512cfc2248c28e5ff72bf0fc06df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.062458 10270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86413c90120d4fae863df0ece3bebb3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:26.046042 10398 tablet_bootstrap.cc:492] T fc68869777e04563a9a887134320adf6 P 21a517d52d81404f9ae245428d42fed8: Bootstrap starting.
I20260709 13:17:26.051247 10347 tablet_service.cc:1511] Processing CreateTablet for tablet 6f703c5bc8da416e9447e3c8d238725e (DEFAULT_TABLE table=test-workload [id=00a37b20853443d8acaba8cf801b0476]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:26.065943 10347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f703c5bc8da416e9447e3c8d238725e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:26.055371 10197 tablet_service.cc:1511] Processing CreateTablet for tablet 86413c90120d4fae863df0ece3bebb3d (DEFAULT_TABLE table=test-workload [id=00a37b20853443d8acaba8cf801b0476]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:26.086227 10197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86413c90120d4fae863df0ece3bebb3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:26.074949 10346 tablet_service.cc:1511] Processing CreateTablet for tablet 86413c90120d4fae863df0ece3bebb3d (DEFAULT_TABLE table=test-workload [id=00a37b20853443d8acaba8cf801b0476]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:26.090934 10346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86413c90120d4fae863df0ece3bebb3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:26.072492 10398 tablet_bootstrap.cc:654] T fc68869777e04563a9a887134320adf6 P 21a517d52d81404f9ae245428d42fed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.118274 10397 tablet_bootstrap.cc:492] T fc68869777e04563a9a887134320adf6 P e7f9e723f3f54a4bb5e4c57869f40d7a: No bootstrap required, opened a new log
I20260709 13:17:26.118983 10397 ts_tablet_manager.cc:1403] T fc68869777e04563a9a887134320adf6 P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent bootstrapping tablet: real 0.098s	user 0.013s	sys 0.020s
I20260709 13:17:26.135686 10397 raft_consensus.cc:359] T fc68869777e04563a9a887134320adf6 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } } peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } }
I20260709 13:17:26.136710 10397 raft_consensus.cc:385] T fc68869777e04563a9a887134320adf6 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.137370 10382 heartbeater.cc:499] Master 127.30.63.62:39875 was elected leader, sending a full tablet report...
I20260709 13:17:26.137984 10397 raft_consensus.cc:740] T fc68869777e04563a9a887134320adf6 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7f9e723f3f54a4bb5e4c57869f40d7a, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.138840 10397 consensus_queue.cc:260] T fc68869777e04563a9a887134320adf6 P e7f9e723f3f54a4bb5e4c57869f40d7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } } peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } }
I20260709 13:17:26.142254 10399 ts_tablet_manager.cc:1434] T 7ce9af49a9d94f40bffa2d91089a906e P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent starting tablet: real 0.085s	user 0.032s	sys 0.040s
I20260709 13:17:26.143930 10399 tablet_bootstrap.cc:492] T a61096290231466cb5e7956f243a99a8 P 9d6c512cfc2248c28e5ff72bf0fc06df: Bootstrap starting.
I20260709 13:17:26.150806 10399 tablet_bootstrap.cc:654] T a61096290231466cb5e7956f243a99a8 P 9d6c512cfc2248c28e5ff72bf0fc06df: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.156147 10397 ts_tablet_manager.cc:1434] T fc68869777e04563a9a887134320adf6 P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent starting tablet: real 0.037s	user 0.019s	sys 0.003s
I20260709 13:17:26.156656 10398 tablet_bootstrap.cc:492] T fc68869777e04563a9a887134320adf6 P 21a517d52d81404f9ae245428d42fed8: No bootstrap required, opened a new log
I20260709 13:17:26.157234 10398 ts_tablet_manager.cc:1403] T fc68869777e04563a9a887134320adf6 P 21a517d52d81404f9ae245428d42fed8: Time spent bootstrapping tablet: real 0.111s	user 0.010s	sys 0.009s
I20260709 13:17:26.159291 10308 heartbeater.cc:499] Master 127.30.63.62:39875 was elected leader, sending a full tablet report...
I20260709 13:17:26.160156 10398 raft_consensus.cc:359] T fc68869777e04563a9a887134320adf6 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } } peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } }
I20260709 13:17:26.160962 10398 raft_consensus.cc:385] T fc68869777e04563a9a887134320adf6 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.161248 10398 raft_consensus.cc:740] T fc68869777e04563a9a887134320adf6 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.163975 10398 consensus_queue.cc:260] T fc68869777e04563a9a887134320adf6 P 21a517d52d81404f9ae245428d42fed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } } peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } }
I20260709 13:17:26.168470 10399 tablet_bootstrap.cc:492] T a61096290231466cb5e7956f243a99a8 P 9d6c512cfc2248c28e5ff72bf0fc06df: No bootstrap required, opened a new log
I20260709 13:17:26.169157 10399 ts_tablet_manager.cc:1403] T a61096290231466cb5e7956f243a99a8 P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.006s
I20260709 13:17:26.169838 10233 heartbeater.cc:499] Master 127.30.63.62:39875 was elected leader, sending a full tablet report...
I20260709 13:17:26.170101 10398 ts_tablet_manager.cc:1434] T fc68869777e04563a9a887134320adf6 P 21a517d52d81404f9ae245428d42fed8: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 13:17:26.170992 10398 tablet_bootstrap.cc:492] T 7ce9af49a9d94f40bffa2d91089a906e P 21a517d52d81404f9ae245428d42fed8: Bootstrap starting.
I20260709 13:17:26.172080 10399 raft_consensus.cc:359] T a61096290231466cb5e7956f243a99a8 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.172911 10399 raft_consensus.cc:385] T a61096290231466cb5e7956f243a99a8 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.173228 10399 raft_consensus.cc:740] T a61096290231466cb5e7956f243a99a8 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.174124 10399 consensus_queue.cc:260] T a61096290231466cb5e7956f243a99a8 P 9d6c512cfc2248c28e5ff72bf0fc06df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.176465 10399 ts_tablet_manager.cc:1434] T a61096290231466cb5e7956f243a99a8 P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:17:26.177498 10399 tablet_bootstrap.cc:492] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df: Bootstrap starting.
I20260709 13:17:26.177690 10398 tablet_bootstrap.cc:654] T 7ce9af49a9d94f40bffa2d91089a906e P 21a517d52d81404f9ae245428d42fed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.181589 10397 tablet_bootstrap.cc:492] T 7ce9af49a9d94f40bffa2d91089a906e P e7f9e723f3f54a4bb5e4c57869f40d7a: Bootstrap starting.
I20260709 13:17:26.183838 10399 tablet_bootstrap.cc:654] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.189098 10398 tablet_bootstrap.cc:492] T 7ce9af49a9d94f40bffa2d91089a906e P 21a517d52d81404f9ae245428d42fed8: No bootstrap required, opened a new log
I20260709 13:17:26.189936 10398 ts_tablet_manager.cc:1403] T 7ce9af49a9d94f40bffa2d91089a906e P 21a517d52d81404f9ae245428d42fed8: Time spent bootstrapping tablet: real 0.019s	user 0.005s	sys 0.010s
I20260709 13:17:26.190202 10397 tablet_bootstrap.cc:654] T 7ce9af49a9d94f40bffa2d91089a906e P e7f9e723f3f54a4bb5e4c57869f40d7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.194463 10398 raft_consensus.cc:359] T 7ce9af49a9d94f40bffa2d91089a906e P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.195561 10398 raft_consensus.cc:385] T 7ce9af49a9d94f40bffa2d91089a906e P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.195932 10398 raft_consensus.cc:740] T 7ce9af49a9d94f40bffa2d91089a906e P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.197271 10398 consensus_queue.cc:260] T 7ce9af49a9d94f40bffa2d91089a906e P 21a517d52d81404f9ae245428d42fed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.202746 10398 ts_tablet_manager.cc:1434] T 7ce9af49a9d94f40bffa2d91089a906e P 21a517d52d81404f9ae245428d42fed8: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.003s
I20260709 13:17:26.204253 10398 tablet_bootstrap.cc:492] T 6f703c5bc8da416e9447e3c8d238725e P 21a517d52d81404f9ae245428d42fed8: Bootstrap starting.
I20260709 13:17:26.213255 10398 tablet_bootstrap.cc:654] T 6f703c5bc8da416e9447e3c8d238725e P 21a517d52d81404f9ae245428d42fed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.215513 10406 raft_consensus.cc:493] T 7ce9af49a9d94f40bffa2d91089a906e P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.216325 10406 raft_consensus.cc:515] T 7ce9af49a9d94f40bffa2d91089a906e P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.224556 10399 tablet_bootstrap.cc:492] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df: No bootstrap required, opened a new log
I20260709 13:17:26.225225 10399 ts_tablet_manager.cc:1403] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent bootstrapping tablet: real 0.048s	user 0.020s	sys 0.024s
I20260709 13:17:26.226419 10397 tablet_bootstrap.cc:492] T 7ce9af49a9d94f40bffa2d91089a906e P e7f9e723f3f54a4bb5e4c57869f40d7a: No bootstrap required, opened a new log
I20260709 13:17:26.227049 10397 ts_tablet_manager.cc:1403] T 7ce9af49a9d94f40bffa2d91089a906e P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.021s
I20260709 13:17:26.228243 10399 raft_consensus.cc:359] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.229043 10399 raft_consensus.cc:385] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.229458 10399 raft_consensus.cc:740] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.229967 10406 leader_election.cc:290] T 7ce9af49a9d94f40bffa2d91089a906e P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:26.230363 10397 raft_consensus.cc:359] T 7ce9af49a9d94f40bffa2d91089a906e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.230357 10399 consensus_queue.cc:260] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.231400 10397 raft_consensus.cc:385] T 7ce9af49a9d94f40bffa2d91089a906e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.231864 10397 raft_consensus.cc:740] T 7ce9af49a9d94f40bffa2d91089a906e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7f9e723f3f54a4bb5e4c57869f40d7a, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.234251 10399 ts_tablet_manager.cc:1434] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:17:26.235687 10399 tablet_bootstrap.cc:492] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df: Bootstrap starting.
I20260709 13:17:26.240264 10401 raft_consensus.cc:493] T a61096290231466cb5e7956f243a99a8 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.240868 10401 raft_consensus.cc:515] T a61096290231466cb5e7956f243a99a8 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.242985 10283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce9af49a9d94f40bffa2d91089a906e" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" is_pre_election: true
I20260709 13:17:26.243342 10399 tablet_bootstrap.cc:654] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.243682 10401 leader_election.cc:290] T a61096290231466cb5e7956f243a99a8 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427)
I20260709 13:17:26.254074 10398 tablet_bootstrap.cc:492] T 6f703c5bc8da416e9447e3c8d238725e P 21a517d52d81404f9ae245428d42fed8: No bootstrap required, opened a new log
I20260709 13:17:26.254784 10398 ts_tablet_manager.cc:1403] T 6f703c5bc8da416e9447e3c8d238725e P 21a517d52d81404f9ae245428d42fed8: Time spent bootstrapping tablet: real 0.051s	user 0.021s	sys 0.004s
I20260709 13:17:26.255702 10397 consensus_queue.cc:260] T 7ce9af49a9d94f40bffa2d91089a906e P e7f9e723f3f54a4bb5e4c57869f40d7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.257956 10283 raft_consensus.cc:2468] T 7ce9af49a9d94f40bffa2d91089a906e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21a517d52d81404f9ae245428d42fed8 in term 0.
I20260709 13:17:26.257767 10398 raft_consensus.cc:359] T 6f703c5bc8da416e9447e3c8d238725e P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.258622 10398 raft_consensus.cc:385] T 6f703c5bc8da416e9447e3c8d238725e P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.258944 10398 raft_consensus.cc:740] T 6f703c5bc8da416e9447e3c8d238725e P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.259820 10398 consensus_queue.cc:260] T 6f703c5bc8da416e9447e3c8d238725e P 21a517d52d81404f9ae245428d42fed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.267719 10357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce9af49a9d94f40bffa2d91089a906e" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" is_pre_election: true
I20260709 13:17:26.260479 10397 ts_tablet_manager.cc:1434] T 7ce9af49a9d94f40bffa2d91089a906e P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.002s
I20260709 13:17:26.267971 10401 raft_consensus.cc:493] T 7ce9af49a9d94f40bffa2d91089a906e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.262547 10171 leader_election.cc:304] T 7ce9af49a9d94f40bffa2d91089a906e P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 
I20260709 13:17:26.269970 10398 ts_tablet_manager.cc:1434] T 6f703c5bc8da416e9447e3c8d238725e P 21a517d52d81404f9ae245428d42fed8: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:17:26.270028 10401 raft_consensus.cc:515] T 7ce9af49a9d94f40bffa2d91089a906e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.271103 10398 tablet_bootstrap.cc:492] T 01f1cef511614c43ae422c6fb06be9c4 P 21a517d52d81404f9ae245428d42fed8: Bootstrap starting.
I20260709 13:17:26.271620 10406 raft_consensus.cc:2804] T 7ce9af49a9d94f40bffa2d91089a906e P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:26.272018 10406 raft_consensus.cc:493] T 7ce9af49a9d94f40bffa2d91089a906e P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.272347 10406 raft_consensus.cc:3060] T 7ce9af49a9d94f40bffa2d91089a906e P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.272768 10401 leader_election.cc:290] T 7ce9af49a9d94f40bffa2d91089a906e P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427)
I20260709 13:17:26.273793 10357 raft_consensus.cc:2468] T 7ce9af49a9d94f40bffa2d91089a906e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21a517d52d81404f9ae245428d42fed8 in term 0.
I20260709 13:17:26.275071 10397 tablet_bootstrap.cc:492] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a: Bootstrap starting.
W20260709 13:17:26.276268 10154 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:26.280692 10398 tablet_bootstrap.cc:654] T 01f1cef511614c43ae422c6fb06be9c4 P 21a517d52d81404f9ae245428d42fed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.282207 10399 tablet_bootstrap.cc:492] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df: No bootstrap required, opened a new log
I20260709 13:17:26.282809 10399 ts_tablet_manager.cc:1403] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent bootstrapping tablet: real 0.047s	user 0.006s	sys 0.005s
I20260709 13:17:26.286011 10399 raft_consensus.cc:359] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } } peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } }
I20260709 13:17:26.286777 10399 raft_consensus.cc:385] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.287073 10399 raft_consensus.cc:740] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.287714 10399 consensus_queue.cc:260] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } } peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } }
I20260709 13:17:26.290457 10399 ts_tablet_manager.cc:1434] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:17:26.291436 10399 tablet_bootstrap.cc:492] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df: Bootstrap starting.
I20260709 13:17:26.291788 10406 raft_consensus.cc:515] T 7ce9af49a9d94f40bffa2d91089a906e P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.293085 10207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce9af49a9d94f40bffa2d91089a906e" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8" is_pre_election: true
I20260709 13:17:26.294010 10207 raft_consensus.cc:2393] T 7ce9af49a9d94f40bffa2d91089a906e P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6c512cfc2248c28e5ff72bf0fc06df in current term 1: Already voted for candidate 21a517d52d81404f9ae245428d42fed8 in this term.
I20260709 13:17:26.294727 10283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce9af49a9d94f40bffa2d91089a906e" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
I20260709 13:17:26.295368 10283 raft_consensus.cc:3060] T 7ce9af49a9d94f40bffa2d91089a906e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.295289 10208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61096290231466cb5e7956f243a99a8" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8" is_pre_election: true
W20260709 13:17:26.297757 10323 leader_election.cc:343] T a61096290231466cb5e7956f243a99a8 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.297660 10399 tablet_bootstrap.cc:654] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.298645 10404 raft_consensus.cc:493] T fc68869777e04563a9a887134320adf6 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.299309 10404 raft_consensus.cc:515] T fc68869777e04563a9a887134320adf6 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } } peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } }
I20260709 13:17:26.309264 10404 leader_election.cc:290] T fc68869777e04563a9a887134320adf6 P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719), 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989)
I20260709 13:17:26.311115 10283 raft_consensus.cc:2468] T 7ce9af49a9d94f40bffa2d91089a906e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a517d52d81404f9ae245428d42fed8 in term 1.
I20260709 13:17:26.313038 10171 leader_election.cc:304] T 7ce9af49a9d94f40bffa2d91089a906e P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 
I20260709 13:17:26.323741 10357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce9af49a9d94f40bffa2d91089a906e" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
I20260709 13:17:26.324653 10357 raft_consensus.cc:3060] T 7ce9af49a9d94f40bffa2d91089a906e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.327164 10397 tablet_bootstrap.cc:654] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.332261 10401 raft_consensus.cc:493] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.333024 10401 raft_consensus.cc:515] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } } peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } }
I20260709 13:17:26.335947 10401 leader_election.cc:290] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427), 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989)
I20260709 13:17:26.337661 10208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc68869777e04563a9a887134320adf6" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8" is_pre_election: true
I20260709 13:17:26.338581 10208 raft_consensus.cc:2468] T fc68869777e04563a9a887134320adf6 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 0.
I20260709 13:17:26.340437 10323 leader_election.cc:304] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, 9d6c512cfc2248c28e5ff72bf0fc06df; no voters: 
I20260709 13:17:26.341703 10401 raft_consensus.cc:2804] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:26.342257 10401 raft_consensus.cc:493] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.342617 10401 raft_consensus.cc:3060] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.343119 10357 raft_consensus.cc:2468] T 7ce9af49a9d94f40bffa2d91089a906e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a517d52d81404f9ae245428d42fed8 in term 1.
I20260709 13:17:26.345471 10406 leader_election.cc:290] T 7ce9af49a9d94f40bffa2d91089a906e P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 election: Requested vote from peers e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:26.346289 10406 raft_consensus.cc:2804] T 7ce9af49a9d94f40bffa2d91089a906e P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:26.346896 10406 raft_consensus.cc:697] T 7ce9af49a9d94f40bffa2d91089a906e P 21a517d52d81404f9ae245428d42fed8 [term 1 LEADER]: Becoming Leader. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Running, Role: LEADER
I20260709 13:17:26.348031 10406 consensus_queue.cc:237] T 7ce9af49a9d94f40bffa2d91089a906e P 21a517d52d81404f9ae245428d42fed8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.364866 10283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61096290231466cb5e7956f243a99a8" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" is_pre_election: true
I20260709 13:17:26.365427 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce9af49a9d94f40bffa2d91089a906e" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" is_pre_election: true
I20260709 13:17:26.366875 10282 raft_consensus.cc:2393] T 7ce9af49a9d94f40bffa2d91089a906e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6c512cfc2248c28e5ff72bf0fc06df in current term 1: Already voted for candidate 21a517d52d81404f9ae245428d42fed8 in this term.
I20260709 13:17:26.368614 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc68869777e04563a9a887134320adf6" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" is_pre_election: true
I20260709 13:17:26.369529 10282 raft_consensus.cc:2468] T fc68869777e04563a9a887134320adf6 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 0.
W20260709 13:17:26.372419 10320 leader_election.cc:343] T a61096290231466cb5e7956f243a99a8 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.372872 10320 leader_election.cc:304] T a61096290231466cb5e7956f243a99a8 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6c512cfc2248c28e5ff72bf0fc06df; no voters: 21a517d52d81404f9ae245428d42fed8, e7f9e723f3f54a4bb5e4c57869f40d7a
I20260709 13:17:26.374451 10105 catalog_manager.cc:5697] T 7ce9af49a9d94f40bffa2d91089a906e P 21a517d52d81404f9ae245428d42fed8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 21a517d52d81404f9ae245428d42fed8 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "21a517d52d81404f9ae245428d42fed8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:26.372851 10171 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:46427, user_credentials={real_user=slave}} blocked reactor thread for 59963.7us
I20260709 13:17:26.379948 10397 tablet_bootstrap.cc:492] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a: No bootstrap required, opened a new log
I20260709 13:17:26.387565 10397 ts_tablet_manager.cc:1403] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent bootstrapping tablet: real 0.113s	user 0.010s	sys 0.005s
I20260709 13:17:26.387835 10423 raft_consensus.cc:2749] T a61096290231466cb5e7956f243a99a8 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:26.388346 10398 tablet_bootstrap.cc:492] T 01f1cef511614c43ae422c6fb06be9c4 P 21a517d52d81404f9ae245428d42fed8: No bootstrap required, opened a new log
I20260709 13:17:26.389606 10398 ts_tablet_manager.cc:1403] T 01f1cef511614c43ae422c6fb06be9c4 P 21a517d52d81404f9ae245428d42fed8: Time spent bootstrapping tablet: real 0.119s	user 0.053s	sys 0.038s
I20260709 13:17:26.389822 10320 leader_election.cc:304] T 7ce9af49a9d94f40bffa2d91089a906e P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6c512cfc2248c28e5ff72bf0fc06df; no voters: 21a517d52d81404f9ae245428d42fed8, e7f9e723f3f54a4bb5e4c57869f40d7a
I20260709 13:17:26.391686 10423 raft_consensus.cc:2749] T 7ce9af49a9d94f40bffa2d91089a906e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:26.389433 10401 raft_consensus.cc:515] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } } peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } }
I20260709 13:17:26.400002 10357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc68869777e04563a9a887134320adf6" candidate_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" is_pre_election: true
I20260709 13:17:26.399868 10397 raft_consensus.cc:359] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.400533 10401 leader_election.cc:290] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 election: Requested vote from peers e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427), 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989)
I20260709 13:17:26.400698 10397 raft_consensus.cc:385] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.395990 10399 tablet_bootstrap.cc:492] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df: No bootstrap required, opened a new log
I20260709 13:17:26.401129 10397 raft_consensus.cc:740] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7f9e723f3f54a4bb5e4c57869f40d7a, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.398169 10208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc68869777e04563a9a887134320adf6" candidate_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8" is_pre_election: true
I20260709 13:17:26.401489 10399 ts_tablet_manager.cc:1403] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent bootstrapping tablet: real 0.110s	user 0.045s	sys 0.057s
I20260709 13:17:26.396934 10398 raft_consensus.cc:359] T 01f1cef511614c43ae422c6fb06be9c4 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.401278 10357 raft_consensus.cc:2393] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e7f9e723f3f54a4bb5e4c57869f40d7a in current term 1: Already voted for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in this term.
I20260709 13:17:26.401755 10207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc68869777e04563a9a887134320adf6" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8"
I20260709 13:17:26.402493 10397 consensus_queue.cc:260] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.401993 10398 raft_consensus.cc:385] T 01f1cef511614c43ae422c6fb06be9c4 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.401794 10208 raft_consensus.cc:2468] T fc68869777e04563a9a887134320adf6 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7f9e723f3f54a4bb5e4c57869f40d7a in term 0.
I20260709 13:17:26.405081 10398 raft_consensus.cc:740] T 01f1cef511614c43ae422c6fb06be9c4 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.404868 10399 raft_consensus.cc:359] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.405712 10399 raft_consensus.cc:385] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.405923 10399 raft_consensus.cc:740] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.405978 10398 consensus_queue.cc:260] T 01f1cef511614c43ae422c6fb06be9c4 P 21a517d52d81404f9ae245428d42fed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.406551 10399 consensus_queue.cc:260] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.408311 10398 ts_tablet_manager.cc:1434] T 01f1cef511614c43ae422c6fb06be9c4 P 21a517d52d81404f9ae245428d42fed8: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:17:26.408771 10399 ts_tablet_manager.cc:1434] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:17:26.409782 10399 tablet_bootstrap.cc:492] T 1fb9419407b247db8c0d9010e24e40e1 P 9d6c512cfc2248c28e5ff72bf0fc06df: Bootstrap starting.
I20260709 13:17:26.404906 10397 ts_tablet_manager.cc:1434] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:17:26.413375 10398 tablet_bootstrap.cc:492] T 1fb9419407b247db8c0d9010e24e40e1 P 21a517d52d81404f9ae245428d42fed8: Bootstrap starting.
I20260709 13:17:26.413830 10397 tablet_bootstrap.cc:492] T a61096290231466cb5e7956f243a99a8 P e7f9e723f3f54a4bb5e4c57869f40d7a: Bootstrap starting.
I20260709 13:17:26.415113 10399 tablet_bootstrap.cc:654] T 1fb9419407b247db8c0d9010e24e40e1 P 9d6c512cfc2248c28e5ff72bf0fc06df: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.420997 10404 raft_consensus.cc:493] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.421617 10404 raft_consensus.cc:515] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.422094 10397 tablet_bootstrap.cc:654] T a61096290231466cb5e7956f243a99a8 P e7f9e723f3f54a4bb5e4c57869f40d7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.423959 10404 leader_election.cc:290] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:26.430229 10398 tablet_bootstrap.cc:654] T 1fb9419407b247db8c0d9010e24e40e1 P 21a517d52d81404f9ae245428d42fed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.434911 10357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1cf62842a6e4d3e8aba94cd94afb57b" candidate_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" is_pre_election: true
I20260709 13:17:26.435175 10249 leader_election.cc:304] T fc68869777e04563a9a887134320adf6 P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 9d6c512cfc2248c28e5ff72bf0fc06df
I20260709 13:17:26.437769 10208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1cf62842a6e4d3e8aba94cd94afb57b" candidate_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8" is_pre_election: true
I20260709 13:17:26.439508 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc68869777e04563a9a887134320adf6" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
I20260709 13:17:26.440346 10282 raft_consensus.cc:3060] T fc68869777e04563a9a887134320adf6 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.441900 10397 tablet_bootstrap.cc:492] T a61096290231466cb5e7956f243a99a8 P e7f9e723f3f54a4bb5e4c57869f40d7a: No bootstrap required, opened a new log
I20260709 13:17:26.442665 10397 ts_tablet_manager.cc:1403] T a61096290231466cb5e7956f243a99a8 P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.007s
I20260709 13:17:26.447235 10397 raft_consensus.cc:359] T a61096290231466cb5e7956f243a99a8 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.448227 10397 raft_consensus.cc:385] T a61096290231466cb5e7956f243a99a8 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.435931 10357 raft_consensus.cc:2468] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7f9e723f3f54a4bb5e4c57869f40d7a in term 0.
I20260709 13:17:26.455806 10397 raft_consensus.cc:740] T a61096290231466cb5e7956f243a99a8 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7f9e723f3f54a4bb5e4c57869f40d7a, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.457039 10397 consensus_queue.cc:260] T a61096290231466cb5e7956f243a99a8 P e7f9e723f3f54a4bb5e4c57869f40d7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.460777 10248 leader_election.cc:304] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6c512cfc2248c28e5ff72bf0fc06df, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 
W20260709 13:17:26.461643 10249 leader_election.cc:343] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.462543 10282 raft_consensus.cc:2468] T fc68869777e04563a9a887134320adf6 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 1.
I20260709 13:17:26.463124 10404 raft_consensus.cc:2764] T fc68869777e04563a9a887134320adf6 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:17:26.465624 10404 raft_consensus.cc:2804] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:26.466133 10404 raft_consensus.cc:493] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.466764 10404 raft_consensus.cc:3060] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.467218 10320 leader_election.cc:304] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6c512cfc2248c28e5ff72bf0fc06df, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 21a517d52d81404f9ae245428d42fed8
I20260709 13:17:26.468457 10401 raft_consensus.cc:2804] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:26.468968 10401 raft_consensus.cc:697] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Becoming Leader. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Running, Role: LEADER
I20260709 13:17:26.469834 10401 consensus_queue.cc:237] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } } peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } }
I20260709 13:17:26.466113 10399 tablet_bootstrap.cc:492] T 1fb9419407b247db8c0d9010e24e40e1 P 9d6c512cfc2248c28e5ff72bf0fc06df: No bootstrap required, opened a new log
I20260709 13:17:26.476486 10399 ts_tablet_manager.cc:1403] T 1fb9419407b247db8c0d9010e24e40e1 P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent bootstrapping tablet: real 0.067s	user 0.019s	sys 0.033s
I20260709 13:17:26.480733 10399 raft_consensus.cc:359] T 1fb9419407b247db8c0d9010e24e40e1 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.481565 10398 tablet_bootstrap.cc:492] T 1fb9419407b247db8c0d9010e24e40e1 P 21a517d52d81404f9ae245428d42fed8: No bootstrap required, opened a new log
I20260709 13:17:26.481717 10399 raft_consensus.cc:385] T 1fb9419407b247db8c0d9010e24e40e1 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.482414 10398 ts_tablet_manager.cc:1403] T 1fb9419407b247db8c0d9010e24e40e1 P 21a517d52d81404f9ae245428d42fed8: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.013s
I20260709 13:17:26.482455 10399 raft_consensus.cc:740] T 1fb9419407b247db8c0d9010e24e40e1 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.485646 10397 ts_tablet_manager.cc:1434] T a61096290231466cb5e7956f243a99a8 P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.017s
I20260709 13:17:26.485507 10404 raft_consensus.cc:515] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.486151 10398 raft_consensus.cc:359] T 1fb9419407b247db8c0d9010e24e40e1 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.487025 10398 raft_consensus.cc:385] T 1fb9419407b247db8c0d9010e24e40e1 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.487320 10398 raft_consensus.cc:740] T 1fb9419407b247db8c0d9010e24e40e1 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.488154 10398 consensus_queue.cc:260] T 1fb9419407b247db8c0d9010e24e40e1 P 21a517d52d81404f9ae245428d42fed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.488736 10208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1cf62842a6e4d3e8aba94cd94afb57b" candidate_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8"
W20260709 13:17:26.490247 10249 leader_election.cc:343] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.490657 10398 ts_tablet_manager.cc:1434] T 1fb9419407b247db8c0d9010e24e40e1 P 21a517d52d81404f9ae245428d42fed8: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:17:26.491032 10399 consensus_queue.cc:260] T 1fb9419407b247db8c0d9010e24e40e1 P 9d6c512cfc2248c28e5ff72bf0fc06df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.491736 10398 tablet_bootstrap.cc:492] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8: Bootstrap starting.
I20260709 13:17:26.493945 10399 ts_tablet_manager.cc:1434] T 1fb9419407b247db8c0d9010e24e40e1 P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:17:26.494295 10397 tablet_bootstrap.cc:492] T 1fb9419407b247db8c0d9010e24e40e1 P e7f9e723f3f54a4bb5e4c57869f40d7a: Bootstrap starting.
I20260709 13:17:26.494988 10399 tablet_bootstrap.cc:492] T 86413c90120d4fae863df0ece3bebb3d P 9d6c512cfc2248c28e5ff72bf0fc06df: Bootstrap starting.
I20260709 13:17:26.498582 10398 tablet_bootstrap.cc:654] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.498389 10357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1cf62842a6e4d3e8aba94cd94afb57b" candidate_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
I20260709 13:17:26.497699 10102 catalog_manager.cc:5697] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3). New cstate: current_term: 1 leader_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:26.499128 10357 raft_consensus.cc:3060] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.501690 10397 tablet_bootstrap.cc:654] T 1fb9419407b247db8c0d9010e24e40e1 P e7f9e723f3f54a4bb5e4c57869f40d7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.507748 10357 raft_consensus.cc:2468] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7f9e723f3f54a4bb5e4c57869f40d7a in term 1.
I20260709 13:17:26.509115 10248 leader_election.cc:304] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6c512cfc2248c28e5ff72bf0fc06df, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 21a517d52d81404f9ae245428d42fed8
I20260709 13:17:26.513489 10406 raft_consensus.cc:493] T 6f703c5bc8da416e9447e3c8d238725e P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.514070 10406 raft_consensus.cc:515] T 6f703c5bc8da416e9447e3c8d238725e P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.516378 10406 leader_election.cc:290] T 6f703c5bc8da416e9447e3c8d238725e P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:26.517539 10431 raft_consensus.cc:2804] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:26.524211 10397 tablet_bootstrap.cc:492] T 1fb9419407b247db8c0d9010e24e40e1 P e7f9e723f3f54a4bb5e4c57869f40d7a: No bootstrap required, opened a new log
I20260709 13:17:26.524540 10431 raft_consensus.cc:697] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 LEADER]: Becoming Leader. State: Replica: e7f9e723f3f54a4bb5e4c57869f40d7a, State: Running, Role: LEADER
I20260709 13:17:26.524837 10397 ts_tablet_manager.cc:1403] T 1fb9419407b247db8c0d9010e24e40e1 P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.009s
I20260709 13:17:26.525498 10431 consensus_queue.cc:237] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.517987 10399 tablet_bootstrap.cc:654] T 86413c90120d4fae863df0ece3bebb3d P 9d6c512cfc2248c28e5ff72bf0fc06df: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.518049 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f703c5bc8da416e9447e3c8d238725e" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" is_pre_election: true
I20260709 13:17:26.518549 10404 leader_election.cc:290] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 1 election: Requested vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:26.528276 10397 raft_consensus.cc:359] T 1fb9419407b247db8c0d9010e24e40e1 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.529115 10397 raft_consensus.cc:385] T 1fb9419407b247db8c0d9010e24e40e1 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.529412 10397 raft_consensus.cc:740] T 1fb9419407b247db8c0d9010e24e40e1 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7f9e723f3f54a4bb5e4c57869f40d7a, State: Initialized, Role: FOLLOWER
W20260709 13:17:26.529553 10171 leader_election.cc:343] T 6f703c5bc8da416e9447e3c8d238725e P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.520149 10357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f703c5bc8da416e9447e3c8d238725e" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" is_pre_election: true
I20260709 13:17:26.530328 10397 consensus_queue.cc:260] T 1fb9419407b247db8c0d9010e24e40e1 P e7f9e723f3f54a4bb5e4c57869f40d7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
W20260709 13:17:26.531440 10173 leader_election.cc:343] T 6f703c5bc8da416e9447e3c8d238725e P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.532125 10173 leader_election.cc:304] T 6f703c5bc8da416e9447e3c8d238725e P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8; no voters: 9d6c512cfc2248c28e5ff72bf0fc06df, e7f9e723f3f54a4bb5e4c57869f40d7a
I20260709 13:17:26.532754 10397 ts_tablet_manager.cc:1434] T 1fb9419407b247db8c0d9010e24e40e1 P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:17:26.533885 10397 tablet_bootstrap.cc:492] T 01f1cef511614c43ae422c6fb06be9c4 P e7f9e723f3f54a4bb5e4c57869f40d7a: Bootstrap starting.
I20260709 13:17:26.533910 10406 raft_consensus.cc:2749] T 6f703c5bc8da416e9447e3c8d238725e P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:26.543275 10398 tablet_bootstrap.cc:492] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8: No bootstrap required, opened a new log
I20260709 13:17:26.543831 10397 tablet_bootstrap.cc:654] T 01f1cef511614c43ae422c6fb06be9c4 P e7f9e723f3f54a4bb5e4c57869f40d7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.543867 10398 ts_tablet_manager.cc:1403] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8: Time spent bootstrapping tablet: real 0.052s	user 0.032s	sys 0.016s
I20260709 13:17:26.545120 10102 catalog_manager.cc:5697] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a reported cstate change: term changed from 0 to 1, leader changed from <none> to e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2). New cstate: current_term: 1 leader_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:26.546697 10399 tablet_bootstrap.cc:492] T 86413c90120d4fae863df0ece3bebb3d P 9d6c512cfc2248c28e5ff72bf0fc06df: No bootstrap required, opened a new log
I20260709 13:17:26.547251 10399 ts_tablet_manager.cc:1403] T 86413c90120d4fae863df0ece3bebb3d P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.000s
I20260709 13:17:26.548528 10398 raft_consensus.cc:359] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.549575 10398 raft_consensus.cc:385] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.549943 10398 raft_consensus.cc:740] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.550278 10399 raft_consensus.cc:359] T 86413c90120d4fae863df0ece3bebb3d P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.551057 10399 raft_consensus.cc:385] T 86413c90120d4fae863df0ece3bebb3d P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.551579 10399 raft_consensus.cc:740] T 86413c90120d4fae863df0ece3bebb3d P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.550985 10398 consensus_queue.cc:260] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.552474 10399 consensus_queue.cc:260] T 86413c90120d4fae863df0ece3bebb3d P 9d6c512cfc2248c28e5ff72bf0fc06df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.554363 10398 ts_tablet_manager.cc:1434] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:17:26.555817 10398 tablet_bootstrap.cc:492] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8: Bootstrap starting.
I20260709 13:17:26.557416 10399 ts_tablet_manager.cc:1434] T 86413c90120d4fae863df0ece3bebb3d P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 13:17:26.558482 10399 tablet_bootstrap.cc:492] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df: Bootstrap starting.
I20260709 13:17:26.565267 10398 tablet_bootstrap.cc:654] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.568614 10399 tablet_bootstrap.cc:654] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.569693 10406 raft_consensus.cc:493] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.570220 10406 raft_consensus.cc:515] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.574180 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61096290231466cb5e7956f243a99a8" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" is_pre_election: true
I20260709 13:17:26.574931 10282 raft_consensus.cc:2468] T a61096290231466cb5e7956f243a99a8 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21a517d52d81404f9ae245428d42fed8 in term 0.
I20260709 13:17:26.576429 10406 leader_election.cc:290] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:26.577883 10357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61096290231466cb5e7956f243a99a8" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" is_pre_election: true
I20260709 13:17:26.578387 10398 tablet_bootstrap.cc:492] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8: No bootstrap required, opened a new log
I20260709 13:17:26.578589 10357 raft_consensus.cc:2468] T a61096290231466cb5e7956f243a99a8 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21a517d52d81404f9ae245428d42fed8 in term 0.
I20260709 13:17:26.578917 10398 ts_tablet_manager.cc:1403] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 13:17:26.576247 10171 leader_election.cc:304] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 
I20260709 13:17:26.582132 10398 raft_consensus.cc:359] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.582890 10398 raft_consensus.cc:385] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.583210 10398 raft_consensus.cc:740] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.584100 10398 consensus_queue.cc:260] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.584975 10397 tablet_bootstrap.cc:492] T 01f1cef511614c43ae422c6fb06be9c4 P e7f9e723f3f54a4bb5e4c57869f40d7a: No bootstrap required, opened a new log
I20260709 13:17:26.584992 10406 raft_consensus.cc:2804] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:26.585806 10397 ts_tablet_manager.cc:1403] T 01f1cef511614c43ae422c6fb06be9c4 P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent bootstrapping tablet: real 0.052s	user 0.027s	sys 0.020s
I20260709 13:17:26.585867 10406 raft_consensus.cc:493] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.586397 10406 raft_consensus.cc:3060] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.586560 10398 ts_tablet_manager.cc:1434] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:17:26.587651 10398 tablet_bootstrap.cc:492] T e35ad6dabd174fe29b0be23dbf63d97f P 21a517d52d81404f9ae245428d42fed8: Bootstrap starting.
I20260709 13:17:26.587821 10420 raft_consensus.cc:493] T 1fb9419407b247db8c0d9010e24e40e1 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.588466 10420 raft_consensus.cc:515] T 1fb9419407b247db8c0d9010e24e40e1 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.589828 10397 raft_consensus.cc:359] T 01f1cef511614c43ae422c6fb06be9c4 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.590687 10397 raft_consensus.cc:385] T 01f1cef511614c43ae422c6fb06be9c4 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.590999 10397 raft_consensus.cc:740] T 01f1cef511614c43ae422c6fb06be9c4 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7f9e723f3f54a4bb5e4c57869f40d7a, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.591081 10420 leader_election.cc:290] T 1fb9419407b247db8c0d9010e24e40e1 P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:26.590309 10399 tablet_bootstrap.cc:492] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df: No bootstrap required, opened a new log
I20260709 13:17:26.592098 10399 ts_tablet_manager.cc:1403] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.002s
I20260709 13:17:26.592783 10357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb9419407b247db8c0d9010e24e40e1" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" is_pre_election: true
I20260709 13:17:26.593596 10357 raft_consensus.cc:2468] T 1fb9419407b247db8c0d9010e24e40e1 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21a517d52d81404f9ae245428d42fed8 in term 0.
I20260709 13:17:26.594992 10173 leader_election.cc:304] T 1fb9419407b247db8c0d9010e24e40e1 P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, 9d6c512cfc2248c28e5ff72bf0fc06df; no voters: 
I20260709 13:17:26.594816 10399 raft_consensus.cc:359] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.596127 10399 raft_consensus.cc:385] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.595844 10397 consensus_queue.cc:260] T 01f1cef511614c43ae422c6fb06be9c4 P e7f9e723f3f54a4bb5e4c57869f40d7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.596490 10399 raft_consensus.cc:740] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.597786 10398 tablet_bootstrap.cc:654] T e35ad6dabd174fe29b0be23dbf63d97f P 21a517d52d81404f9ae245428d42fed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.598914 10397 ts_tablet_manager.cc:1434] T 01f1cef511614c43ae422c6fb06be9c4 P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:17:26.600081 10397 tablet_bootstrap.cc:492] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a: Bootstrap starting.
I20260709 13:17:26.603068 10420 raft_consensus.cc:2804] T 1fb9419407b247db8c0d9010e24e40e1 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:26.603673 10420 raft_consensus.cc:493] T 1fb9419407b247db8c0d9010e24e40e1 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.604529 10399 consensus_queue.cc:260] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.605273 10420 raft_consensus.cc:3060] T 1fb9419407b247db8c0d9010e24e40e1 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.608914 10397 tablet_bootstrap.cc:654] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.594888 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb9419407b247db8c0d9010e24e40e1" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" is_pre_election: true
I20260709 13:17:26.617437 10282 raft_consensus.cc:2468] T 1fb9419407b247db8c0d9010e24e40e1 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21a517d52d81404f9ae245428d42fed8 in term 0.
I20260709 13:17:26.617592 10399 ts_tablet_manager.cc:1434] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent starting tablet: real 0.025s	user 0.002s	sys 0.005s
I20260709 13:17:26.623266 10399 tablet_bootstrap.cc:492] T e35ad6dabd174fe29b0be23dbf63d97f P 9d6c512cfc2248c28e5ff72bf0fc06df: Bootstrap starting.
I20260709 13:17:26.632349 10399 tablet_bootstrap.cc:654] T e35ad6dabd174fe29b0be23dbf63d97f P 9d6c512cfc2248c28e5ff72bf0fc06df: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.633513 10397 tablet_bootstrap.cc:492] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a: No bootstrap required, opened a new log
I20260709 13:17:26.634171 10397 ts_tablet_manager.cc:1403] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.026s
I20260709 13:17:26.638398 10397 raft_consensus.cc:359] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.639607 10397 raft_consensus.cc:385] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.640127 10397 raft_consensus.cc:740] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7f9e723f3f54a4bb5e4c57869f40d7a, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.641449 10397 consensus_queue.cc:260] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.645269 10397 ts_tablet_manager.cc:1434] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.002s
I20260709 13:17:26.647015 10397 tablet_bootstrap.cc:492] T 86413c90120d4fae863df0ece3bebb3d P e7f9e723f3f54a4bb5e4c57869f40d7a: Bootstrap starting.
I20260709 13:17:26.657873 10397 tablet_bootstrap.cc:654] T 86413c90120d4fae863df0ece3bebb3d P e7f9e723f3f54a4bb5e4c57869f40d7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.660341 10401 raft_consensus.cc:493] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.661221 10401 raft_consensus.cc:515] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.666522 10208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f1cef511614c43ae422c6fb06be9c4" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8" is_pre_election: true
I20260709 13:17:26.667768 10208 raft_consensus.cc:2468] T 01f1cef511614c43ae422c6fb06be9c4 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 0.
I20260709 13:17:26.670302 10425 raft_consensus.cc:493] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.671079 10425 raft_consensus.cc:515] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.674192 10425 leader_election.cc:290] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427)
I20260709 13:17:26.674031 10444 raft_consensus.cc:493] T 01f1cef511614c43ae422c6fb06be9c4 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.676002 10207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f703c5bc8da416e9447e3c8d238725e" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8" is_pre_election: true
I20260709 13:17:26.675490 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f703c5bc8da416e9447e3c8d238725e" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" is_pre_election: true
I20260709 13:17:26.676959 10207 raft_consensus.cc:2468] T 6f703c5bc8da416e9447e3c8d238725e P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 0.
I20260709 13:17:26.678113 10444 raft_consensus.cc:515] T 01f1cef511614c43ae422c6fb06be9c4 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.678432 10323 leader_election.cc:304] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, 9d6c512cfc2248c28e5ff72bf0fc06df; no voters: 
I20260709 13:17:26.679773 10323 leader_election.cc:304] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, 9d6c512cfc2248c28e5ff72bf0fc06df; no voters: 
W20260709 13:17:26.682119 10320 leader_election.cc:343] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.682451 10423 raft_consensus.cc:2804] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:26.683050 10423 raft_consensus.cc:493] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.683491 10423 raft_consensus.cc:3060] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.683688 10444 leader_election.cc:290] T 01f1cef511614c43ae422c6fb06be9c4 P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:26.684023 10357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f1cef511614c43ae422c6fb06be9c4" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" is_pre_election: true
I20260709 13:17:26.681421 10401 leader_election.cc:290] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427)
I20260709 13:17:26.685853 10283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f1cef511614c43ae422c6fb06be9c4" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" is_pre_election: true
I20260709 13:17:26.686112 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f1cef511614c43ae422c6fb06be9c4" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" is_pre_election: true
I20260709 13:17:26.688508 10283 raft_consensus.cc:2468] T 01f1cef511614c43ae422c6fb06be9c4 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 0.
I20260709 13:17:26.687438 10425 raft_consensus.cc:2804] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:26.693521 10425 raft_consensus.cc:493] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.693970 10425 raft_consensus.cc:3060] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.675643 10406 raft_consensus.cc:515] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.697722 10283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61096290231466cb5e7956f243a99a8" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
I20260709 13:17:26.698523 10283 raft_consensus.cc:3060] T a61096290231466cb5e7956f243a99a8 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.707952 10420 raft_consensus.cc:515] T 1fb9419407b247db8c0d9010e24e40e1 P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.708441 10425 raft_consensus.cc:515] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.712538 10423 raft_consensus.cc:515] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.714190 10356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61096290231466cb5e7956f243a99a8" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
I20260709 13:17:26.715077 10356 raft_consensus.cc:3060] T a61096290231466cb5e7956f243a99a8 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.715193 10357 raft_consensus.cc:2393] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21a517d52d81404f9ae245428d42fed8 in current term 1: Already voted for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in this term.
I20260709 13:17:26.715462 10207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f703c5bc8da416e9447e3c8d238725e" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8"
I20260709 13:17:26.716107 10207 raft_consensus.cc:3060] T 6f703c5bc8da416e9447e3c8d238725e P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.716239 10423 leader_election.cc:290] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 election: Requested vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427)
I20260709 13:17:26.717630 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f1cef511614c43ae422c6fb06be9c4" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
I20260709 13:17:26.717880 10208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f1cef511614c43ae422c6fb06be9c4" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8"
I20260709 13:17:26.718238 10282 raft_consensus.cc:3060] T 01f1cef511614c43ae422c6fb06be9c4 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.718461 10208 raft_consensus.cc:3060] T 01f1cef511614c43ae422c6fb06be9c4 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.721809 10173 leader_election.cc:304] T 01f1cef511614c43ae422c6fb06be9c4 P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8; no voters: 9d6c512cfc2248c28e5ff72bf0fc06df, e7f9e723f3f54a4bb5e4c57869f40d7a
I20260709 13:17:26.724645 10207 raft_consensus.cc:2468] T 6f703c5bc8da416e9447e3c8d238725e P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 1.
I20260709 13:17:26.713013 10406 leader_election.cc:290] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 election: Requested vote from peers e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:26.728056 10399 tablet_bootstrap.cc:492] T e35ad6dabd174fe29b0be23dbf63d97f P 9d6c512cfc2248c28e5ff72bf0fc06df: No bootstrap required, opened a new log
I20260709 13:17:26.726303 10323 leader_election.cc:304] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, 9d6c512cfc2248c28e5ff72bf0fc06df; no voters: 
I20260709 13:17:26.725976 10356 raft_consensus.cc:2468] T a61096290231466cb5e7956f243a99a8 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a517d52d81404f9ae245428d42fed8 in term 1.
I20260709 13:17:26.727322 10398 tablet_bootstrap.cc:492] T e35ad6dabd174fe29b0be23dbf63d97f P 21a517d52d81404f9ae245428d42fed8: No bootstrap required, opened a new log
I20260709 13:17:26.731730 10399 ts_tablet_manager.cc:1403] T e35ad6dabd174fe29b0be23dbf63d97f P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent bootstrapping tablet: real 0.109s	user 0.038s	sys 0.049s
I20260709 13:17:26.732128 10398 ts_tablet_manager.cc:1403] T e35ad6dabd174fe29b0be23dbf63d97f P 21a517d52d81404f9ae245428d42fed8: Time spent bootstrapping tablet: real 0.145s	user 0.040s	sys 0.064s
I20260709 13:17:26.730001 10357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb9419407b247db8c0d9010e24e40e1" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
I20260709 13:17:26.732863 10357 raft_consensus.cc:3060] T 1fb9419407b247db8c0d9010e24e40e1 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.734329 10399 raft_consensus.cc:359] T e35ad6dabd174fe29b0be23dbf63d97f P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.734894 10399 raft_consensus.cc:385] T e35ad6dabd174fe29b0be23dbf63d97f P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.735491 10423 raft_consensus.cc:2804] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:26.727797 10281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb9419407b247db8c0d9010e24e40e1" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
I20260709 13:17:26.735227 10398 raft_consensus.cc:359] T e35ad6dabd174fe29b0be23dbf63d97f P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.736222 10281 raft_consensus.cc:3060] T 1fb9419407b247db8c0d9010e24e40e1 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.736491 10398 raft_consensus.cc:385] T e35ad6dabd174fe29b0be23dbf63d97f P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.729952 10280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f703c5bc8da416e9447e3c8d238725e" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
I20260709 13:17:26.727277 10208 raft_consensus.cc:2468] T 01f1cef511614c43ae422c6fb06be9c4 P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 1.
I20260709 13:17:26.731407 10282 raft_consensus.cc:2468] T 01f1cef511614c43ae422c6fb06be9c4 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 1.
I20260709 13:17:26.737030 10398 raft_consensus.cc:740] T e35ad6dabd174fe29b0be23dbf63d97f P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Initialized, Role: FOLLOWER
W20260709 13:17:26.738391 10320 leader_election.cc:343] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.738438 10323 leader_election.cc:304] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, 9d6c512cfc2248c28e5ff72bf0fc06df; no voters: 
I20260709 13:17:26.738801 10398 consensus_queue.cc:260] T e35ad6dabd174fe29b0be23dbf63d97f P 21a517d52d81404f9ae245428d42fed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.739508 10401 raft_consensus.cc:2804] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:26.740738 10444 raft_consensus.cc:2749] T 01f1cef511614c43ae422c6fb06be9c4 P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:26.741326 10398 ts_tablet_manager.cc:1434] T e35ad6dabd174fe29b0be23dbf63d97f P 21a517d52d81404f9ae245428d42fed8: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:17:26.742408 10398 tablet_bootstrap.cc:492] T 86413c90120d4fae863df0ece3bebb3d P 21a517d52d81404f9ae245428d42fed8: Bootstrap starting.
I20260709 13:17:26.729678 10283 raft_consensus.cc:2468] T a61096290231466cb5e7956f243a99a8 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a517d52d81404f9ae245428d42fed8 in term 1.
I20260709 13:17:26.728092 10425 leader_election.cc:290] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 election: Requested vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427)
I20260709 13:17:26.730377 10420 leader_election.cc:290] T 1fb9419407b247db8c0d9010e24e40e1 P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 election: Requested vote from peers e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:26.737026 10423 raft_consensus.cc:697] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Becoming Leader. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Running, Role: LEADER
I20260709 13:17:26.735285 10399 raft_consensus.cc:740] T e35ad6dabd174fe29b0be23dbf63d97f P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.749810 10357 raft_consensus.cc:2468] T 1fb9419407b247db8c0d9010e24e40e1 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a517d52d81404f9ae245428d42fed8 in term 1.
I20260709 13:17:26.749533 10399 consensus_queue.cc:260] T e35ad6dabd174fe29b0be23dbf63d97f P 9d6c512cfc2248c28e5ff72bf0fc06df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.748515 10398 tablet_bootstrap.cc:654] T 86413c90120d4fae863df0ece3bebb3d P 21a517d52d81404f9ae245428d42fed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.750360 10171 leader_election.cc:304] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 
I20260709 13:17:26.748647 10423 consensus_queue.cc:237] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.752286 10399 ts_tablet_manager.cc:1434] T e35ad6dabd174fe29b0be23dbf63d97f P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent starting tablet: real 0.020s	user 0.001s	sys 0.005s
I20260709 13:17:26.753005 10173 leader_election.cc:304] T 1fb9419407b247db8c0d9010e24e40e1 P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, 9d6c512cfc2248c28e5ff72bf0fc06df; no voters: 
I20260709 13:17:26.754225 10444 raft_consensus.cc:2804] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:26.727298 10397 tablet_bootstrap.cc:492] T 86413c90120d4fae863df0ece3bebb3d P e7f9e723f3f54a4bb5e4c57869f40d7a: No bootstrap required, opened a new log
I20260709 13:17:26.755616 10397 ts_tablet_manager.cc:1403] T 86413c90120d4fae863df0ece3bebb3d P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent bootstrapping tablet: real 0.109s	user 0.010s	sys 0.009s
I20260709 13:17:26.754702 10401 raft_consensus.cc:697] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Becoming Leader. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Running, Role: LEADER
I20260709 13:17:26.756808 10401 consensus_queue.cc:237] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.758939 10420 raft_consensus.cc:2804] T 1fb9419407b247db8c0d9010e24e40e1 P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:26.759449 10420 raft_consensus.cc:697] T 1fb9419407b247db8c0d9010e24e40e1 P 21a517d52d81404f9ae245428d42fed8 [term 1 LEADER]: Becoming Leader. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Running, Role: LEADER
I20260709 13:17:26.766271 10397 raft_consensus.cc:359] T 86413c90120d4fae863df0ece3bebb3d P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.767475 10397 raft_consensus.cc:385] T 86413c90120d4fae863df0ece3bebb3d P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.767915 10397 raft_consensus.cc:740] T 86413c90120d4fae863df0ece3bebb3d P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7f9e723f3f54a4bb5e4c57869f40d7a, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.760524 10420 consensus_queue.cc:237] T 1fb9419407b247db8c0d9010e24e40e1 P 21a517d52d81404f9ae245428d42fed8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.768782 10106 catalog_manager.cc:5697] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3). New cstate: current_term: 1 leader_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:26.769099 10397 consensus_queue.cc:260] T 86413c90120d4fae863df0ece3bebb3d P e7f9e723f3f54a4bb5e4c57869f40d7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.773015 10397 ts_tablet_manager.cc:1434] T 86413c90120d4fae863df0ece3bebb3d P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:17:26.776401 10397 tablet_bootstrap.cc:492] T 6f703c5bc8da416e9447e3c8d238725e P e7f9e723f3f54a4bb5e4c57869f40d7a: Bootstrap starting.
I20260709 13:17:26.783447 10401 raft_consensus.cc:493] T 86413c90120d4fae863df0ece3bebb3d P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.785339 10401 raft_consensus.cc:515] T 86413c90120d4fae863df0ece3bebb3d P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.784649 10444 raft_consensus.cc:697] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8 [term 1 LEADER]: Becoming Leader. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Running, Role: LEADER
I20260709 13:17:26.788264 10208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86413c90120d4fae863df0ece3bebb3d" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8" is_pre_election: true
I20260709 13:17:26.790788 10444 consensus_queue.cc:237] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.795240 10397 tablet_bootstrap.cc:654] T 6f703c5bc8da416e9447e3c8d238725e P e7f9e723f3f54a4bb5e4c57869f40d7a: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:26.797052 10323 leader_election.cc:343] T 86413c90120d4fae863df0ece3bebb3d P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.799860 10283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86413c90120d4fae863df0ece3bebb3d" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" is_pre_election: true
I20260709 13:17:26.801896 10283 raft_consensus.cc:2468] T 86413c90120d4fae863df0ece3bebb3d P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 0.
I20260709 13:17:26.803745 10320 leader_election.cc:304] T 86413c90120d4fae863df0ece3bebb3d P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6c512cfc2248c28e5ff72bf0fc06df, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 21a517d52d81404f9ae245428d42fed8
I20260709 13:17:26.801525 10401 leader_election.cc:290] T 86413c90120d4fae863df0ece3bebb3d P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427)
I20260709 13:17:26.804975 10446 raft_consensus.cc:2804] T 86413c90120d4fae863df0ece3bebb3d P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:26.805354 10446 raft_consensus.cc:493] T 86413c90120d4fae863df0ece3bebb3d P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.797860 10281 raft_consensus.cc:2468] T 1fb9419407b247db8c0d9010e24e40e1 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a517d52d81404f9ae245428d42fed8 in term 1.
I20260709 13:17:26.805696 10446 raft_consensus.cc:3060] T 86413c90120d4fae863df0ece3bebb3d P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.814607 10397 tablet_bootstrap.cc:492] T 6f703c5bc8da416e9447e3c8d238725e P e7f9e723f3f54a4bb5e4c57869f40d7a: No bootstrap required, opened a new log
I20260709 13:17:26.815162 10397 ts_tablet_manager.cc:1403] T 6f703c5bc8da416e9447e3c8d238725e P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.006s
I20260709 13:17:26.816440 10103 catalog_manager.cc:5697] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3). New cstate: current_term: 1 leader_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:26.817922 10397 raft_consensus.cc:359] T 6f703c5bc8da416e9447e3c8d238725e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.818269 10446 raft_consensus.cc:515] T 86413c90120d4fae863df0ece3bebb3d P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.818681 10397 raft_consensus.cc:385] T 6f703c5bc8da416e9447e3c8d238725e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.819003 10397 raft_consensus.cc:740] T 6f703c5bc8da416e9447e3c8d238725e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7f9e723f3f54a4bb5e4c57869f40d7a, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.819841 10397 consensus_queue.cc:260] T 6f703c5bc8da416e9447e3c8d238725e P e7f9e723f3f54a4bb5e4c57869f40d7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.822213 10398 tablet_bootstrap.cc:492] T 86413c90120d4fae863df0ece3bebb3d P 21a517d52d81404f9ae245428d42fed8: No bootstrap required, opened a new log
I20260709 13:17:26.822703 10398 ts_tablet_manager.cc:1403] T 86413c90120d4fae863df0ece3bebb3d P 21a517d52d81404f9ae245428d42fed8: Time spent bootstrapping tablet: real 0.081s	user 0.027s	sys 0.030s
I20260709 13:17:26.825363 10398 raft_consensus.cc:359] T 86413c90120d4fae863df0ece3bebb3d P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.825769 10397 ts_tablet_manager.cc:1434] T 6f703c5bc8da416e9447e3c8d238725e P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:17:26.826090 10398 raft_consensus.cc:385] T 86413c90120d4fae863df0ece3bebb3d P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.826380 10398 raft_consensus.cc:740] T 86413c90120d4fae863df0ece3bebb3d P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.827049 10398 consensus_queue.cc:260] T 86413c90120d4fae863df0ece3bebb3d P 21a517d52d81404f9ae245428d42fed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.824357 10106 catalog_manager.cc:5697] T 1fb9419407b247db8c0d9010e24e40e1 P 21a517d52d81404f9ae245428d42fed8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 21a517d52d81404f9ae245428d42fed8 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "21a517d52d81404f9ae245428d42fed8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:26.829150 10398 ts_tablet_manager.cc:1434] T 86413c90120d4fae863df0ece3bebb3d P 21a517d52d81404f9ae245428d42fed8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:17:26.828876 10420 consensus_queue.cc:1048] T 7ce9af49a9d94f40bffa2d91089a906e P 21a517d52d81404f9ae245428d42fed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:26.830309 10106 catalog_manager.cc:5697] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 21a517d52d81404f9ae245428d42fed8 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "21a517d52d81404f9ae245428d42fed8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:26.834946 10208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86413c90120d4fae863df0ece3bebb3d" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8"
I20260709 13:17:26.835003 10283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86413c90120d4fae863df0ece3bebb3d" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
I20260709 13:17:26.835625 10208 raft_consensus.cc:3060] T 86413c90120d4fae863df0ece3bebb3d P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.835755 10283 raft_consensus.cc:3060] T 86413c90120d4fae863df0ece3bebb3d P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.839360 10446 leader_election.cc:290] T 86413c90120d4fae863df0ece3bebb3d P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 election: Requested vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427)
I20260709 13:17:26.843405 10283 raft_consensus.cc:2468] T 86413c90120d4fae863df0ece3bebb3d P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 1.
I20260709 13:17:26.844646 10208 raft_consensus.cc:2468] T 86413c90120d4fae863df0ece3bebb3d P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 1.
I20260709 13:17:26.845152 10320 leader_election.cc:304] T 86413c90120d4fae863df0ece3bebb3d P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6c512cfc2248c28e5ff72bf0fc06df, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 
I20260709 13:17:26.845293 10420 consensus_queue.cc:1048] T 7ce9af49a9d94f40bffa2d91089a906e P 21a517d52d81404f9ae245428d42fed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:26.846060 10446 raft_consensus.cc:2804] T 86413c90120d4fae863df0ece3bebb3d P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:26.848232 10420 raft_consensus.cc:493] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.851503 10446 raft_consensus.cc:697] T 86413c90120d4fae863df0ece3bebb3d P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Becoming Leader. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Running, Role: LEADER
I20260709 13:17:26.852535 10446 consensus_queue.cc:237] T 86413c90120d4fae863df0ece3bebb3d P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.854197 10420 raft_consensus.cc:515] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:26.857239 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1cf62842a6e4d3e8aba94cd94afb57b" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" is_pre_election: true
I20260709 13:17:26.858953 10401 consensus_queue.cc:1048] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:26.868746 10420 leader_election.cc:290] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:26.872613 10106 catalog_manager.cc:5697] T 86413c90120d4fae863df0ece3bebb3d P 9d6c512cfc2248c28e5ff72bf0fc06df reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3). New cstate: current_term: 1 leader_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:26.877992 10356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1cf62842a6e4d3e8aba94cd94afb57b" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" is_pre_election: true
I20260709 13:17:26.879118 10356 raft_consensus.cc:2393] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21a517d52d81404f9ae245428d42fed8 in current term 1: Already voted for candidate e7f9e723f3f54a4bb5e4c57869f40d7a in this term.
I20260709 13:17:26.880421 10173 leader_election.cc:304] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8; no voters: 9d6c512cfc2248c28e5ff72bf0fc06df, e7f9e723f3f54a4bb5e4c57869f40d7a
I20260709 13:17:26.882411 10444 raft_consensus.cc:3060] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.883584 10208 raft_consensus.cc:3060] T fc68869777e04563a9a887134320adf6 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.891360 10444 raft_consensus.cc:2749] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:26.902498 10423 consensus_queue.cc:1048] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:27.030794 10431 consensus_queue.cc:1048] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:27.043149 10431 consensus_queue.cc:1048] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:27.070489 10431 raft_consensus.cc:493] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.070982 10431 raft_consensus.cc:515] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:27.072803 10431 leader_election.cc:290] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:27.073616 10208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35ad6dabd174fe29b0be23dbf63d97f" candidate_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8" is_pre_election: true
I20260709 13:17:27.073835 10357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35ad6dabd174fe29b0be23dbf63d97f" candidate_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" is_pre_election: true
I20260709 13:17:27.074333 10208 raft_consensus.cc:2468] T e35ad6dabd174fe29b0be23dbf63d97f P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7f9e723f3f54a4bb5e4c57869f40d7a in term 0.
I20260709 13:17:27.074496 10357 raft_consensus.cc:2468] T e35ad6dabd174fe29b0be23dbf63d97f P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7f9e723f3f54a4bb5e4c57869f40d7a in term 0.
I20260709 13:17:27.075423 10249 leader_election.cc:304] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 
I20260709 13:17:27.076249 10431 raft_consensus.cc:2804] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:27.077086 10431 raft_consensus.cc:493] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.077323 10431 raft_consensus.cc:3060] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.082296 10431 raft_consensus.cc:515] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:27.084309 10431 leader_election.cc:290] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 1 election: Requested vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:27.084944 10357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35ad6dabd174fe29b0be23dbf63d97f" candidate_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
I20260709 13:17:27.084856 10208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35ad6dabd174fe29b0be23dbf63d97f" candidate_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8"
I20260709 13:17:27.085666 10357 raft_consensus.cc:3060] T e35ad6dabd174fe29b0be23dbf63d97f P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.085749 10208 raft_consensus.cc:3060] T e35ad6dabd174fe29b0be23dbf63d97f P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.090880 10357 raft_consensus.cc:2468] T e35ad6dabd174fe29b0be23dbf63d97f P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7f9e723f3f54a4bb5e4c57869f40d7a in term 1.
I20260709 13:17:27.091444 10208 raft_consensus.cc:2468] T e35ad6dabd174fe29b0be23dbf63d97f P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7f9e723f3f54a4bb5e4c57869f40d7a in term 1.
I20260709 13:17:27.092243 10248 leader_election.cc:304] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6c512cfc2248c28e5ff72bf0fc06df, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 
I20260709 13:17:27.093262 10431 raft_consensus.cc:2804] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:27.093900 10431 raft_consensus.cc:697] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 LEADER]: Becoming Leader. State: Replica: e7f9e723f3f54a4bb5e4c57869f40d7a, State: Running, Role: LEADER
I20260709 13:17:27.094774 10431 consensus_queue.cc:237] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:27.102190 10103 catalog_manager.cc:5697] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a reported cstate change: term changed from 0 to 1, leader changed from <none> to e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2). New cstate: current_term: 1 leader_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:27.139262 10423 consensus_queue.cc:1048] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:27.150612 10446 consensus_queue.cc:1048] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:27.174058 10420 consensus_queue.cc:1048] T 1fb9419407b247db8c0d9010e24e40e1 P 21a517d52d81404f9ae245428d42fed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:27.176317 10431 raft_consensus.cc:493] T 6f703c5bc8da416e9447e3c8d238725e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.176908 10431 raft_consensus.cc:515] T 6f703c5bc8da416e9447e3c8d238725e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:27.179026 10431 leader_election.cc:290] T 6f703c5bc8da416e9447e3c8d238725e P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:27.179915 10208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f703c5bc8da416e9447e3c8d238725e" candidate_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8" is_pre_election: true
I20260709 13:17:27.180678 10356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f703c5bc8da416e9447e3c8d238725e" candidate_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" is_pre_election: true
I20260709 13:17:27.180898 10208 raft_consensus.cc:2393] T 6f703c5bc8da416e9447e3c8d238725e P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e7f9e723f3f54a4bb5e4c57869f40d7a in current term 1: Already voted for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in this term.
I20260709 13:17:27.184634 10249 leader_election.cc:304] T 6f703c5bc8da416e9447e3c8d238725e P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 21a517d52d81404f9ae245428d42fed8, 9d6c512cfc2248c28e5ff72bf0fc06df
I20260709 13:17:27.186266 10450 consensus_queue.cc:1048] T 1fb9419407b247db8c0d9010e24e40e1 P 21a517d52d81404f9ae245428d42fed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:27.186954 10431 raft_consensus.cc:3060] T 6f703c5bc8da416e9447e3c8d238725e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.195536 10431 raft_consensus.cc:2749] T 6f703c5bc8da416e9447e3c8d238725e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:27.213986 10420 consensus_queue.cc:1048] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:27.225801 10420 consensus_queue.cc:1048] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:27.259490 10446 consensus_queue.cc:1048] T 86413c90120d4fae863df0ece3bebb3d P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:27.270049 10446 consensus_queue.cc:1048] T 86413c90120d4fae863df0ece3bebb3d P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:27.309870 10356 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc68869777e04563a9a887134320adf6"
dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
mode: GRACEFUL
new_leader_uuid: "21a517d52d81404f9ae245428d42fed8"
 from {username='slave'} at 127.0.0.1:36830
I20260709 13:17:27.309831 10425 consensus_queue.cc:1048] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:27.310774 10356 raft_consensus.cc:606] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Received request to transfer leadership to TS 21a517d52d81404f9ae245428d42fed8
I20260709 13:17:27.327003 10446 raft_consensus.cc:993] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df: : Instructing follower 21a517d52d81404f9ae245428d42fed8 to start an election
I20260709 13:17:27.327631 10446 raft_consensus.cc:1081] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Signalling peer 21a517d52d81404f9ae245428d42fed8 to start an election
I20260709 13:17:27.329859 10207 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc68869777e04563a9a887134320adf6"
dest_uuid: "21a517d52d81404f9ae245428d42fed8"
 from {username='slave'} at 127.0.0.1:44274
I20260709 13:17:27.330520 10207 raft_consensus.cc:493] T fc68869777e04563a9a887134320adf6 P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:27.330981 10207 raft_consensus.cc:3060] T fc68869777e04563a9a887134320adf6 P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.333496 10401 consensus_queue.cc:1048] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:27.340420 10207 raft_consensus.cc:515] T fc68869777e04563a9a887134320adf6 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } } peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } }
I20260709 13:17:27.342862 10207 leader_election.cc:290] T fc68869777e04563a9a887134320adf6 P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 2 election: Requested vote from peers e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:27.344246 10356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc68869777e04563a9a887134320adf6" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
I20260709 13:17:27.344396 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc68869777e04563a9a887134320adf6" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
I20260709 13:17:27.344947 10356 raft_consensus.cc:3055] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:27.345067 10282 raft_consensus.cc:3060] T fc68869777e04563a9a887134320adf6 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.345374 10356 raft_consensus.cc:740] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Running, Role: LEADER
I20260709 13:17:27.346087 10281 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1cf62842a6e4d3e8aba94cd94afb57b"
dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
mode: GRACEFUL
new_leader_uuid: "21a517d52d81404f9ae245428d42fed8"
 from {username='slave'} at 127.0.0.1:52680
I20260709 13:17:27.346359 10356 consensus_queue.cc:260] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } } peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } }
I20260709 13:17:27.346720 10281 raft_consensus.cc:606] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 LEADER]: Received request to transfer leadership to TS 21a517d52d81404f9ae245428d42fed8
I20260709 13:17:27.347594 10356 raft_consensus.cc:3060] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.354760 10282 raft_consensus.cc:2468] T fc68869777e04563a9a887134320adf6 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a517d52d81404f9ae245428d42fed8 in term 2.
I20260709 13:17:27.356173 10171 leader_election.cc:304] T fc68869777e04563a9a887134320adf6 P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 
I20260709 13:17:27.357088 10420 raft_consensus.cc:2804] T fc68869777e04563a9a887134320adf6 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:27.357249 10356 raft_consensus.cc:2468] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a517d52d81404f9ae245428d42fed8 in term 2.
I20260709 13:17:27.357652 10420 raft_consensus.cc:697] T fc68869777e04563a9a887134320adf6 P 21a517d52d81404f9ae245428d42fed8 [term 2 LEADER]: Becoming Leader. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Running, Role: LEADER
I20260709 13:17:27.359285 10420 consensus_queue.cc:237] T fc68869777e04563a9a887134320adf6 P 21a517d52d81404f9ae245428d42fed8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } } peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } }
I20260709 13:17:27.366633 10103 catalog_manager.cc:5697] T fc68869777e04563a9a887134320adf6 P 21a517d52d81404f9ae245428d42fed8 reported cstate change: term changed from 1 to 2, leader changed from 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3) to 21a517d52d81404f9ae245428d42fed8 (127.30.63.1). New cstate: current_term: 2 leader_uuid: "21a517d52d81404f9ae245428d42fed8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:27.369941 10207 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a61096290231466cb5e7956f243a99a8"
dest_uuid: "21a517d52d81404f9ae245428d42fed8"
mode: GRACEFUL
new_leader_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
 from {username='slave'} at 127.0.0.1:44292
I20260709 13:17:27.370523 10207 raft_consensus.cc:606] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8 [term 1 LEADER]: Received request to transfer leadership to TS e7f9e723f3f54a4bb5e4c57869f40d7a
I20260709 13:17:27.378644 10356 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01f1cef511614c43ae422c6fb06be9c4"
dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
mode: GRACEFUL
new_leader_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
 from {username='slave'} at 127.0.0.1:36830
I20260709 13:17:27.379158 10356 raft_consensus.cc:606] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Received request to transfer leadership to TS e7f9e723f3f54a4bb5e4c57869f40d7a
I20260709 13:17:27.384404 10356 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f703c5bc8da416e9447e3c8d238725e"
dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
mode: GRACEFUL
new_leader_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
 from {username='slave'} at 127.0.0.1:36830
I20260709 13:17:27.385030 10356 raft_consensus.cc:606] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Received request to transfer leadership to TS e7f9e723f3f54a4bb5e4c57869f40d7a
I20260709 13:17:27.503165 10431 raft_consensus.cc:993] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a: : Instructing follower 21a517d52d81404f9ae245428d42fed8 to start an election
I20260709 13:17:27.503611 10464 raft_consensus.cc:1081] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 LEADER]: Signalling peer 21a517d52d81404f9ae245428d42fed8 to start an election
I20260709 13:17:27.505015 10207 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1cf62842a6e4d3e8aba94cd94afb57b"
dest_uuid: "21a517d52d81404f9ae245428d42fed8"
 from {username='slave'} at 127.0.0.1:44284
I20260709 13:17:27.505523 10207 raft_consensus.cc:493] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:27.505828 10207 raft_consensus.cc:3060] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.510838 10207 raft_consensus.cc:515] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:27.512682 10207 leader_election.cc:290] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 2 election: Requested vote from peers e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:27.513644 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1cf62842a6e4d3e8aba94cd94afb57b" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
I20260709 13:17:27.513768 10356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1cf62842a6e4d3e8aba94cd94afb57b" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
I20260709 13:17:27.514219 10282 raft_consensus.cc:3055] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:27.514423 10356 raft_consensus.cc:3060] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.514640 10282 raft_consensus.cc:740] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e7f9e723f3f54a4bb5e4c57869f40d7a, State: Running, Role: LEADER
I20260709 13:17:27.515538 10282 consensus_queue.cc:260] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:27.516499 10282 raft_consensus.cc:3060] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.519934 10356 raft_consensus.cc:2468] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a517d52d81404f9ae245428d42fed8 in term 2.
I20260709 13:17:27.521165 10173 leader_election.cc:304] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, 9d6c512cfc2248c28e5ff72bf0fc06df; no voters: 
I20260709 13:17:27.521770 10282 raft_consensus.cc:2468] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a517d52d81404f9ae245428d42fed8 in term 2.
I20260709 13:17:27.521862 10420 raft_consensus.cc:2804] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:27.522418 10420 raft_consensus.cc:697] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8 [term 2 LEADER]: Becoming Leader. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Running, Role: LEADER
I20260709 13:17:27.523208 10420 consensus_queue.cc:237] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:27.530027 10103 catalog_manager.cc:5697] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8 reported cstate change: term changed from 1 to 2, leader changed from e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2) to 21a517d52d81404f9ae245428d42fed8 (127.30.63.1). New cstate: current_term: 2 leader_uuid: "21a517d52d81404f9ae245428d42fed8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:27.569546 10464 consensus_queue.cc:1048] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:27.582769 10464 consensus_queue.cc:1048] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:27.733644 10446 raft_consensus.cc:993] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df: : Instructing follower e7f9e723f3f54a4bb5e4c57869f40d7a to start an election
I20260709 13:17:27.734068 10425 raft_consensus.cc:1081] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Signalling peer e7f9e723f3f54a4bb5e4c57869f40d7a to start an election
I20260709 13:17:27.735464 10282 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01f1cef511614c43ae422c6fb06be9c4"
dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
 from {username='slave'} at 127.0.0.1:52678
I20260709 13:17:27.736030 10282 raft_consensus.cc:493] T 01f1cef511614c43ae422c6fb06be9c4 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:27.736349 10282 raft_consensus.cc:3060] T 01f1cef511614c43ae422c6fb06be9c4 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.741640 10282 raft_consensus.cc:515] T 01f1cef511614c43ae422c6fb06be9c4 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:27.743631 10282 leader_election.cc:290] T 01f1cef511614c43ae422c6fb06be9c4 P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 2 election: Requested vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:27.744710 10356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f1cef511614c43ae422c6fb06be9c4" candidate_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
I20260709 13:17:27.744704 10207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f1cef511614c43ae422c6fb06be9c4" candidate_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21a517d52d81404f9ae245428d42fed8"
I20260709 13:17:27.745389 10356 raft_consensus.cc:3055] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:27.745448 10207 raft_consensus.cc:3060] T 01f1cef511614c43ae422c6fb06be9c4 P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.745751 10356 raft_consensus.cc:740] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Running, Role: LEADER
I20260709 13:17:27.746533 10356 consensus_queue.cc:260] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:27.747673 10356 raft_consensus.cc:3060] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.752731 10207 raft_consensus.cc:2468] T 01f1cef511614c43ae422c6fb06be9c4 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7f9e723f3f54a4bb5e4c57869f40d7a in term 2.
I20260709 13:17:27.753765 10356 raft_consensus.cc:2468] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7f9e723f3f54a4bb5e4c57869f40d7a in term 2.
I20260709 13:17:27.754063 10249 leader_election.cc:304] T 01f1cef511614c43ae422c6fb06be9c4 P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 
I20260709 13:17:27.754963 10464 raft_consensus.cc:2804] T 01f1cef511614c43ae422c6fb06be9c4 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:27.755398 10464 raft_consensus.cc:697] T 01f1cef511614c43ae422c6fb06be9c4 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 LEADER]: Becoming Leader. State: Replica: e7f9e723f3f54a4bb5e4c57869f40d7a, State: Running, Role: LEADER
I20260709 13:17:27.756263 10464 consensus_queue.cc:237] T 01f1cef511614c43ae422c6fb06be9c4 P e7f9e723f3f54a4bb5e4c57869f40d7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:27.763738 10106 catalog_manager.cc:5697] T 01f1cef511614c43ae422c6fb06be9c4 P e7f9e723f3f54a4bb5e4c57869f40d7a reported cstate change: term changed from 1 to 2, leader changed from 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3) to e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2). New cstate: current_term: 2 leader_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:27.805619 10446 raft_consensus.cc:993] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df: : Instructing follower e7f9e723f3f54a4bb5e4c57869f40d7a to start an election
I20260709 13:17:27.806118 10425 raft_consensus.cc:1081] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Signalling peer e7f9e723f3f54a4bb5e4c57869f40d7a to start an election
I20260709 13:17:27.807726 10282 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f703c5bc8da416e9447e3c8d238725e"
dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
 from {username='slave'} at 127.0.0.1:52678
I20260709 13:17:27.808254 10282 raft_consensus.cc:493] T 6f703c5bc8da416e9447e3c8d238725e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:27.808635 10282 raft_consensus.cc:3060] T 6f703c5bc8da416e9447e3c8d238725e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.814052 10281 raft_consensus.cc:1275] T fc68869777e04563a9a887134320adf6 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Refusing update from remote peer 21a517d52d81404f9ae245428d42fed8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:27.814323 10282 raft_consensus.cc:515] T 6f703c5bc8da416e9447e3c8d238725e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:27.815699 10483 consensus_queue.cc:1048] T fc68869777e04563a9a887134320adf6 P 21a517d52d81404f9ae245428d42fed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:27.816565 10282 leader_election.cc:290] T 6f703c5bc8da416e9447e3c8d238725e P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 2 election: Requested vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:27.817745 10356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f703c5bc8da416e9447e3c8d238725e" candidate_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
I20260709 13:17:27.817974 10207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f703c5bc8da416e9447e3c8d238725e" candidate_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21a517d52d81404f9ae245428d42fed8"
I20260709 13:17:27.818385 10356 raft_consensus.cc:3055] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:27.818642 10207 raft_consensus.cc:3060] T 6f703c5bc8da416e9447e3c8d238725e P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.818776 10356 raft_consensus.cc:740] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Running, Role: LEADER
I20260709 13:17:27.819963 10356 consensus_queue.cc:260] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:27.821724 10356 raft_consensus.cc:3060] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.828219 10357 raft_consensus.cc:1275] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Refusing update from remote peer 21a517d52d81404f9ae245428d42fed8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:27.828270 10207 raft_consensus.cc:2468] T 6f703c5bc8da416e9447e3c8d238725e P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7f9e723f3f54a4bb5e4c57869f40d7a in term 2.
I20260709 13:17:27.830271 10444 consensus_queue.cc:1048] T fc68869777e04563a9a887134320adf6 P 21a517d52d81404f9ae245428d42fed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:27.833483 10249 leader_election.cc:304] T 6f703c5bc8da416e9447e3c8d238725e P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 
I20260709 13:17:27.834182 10483 raft_consensus.cc:993] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8: : Instructing follower e7f9e723f3f54a4bb5e4c57869f40d7a to start an election
I20260709 13:17:27.834483 10464 raft_consensus.cc:2804] T 6f703c5bc8da416e9447e3c8d238725e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:27.834995 10464 raft_consensus.cc:697] T 6f703c5bc8da416e9447e3c8d238725e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 LEADER]: Becoming Leader. State: Replica: e7f9e723f3f54a4bb5e4c57869f40d7a, State: Running, Role: LEADER
I20260709 13:17:27.836067 10464 consensus_queue.cc:237] T 6f703c5bc8da416e9447e3c8d238725e P e7f9e723f3f54a4bb5e4c57869f40d7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:27.836692 10483 raft_consensus.cc:1081] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8 [term 1 LEADER]: Signalling peer e7f9e723f3f54a4bb5e4c57869f40d7a to start an election
I20260709 13:17:27.841136 10281 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a61096290231466cb5e7956f243a99a8"
dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
 from {username='slave'} at 127.0.0.1:52670
I20260709 13:17:27.841785 10281 raft_consensus.cc:493] T a61096290231466cb5e7956f243a99a8 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:27.842171 10281 raft_consensus.cc:3060] T a61096290231466cb5e7956f243a99a8 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.845645 10356 raft_consensus.cc:2468] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7f9e723f3f54a4bb5e4c57869f40d7a in term 2.
I20260709 13:17:27.852198 10103 catalog_manager.cc:5697] T 6f703c5bc8da416e9447e3c8d238725e P e7f9e723f3f54a4bb5e4c57869f40d7a reported cstate change: term changed from 1 to 2, leader changed from 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3) to e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2). New cstate: current_term: 2 leader_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:27.853590 10281 raft_consensus.cc:515] T a61096290231466cb5e7956f243a99a8 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:27.856294 10281 leader_election.cc:290] T a61096290231466cb5e7956f243a99a8 P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 2 election: Requested vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:27.857471 10207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61096290231466cb5e7956f243a99a8" candidate_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21a517d52d81404f9ae245428d42fed8"
I20260709 13:17:27.858103 10207 raft_consensus.cc:3055] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:27.857380 10357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61096290231466cb5e7956f243a99a8" candidate_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
I20260709 13:17:27.858621 10207 raft_consensus.cc:740] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Running, Role: LEADER
I20260709 13:17:27.858922 10357 raft_consensus.cc:3060] T a61096290231466cb5e7956f243a99a8 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.859596 10207 consensus_queue.cc:260] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:27.860905 10207 raft_consensus.cc:3060] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.865971 10357 raft_consensus.cc:2468] T a61096290231466cb5e7956f243a99a8 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7f9e723f3f54a4bb5e4c57869f40d7a in term 2.
I20260709 13:17:27.867503 10248 leader_election.cc:304] T a61096290231466cb5e7956f243a99a8 P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6c512cfc2248c28e5ff72bf0fc06df, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 
I20260709 13:17:27.868093 10207 raft_consensus.cc:2468] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7f9e723f3f54a4bb5e4c57869f40d7a in term 2.
I20260709 13:17:27.868408 10464 raft_consensus.cc:2804] T a61096290231466cb5e7956f243a99a8 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:27.869211 10464 raft_consensus.cc:697] T a61096290231466cb5e7956f243a99a8 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 LEADER]: Becoming Leader. State: Replica: e7f9e723f3f54a4bb5e4c57869f40d7a, State: Running, Role: LEADER
I20260709 13:17:27.870306 10464 consensus_queue.cc:237] T a61096290231466cb5e7956f243a99a8 P e7f9e723f3f54a4bb5e4c57869f40d7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:27.877476 10103 catalog_manager.cc:5697] T a61096290231466cb5e7956f243a99a8 P e7f9e723f3f54a4bb5e4c57869f40d7a reported cstate change: term changed from 1 to 2, leader changed from 21a517d52d81404f9ae245428d42fed8 (127.30.63.1) to e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2). New cstate: current_term: 2 leader_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:28.039229 10282 raft_consensus.cc:1275] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Refusing update from remote peer 21a517d52d81404f9ae245428d42fed8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:28.040759 10483 consensus_queue.cc:1048] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:28.058244 10357 raft_consensus.cc:1275] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Refusing update from remote peer 21a517d52d81404f9ae245428d42fed8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:28.059878 10444 consensus_queue.cc:1048] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:28.224889 10357 raft_consensus.cc:1275] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Refusing update from remote peer e7f9e723f3f54a4bb5e4c57869f40d7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:28.226244 10431 consensus_queue.cc:1048] T 6f703c5bc8da416e9447e3c8d238725e P e7f9e723f3f54a4bb5e4c57869f40d7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:28.232369 10207 raft_consensus.cc:1275] T 01f1cef511614c43ae422c6fb06be9c4 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Refusing update from remote peer e7f9e723f3f54a4bb5e4c57869f40d7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:28.233779 10464 consensus_queue.cc:1048] T 01f1cef511614c43ae422c6fb06be9c4 P e7f9e723f3f54a4bb5e4c57869f40d7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:28.234519 10207 raft_consensus.cc:1275] T 6f703c5bc8da416e9447e3c8d238725e P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Refusing update from remote peer e7f9e723f3f54a4bb5e4c57869f40d7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:28.236480 10464 consensus_queue.cc:1048] T 6f703c5bc8da416e9447e3c8d238725e P e7f9e723f3f54a4bb5e4c57869f40d7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:28.247646 10357 raft_consensus.cc:1275] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Refusing update from remote peer e7f9e723f3f54a4bb5e4c57869f40d7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:28.249225 10464 consensus_queue.cc:1048] T 01f1cef511614c43ae422c6fb06be9c4 P e7f9e723f3f54a4bb5e4c57869f40d7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:28.269757 10357 raft_consensus.cc:1275] T a61096290231466cb5e7956f243a99a8 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Refusing update from remote peer e7f9e723f3f54a4bb5e4c57869f40d7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:28.271270 10464 consensus_queue.cc:1048] T a61096290231466cb5e7956f243a99a8 P e7f9e723f3f54a4bb5e4c57869f40d7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:28.282437 10207 raft_consensus.cc:1275] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Refusing update from remote peer e7f9e723f3f54a4bb5e4c57869f40d7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:28.283874 10464 consensus_queue.cc:1048] T a61096290231466cb5e7956f243a99a8 P e7f9e723f3f54a4bb5e4c57869f40d7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:30.414992 10105 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60410:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:30.418095 10105 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:30.473941 10197 tablet_service.cc:1511] Processing CreateTablet for tablet 8d7a52940bd74fa4b2577722105b2f7e (DEFAULT_TABLE table=soft_deleted_table [id=5b9bfbb2b5ee48f7aabb157f2c72784d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:30.475169 10273 tablet_service.cc:1511] Processing CreateTablet for tablet 8d7a52940bd74fa4b2577722105b2f7e (DEFAULT_TABLE table=soft_deleted_table [id=5b9bfbb2b5ee48f7aabb157f2c72784d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:30.476306 10347 tablet_service.cc:1511] Processing CreateTablet for tablet 8d7a52940bd74fa4b2577722105b2f7e (DEFAULT_TABLE table=soft_deleted_table [id=5b9bfbb2b5ee48f7aabb157f2c72784d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:30.476632 10273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d7a52940bd74fa4b2577722105b2f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.475207 10197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d7a52940bd74fa4b2577722105b2f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.477737 10347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d7a52940bd74fa4b2577722105b2f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.477800 10193 tablet_service.cc:1511] Processing CreateTablet for tablet 538fe68707244d72b1909ca4c2a6dd79 (DEFAULT_TABLE table=soft_deleted_table [id=5b9bfbb2b5ee48f7aabb157f2c72784d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:30.479146 10193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 538fe68707244d72b1909ca4c2a6dd79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.495261 10270 tablet_service.cc:1511] Processing CreateTablet for tablet 538fe68707244d72b1909ca4c2a6dd79 (DEFAULT_TABLE table=soft_deleted_table [id=5b9bfbb2b5ee48f7aabb157f2c72784d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:30.495707 10343 tablet_service.cc:1511] Processing CreateTablet for tablet 538fe68707244d72b1909ca4c2a6dd79 (DEFAULT_TABLE table=soft_deleted_table [id=5b9bfbb2b5ee48f7aabb157f2c72784d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:30.496943 10270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 538fe68707244d72b1909ca4c2a6dd79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.497061 10343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 538fe68707244d72b1909ca4c2a6dd79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.502367 10196 tablet_service.cc:1511] Processing CreateTablet for tablet 34e9bf7ab8d94fc992029d96d68291e4 (DEFAULT_TABLE table=soft_deleted_table [id=5b9bfbb2b5ee48f7aabb157f2c72784d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:30.503804 10196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34e9bf7ab8d94fc992029d96d68291e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.506115 10346 tablet_service.cc:1511] Processing CreateTablet for tablet 34e9bf7ab8d94fc992029d96d68291e4 (DEFAULT_TABLE table=soft_deleted_table [id=5b9bfbb2b5ee48f7aabb157f2c72784d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:30.507649 10346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34e9bf7ab8d94fc992029d96d68291e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.509370 10194 tablet_service.cc:1511] Processing CreateTablet for tablet 111172fb47f14e48baeee36903d67848 (DEFAULT_TABLE table=soft_deleted_table [id=5b9bfbb2b5ee48f7aabb157f2c72784d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:30.506135 10269 tablet_service.cc:1511] Processing CreateTablet for tablet 34e9bf7ab8d94fc992029d96d68291e4 (DEFAULT_TABLE table=soft_deleted_table [id=5b9bfbb2b5ee48f7aabb157f2c72784d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:30.510703 10194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 111172fb47f14e48baeee36903d67848. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.511112 10269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34e9bf7ab8d94fc992029d96d68291e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.514667 10272 tablet_service.cc:1511] Processing CreateTablet for tablet 111172fb47f14e48baeee36903d67848 (DEFAULT_TABLE table=soft_deleted_table [id=5b9bfbb2b5ee48f7aabb157f2c72784d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:30.515992 10272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 111172fb47f14e48baeee36903d67848. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.517462 10195 tablet_service.cc:1511] Processing CreateTablet for tablet 820297e85e1a490ea6da4d46b3f93f80 (DEFAULT_TABLE table=soft_deleted_table [id=5b9bfbb2b5ee48f7aabb157f2c72784d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:30.518774 10195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 820297e85e1a490ea6da4d46b3f93f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.519083 10344 tablet_service.cc:1511] Processing CreateTablet for tablet 111172fb47f14e48baeee36903d67848 (DEFAULT_TABLE table=soft_deleted_table [id=5b9bfbb2b5ee48f7aabb157f2c72784d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:30.520500 10344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 111172fb47f14e48baeee36903d67848. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.533368 10271 tablet_service.cc:1511] Processing CreateTablet for tablet 820297e85e1a490ea6da4d46b3f93f80 (DEFAULT_TABLE table=soft_deleted_table [id=5b9bfbb2b5ee48f7aabb157f2c72784d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:30.534989 10271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 820297e85e1a490ea6da4d46b3f93f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.557932 10343 tablet_service.cc:1511] Processing CreateTablet for tablet 820297e85e1a490ea6da4d46b3f93f80 (DEFAULT_TABLE table=soft_deleted_table [id=5b9bfbb2b5ee48f7aabb157f2c72784d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:30.559314 10343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 820297e85e1a490ea6da4d46b3f93f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.563118 10504 tablet_bootstrap.cc:492] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df: Bootstrap starting.
I20260709 13:17:30.565403 10505 tablet_bootstrap.cc:492] T 538fe68707244d72b1909ca4c2a6dd79 P 21a517d52d81404f9ae245428d42fed8: Bootstrap starting.
I20260709 13:17:30.574752 10268 tablet_service.cc:1511] Processing CreateTablet for tablet fa6dd77092c7440ab9949cc582c38f52 (DEFAULT_TABLE table=soft_deleted_table [id=5b9bfbb2b5ee48f7aabb157f2c72784d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:30.576280 10268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa6dd77092c7440ab9949cc582c38f52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.583671 10504 tablet_bootstrap.cc:654] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.583561 10347 tablet_service.cc:1511] Processing CreateTablet for tablet fa6dd77092c7440ab9949cc582c38f52 (DEFAULT_TABLE table=soft_deleted_table [id=5b9bfbb2b5ee48f7aabb157f2c72784d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:30.585081 10347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa6dd77092c7440ab9949cc582c38f52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.585798 10193 tablet_service.cc:1511] Processing CreateTablet for tablet 7befc9a38bed4affbb60b2ac29a62328 (DEFAULT_TABLE table=soft_deleted_table [id=5b9bfbb2b5ee48f7aabb157f2c72784d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:30.586640 10197 tablet_service.cc:1511] Processing CreateTablet for tablet fa6dd77092c7440ab9949cc582c38f52 (DEFAULT_TABLE table=soft_deleted_table [id=5b9bfbb2b5ee48f7aabb157f2c72784d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:30.587126 10193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7befc9a38bed4affbb60b2ac29a62328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.587924 10197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa6dd77092c7440ab9949cc582c38f52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.599092 10505 tablet_bootstrap.cc:654] T 538fe68707244d72b1909ca4c2a6dd79 P 21a517d52d81404f9ae245428d42fed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.601341 10506 tablet_bootstrap.cc:492] T 8d7a52940bd74fa4b2577722105b2f7e P e7f9e723f3f54a4bb5e4c57869f40d7a: Bootstrap starting.
I20260709 13:17:30.602757 10269 tablet_service.cc:1511] Processing CreateTablet for tablet 7befc9a38bed4affbb60b2ac29a62328 (DEFAULT_TABLE table=soft_deleted_table [id=5b9bfbb2b5ee48f7aabb157f2c72784d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:30.604187 10269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7befc9a38bed4affbb60b2ac29a62328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.608239 10506 tablet_bootstrap.cc:654] T 8d7a52940bd74fa4b2577722105b2f7e P e7f9e723f3f54a4bb5e4c57869f40d7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.612649 10346 tablet_service.cc:1511] Processing CreateTablet for tablet 7befc9a38bed4affbb60b2ac29a62328 (DEFAULT_TABLE table=soft_deleted_table [id=5b9bfbb2b5ee48f7aabb157f2c72784d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:30.624374 10346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7befc9a38bed4affbb60b2ac29a62328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.614652 10195 tablet_service.cc:1511] Processing CreateTablet for tablet ec0d67d4e5a84f3ab998b18ddbdbe1e0 (DEFAULT_TABLE table=soft_deleted_table [id=5b9bfbb2b5ee48f7aabb157f2c72784d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:30.616004 10270 tablet_service.cc:1511] Processing CreateTablet for tablet ec0d67d4e5a84f3ab998b18ddbdbe1e0 (DEFAULT_TABLE table=soft_deleted_table [id=5b9bfbb2b5ee48f7aabb157f2c72784d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:30.621622 10344 tablet_service.cc:1511] Processing CreateTablet for tablet ec0d67d4e5a84f3ab998b18ddbdbe1e0 (DEFAULT_TABLE table=soft_deleted_table [id=5b9bfbb2b5ee48f7aabb157f2c72784d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:30.629065 10195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec0d67d4e5a84f3ab998b18ddbdbe1e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.629894 10344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec0d67d4e5a84f3ab998b18ddbdbe1e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.629091 10270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec0d67d4e5a84f3ab998b18ddbdbe1e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.638931 10504 tablet_bootstrap.cc:492] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df: No bootstrap required, opened a new log
I20260709 13:17:30.639567 10504 ts_tablet_manager.cc:1403] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent bootstrapping tablet: real 0.077s	user 0.018s	sys 0.000s
I20260709 13:17:30.642690 10504 raft_consensus.cc:359] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.643393 10504 raft_consensus.cc:385] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.643687 10504 raft_consensus.cc:740] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.646756 10193 tablet_service.cc:1511] Processing CreateTablet for tablet 51391c6e644f4174b2a977865398bccd (DEFAULT_TABLE table=soft_deleted_table [id=5b9bfbb2b5ee48f7aabb157f2c72784d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:30.647428 10505 tablet_bootstrap.cc:492] T 538fe68707244d72b1909ca4c2a6dd79 P 21a517d52d81404f9ae245428d42fed8: No bootstrap required, opened a new log
I20260709 13:17:30.644421 10504 consensus_queue.cc:260] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.647950 10505 ts_tablet_manager.cc:1403] T 538fe68707244d72b1909ca4c2a6dd79 P 21a517d52d81404f9ae245428d42fed8: Time spent bootstrapping tablet: real 0.083s	user 0.015s	sys 0.008s
I20260709 13:17:30.648514 10193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51391c6e644f4174b2a977865398bccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.651193 10505 raft_consensus.cc:359] T 538fe68707244d72b1909ca4c2a6dd79 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.652002 10505 raft_consensus.cc:385] T 538fe68707244d72b1909ca4c2a6dd79 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.652305 10505 raft_consensus.cc:740] T 538fe68707244d72b1909ca4c2a6dd79 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.655854 10505 consensus_queue.cc:260] T 538fe68707244d72b1909ca4c2a6dd79 P 21a517d52d81404f9ae245428d42fed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.657238 10504 ts_tablet_manager.cc:1434] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:17:30.664276 10347 tablet_service.cc:1511] Processing CreateTablet for tablet 51391c6e644f4174b2a977865398bccd (DEFAULT_TABLE table=soft_deleted_table [id=5b9bfbb2b5ee48f7aabb157f2c72784d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:30.666460 10347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51391c6e644f4174b2a977865398bccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.666802 10504 tablet_bootstrap.cc:492] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df: Bootstrap starting.
I20260709 13:17:30.658145 10505 ts_tablet_manager.cc:1434] T 538fe68707244d72b1909ca4c2a6dd79 P 21a517d52d81404f9ae245428d42fed8: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.003s
I20260709 13:17:30.673651 10505 tablet_bootstrap.cc:492] T 111172fb47f14e48baeee36903d67848 P 21a517d52d81404f9ae245428d42fed8: Bootstrap starting.
I20260709 13:17:30.658563 10269 tablet_service.cc:1511] Processing CreateTablet for tablet 51391c6e644f4174b2a977865398bccd (DEFAULT_TABLE table=soft_deleted_table [id=5b9bfbb2b5ee48f7aabb157f2c72784d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:30.676373 10269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51391c6e644f4174b2a977865398bccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.683698 10506 tablet_bootstrap.cc:492] T 8d7a52940bd74fa4b2577722105b2f7e P e7f9e723f3f54a4bb5e4c57869f40d7a: No bootstrap required, opened a new log
I20260709 13:17:30.691184 10506 ts_tablet_manager.cc:1403] T 8d7a52940bd74fa4b2577722105b2f7e P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent bootstrapping tablet: real 0.106s	user 0.013s	sys 0.000s
I20260709 13:17:30.692026 10505 tablet_bootstrap.cc:654] T 111172fb47f14e48baeee36903d67848 P 21a517d52d81404f9ae245428d42fed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.681991 10504 tablet_bootstrap.cc:654] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.696336 10506 raft_consensus.cc:359] T 8d7a52940bd74fa4b2577722105b2f7e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.697480 10506 raft_consensus.cc:385] T 8d7a52940bd74fa4b2577722105b2f7e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.697968 10506 raft_consensus.cc:740] T 8d7a52940bd74fa4b2577722105b2f7e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7f9e723f3f54a4bb5e4c57869f40d7a, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.698939 10506 consensus_queue.cc:260] T 8d7a52940bd74fa4b2577722105b2f7e P e7f9e723f3f54a4bb5e4c57869f40d7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.704093 10505 tablet_bootstrap.cc:492] T 111172fb47f14e48baeee36903d67848 P 21a517d52d81404f9ae245428d42fed8: No bootstrap required, opened a new log
I20260709 13:17:30.704644 10505 ts_tablet_manager.cc:1403] T 111172fb47f14e48baeee36903d67848 P 21a517d52d81404f9ae245428d42fed8: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.008s
I20260709 13:17:30.704643 10506 ts_tablet_manager.cc:1434] T 8d7a52940bd74fa4b2577722105b2f7e P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:17:30.706462 10506 tablet_bootstrap.cc:492] T 34e9bf7ab8d94fc992029d96d68291e4 P e7f9e723f3f54a4bb5e4c57869f40d7a: Bootstrap starting.
I20260709 13:17:30.708209 10505 raft_consensus.cc:359] T 111172fb47f14e48baeee36903d67848 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.710475 10505 raft_consensus.cc:385] T 111172fb47f14e48baeee36903d67848 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.710788 10505 raft_consensus.cc:740] T 111172fb47f14e48baeee36903d67848 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.711547 10505 consensus_queue.cc:260] T 111172fb47f14e48baeee36903d67848 P 21a517d52d81404f9ae245428d42fed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.713883 10505 ts_tablet_manager.cc:1434] T 111172fb47f14e48baeee36903d67848 P 21a517d52d81404f9ae245428d42fed8: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 13:17:30.714859 10505 tablet_bootstrap.cc:492] T 8d7a52940bd74fa4b2577722105b2f7e P 21a517d52d81404f9ae245428d42fed8: Bootstrap starting.
I20260709 13:17:30.716957 10504 tablet_bootstrap.cc:492] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df: No bootstrap required, opened a new log
I20260709 13:17:30.717450 10504 ts_tablet_manager.cc:1403] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.013s
I20260709 13:17:30.720041 10504 raft_consensus.cc:359] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.720793 10504 raft_consensus.cc:385] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.721102 10504 raft_consensus.cc:740] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.721283 10506 tablet_bootstrap.cc:654] T 34e9bf7ab8d94fc992029d96d68291e4 P e7f9e723f3f54a4bb5e4c57869f40d7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.721961 10505 tablet_bootstrap.cc:654] T 8d7a52940bd74fa4b2577722105b2f7e P 21a517d52d81404f9ae245428d42fed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.721974 10504 consensus_queue.cc:260] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.726454 10504 ts_tablet_manager.cc:1434] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:17:30.727526 10504 tablet_bootstrap.cc:492] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df: Bootstrap starting.
I20260709 13:17:30.730666 10506 tablet_bootstrap.cc:492] T 34e9bf7ab8d94fc992029d96d68291e4 P e7f9e723f3f54a4bb5e4c57869f40d7a: No bootstrap required, opened a new log
I20260709 13:17:30.731256 10506 ts_tablet_manager.cc:1403] T 34e9bf7ab8d94fc992029d96d68291e4 P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent bootstrapping tablet: real 0.025s	user 0.003s	sys 0.014s
I20260709 13:17:30.734210 10504 tablet_bootstrap.cc:654] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.735333 10506 raft_consensus.cc:359] T 34e9bf7ab8d94fc992029d96d68291e4 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.736403 10506 raft_consensus.cc:385] T 34e9bf7ab8d94fc992029d96d68291e4 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.736843 10506 raft_consensus.cc:740] T 34e9bf7ab8d94fc992029d96d68291e4 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7f9e723f3f54a4bb5e4c57869f40d7a, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.737854 10506 consensus_queue.cc:260] T 34e9bf7ab8d94fc992029d96d68291e4 P e7f9e723f3f54a4bb5e4c57869f40d7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.740883 10464 raft_consensus.cc:493] T 34e9bf7ab8d94fc992029d96d68291e4 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.741123 10505 tablet_bootstrap.cc:492] T 8d7a52940bd74fa4b2577722105b2f7e P 21a517d52d81404f9ae245428d42fed8: No bootstrap required, opened a new log
I20260709 13:17:30.741645 10505 ts_tablet_manager.cc:1403] T 8d7a52940bd74fa4b2577722105b2f7e P 21a517d52d81404f9ae245428d42fed8: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.003s
I20260709 13:17:30.741355 10464 raft_consensus.cc:515] T 34e9bf7ab8d94fc992029d96d68291e4 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.745380 10207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e9bf7ab8d94fc992029d96d68291e4" candidate_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8" is_pre_election: true
I20260709 13:17:30.744474 10505 raft_consensus.cc:359] T 8d7a52940bd74fa4b2577722105b2f7e P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.745925 10357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e9bf7ab8d94fc992029d96d68291e4" candidate_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" is_pre_election: true
I20260709 13:17:30.746553 10505 raft_consensus.cc:385] T 8d7a52940bd74fa4b2577722105b2f7e P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.746939 10505 raft_consensus.cc:740] T 8d7a52940bd74fa4b2577722105b2f7e P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Initialized, Role: FOLLOWER
W20260709 13:17:30.747465 10249 leader_election.cc:343] T 34e9bf7ab8d94fc992029d96d68291e4 P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:30.747741 10505 consensus_queue.cc:260] T 8d7a52940bd74fa4b2577722105b2f7e P 21a517d52d81404f9ae245428d42fed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.748494 10506 ts_tablet_manager.cc:1434] T 34e9bf7ab8d94fc992029d96d68291e4 P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
W20260709 13:17:30.749192 10248 leader_election.cc:343] T 34e9bf7ab8d94fc992029d96d68291e4 P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:30.749861 10248 leader_election.cc:304] T 34e9bf7ab8d94fc992029d96d68291e4 P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 21a517d52d81404f9ae245428d42fed8, 9d6c512cfc2248c28e5ff72bf0fc06df
I20260709 13:17:30.750434 10505 ts_tablet_manager.cc:1434] T 8d7a52940bd74fa4b2577722105b2f7e P 21a517d52d81404f9ae245428d42fed8: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:17:30.751583 10505 tablet_bootstrap.cc:492] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8: Bootstrap starting.
I20260709 13:17:30.751914 10506 tablet_bootstrap.cc:492] T 111172fb47f14e48baeee36903d67848 P e7f9e723f3f54a4bb5e4c57869f40d7a: Bootstrap starting.
I20260709 13:17:30.755864 10464 leader_election.cc:290] T 34e9bf7ab8d94fc992029d96d68291e4 P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:30.756261 10504 tablet_bootstrap.cc:492] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df: No bootstrap required, opened a new log
I20260709 13:17:30.756558 10464 raft_consensus.cc:2749] T 34e9bf7ab8d94fc992029d96d68291e4 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:30.756839 10504 ts_tablet_manager.cc:1403] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.000s
I20260709 13:17:30.757491 10425 raft_consensus.cc:493] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.757965 10425 raft_consensus.cc:515] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.760013 10504 raft_consensus.cc:359] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.760795 10504 raft_consensus.cc:385] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.761099 10504 raft_consensus.cc:740] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.761873 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d7a52940bd74fa4b2577722105b2f7e" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" is_pre_election: true
I20260709 13:17:30.761853 10504 consensus_queue.cc:260] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.762667 10282 raft_consensus.cc:2468] T 8d7a52940bd74fa4b2577722105b2f7e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 0.
I20260709 13:17:30.762761 10425 leader_election.cc:290] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427)
I20260709 13:17:30.764319 10207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d7a52940bd74fa4b2577722105b2f7e" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8" is_pre_election: true
I20260709 13:17:30.765043 10207 raft_consensus.cc:2468] T 8d7a52940bd74fa4b2577722105b2f7e P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 0.
I20260709 13:17:30.766361 10323 leader_election.cc:304] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, 9d6c512cfc2248c28e5ff72bf0fc06df; no voters: 
I20260709 13:17:30.768559 10425 raft_consensus.cc:2804] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:30.769101 10425 raft_consensus.cc:493] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.769816 10425 raft_consensus.cc:3060] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.769116 10505 tablet_bootstrap.cc:654] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.783991 10506 tablet_bootstrap.cc:654] T 111172fb47f14e48baeee36903d67848 P e7f9e723f3f54a4bb5e4c57869f40d7a: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:30.794054 10248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:41719, user_credentials={real_user=slave}} blocked reactor thread for 44889.9us
I20260709 13:17:30.794642 10504 ts_tablet_manager.cc:1434] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent starting tablet: real 0.037s	user 0.016s	sys 0.005s
I20260709 13:17:30.795923 10504 tablet_bootstrap.cc:492] T 111172fb47f14e48baeee36903d67848 P 9d6c512cfc2248c28e5ff72bf0fc06df: Bootstrap starting.
I20260709 13:17:30.800114 10425 raft_consensus.cc:515] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.801314 10506 tablet_bootstrap.cc:492] T 111172fb47f14e48baeee36903d67848 P e7f9e723f3f54a4bb5e4c57869f40d7a: No bootstrap required, opened a new log
I20260709 13:17:30.801915 10506 ts_tablet_manager.cc:1403] T 111172fb47f14e48baeee36903d67848 P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.000s
I20260709 13:17:30.802639 10425 leader_election.cc:290] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 election: Requested vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427)
I20260709 13:17:30.803551 10504 tablet_bootstrap.cc:654] T 111172fb47f14e48baeee36903d67848 P 9d6c512cfc2248c28e5ff72bf0fc06df: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.803572 10207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d7a52940bd74fa4b2577722105b2f7e" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8"
I20260709 13:17:30.804451 10207 raft_consensus.cc:3060] T 8d7a52940bd74fa4b2577722105b2f7e P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.804502 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d7a52940bd74fa4b2577722105b2f7e" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
I20260709 13:17:30.805333 10282 raft_consensus.cc:3060] T 8d7a52940bd74fa4b2577722105b2f7e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.805187 10506 raft_consensus.cc:359] T 111172fb47f14e48baeee36903d67848 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.805965 10506 raft_consensus.cc:385] T 111172fb47f14e48baeee36903d67848 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.806269 10506 raft_consensus.cc:740] T 111172fb47f14e48baeee36903d67848 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7f9e723f3f54a4bb5e4c57869f40d7a, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.807129 10506 consensus_queue.cc:260] T 111172fb47f14e48baeee36903d67848 P e7f9e723f3f54a4bb5e4c57869f40d7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.809444 10506 ts_tablet_manager.cc:1434] T 111172fb47f14e48baeee36903d67848 P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:30.810434 10506 tablet_bootstrap.cc:492] T fa6dd77092c7440ab9949cc582c38f52 P e7f9e723f3f54a4bb5e4c57869f40d7a: Bootstrap starting.
I20260709 13:17:30.815696 10207 raft_consensus.cc:2468] T 8d7a52940bd74fa4b2577722105b2f7e P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 1.
I20260709 13:17:30.816447 10504 tablet_bootstrap.cc:492] T 111172fb47f14e48baeee36903d67848 P 9d6c512cfc2248c28e5ff72bf0fc06df: No bootstrap required, opened a new log
I20260709 13:17:30.816864 10506 tablet_bootstrap.cc:654] T fa6dd77092c7440ab9949cc582c38f52 P e7f9e723f3f54a4bb5e4c57869f40d7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.817154 10504 ts_tablet_manager.cc:1403] T 111172fb47f14e48baeee36903d67848 P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.012s
I20260709 13:17:30.817276 10323 leader_election.cc:304] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, 9d6c512cfc2248c28e5ff72bf0fc06df; no voters: 
I20260709 13:17:30.817749 10505 tablet_bootstrap.cc:492] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8: No bootstrap required, opened a new log
I20260709 13:17:30.818383 10282 raft_consensus.cc:2468] T 8d7a52940bd74fa4b2577722105b2f7e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 1.
I20260709 13:17:30.818434 10505 ts_tablet_manager.cc:1403] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8: Time spent bootstrapping tablet: real 0.067s	user 0.017s	sys 0.002s
I20260709 13:17:30.819023 10425 raft_consensus.cc:2804] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:30.820930 10425 raft_consensus.cc:697] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Becoming Leader. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Running, Role: LEADER
I20260709 13:17:30.821949 10504 raft_consensus.cc:359] T 111172fb47f14e48baeee36903d67848 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.822017 10425 consensus_queue.cc:237] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.823138 10504 raft_consensus.cc:385] T 111172fb47f14e48baeee36903d67848 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.823935 10504 raft_consensus.cc:740] T 111172fb47f14e48baeee36903d67848 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.823558 10505 raft_consensus.cc:359] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.825295 10504 consensus_queue.cc:260] T 111172fb47f14e48baeee36903d67848 P 9d6c512cfc2248c28e5ff72bf0fc06df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.825314 10505 raft_consensus.cc:385] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.827869 10505 raft_consensus.cc:740] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.828207 10504 ts_tablet_manager.cc:1434] T 111172fb47f14e48baeee36903d67848 P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 13:17:30.829550 10504 tablet_bootstrap.cc:492] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df: Bootstrap starting.
I20260709 13:17:30.828876 10505 consensus_queue.cc:260] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.831440 10506 tablet_bootstrap.cc:492] T fa6dd77092c7440ab9949cc582c38f52 P e7f9e723f3f54a4bb5e4c57869f40d7a: No bootstrap required, opened a new log
I20260709 13:17:30.832056 10505 ts_tablet_manager.cc:1434] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:17:30.832149 10506 ts_tablet_manager.cc:1403] T fa6dd77092c7440ab9949cc582c38f52 P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.004s
I20260709 13:17:30.833626 10505 tablet_bootstrap.cc:492] T 820297e85e1a490ea6da4d46b3f93f80 P 21a517d52d81404f9ae245428d42fed8: Bootstrap starting.
I20260709 13:17:30.837275 10506 raft_consensus.cc:359] T fa6dd77092c7440ab9949cc582c38f52 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.838256 10504 tablet_bootstrap.cc:654] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.905400 10505 tablet_bootstrap.cc:654] T 820297e85e1a490ea6da4d46b3f93f80 P 21a517d52d81404f9ae245428d42fed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.838135 10506 raft_consensus.cc:385] T fa6dd77092c7440ab9949cc582c38f52 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.917155 10506 raft_consensus.cc:740] T fa6dd77092c7440ab9949cc582c38f52 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7f9e723f3f54a4bb5e4c57869f40d7a, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.919382 10506 consensus_queue.cc:260] T fa6dd77092c7440ab9949cc582c38f52 P e7f9e723f3f54a4bb5e4c57869f40d7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.916188 10102 catalog_manager.cc:5697] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3). New cstate: current_term: 1 leader_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:30.922928 10504 tablet_bootstrap.cc:492] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df: No bootstrap required, opened a new log
I20260709 13:17:30.924075 10504 ts_tablet_manager.cc:1403] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent bootstrapping tablet: real 0.095s	user 0.015s	sys 0.016s
I20260709 13:17:30.925058 10505 tablet_bootstrap.cc:492] T 820297e85e1a490ea6da4d46b3f93f80 P 21a517d52d81404f9ae245428d42fed8: No bootstrap required, opened a new log
I20260709 13:17:30.926167 10505 ts_tablet_manager.cc:1403] T 820297e85e1a490ea6da4d46b3f93f80 P 21a517d52d81404f9ae245428d42fed8: Time spent bootstrapping tablet: real 0.093s	user 0.017s	sys 0.010s
I20260709 13:17:30.930119 10504 raft_consensus.cc:359] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.931324 10504 raft_consensus.cc:385] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.930889 10505 raft_consensus.cc:359] T 820297e85e1a490ea6da4d46b3f93f80 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.931764 10504 raft_consensus.cc:740] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.931921 10505 raft_consensus.cc:385] T 820297e85e1a490ea6da4d46b3f93f80 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.932315 10505 raft_consensus.cc:740] T 820297e85e1a490ea6da4d46b3f93f80 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.932839 10504 consensus_queue.cc:260] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.933383 10505 consensus_queue.cc:260] T 820297e85e1a490ea6da4d46b3f93f80 P 21a517d52d81404f9ae245428d42fed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.938134 10505 ts_tablet_manager.cc:1434] T 820297e85e1a490ea6da4d46b3f93f80 P 21a517d52d81404f9ae245428d42fed8: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.006s
I20260709 13:17:30.940042 10505 tablet_bootstrap.cc:492] T 7befc9a38bed4affbb60b2ac29a62328 P 21a517d52d81404f9ae245428d42fed8: Bootstrap starting.
I20260709 13:17:30.941524 10506 ts_tablet_manager.cc:1434] T fa6dd77092c7440ab9949cc582c38f52 P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent starting tablet: real 0.107s	user 0.003s	sys 0.009s
I20260709 13:17:30.943571 10506 tablet_bootstrap.cc:492] T 538fe68707244d72b1909ca4c2a6dd79 P e7f9e723f3f54a4bb5e4c57869f40d7a: Bootstrap starting.
I20260709 13:17:30.949708 10505 tablet_bootstrap.cc:654] T 7befc9a38bed4affbb60b2ac29a62328 P 21a517d52d81404f9ae245428d42fed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.940290 10504 ts_tablet_manager.cc:1434] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent starting tablet: real 0.016s	user 0.000s	sys 0.010s
I20260709 13:17:30.951743 10506 tablet_bootstrap.cc:654] T 538fe68707244d72b1909ca4c2a6dd79 P e7f9e723f3f54a4bb5e4c57869f40d7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.953320 10504 tablet_bootstrap.cc:492] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df: Bootstrap starting.
I20260709 13:17:30.961488 10504 tablet_bootstrap.cc:654] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.963171 10525 raft_consensus.cc:493] T 111172fb47f14e48baeee36903d67848 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.964357 10525 raft_consensus.cc:515] T 111172fb47f14e48baeee36903d67848 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.971284 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111172fb47f14e48baeee36903d67848" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" is_pre_election: true
I20260709 13:17:30.972533 10282 raft_consensus.cc:2468] T 111172fb47f14e48baeee36903d67848 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21a517d52d81404f9ae245428d42fed8 in term 0.
I20260709 13:17:30.975487 10171 leader_election.cc:304] T 111172fb47f14e48baeee36903d67848 P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 
I20260709 13:17:30.977298 10444 raft_consensus.cc:2804] T 111172fb47f14e48baeee36903d67848 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:30.977854 10444 raft_consensus.cc:493] T 111172fb47f14e48baeee36903d67848 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.978317 10444 raft_consensus.cc:3060] T 111172fb47f14e48baeee36903d67848 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.979796 10506 tablet_bootstrap.cc:492] T 538fe68707244d72b1909ca4c2a6dd79 P e7f9e723f3f54a4bb5e4c57869f40d7a: No bootstrap required, opened a new log
I20260709 13:17:30.980741 10506 ts_tablet_manager.cc:1403] T 538fe68707244d72b1909ca4c2a6dd79 P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.009s
I20260709 13:17:30.985884 10357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111172fb47f14e48baeee36903d67848" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" is_pre_election: true
I20260709 13:17:30.986980 10357 raft_consensus.cc:2468] T 111172fb47f14e48baeee36903d67848 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21a517d52d81404f9ae245428d42fed8 in term 0.
I20260709 13:17:30.988905 10525 leader_election.cc:290] T 111172fb47f14e48baeee36903d67848 P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:30.987949 10506 raft_consensus.cc:359] T 538fe68707244d72b1909ca4c2a6dd79 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.989617 10506 raft_consensus.cc:385] T 538fe68707244d72b1909ca4c2a6dd79 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.989962 10506 raft_consensus.cc:740] T 538fe68707244d72b1909ca4c2a6dd79 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7f9e723f3f54a4bb5e4c57869f40d7a, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.990825 10506 consensus_queue.cc:260] T 538fe68707244d72b1909ca4c2a6dd79 P e7f9e723f3f54a4bb5e4c57869f40d7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.992298 10505 tablet_bootstrap.cc:492] T 7befc9a38bed4affbb60b2ac29a62328 P 21a517d52d81404f9ae245428d42fed8: No bootstrap required, opened a new log
I20260709 13:17:30.992992 10505 ts_tablet_manager.cc:1403] T 7befc9a38bed4affbb60b2ac29a62328 P 21a517d52d81404f9ae245428d42fed8: Time spent bootstrapping tablet: real 0.053s	user 0.017s	sys 0.025s
I20260709 13:17:30.993485 10506 ts_tablet_manager.cc:1434] T 538fe68707244d72b1909ca4c2a6dd79 P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 13:17:30.993410 10444 raft_consensus.cc:515] T 111172fb47f14e48baeee36903d67848 P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:30.995267 10506 tablet_bootstrap.cc:492] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a: Bootstrap starting.
I20260709 13:17:30.995587 10504 tablet_bootstrap.cc:492] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df: No bootstrap required, opened a new log
I20260709 13:17:30.996228 10504 ts_tablet_manager.cc:1403] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.022s
I20260709 13:17:30.997210 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111172fb47f14e48baeee36903d67848" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
I20260709 13:17:30.997920 10282 raft_consensus.cc:3060] T 111172fb47f14e48baeee36903d67848 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.003252 10425 raft_consensus.cc:493] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.003612 10506 tablet_bootstrap.cc:654] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.004132 10425 raft_consensus.cc:515] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.004146 10505 raft_consensus.cc:359] T 7befc9a38bed4affbb60b2ac29a62328 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.005976 10505 raft_consensus.cc:385] T 7befc9a38bed4affbb60b2ac29a62328 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.006392 10505 raft_consensus.cc:740] T 7befc9a38bed4affbb60b2ac29a62328 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.000156 10504 raft_consensus.cc:359] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.010296 10207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e9bf7ab8d94fc992029d96d68291e4" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8" is_pre_election: true
I20260709 13:17:31.011209 10207 raft_consensus.cc:2468] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 0.
I20260709 13:17:31.016446 10444 leader_election.cc:290] T 111172fb47f14e48baeee36903d67848 P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 election: Requested vote from peers e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:31.008249 10504 raft_consensus.cc:385] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.016513 10425 leader_election.cc:290] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427)
I20260709 13:17:31.017791 10504 raft_consensus.cc:740] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.018359 10281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e9bf7ab8d94fc992029d96d68291e4" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" is_pre_election: true
I20260709 13:17:31.018668 10505 consensus_queue.cc:260] T 7befc9a38bed4affbb60b2ac29a62328 P 21a517d52d81404f9ae245428d42fed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.024910 10357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111172fb47f14e48baeee36903d67848" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
I20260709 13:17:31.025832 10357 raft_consensus.cc:3060] T 111172fb47f14e48baeee36903d67848 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.028132 10505 ts_tablet_manager.cc:1434] T 7befc9a38bed4affbb60b2ac29a62328 P 21a517d52d81404f9ae245428d42fed8: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.001s
I20260709 13:17:31.020409 10517 raft_consensus.cc:493] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.021492 10323 leader_election.cc:304] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, 9d6c512cfc2248c28e5ff72bf0fc06df; no voters: 
I20260709 13:17:31.029028 10517 raft_consensus.cc:515] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.030344 10425 raft_consensus.cc:2804] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:31.025104 10281 raft_consensus.cc:2468] T 34e9bf7ab8d94fc992029d96d68291e4 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 0.
I20260709 13:17:31.030947 10425 raft_consensus.cc:493] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.033617 10425 raft_consensus.cc:3060] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.038666 10505 tablet_bootstrap.cc:492] T fa6dd77092c7440ab9949cc582c38f52 P 21a517d52d81404f9ae245428d42fed8: Bootstrap starting.
I20260709 13:17:31.023741 10282 raft_consensus.cc:2468] T 111172fb47f14e48baeee36903d67848 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a517d52d81404f9ae245428d42fed8 in term 1.
I20260709 13:17:31.042177 10171 leader_election.cc:304] T 111172fb47f14e48baeee36903d67848 P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 
I20260709 13:17:31.042506 10517 leader_election.cc:290] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427)
I20260709 13:17:31.042384 10504 consensus_queue.cc:260] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.044504 10525 raft_consensus.cc:2804] T 111172fb47f14e48baeee36903d67848 P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:31.044644 10281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820297e85e1a490ea6da4d46b3f93f80" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" is_pre_election: true
I20260709 13:17:31.045244 10525 raft_consensus.cc:697] T 111172fb47f14e48baeee36903d67848 P 21a517d52d81404f9ae245428d42fed8 [term 1 LEADER]: Becoming Leader. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Running, Role: LEADER
I20260709 13:17:31.046640 10525 consensus_queue.cc:237] T 111172fb47f14e48baeee36903d67848 P 21a517d52d81404f9ae245428d42fed8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.048424 10506 tablet_bootstrap.cc:492] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a: No bootstrap required, opened a new log
I20260709 13:17:31.048806 10530 raft_consensus.cc:493] T 7befc9a38bed4affbb60b2ac29a62328 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.049033 10506 ts_tablet_manager.cc:1403] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.021s
I20260709 13:17:31.049348 10530 raft_consensus.cc:515] T 7befc9a38bed4affbb60b2ac29a62328 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
W20260709 13:17:31.050115 10320 leader_election.cc:343] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:31.044911 10504 ts_tablet_manager.cc:1434] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent starting tablet: real 0.048s	user 0.012s	sys 0.007s
I20260709 13:17:31.055063 10504 tablet_bootstrap.cc:492] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df: Bootstrap starting.
I20260709 13:17:31.056577 10505 tablet_bootstrap.cc:654] T fa6dd77092c7440ab9949cc582c38f52 P 21a517d52d81404f9ae245428d42fed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.049955 10207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820297e85e1a490ea6da4d46b3f93f80" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8" is_pre_election: true
I20260709 13:17:31.058800 10207 raft_consensus.cc:2468] T 820297e85e1a490ea6da4d46b3f93f80 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 0.
I20260709 13:17:31.060297 10323 leader_election.cc:304] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, 9d6c512cfc2248c28e5ff72bf0fc06df; no voters: e7f9e723f3f54a4bb5e4c57869f40d7a
I20260709 13:17:31.061293 10517 raft_consensus.cc:2804] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:31.061687 10517 raft_consensus.cc:493] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.061722 10281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befc9a38bed4affbb60b2ac29a62328" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" is_pre_election: true
I20260709 13:17:31.062232 10517 raft_consensus.cc:3060] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.062038 10506 raft_consensus.cc:359] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.062934 10506 raft_consensus.cc:385] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.063287 10506 raft_consensus.cc:740] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7f9e723f3f54a4bb5e4c57869f40d7a, State: Initialized, Role: FOLLOWER
W20260709 13:17:31.063299 10171 leader_election.cc:343] T 7befc9a38bed4affbb60b2ac29a62328 P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:31.065047 10530 leader_election.cc:290] T 7befc9a38bed4affbb60b2ac29a62328 P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:31.066859 10356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befc9a38bed4affbb60b2ac29a62328" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" is_pre_election: true
I20260709 13:17:31.064433 10506 consensus_queue.cc:260] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
W20260709 13:17:31.070137 10173 leader_election.cc:343] T 7befc9a38bed4affbb60b2ac29a62328 P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:31.070604 10173 leader_election.cc:304] T 7befc9a38bed4affbb60b2ac29a62328 P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8; no voters: 9d6c512cfc2248c28e5ff72bf0fc06df, e7f9e723f3f54a4bb5e4c57869f40d7a
I20260709 13:17:31.071516 10506 ts_tablet_manager.cc:1434] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.003s
I20260709 13:17:31.072862 10530 raft_consensus.cc:2749] T 7befc9a38bed4affbb60b2ac29a62328 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:31.073529 10517 raft_consensus.cc:515] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.079111 10517 leader_election.cc:290] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 election: Requested vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427)
I20260709 13:17:31.077219 10504 tablet_bootstrap.cc:654] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.081207 10207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820297e85e1a490ea6da4d46b3f93f80" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8"
I20260709 13:17:31.081952 10207 raft_consensus.cc:3060] T 820297e85e1a490ea6da4d46b3f93f80 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.083478 10517 raft_consensus.cc:493] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.083479 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820297e85e1a490ea6da4d46b3f93f80" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
I20260709 13:17:31.084388 10515 raft_consensus.cc:493] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.084311 10517 raft_consensus.cc:515] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.085078 10515 raft_consensus.cc:515] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.086149 10282 raft_consensus.cc:3060] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.087247 10517 leader_election.cc:290] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427)
I20260709 13:17:31.088521 10517 raft_consensus.cc:493] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.089555 10517 raft_consensus.cc:515] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.090215 10208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538fe68707244d72b1909ca4c2a6dd79" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8" is_pre_election: true
I20260709 13:17:31.085589 10506 tablet_bootstrap.cc:492] T 7befc9a38bed4affbb60b2ac29a62328 P e7f9e723f3f54a4bb5e4c57869f40d7a: Bootstrap starting.
I20260709 13:17:31.091444 10206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820297e85e1a490ea6da4d46b3f93f80" candidate_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8" is_pre_election: true
I20260709 13:17:31.091449 10208 raft_consensus.cc:2468] T 538fe68707244d72b1909ca4c2a6dd79 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 0.
I20260709 13:17:31.087747 10515 leader_election.cc:290] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:31.094272 10323 leader_election.cc:304] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, 9d6c512cfc2248c28e5ff72bf0fc06df; no voters: 
I20260709 13:17:31.096813 10357 raft_consensus.cc:2468] T 111172fb47f14e48baeee36903d67848 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a517d52d81404f9ae245428d42fed8 in term 1.
I20260709 13:17:31.099080 10206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6dd77092c7440ab9949cc582c38f52" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8" is_pre_election: true
I20260709 13:17:31.104157 10282 raft_consensus.cc:2468] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 1.
W20260709 13:17:31.102514 10323 leader_election.cc:343] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:31.105894 10283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538fe68707244d72b1909ca4c2a6dd79" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" is_pre_election: true
I20260709 13:17:31.106643 10283 raft_consensus.cc:2468] T 538fe68707244d72b1909ca4c2a6dd79 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 0.
I20260709 13:17:31.108253 10534 raft_consensus.cc:2804] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:31.108747 10534 raft_consensus.cc:493] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.109095 10534 raft_consensus.cc:3060] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.109751 10517 leader_election.cc:290] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427)
I20260709 13:17:31.111948 10504 tablet_bootstrap.cc:492] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df: No bootstrap required, opened a new log
I20260709 13:17:31.113617 10320 leader_election.cc:304] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6c512cfc2248c28e5ff72bf0fc06df, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 
I20260709 13:17:31.112733 10504 ts_tablet_manager.cc:1403] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent bootstrapping tablet: real 0.058s	user 0.016s	sys 0.005s
I20260709 13:17:31.114769 10517 raft_consensus.cc:2804] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:31.115335 10517 raft_consensus.cc:697] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Becoming Leader. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Running, Role: LEADER
I20260709 13:17:31.116266 10517 consensus_queue.cc:237] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.116992 10506 tablet_bootstrap.cc:654] T 7befc9a38bed4affbb60b2ac29a62328 P e7f9e723f3f54a4bb5e4c57869f40d7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.118373 10504 raft_consensus.cc:359] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.119181 10504 raft_consensus.cc:385] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.121383 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6dd77092c7440ab9949cc582c38f52" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" is_pre_election: true
I20260709 13:17:31.122251 10282 raft_consensus.cc:2468] T fa6dd77092c7440ab9949cc582c38f52 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 0.
I20260709 13:17:31.101598 10425 raft_consensus.cc:515] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.119925 10504 raft_consensus.cc:740] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.126860 10504 consensus_queue.cc:260] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.129050 10320 leader_election.cc:304] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6c512cfc2248c28e5ff72bf0fc06df, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 21a517d52d81404f9ae245428d42fed8
I20260709 13:17:31.132570 10425 leader_election.cc:290] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 election: Requested vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427)
I20260709 13:17:31.133405 10207 raft_consensus.cc:2468] T 820297e85e1a490ea6da4d46b3f93f80 P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 1.
I20260709 13:17:31.133924 10206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e9bf7ab8d94fc992029d96d68291e4" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8"
I20260709 13:17:31.136029 10206 raft_consensus.cc:3060] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.135145 10517 raft_consensus.cc:2804] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:31.138948 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e9bf7ab8d94fc992029d96d68291e4" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
I20260709 13:17:31.139904 10282 raft_consensus.cc:3060] T 34e9bf7ab8d94fc992029d96d68291e4 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.137419 10105 catalog_manager.cc:5697] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3). New cstate: current_term: 1 leader_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:31.142225 10505 tablet_bootstrap.cc:492] T fa6dd77092c7440ab9949cc582c38f52 P 21a517d52d81404f9ae245428d42fed8: No bootstrap required, opened a new log
I20260709 13:17:31.142779 10505 ts_tablet_manager.cc:1403] T fa6dd77092c7440ab9949cc582c38f52 P 21a517d52d81404f9ae245428d42fed8: Time spent bootstrapping tablet: real 0.105s	user 0.017s	sys 0.010s
I20260709 13:17:31.146092 10505 raft_consensus.cc:359] T fa6dd77092c7440ab9949cc582c38f52 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.147306 10505 raft_consensus.cc:385] T fa6dd77092c7440ab9949cc582c38f52 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.139737 10517 raft_consensus.cc:493] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.148622 10282 raft_consensus.cc:2468] T 34e9bf7ab8d94fc992029d96d68291e4 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 1.
I20260709 13:17:31.149109 10517 raft_consensus.cc:3060] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.150276 10320 leader_election.cc:304] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6c512cfc2248c28e5ff72bf0fc06df, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 
I20260709 13:17:31.135192 10103 catalog_manager.cc:5697] T 111172fb47f14e48baeee36903d67848 P 21a517d52d81404f9ae245428d42fed8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 21a517d52d81404f9ae245428d42fed8 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "21a517d52d81404f9ae245428d42fed8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:31.153970 10533 raft_consensus.cc:2804] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:31.154915 10533 raft_consensus.cc:697] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Becoming Leader. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Running, Role: LEADER
I20260709 13:17:31.156615 10206 raft_consensus.cc:2468] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 1.
I20260709 13:17:31.156185 10533 consensus_queue.cc:237] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.147588 10505 raft_consensus.cc:740] T fa6dd77092c7440ab9949cc582c38f52 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.158653 10357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820297e85e1a490ea6da4d46b3f93f80" candidate_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" is_pre_election: true
I20260709 13:17:31.161068 10505 consensus_queue.cc:260] T fa6dd77092c7440ab9949cc582c38f52 P 21a517d52d81404f9ae245428d42fed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.162513 10504 ts_tablet_manager.cc:1434] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent starting tablet: real 0.047s	user 0.010s	sys 0.002s
I20260709 13:17:31.163424 10248 leader_election.cc:304] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 21a517d52d81404f9ae245428d42fed8, 9d6c512cfc2248c28e5ff72bf0fc06df
I20260709 13:17:31.164513 10504 tablet_bootstrap.cc:492] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df: Bootstrap starting.
I20260709 13:17:31.165027 10515 raft_consensus.cc:2749] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:31.164738 10505 ts_tablet_manager.cc:1434] T fa6dd77092c7440ab9949cc582c38f52 P 21a517d52d81404f9ae245428d42fed8: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.003s
I20260709 13:17:31.173735 10505 tablet_bootstrap.cc:492] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8: Bootstrap starting.
I20260709 13:17:31.178496 10506 tablet_bootstrap.cc:492] T 7befc9a38bed4affbb60b2ac29a62328 P e7f9e723f3f54a4bb5e4c57869f40d7a: No bootstrap required, opened a new log
I20260709 13:17:31.179184 10504 tablet_bootstrap.cc:654] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.179232 10506 ts_tablet_manager.cc:1403] T 7befc9a38bed4affbb60b2ac29a62328 P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent bootstrapping tablet: real 0.107s	user 0.014s	sys 0.003s
I20260709 13:17:31.178036 10534 raft_consensus.cc:515] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.185811 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538fe68707244d72b1909ca4c2a6dd79" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
I20260709 13:17:31.186427 10282 raft_consensus.cc:3060] T 538fe68707244d72b1909ca4c2a6dd79 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.190596 10506 raft_consensus.cc:359] T 7befc9a38bed4affbb60b2ac29a62328 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.191895 10506 raft_consensus.cc:385] T 7befc9a38bed4affbb60b2ac29a62328 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.194542 10282 raft_consensus.cc:2468] T 538fe68707244d72b1909ca4c2a6dd79 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 1.
I20260709 13:17:31.195281 10534 leader_election.cc:290] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 election: Requested vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427)
I20260709 13:17:31.195773 10206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538fe68707244d72b1909ca4c2a6dd79" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8"
I20260709 13:17:31.196317 10206 raft_consensus.cc:3060] T 538fe68707244d72b1909ca4c2a6dd79 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.192320 10105 catalog_manager.cc:5697] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3). New cstate: current_term: 1 leader_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:31.200372 10320 leader_election.cc:304] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6c512cfc2248c28e5ff72bf0fc06df, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 
I20260709 13:17:31.204007 10534 raft_consensus.cc:2804] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:31.208235 10517 raft_consensus.cc:515] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.192335 10506 raft_consensus.cc:740] T 7befc9a38bed4affbb60b2ac29a62328 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7f9e723f3f54a4bb5e4c57869f40d7a, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.210683 10506 consensus_queue.cc:260] T 7befc9a38bed4affbb60b2ac29a62328 P e7f9e723f3f54a4bb5e4c57869f40d7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.204627 10534 raft_consensus.cc:697] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Becoming Leader. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Running, Role: LEADER
I20260709 13:17:31.213316 10506 ts_tablet_manager.cc:1434] T 7befc9a38bed4affbb60b2ac29a62328 P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent starting tablet: real 0.033s	user 0.002s	sys 0.007s
I20260709 13:17:31.213522 10534 consensus_queue.cc:237] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.214596 10506 tablet_bootstrap.cc:492] T 51391c6e644f4174b2a977865398bccd P e7f9e723f3f54a4bb5e4c57869f40d7a: Bootstrap starting.
I20260709 13:17:31.219775 10517 leader_election.cc:290] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 election: Requested vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427)
I20260709 13:17:31.220424 10207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6dd77092c7440ab9949cc582c38f52" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8"
I20260709 13:17:31.221066 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6dd77092c7440ab9949cc582c38f52" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
I20260709 13:17:31.221320 10504 tablet_bootstrap.cc:492] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df: No bootstrap required, opened a new log
I20260709 13:17:31.221223 10206 raft_consensus.cc:2468] T 538fe68707244d72b1909ca4c2a6dd79 P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 1.
I20260709 13:17:31.221133 10207 raft_consensus.cc:3060] T fa6dd77092c7440ab9949cc582c38f52 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.221987 10504 ts_tablet_manager.cc:1403] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent bootstrapping tablet: real 0.058s	user 0.021s	sys 0.016s
I20260709 13:17:31.224188 10504 raft_consensus.cc:359] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.224800 10504 raft_consensus.cc:385] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.225063 10504 raft_consensus.cc:740] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.225883 10504 consensus_queue.cc:260] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.228070 10504 ts_tablet_manager.cc:1434] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:31.221676 10282 raft_consensus.cc:3060] T fa6dd77092c7440ab9949cc582c38f52 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.229290 10504 tablet_bootstrap.cc:492] T 51391c6e644f4174b2a977865398bccd P 9d6c512cfc2248c28e5ff72bf0fc06df: Bootstrap starting.
I20260709 13:17:31.230506 10505 tablet_bootstrap.cc:654] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.229179 10506 tablet_bootstrap.cc:654] T 51391c6e644f4174b2a977865398bccd P e7f9e723f3f54a4bb5e4c57869f40d7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.245203 10282 raft_consensus.cc:2468] T fa6dd77092c7440ab9949cc582c38f52 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 1.
I20260709 13:17:31.246992 10504 tablet_bootstrap.cc:654] T 51391c6e644f4174b2a977865398bccd P 9d6c512cfc2248c28e5ff72bf0fc06df: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.248732 10320 leader_election.cc:304] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6c512cfc2248c28e5ff72bf0fc06df, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 
I20260709 13:17:31.249676 10517 raft_consensus.cc:2804] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:31.250324 10517 raft_consensus.cc:697] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Becoming Leader. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Running, Role: LEADER
I20260709 13:17:31.251224 10517 consensus_queue.cc:237] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.254680 10207 raft_consensus.cc:2468] T fa6dd77092c7440ab9949cc582c38f52 P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 1.
I20260709 13:17:31.258391 10506 tablet_bootstrap.cc:492] T 51391c6e644f4174b2a977865398bccd P e7f9e723f3f54a4bb5e4c57869f40d7a: No bootstrap required, opened a new log
I20260709 13:17:31.257663 10105 catalog_manager.cc:5697] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3). New cstate: current_term: 1 leader_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:31.259230 10506 ts_tablet_manager.cc:1403] T 51391c6e644f4174b2a977865398bccd P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.002s
I20260709 13:17:31.263144 10505 tablet_bootstrap.cc:492] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8: No bootstrap required, opened a new log
I20260709 13:17:31.263392 10506 raft_consensus.cc:359] T 51391c6e644f4174b2a977865398bccd P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.264549 10506 raft_consensus.cc:385] T 51391c6e644f4174b2a977865398bccd P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.264911 10506 raft_consensus.cc:740] T 51391c6e644f4174b2a977865398bccd P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7f9e723f3f54a4bb5e4c57869f40d7a, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.264176 10505 ts_tablet_manager.cc:1403] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8: Time spent bootstrapping tablet: real 0.091s	user 0.012s	sys 0.012s
I20260709 13:17:31.265774 10506 consensus_queue.cc:260] T 51391c6e644f4174b2a977865398bccd P e7f9e723f3f54a4bb5e4c57869f40d7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.267817 10534 consensus_queue.cc:1048] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:31.268651 10504 tablet_bootstrap.cc:492] T 51391c6e644f4174b2a977865398bccd P 9d6c512cfc2248c28e5ff72bf0fc06df: No bootstrap required, opened a new log
I20260709 13:17:31.269150 10504 ts_tablet_manager.cc:1403] T 51391c6e644f4174b2a977865398bccd P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.011s
I20260709 13:17:31.272663 10505 raft_consensus.cc:359] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.273416 10505 raft_consensus.cc:385] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.273667 10505 raft_consensus.cc:740] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.274358 10505 consensus_queue.cc:260] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.275995 10505 ts_tablet_manager.cc:1434] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:17:31.277109 10505 tablet_bootstrap.cc:492] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 21a517d52d81404f9ae245428d42fed8: Bootstrap starting.
I20260709 13:17:31.285053 10505 tablet_bootstrap.cc:654] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 21a517d52d81404f9ae245428d42fed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.293246 10504 raft_consensus.cc:359] T 51391c6e644f4174b2a977865398bccd P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.294307 10504 raft_consensus.cc:385] T 51391c6e644f4174b2a977865398bccd P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.297801 10504 raft_consensus.cc:740] T 51391c6e644f4174b2a977865398bccd P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.298544 10504 consensus_queue.cc:260] T 51391c6e644f4174b2a977865398bccd P 9d6c512cfc2248c28e5ff72bf0fc06df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.299990 10506 ts_tablet_manager.cc:1434] T 51391c6e644f4174b2a977865398bccd P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:17:31.303412 10504 ts_tablet_manager.cc:1434] T 51391c6e644f4174b2a977865398bccd P 9d6c512cfc2248c28e5ff72bf0fc06df: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:17:31.309737 10506 tablet_bootstrap.cc:492] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P e7f9e723f3f54a4bb5e4c57869f40d7a: Bootstrap starting.
I20260709 13:17:31.311151 10505 tablet_bootstrap.cc:492] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 21a517d52d81404f9ae245428d42fed8: No bootstrap required, opened a new log
I20260709 13:17:31.311673 10505 ts_tablet_manager.cc:1403] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 21a517d52d81404f9ae245428d42fed8: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.010s
I20260709 13:17:31.314432 10505 raft_consensus.cc:359] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.315124 10505 raft_consensus.cc:385] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.315387 10505 raft_consensus.cc:740] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.315969 10505 consensus_queue.cc:260] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 21a517d52d81404f9ae245428d42fed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.316454 10506 tablet_bootstrap.cc:654] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P e7f9e723f3f54a4bb5e4c57869f40d7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.316970 10102 catalog_manager.cc:5697] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3). New cstate: current_term: 1 leader_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:31.318178 10505 ts_tablet_manager.cc:1434] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 21a517d52d81404f9ae245428d42fed8: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:17:31.330457 10517 consensus_queue.cc:1048] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:31.340095 10154 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:31.340837 10517 raft_consensus.cc:493] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.340967 10506 tablet_bootstrap.cc:492] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P e7f9e723f3f54a4bb5e4c57869f40d7a: No bootstrap required, opened a new log
I20260709 13:17:31.341812 10506 ts_tablet_manager.cc:1403] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.000s
I20260709 13:17:31.341563 10517 raft_consensus.cc:515] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.343895 10517 leader_election.cc:290] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427)
I20260709 13:17:31.344708 10206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0d67d4e5a84f3ab998b18ddbdbe1e0" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8" is_pre_election: true
I20260709 13:17:31.345220 10283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0d67d4e5a84f3ab998b18ddbdbe1e0" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" is_pre_election: true
I20260709 13:17:31.345618 10206 raft_consensus.cc:2468] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 0.
I20260709 13:17:31.347047 10323 leader_election.cc:304] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, 9d6c512cfc2248c28e5ff72bf0fc06df; no voters: 
W20260709 13:17:31.347631 10320 leader_election.cc:343] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:31.347965 10517 raft_consensus.cc:2804] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:31.348538 10517 raft_consensus.cc:493] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.348948 10517 raft_consensus.cc:3060] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.349660 10506 raft_consensus.cc:359] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.350595 10506 raft_consensus.cc:385] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.354065 10506 raft_consensus.cc:740] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7f9e723f3f54a4bb5e4c57869f40d7a, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.356698 10506 consensus_queue.cc:260] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P e7f9e723f3f54a4bb5e4c57869f40d7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.359428 10517 raft_consensus.cc:515] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.359891 10506 ts_tablet_manager.cc:1434] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P e7f9e723f3f54a4bb5e4c57869f40d7a: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260709 13:17:31.361670 10517 leader_election.cc:290] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 election: Requested vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427)
I20260709 13:17:31.363332 10207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0d67d4e5a84f3ab998b18ddbdbe1e0" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8"
I20260709 13:17:31.363780 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0d67d4e5a84f3ab998b18ddbdbe1e0" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
I20260709 13:17:31.363994 10207 raft_consensus.cc:3060] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.364362 10282 raft_consensus.cc:3060] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.370344 10207 raft_consensus.cc:2468] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 1.
I20260709 13:17:31.371258 10323 leader_election.cc:304] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, 9d6c512cfc2248c28e5ff72bf0fc06df; no voters: 
I20260709 13:17:31.372094 10517 raft_consensus.cc:2804] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:31.372175 10282 raft_consensus.cc:2468] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 1.
I20260709 13:17:31.372571 10517 raft_consensus.cc:697] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Becoming Leader. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Running, Role: LEADER
I20260709 13:17:31.373525 10517 consensus_queue.cc:237] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.382577 10105 catalog_manager.cc:5697] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3). New cstate: current_term: 1 leader_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:31.441236 10517 raft_consensus.cc:493] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.441910 10517 raft_consensus.cc:515] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.443755 10517 leader_election.cc:290] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427)
I20260709 13:17:31.444691 10207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befc9a38bed4affbb60b2ac29a62328" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8" is_pre_election: true
I20260709 13:17:31.444927 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befc9a38bed4affbb60b2ac29a62328" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" is_pre_election: true
I20260709 13:17:31.445494 10207 raft_consensus.cc:2468] T 7befc9a38bed4affbb60b2ac29a62328 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 0.
I20260709 13:17:31.445667 10282 raft_consensus.cc:2468] T 7befc9a38bed4affbb60b2ac29a62328 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 0.
I20260709 13:17:31.446961 10320 leader_election.cc:304] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6c512cfc2248c28e5ff72bf0fc06df, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 
I20260709 13:17:31.454864 10517 raft_consensus.cc:2804] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:31.455369 10517 raft_consensus.cc:493] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.455767 10517 raft_consensus.cc:3060] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.461706 10517 raft_consensus.cc:515] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.463554 10517 leader_election.cc:290] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 election: Requested vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427)
I20260709 13:17:31.464344 10207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befc9a38bed4affbb60b2ac29a62328" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a517d52d81404f9ae245428d42fed8"
I20260709 13:17:31.464663 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befc9a38bed4affbb60b2ac29a62328" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
I20260709 13:17:31.465021 10207 raft_consensus.cc:3060] T 7befc9a38bed4affbb60b2ac29a62328 P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.465240 10282 raft_consensus.cc:3060] T 7befc9a38bed4affbb60b2ac29a62328 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.469735 10282 raft_consensus.cc:2468] T 7befc9a38bed4affbb60b2ac29a62328 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 1.
I20260709 13:17:31.469929 10207 raft_consensus.cc:2468] T 7befc9a38bed4affbb60b2ac29a62328 P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 1.
I20260709 13:17:31.470733 10320 leader_election.cc:304] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6c512cfc2248c28e5ff72bf0fc06df, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 
I20260709 13:17:31.471592 10517 raft_consensus.cc:2804] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:31.472101 10517 raft_consensus.cc:697] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Becoming Leader. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Running, Role: LEADER
I20260709 13:17:31.472872 10517 consensus_queue.cc:237] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.479523 10105 catalog_manager.cc:5697] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3). New cstate: current_term: 1 leader_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:31.525619 10530 raft_consensus.cc:493] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.526079 10530 raft_consensus.cc:515] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.528030 10530 leader_election.cc:290] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:31.528721 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51391c6e644f4174b2a977865398bccd" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" is_pre_election: true
I20260709 13:17:31.529081 10357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51391c6e644f4174b2a977865398bccd" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" is_pre_election: true
I20260709 13:17:31.529422 10282 raft_consensus.cc:2468] T 51391c6e644f4174b2a977865398bccd P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21a517d52d81404f9ae245428d42fed8 in term 0.
I20260709 13:17:31.529672 10357 raft_consensus.cc:2468] T 51391c6e644f4174b2a977865398bccd P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21a517d52d81404f9ae245428d42fed8 in term 0.
I20260709 13:17:31.530489 10171 leader_election.cc:304] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 
I20260709 13:17:31.531265 10530 raft_consensus.cc:2804] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:31.531585 10530 raft_consensus.cc:493] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.531869 10530 raft_consensus.cc:3060] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.537827 10525 consensus_queue.cc:1048] T 111172fb47f14e48baeee36903d67848 P 21a517d52d81404f9ae245428d42fed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:31.538138 10530 raft_consensus.cc:515] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.540576 10530 leader_election.cc:290] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 election: Requested vote from peers e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:31.541448 10356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51391c6e644f4174b2a977865398bccd" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
I20260709 13:17:31.542080 10356 raft_consensus.cc:3060] T 51391c6e644f4174b2a977865398bccd P 9d6c512cfc2248c28e5ff72bf0fc06df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.542657 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51391c6e644f4174b2a977865398bccd" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
I20260709 13:17:31.543292 10282 raft_consensus.cc:3060] T 51391c6e644f4174b2a977865398bccd P e7f9e723f3f54a4bb5e4c57869f40d7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.552016 10356 raft_consensus.cc:2468] T 51391c6e644f4174b2a977865398bccd P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a517d52d81404f9ae245428d42fed8 in term 1.
I20260709 13:17:31.553253 10173 leader_election.cc:304] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, 9d6c512cfc2248c28e5ff72bf0fc06df; no voters: 
I20260709 13:17:31.555784 10530 raft_consensus.cc:2804] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:31.555980 10559 consensus_queue.cc:1048] T 111172fb47f14e48baeee36903d67848 P 21a517d52d81404f9ae245428d42fed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:31.561113 10282 raft_consensus.cc:2468] T 51391c6e644f4174b2a977865398bccd P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a517d52d81404f9ae245428d42fed8 in term 1.
I20260709 13:17:31.567530 10533 consensus_queue.cc:1048] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:31.568913 10530 raft_consensus.cc:697] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8 [term 1 LEADER]: Becoming Leader. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Running, Role: LEADER
I20260709 13:17:31.572070 10533 consensus_queue.cc:1048] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:31.572660 10517 consensus_queue.cc:1048] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:31.572510 10530 consensus_queue.cc:237] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.602792 10425 consensus_queue.cc:1048] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:31.614584 10173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:41719, user_credentials={real_user=slave}} blocked reactor thread for 61457.9us
I20260709 13:17:31.612051 10105 catalog_manager.cc:5697] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 21a517d52d81404f9ae245428d42fed8 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "21a517d52d81404f9ae245428d42fed8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:31.682505 10517 consensus_queue.cc:1048] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:31.693502 10425 consensus_queue.cc:1048] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:31.707544 10357 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d7a52940bd74fa4b2577722105b2f7e"
dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
mode: GRACEFUL
new_leader_uuid: "21a517d52d81404f9ae245428d42fed8"
 from {username='slave'} at 127.0.0.1:36830
I20260709 13:17:31.708210 10357 raft_consensus.cc:606] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Received request to transfer leadership to TS 21a517d52d81404f9ae245428d42fed8
I20260709 13:17:31.714778 10357 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "538fe68707244d72b1909ca4c2a6dd79"
dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
mode: GRACEFUL
new_leader_uuid: "21a517d52d81404f9ae245428d42fed8"
 from {username='slave'} at 127.0.0.1:36830
I20260709 13:17:31.715320 10357 raft_consensus.cc:606] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Received request to transfer leadership to TS 21a517d52d81404f9ae245428d42fed8
I20260709 13:17:31.720366 10357 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34e9bf7ab8d94fc992029d96d68291e4"
dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
mode: GRACEFUL
new_leader_uuid: "21a517d52d81404f9ae245428d42fed8"
 from {username='slave'} at 127.0.0.1:36830
I20260709 13:17:31.720911 10357 raft_consensus.cc:606] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Received request to transfer leadership to TS 21a517d52d81404f9ae245428d42fed8
I20260709 13:17:31.728786 10356 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "820297e85e1a490ea6da4d46b3f93f80"
dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
mode: GRACEFUL
new_leader_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
 from {username='slave'} at 127.0.0.1:36830
I20260709 13:17:31.729277 10356 raft_consensus.cc:606] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Received request to transfer leadership to TS e7f9e723f3f54a4bb5e4c57869f40d7a
I20260709 13:17:31.734371 10356 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa6dd77092c7440ab9949cc582c38f52"
dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
mode: GRACEFUL
new_leader_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
 from {username='slave'} at 127.0.0.1:36830
I20260709 13:17:31.734889 10356 raft_consensus.cc:606] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Received request to transfer leadership to TS e7f9e723f3f54a4bb5e4c57869f40d7a
I20260709 13:17:31.740085 10356 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7befc9a38bed4affbb60b2ac29a62328"
dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
mode: GRACEFUL
new_leader_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
 from {username='slave'} at 127.0.0.1:36830
I20260709 13:17:31.740648 10356 raft_consensus.cc:606] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Received request to transfer leadership to TS e7f9e723f3f54a4bb5e4c57869f40d7a
I20260709 13:17:31.745826 10356 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec0d67d4e5a84f3ab998b18ddbdbe1e0"
dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
mode: GRACEFUL
new_leader_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
 from {username='slave'} at 127.0.0.1:36830
I20260709 13:17:31.746447 10356 raft_consensus.cc:606] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Received request to transfer leadership to TS e7f9e723f3f54a4bb5e4c57869f40d7a
I20260709 13:17:31.752108 10207 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51391c6e644f4174b2a977865398bccd"
dest_uuid: "21a517d52d81404f9ae245428d42fed8"
mode: GRACEFUL
new_leader_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
 from {username='slave'} at 127.0.0.1:44292
I20260709 13:17:31.752724 10207 raft_consensus.cc:606] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8 [term 1 LEADER]: Received request to transfer leadership to TS 9d6c512cfc2248c28e5ff72bf0fc06df
I20260709 13:17:31.773108 10425 consensus_queue.cc:1048] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:31.784116 10425 consensus_queue.cc:1048] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:31.793126 10538 raft_consensus.cc:993] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df: : Instructing follower e7f9e723f3f54a4bb5e4c57869f40d7a to start an election
I20260709 13:17:31.793661 10425 raft_consensus.cc:1081] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Signalling peer e7f9e723f3f54a4bb5e4c57869f40d7a to start an election
I20260709 13:17:31.800138 10283 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa6dd77092c7440ab9949cc582c38f52"
dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
 from {username='slave'} at 127.0.0.1:52678
I20260709 13:17:31.800948 10283 raft_consensus.cc:493] T fa6dd77092c7440ab9949cc582c38f52 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:31.801326 10283 raft_consensus.cc:3060] T fa6dd77092c7440ab9949cc582c38f52 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.807271 10283 raft_consensus.cc:515] T fa6dd77092c7440ab9949cc582c38f52 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.809194 10283 leader_election.cc:290] T fa6dd77092c7440ab9949cc582c38f52 P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 2 election: Requested vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:31.809939 10207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6dd77092c7440ab9949cc582c38f52" candidate_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21a517d52d81404f9ae245428d42fed8"
I20260709 13:17:31.810737 10356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6dd77092c7440ab9949cc582c38f52" candidate_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
I20260709 13:17:31.810935 10207 raft_consensus.cc:3060] T fa6dd77092c7440ab9949cc582c38f52 P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.811370 10356 raft_consensus.cc:3055] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:31.811698 10356 raft_consensus.cc:740] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Running, Role: LEADER
I20260709 13:17:31.812477 10356 consensus_queue.cc:260] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.813804 10356 raft_consensus.cc:3060] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.818049 10207 raft_consensus.cc:2468] T fa6dd77092c7440ab9949cc582c38f52 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7f9e723f3f54a4bb5e4c57869f40d7a in term 2.
I20260709 13:17:31.819430 10249 leader_election.cc:304] T fa6dd77092c7440ab9949cc582c38f52 P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 
I20260709 13:17:31.820228 10515 raft_consensus.cc:2804] T fa6dd77092c7440ab9949cc582c38f52 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:31.820732 10515 raft_consensus.cc:697] T fa6dd77092c7440ab9949cc582c38f52 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 LEADER]: Becoming Leader. State: Replica: e7f9e723f3f54a4bb5e4c57869f40d7a, State: Running, Role: LEADER
I20260709 13:17:31.821173 10356 raft_consensus.cc:2468] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7f9e723f3f54a4bb5e4c57869f40d7a in term 2.
I20260709 13:17:31.821514 10515 consensus_queue.cc:237] T fa6dd77092c7440ab9949cc582c38f52 P e7f9e723f3f54a4bb5e4c57869f40d7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.829319 10102 catalog_manager.cc:5697] T fa6dd77092c7440ab9949cc582c38f52 P e7f9e723f3f54a4bb5e4c57869f40d7a reported cstate change: term changed from 1 to 2, leader changed from 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3) to e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2). New cstate: current_term: 2 leader_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:31.877466 10538 raft_consensus.cc:993] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df: : Instructing follower 21a517d52d81404f9ae245428d42fed8 to start an election
I20260709 13:17:31.877938 10425 raft_consensus.cc:1081] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Signalling peer 21a517d52d81404f9ae245428d42fed8 to start an election
I20260709 13:17:31.879606 10207 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d7a52940bd74fa4b2577722105b2f7e"
dest_uuid: "21a517d52d81404f9ae245428d42fed8"
 from {username='slave'} at 127.0.0.1:44274
I20260709 13:17:31.880156 10207 raft_consensus.cc:493] T 8d7a52940bd74fa4b2577722105b2f7e P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:31.880482 10207 raft_consensus.cc:3060] T 8d7a52940bd74fa4b2577722105b2f7e P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.881641 10538 consensus_queue.cc:1048] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:31.886997 10207 raft_consensus.cc:515] T 8d7a52940bd74fa4b2577722105b2f7e P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.889678 10283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d7a52940bd74fa4b2577722105b2f7e" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
I20260709 13:17:31.890303 10283 raft_consensus.cc:3060] T 8d7a52940bd74fa4b2577722105b2f7e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.890607 10356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d7a52940bd74fa4b2577722105b2f7e" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
I20260709 13:17:31.891235 10356 raft_consensus.cc:3055] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:31.891585 10356 raft_consensus.cc:740] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Running, Role: LEADER
I20260709 13:17:31.892462 10356 consensus_queue.cc:260] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.893697 10356 raft_consensus.cc:3060] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.894888 10425 consensus_queue.cc:1048] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:31.905304 10283 raft_consensus.cc:2468] T 8d7a52940bd74fa4b2577722105b2f7e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a517d52d81404f9ae245428d42fed8 in term 2.
I20260709 13:17:31.907469 10171 leader_election.cc:304] T 8d7a52940bd74fa4b2577722105b2f7e P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 
I20260709 13:17:31.908749 10558 raft_consensus.cc:2804] T 8d7a52940bd74fa4b2577722105b2f7e P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:31.909284 10558 raft_consensus.cc:697] T 8d7a52940bd74fa4b2577722105b2f7e P 21a517d52d81404f9ae245428d42fed8 [term 2 LEADER]: Becoming Leader. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Running, Role: LEADER
I20260709 13:17:31.910009 10356 raft_consensus.cc:2468] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a517d52d81404f9ae245428d42fed8 in term 2.
I20260709 13:17:31.910229 10558 consensus_queue.cc:237] T 8d7a52940bd74fa4b2577722105b2f7e P 21a517d52d81404f9ae245428d42fed8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.911502 10207 leader_election.cc:290] T 8d7a52940bd74fa4b2577722105b2f7e P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 2 election: Requested vote from peers e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:31.913328 10517 raft_consensus.cc:993] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df: : Instructing follower e7f9e723f3f54a4bb5e4c57869f40d7a to start an election
I20260709 13:17:31.913839 10517 raft_consensus.cc:1081] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Signalling peer e7f9e723f3f54a4bb5e4c57869f40d7a to start an election
I20260709 13:17:31.915457 10282 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec0d67d4e5a84f3ab998b18ddbdbe1e0"
dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
 from {username='slave'} at 127.0.0.1:52678
I20260709 13:17:31.915938 10282 raft_consensus.cc:493] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:31.917045 10282 raft_consensus.cc:3060] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.918756 10102 catalog_manager.cc:5697] T 8d7a52940bd74fa4b2577722105b2f7e P 21a517d52d81404f9ae245428d42fed8 reported cstate change: term changed from 1 to 2, leader changed from 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3) to 21a517d52d81404f9ae245428d42fed8 (127.30.63.1). New cstate: current_term: 2 leader_uuid: "21a517d52d81404f9ae245428d42fed8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:31.921779 10282 raft_consensus.cc:515] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.924459 10207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0d67d4e5a84f3ab998b18ddbdbe1e0" candidate_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21a517d52d81404f9ae245428d42fed8"
I20260709 13:17:31.924489 10282 leader_election.cc:290] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 2 election: Requested vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:31.924728 10356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0d67d4e5a84f3ab998b18ddbdbe1e0" candidate_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
I20260709 13:17:31.925076 10207 raft_consensus.cc:3060] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.925352 10356 raft_consensus.cc:3055] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:31.925671 10356 raft_consensus.cc:740] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Running, Role: LEADER
I20260709 13:17:31.926482 10356 consensus_queue.cc:260] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.928438 10356 raft_consensus.cc:3060] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.932180 10207 raft_consensus.cc:2468] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7f9e723f3f54a4bb5e4c57869f40d7a in term 2.
I20260709 13:17:31.933378 10249 leader_election.cc:304] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 
I20260709 13:17:31.934249 10515 raft_consensus.cc:2804] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:31.934795 10515 raft_consensus.cc:697] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 LEADER]: Becoming Leader. State: Replica: e7f9e723f3f54a4bb5e4c57869f40d7a, State: Running, Role: LEADER
I20260709 13:17:31.935688 10356 raft_consensus.cc:2468] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7f9e723f3f54a4bb5e4c57869f40d7a in term 2.
I20260709 13:17:31.935743 10515 consensus_queue.cc:237] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P e7f9e723f3f54a4bb5e4c57869f40d7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:31.943420 10102 catalog_manager.cc:5697] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P e7f9e723f3f54a4bb5e4c57869f40d7a reported cstate change: term changed from 1 to 2, leader changed from 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3) to e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2). New cstate: current_term: 2 leader_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:32.043318 10425 raft_consensus.cc:993] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df: : Instructing follower e7f9e723f3f54a4bb5e4c57869f40d7a to start an election
I20260709 13:17:32.043816 10425 raft_consensus.cc:1081] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Signalling peer e7f9e723f3f54a4bb5e4c57869f40d7a to start an election
I20260709 13:17:32.045284 10283 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "820297e85e1a490ea6da4d46b3f93f80"
dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
 from {username='slave'} at 127.0.0.1:52678
I20260709 13:17:32.045806 10283 raft_consensus.cc:493] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:32.046159 10283 raft_consensus.cc:3060] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.052929 10283 raft_consensus.cc:515] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:32.055809 10207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820297e85e1a490ea6da4d46b3f93f80" candidate_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21a517d52d81404f9ae245428d42fed8"
I20260709 13:17:32.057474 10207 raft_consensus.cc:3060] T 820297e85e1a490ea6da4d46b3f93f80 P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.057819 10283 leader_election.cc:290] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 2 election: Requested vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:32.058146 10517 raft_consensus.cc:993] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df: : Instructing follower 21a517d52d81404f9ae245428d42fed8 to start an election
I20260709 13:17:32.058660 10533 raft_consensus.cc:1081] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Signalling peer 21a517d52d81404f9ae245428d42fed8 to start an election
I20260709 13:17:32.057713 10425 consensus_queue.cc:1048] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:17:32.059167 10357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820297e85e1a490ea6da4d46b3f93f80" candidate_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
I20260709 13:17:32.060556 10206 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34e9bf7ab8d94fc992029d96d68291e4"
dest_uuid: "21a517d52d81404f9ae245428d42fed8"
 from {username='slave'} at 127.0.0.1:44274
I20260709 13:17:32.060952 10357 raft_consensus.cc:3055] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:32.061194 10206 raft_consensus.cc:493] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:32.061419 10357 raft_consensus.cc:740] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Running, Role: LEADER
I20260709 13:17:32.061698 10206 raft_consensus.cc:3060] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.062430 10357 consensus_queue.cc:260] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:32.063536 10357 raft_consensus.cc:3060] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.065022 10207 raft_consensus.cc:2468] T 820297e85e1a490ea6da4d46b3f93f80 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7f9e723f3f54a4bb5e4c57869f40d7a in term 2.
I20260709 13:17:32.066358 10249 leader_election.cc:304] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 
I20260709 13:17:32.067181 10515 raft_consensus.cc:2804] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:32.067698 10515 raft_consensus.cc:697] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 LEADER]: Becoming Leader. State: Replica: e7f9e723f3f54a4bb5e4c57869f40d7a, State: Running, Role: LEADER
I20260709 13:17:32.068539 10515 consensus_queue.cc:237] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:32.071833 10357 raft_consensus.cc:2468] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7f9e723f3f54a4bb5e4c57869f40d7a in term 2.
I20260709 13:17:32.069516 10206 raft_consensus.cc:515] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:32.075441 10517 consensus_queue.cc:1048] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:17:32.077508 10357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e9bf7ab8d94fc992029d96d68291e4" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
I20260709 13:17:32.078128 10357 raft_consensus.cc:3055] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:32.078436 10357 raft_consensus.cc:740] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Running, Role: LEADER
I20260709 13:17:32.078874 10283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e9bf7ab8d94fc992029d96d68291e4" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
I20260709 13:17:32.076498 10206 leader_election.cc:290] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 2 election: Requested vote from peers e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:32.079530 10283 raft_consensus.cc:3060] T 34e9bf7ab8d94fc992029d96d68291e4 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.080565 10425 raft_consensus.cc:993] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df: : Instructing follower e7f9e723f3f54a4bb5e4c57869f40d7a to start an election
I20260709 13:17:32.081127 10517 raft_consensus.cc:1081] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Signalling peer e7f9e723f3f54a4bb5e4c57869f40d7a to start an election
I20260709 13:17:32.079154 10357 consensus_queue.cc:260] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:32.083057 10357 raft_consensus.cc:3060] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.084841 10425 raft_consensus.cc:993] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df: : Instructing follower 21a517d52d81404f9ae245428d42fed8 to start an election
I20260709 13:17:32.085474 10425 raft_consensus.cc:1081] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Signalling peer 21a517d52d81404f9ae245428d42fed8 to start an election
I20260709 13:17:32.088536 10282 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7befc9a38bed4affbb60b2ac29a62328"
dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
 from {username='slave'} at 127.0.0.1:52678
I20260709 13:17:32.088681 10207 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "538fe68707244d72b1909ca4c2a6dd79"
dest_uuid: "21a517d52d81404f9ae245428d42fed8"
 from {username='slave'} at 127.0.0.1:44274
I20260709 13:17:32.089318 10282 raft_consensus.cc:493] T 7befc9a38bed4affbb60b2ac29a62328 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:32.089330 10207 raft_consensus.cc:493] T 538fe68707244d72b1909ca4c2a6dd79 P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:32.089849 10282 raft_consensus.cc:3060] T 7befc9a38bed4affbb60b2ac29a62328 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.090922 10357 raft_consensus.cc:2468] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a517d52d81404f9ae245428d42fed8 in term 2.
I20260709 13:17:32.089890 10207 raft_consensus.cc:3060] T 538fe68707244d72b1909ca4c2a6dd79 P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.092166 10173 leader_election.cc:304] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, 9d6c512cfc2248c28e5ff72bf0fc06df; no voters: 
I20260709 13:17:32.093168 10530 raft_consensus.cc:2804] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:32.093638 10530 raft_consensus.cc:697] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8 [term 2 LEADER]: Becoming Leader. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Running, Role: LEADER
I20260709 13:17:32.094501 10530 consensus_queue.cc:237] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:32.097319 10283 raft_consensus.cc:2468] T 34e9bf7ab8d94fc992029d96d68291e4 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a517d52d81404f9ae245428d42fed8 in term 2.
I20260709 13:17:32.097640 10282 raft_consensus.cc:515] T 7befc9a38bed4affbb60b2ac29a62328 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:32.101465 10282 leader_election.cc:290] T 7befc9a38bed4affbb60b2ac29a62328 P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 2 election: Requested vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:32.101591 10208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befc9a38bed4affbb60b2ac29a62328" candidate_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21a517d52d81404f9ae245428d42fed8"
I20260709 13:17:32.102293 10208 raft_consensus.cc:3060] T 7befc9a38bed4affbb60b2ac29a62328 P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.103487 10357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befc9a38bed4affbb60b2ac29a62328" candidate_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
I20260709 13:17:32.104063 10357 raft_consensus.cc:3055] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:32.104341 10357 raft_consensus.cc:740] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Running, Role: LEADER
I20260709 13:17:32.105070 10357 consensus_queue.cc:260] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:32.106083 10357 raft_consensus.cc:3060] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.111021 10207 raft_consensus.cc:515] T 538fe68707244d72b1909ca4c2a6dd79 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:32.111927 10208 raft_consensus.cc:2468] T 7befc9a38bed4affbb60b2ac29a62328 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7f9e723f3f54a4bb5e4c57869f40d7a in term 2.
I20260709 13:17:32.113183 10249 leader_election.cc:304] T 7befc9a38bed4affbb60b2ac29a62328 P e7f9e723f3f54a4bb5e4c57869f40d7a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 
I20260709 13:17:32.113302 10103 catalog_manager.cc:5697] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8 reported cstate change: term changed from 1 to 2, leader changed from 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3) to 21a517d52d81404f9ae245428d42fed8 (127.30.63.1). New cstate: current_term: 2 leader_uuid: "21a517d52d81404f9ae245428d42fed8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:32.114137 10515 raft_consensus.cc:2804] T 7befc9a38bed4affbb60b2ac29a62328 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:32.114285 10206 raft_consensus.cc:1240] T 7befc9a38bed4affbb60b2ac29a62328 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Rejecting Update request from peer 9d6c512cfc2248c28e5ff72bf0fc06df for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:17:32.114663 10515 raft_consensus.cc:697] T 7befc9a38bed4affbb60b2ac29a62328 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 LEADER]: Becoming Leader. State: Replica: e7f9e723f3f54a4bb5e4c57869f40d7a, State: Running, Role: LEADER
I20260709 13:17:32.114857 10356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538fe68707244d72b1909ca4c2a6dd79" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
I20260709 13:17:32.115573 10356 raft_consensus.cc:3055] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:32.116106 10356 raft_consensus.cc:740] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Running, Role: LEADER
I20260709 13:17:32.115623 10515 consensus_queue.cc:237] T 7befc9a38bed4affbb60b2ac29a62328 P e7f9e723f3f54a4bb5e4c57869f40d7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:32.117105 10356 consensus_queue.cc:260] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:32.118448 10356 raft_consensus.cc:3060] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.118386 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538fe68707244d72b1909ca4c2a6dd79" candidate_uuid: "21a517d52d81404f9ae245428d42fed8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
I20260709 13:17:32.119289 10282 raft_consensus.cc:3060] T 538fe68707244d72b1909ca4c2a6dd79 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.121785 10357 raft_consensus.cc:2468] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7f9e723f3f54a4bb5e4c57869f40d7a in term 2.
I20260709 13:17:32.124446 10207 leader_election.cc:290] T 538fe68707244d72b1909ca4c2a6dd79 P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 2 election: Requested vote from peers e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427), 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3:41719)
I20260709 13:17:32.127728 10356 raft_consensus.cc:2468] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a517d52d81404f9ae245428d42fed8 in term 2.
I20260709 13:17:32.126556 10282 raft_consensus.cc:2468] T 538fe68707244d72b1909ca4c2a6dd79 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a517d52d81404f9ae245428d42fed8 in term 2.
I20260709 13:17:32.130394 10173 leader_election.cc:304] T 538fe68707244d72b1909ca4c2a6dd79 P 21a517d52d81404f9ae245428d42fed8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, 9d6c512cfc2248c28e5ff72bf0fc06df; no voters: 
I20260709 13:17:32.131301 10530 raft_consensus.cc:2804] T 538fe68707244d72b1909ca4c2a6dd79 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:32.131798 10530 raft_consensus.cc:697] T 538fe68707244d72b1909ca4c2a6dd79 P 21a517d52d81404f9ae245428d42fed8 [term 2 LEADER]: Becoming Leader. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Running, Role: LEADER
I20260709 13:17:32.132746 10530 consensus_queue.cc:237] T 538fe68707244d72b1909ca4c2a6dd79 P 21a517d52d81404f9ae245428d42fed8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:32.135511 10102 catalog_manager.cc:5697] T 7befc9a38bed4affbb60b2ac29a62328 P e7f9e723f3f54a4bb5e4c57869f40d7a reported cstate change: term changed from 1 to 2, leader changed from 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3) to e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2). New cstate: current_term: 2 leader_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:32.137015 10102 catalog_manager.cc:5697] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a reported cstate change: term changed from 1 to 2, leader changed from 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3) to e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2). New cstate: current_term: 2 leader_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:32.141873 10103 catalog_manager.cc:5697] T 538fe68707244d72b1909ca4c2a6dd79 P 21a517d52d81404f9ae245428d42fed8 reported cstate change: term changed from 1 to 2, leader changed from 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3) to 21a517d52d81404f9ae245428d42fed8 (127.30.63.1). New cstate: current_term: 2 leader_uuid: "21a517d52d81404f9ae245428d42fed8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:32.182430 10530 consensus_queue.cc:1048] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:32.190956 10557 raft_consensus.cc:993] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8: : Instructing follower 9d6c512cfc2248c28e5ff72bf0fc06df to start an election
I20260709 13:17:32.192101 10558 raft_consensus.cc:1081] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8 [term 1 LEADER]: Signalling peer 9d6c512cfc2248c28e5ff72bf0fc06df to start an election
I20260709 13:17:32.191977 10530 consensus_queue.cc:1048] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:32.195195 10357 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51391c6e644f4174b2a977865398bccd"
dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
 from {username='slave'} at 127.0.0.1:36810
I20260709 13:17:32.195895 10357 raft_consensus.cc:493] T 51391c6e644f4174b2a977865398bccd P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:32.196319 10357 raft_consensus.cc:3060] T 51391c6e644f4174b2a977865398bccd P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.205139 10357 raft_consensus.cc:515] T 51391c6e644f4174b2a977865398bccd P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:32.206110 10356 raft_consensus.cc:1240] T 51391c6e644f4174b2a977865398bccd P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Rejecting Update request from peer 21a517d52d81404f9ae245428d42fed8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:32.207487 10357 leader_election.cc:290] T 51391c6e644f4174b2a977865398bccd P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 2 election: Requested vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427)
I20260709 13:17:32.208457 10207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51391c6e644f4174b2a977865398bccd" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21a517d52d81404f9ae245428d42fed8"
I20260709 13:17:32.208576 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51391c6e644f4174b2a977865398bccd" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
I20260709 13:17:32.209065 10530 consensus_queue.cc:1059] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:32.209967 10282 raft_consensus.cc:3060] T 51391c6e644f4174b2a977865398bccd P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.212414 10207 raft_consensus.cc:3055] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:32.212850 10207 raft_consensus.cc:740] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Running, Role: LEADER
I20260709 13:17:32.213551 10207 consensus_queue.cc:260] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:32.214744 10207 raft_consensus.cc:3060] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.217072 10282 raft_consensus.cc:2468] T 51391c6e644f4174b2a977865398bccd P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 2.
I20260709 13:17:32.218794 10320 leader_election.cc:304] T 51391c6e644f4174b2a977865398bccd P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6c512cfc2248c28e5ff72bf0fc06df, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 
I20260709 13:17:32.219724 10517 raft_consensus.cc:2804] T 51391c6e644f4174b2a977865398bccd P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:32.220249 10517 raft_consensus.cc:697] T 51391c6e644f4174b2a977865398bccd P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 LEADER]: Becoming Leader. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Running, Role: LEADER
I20260709 13:17:32.221923 10207 raft_consensus.cc:2468] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 2.
I20260709 13:17:32.221596 10517 consensus_queue.cc:237] T 51391c6e644f4174b2a977865398bccd P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
W20260709 13:17:32.222492 10557 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:17:32.229673 10102 catalog_manager.cc:5697] T 51391c6e644f4174b2a977865398bccd P 9d6c512cfc2248c28e5ff72bf0fc06df reported cstate change: term changed from 1 to 2, leader changed from 21a517d52d81404f9ae245428d42fed8 (127.30.63.1) to 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3). New cstate: current_term: 2 leader_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:32.235743 10207 raft_consensus.cc:1275] T fa6dd77092c7440ab9949cc582c38f52 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Refusing update from remote peer e7f9e723f3f54a4bb5e4c57869f40d7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:32.237341 10464 consensus_queue.cc:1048] T fa6dd77092c7440ab9949cc582c38f52 P e7f9e723f3f54a4bb5e4c57869f40d7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:32.245222 10357 raft_consensus.cc:1275] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Refusing update from remote peer e7f9e723f3f54a4bb5e4c57869f40d7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:32.246934 10464 consensus_queue.cc:1048] T fa6dd77092c7440ab9949cc582c38f52 P e7f9e723f3f54a4bb5e4c57869f40d7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:32.327347 10357 raft_consensus.cc:1275] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Refusing update from remote peer 21a517d52d81404f9ae245428d42fed8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:32.328672 10557 consensus_queue.cc:1048] T 8d7a52940bd74fa4b2577722105b2f7e P 21a517d52d81404f9ae245428d42fed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:32.339798 10282 raft_consensus.cc:1275] T 8d7a52940bd74fa4b2577722105b2f7e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Refusing update from remote peer 21a517d52d81404f9ae245428d42fed8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:32.341636 10557 consensus_queue.cc:1048] T 8d7a52940bd74fa4b2577722105b2f7e P 21a517d52d81404f9ae245428d42fed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:32.516763 10357 raft_consensus.cc:1275] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Refusing update from remote peer 21a517d52d81404f9ae245428d42fed8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:32.518160 10558 consensus_queue.cc:1048] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:32.529474 10282 raft_consensus.cc:1275] T 34e9bf7ab8d94fc992029d96d68291e4 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Refusing update from remote peer 21a517d52d81404f9ae245428d42fed8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:32.530782 10557 consensus_queue.cc:1048] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:32.538343 10357 raft_consensus.cc:1275] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Refusing update from remote peer e7f9e723f3f54a4bb5e4c57869f40d7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:32.539790 10515 consensus_queue.cc:1048] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P e7f9e723f3f54a4bb5e4c57869f40d7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:32.548563 10207 raft_consensus.cc:1275] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Refusing update from remote peer e7f9e723f3f54a4bb5e4c57869f40d7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:32.550407 10515 consensus_queue.cc:1048] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P e7f9e723f3f54a4bb5e4c57869f40d7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:32.558246 10357 raft_consensus.cc:1275] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Refusing update from remote peer e7f9e723f3f54a4bb5e4c57869f40d7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:32.559674 10515 consensus_queue.cc:1048] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:32.569027 10207 raft_consensus.cc:1275] T 820297e85e1a490ea6da4d46b3f93f80 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Refusing update from remote peer e7f9e723f3f54a4bb5e4c57869f40d7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:32.570950 10464 consensus_queue.cc:1048] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:32.581743 10357 raft_consensus.cc:1275] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Refusing update from remote peer e7f9e723f3f54a4bb5e4c57869f40d7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:32.583050 10515 consensus_queue.cc:1048] T 7befc9a38bed4affbb60b2ac29a62328 P e7f9e723f3f54a4bb5e4c57869f40d7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:32.596779 10207 raft_consensus.cc:1275] T 7befc9a38bed4affbb60b2ac29a62328 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Refusing update from remote peer e7f9e723f3f54a4bb5e4c57869f40d7a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:32.598395 10515 consensus_queue.cc:1048] T 7befc9a38bed4affbb60b2ac29a62328 P e7f9e723f3f54a4bb5e4c57869f40d7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:32.611022 10207 raft_consensus.cc:1275] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Refusing update from remote peer 9d6c512cfc2248c28e5ff72bf0fc06df: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:32.612627 10533 consensus_queue.cc:1048] T 51391c6e644f4174b2a977865398bccd P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:32.627486 10282 raft_consensus.cc:1275] T 51391c6e644f4174b2a977865398bccd P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Refusing update from remote peer 9d6c512cfc2248c28e5ff72bf0fc06df: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:32.628786 10579 consensus_queue.cc:1048] T 51391c6e644f4174b2a977865398bccd P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:32.689379 10357 raft_consensus.cc:1275] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Refusing update from remote peer 21a517d52d81404f9ae245428d42fed8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:32.690459 10282 raft_consensus.cc:1275] T 538fe68707244d72b1909ca4c2a6dd79 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Refusing update from remote peer 21a517d52d81404f9ae245428d42fed8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:32.692229 10557 consensus_queue.cc:1048] T 538fe68707244d72b1909ca4c2a6dd79 P 21a517d52d81404f9ae245428d42fed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:32.692920 10558 consensus_queue.cc:1048] T 538fe68707244d72b1909ca4c2a6dd79 P 21a517d52d81404f9ae245428d42fed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.756546 10102 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60410:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:17:34.778326 10102 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60410:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:17:34.831270 30972 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:17:35.095960 10618 log.cc:927] Time spent T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:17:35.093679 10171 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:46427, user_credentials={real_user=slave}} blocked reactor thread for 85597.1us
I20260709 13:17:35.223253 10636 tablet.cc:1724] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:35.241535 10641 tablet.cc:1724] T fa6dd77092c7440ab9949cc582c38f52 P e7f9e723f3f54a4bb5e4c57869f40d7a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:17:35.246565 10633 log.cc:927] Time spent T 51391c6e644f4174b2a977865398bccd P e7f9e723f3f54a4bb5e4c57869f40d7a: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:17:35.220060 10640 tablet.cc:1724] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P e7f9e723f3f54a4bb5e4c57869f40d7a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:17:35.270733 10309 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:ec0d67d4e5a84f3ab998b18ddbdbe1e0)
W20260709 13:17:35.279520 10309 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:ec0d67d4e5a84f3ab998b18ddbdbe1e0)
W20260709 13:17:35.285012 10309 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:ec0d67d4e5a84f3ab998b18ddbdbe1e0)
I20260709 13:17:35.219836 10639 tablet.cc:1724] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:35.280452 10645 tablet.cc:1724] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:17:35.314232 10627 log.cc:927] Time spent T 8d7a52940bd74fa4b2577722105b2f7e P 21a517d52d81404f9ae245428d42fed8: Append to log took a long time: real 0.137s	user 0.002s	sys 0.000s
I20260709 13:17:35.320870 10649 tablet.cc:1724] T 51391c6e644f4174b2a977865398bccd P 9d6c512cfc2248c28e5ff72bf0fc06df: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:35.309229 10644 tablet.cc:1724] T 111172fb47f14e48baeee36903d67848 P 21a517d52d81404f9ae245428d42fed8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:35.358865 10650 tablet.cc:1724] T 111172fb47f14e48baeee36903d67848 P 9d6c512cfc2248c28e5ff72bf0fc06df: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:35.360846 10648 tablet.cc:1724] T fa6dd77092c7440ab9949cc582c38f52 P 21a517d52d81404f9ae245428d42fed8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:35.362572 10652 tablet.cc:1724] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:35.365124 10653 tablet.cc:1724] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:17:35.372469 10320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:46427, user_credentials={real_user=slave}} blocked reactor thread for 119298us
I20260709 13:17:35.354272 10208 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34e9bf7ab8d94fc992029d96d68291e4"
dest_uuid: "21a517d52d81404f9ae245428d42fed8"
mode: GRACEFUL
new_leader_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
 from {username='slave'} at 127.0.0.1:60752
I20260709 13:17:35.391363 10654 tablet.cc:1724] T 7befc9a38bed4affbb60b2ac29a62328 P e7f9e723f3f54a4bb5e4c57869f40d7a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:35.398530 10208 raft_consensus.cc:606] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8 [term 2 LEADER]: Received request to transfer leadership to TS 9d6c512cfc2248c28e5ff72bf0fc06df
I20260709 13:17:35.364421 10640 tablet.cc:1724] T 34e9bf7ab8d94fc992029d96d68291e4 P e7f9e723f3f54a4bb5e4c57869f40d7a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:35.384231 10649 tablet.cc:1724] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:35.428411 10641 tablet.cc:1724] T 8d7a52940bd74fa4b2577722105b2f7e P e7f9e723f3f54a4bb5e4c57869f40d7a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:35.451536 10640 tablet.cc:1724] T 51391c6e644f4174b2a977865398bccd P e7f9e723f3f54a4bb5e4c57869f40d7a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:35.453495 10649 tablet.cc:1724] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:35.467223 10650 tablet.cc:1724] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:35.473492 10639 tablet.cc:1724] T 538fe68707244d72b1909ca4c2a6dd79 P e7f9e723f3f54a4bb5e4c57869f40d7a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:35.476344 10645 tablet.cc:1724] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:35.457727 10654 tablet.cc:1724] T 111172fb47f14e48baeee36903d67848 P e7f9e723f3f54a4bb5e4c57869f40d7a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:35.485085 10653 tablet.cc:1724] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 21a517d52d81404f9ae245428d42fed8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:35.483614 10636 tablet.cc:1724] T 8d7a52940bd74fa4b2577722105b2f7e P 21a517d52d81404f9ae245428d42fed8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:35.499985 10282 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "820297e85e1a490ea6da4d46b3f93f80"
dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
mode: GRACEFUL
new_leader_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
 from {username='slave'} at 127.0.0.1:36914
I20260709 13:17:35.500661 10282 raft_consensus.cc:606] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 LEADER]: Received request to transfer leadership to TS 9d6c512cfc2248c28e5ff72bf0fc06df
I20260709 13:17:35.501116 10106 catalog_manager.cc:5789] TS 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989) does not have the latest schema for tablet 8d7a52940bd74fa4b2577722105b2f7e (table soft_deleted_table [id=5b9bfbb2b5ee48f7aabb157f2c72784d]). Expected version 1 got 0
I20260709 13:17:35.502030 10106 catalog_manager.cc:5789] TS 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989) does not have the latest schema for tablet 538fe68707244d72b1909ca4c2a6dd79 (table soft_deleted_table [id=5b9bfbb2b5ee48f7aabb157f2c72784d]). Expected version 1 got 0
I20260709 13:17:35.502481 30972 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:17:35.503611 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:35.516490 10204 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1cf62842a6e4d3e8aba94cd94afb57b"
dest_uuid: "21a517d52d81404f9ae245428d42fed8"
mode: GRACEFUL
new_leader_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
 from {username='slave'} at 127.0.0.1:60752
I20260709 13:17:35.517211 10204 raft_consensus.cc:606] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8 [term 2 LEADER]: Received request to transfer leadership to TS 9d6c512cfc2248c28e5ff72bf0fc06df
I20260709 13:17:35.512626 10653 tablet.cc:1724] T 820297e85e1a490ea6da4d46b3f93f80 P 21a517d52d81404f9ae245428d42fed8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:35.527333 10644 tablet.cc:1724] T 7befc9a38bed4affbb60b2ac29a62328 P 21a517d52d81404f9ae245428d42fed8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:35.528553 10636 tablet.cc:1724] T 538fe68707244d72b1909ca4c2a6dd79 P 21a517d52d81404f9ae245428d42fed8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:35.531739 10652 tablet.cc:1724] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:35.536612 10282 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e35ad6dabd174fe29b0be23dbf63d97f"
dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
mode: GRACEFUL
new_leader_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
 from {username='slave'} at 127.0.0.1:36914
I20260709 13:17:35.544180 10282 raft_consensus.cc:606] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 LEADER]: Received request to transfer leadership to TS 9d6c512cfc2248c28e5ff72bf0fc06df
I20260709 13:17:35.552810 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:35.553462 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:35.574242 10103 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 52a24134fe5047e4bfaf109513392281: soft_deleted_table [id=5b9bfbb2b5ee48f7aabb157f2c72784d] alter complete (version 1)
I20260709 13:17:35.799641 10638 raft_consensus.cc:993] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a: : Instructing follower 9d6c512cfc2248c28e5ff72bf0fc06df to start an election
I20260709 13:17:35.800113 10638 raft_consensus.cc:1081] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 LEADER]: Signalling peer 9d6c512cfc2248c28e5ff72bf0fc06df to start an election
I20260709 13:17:35.801820 10351 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e35ad6dabd174fe29b0be23dbf63d97f"
dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
 from {username='slave'} at 127.0.0.1:36822
I20260709 13:17:35.802361 10351 raft_consensus.cc:493] T e35ad6dabd174fe29b0be23dbf63d97f P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:35.802664 10351 raft_consensus.cc:3060] T e35ad6dabd174fe29b0be23dbf63d97f P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.808704 10351 raft_consensus.cc:515] T e35ad6dabd174fe29b0be23dbf63d97f P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:35.811015 10351 leader_election.cc:290] T e35ad6dabd174fe29b0be23dbf63d97f P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 2 election: Requested vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427)
I20260709 13:17:35.811616 10630 raft_consensus.cc:993] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8: : Instructing follower 9d6c512cfc2248c28e5ff72bf0fc06df to start an election
I20260709 13:17:35.811939 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35ad6dabd174fe29b0be23dbf63d97f" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
I20260709 13:17:35.812196 10630 raft_consensus.cc:1081] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8 [term 2 LEADER]: Signalling peer 9d6c512cfc2248c28e5ff72bf0fc06df to start an election
I20260709 13:17:35.812016 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35ad6dabd174fe29b0be23dbf63d97f" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21a517d52d81404f9ae245428d42fed8"
I20260709 13:17:35.812647 10282 raft_consensus.cc:3055] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:35.812951 10204 raft_consensus.cc:3060] T e35ad6dabd174fe29b0be23dbf63d97f P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.813010 10282 raft_consensus.cc:740] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e7f9e723f3f54a4bb5e4c57869f40d7a, State: Running, Role: LEADER
I20260709 13:17:35.814248 10351 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1cf62842a6e4d3e8aba94cd94afb57b"
dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
 from {username='slave'} at 127.0.0.1:36810
I20260709 13:17:35.814074 10282 consensus_queue.cc:260] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:35.814827 10351 raft_consensus.cc:493] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:35.815218 10351 raft_consensus.cc:3060] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.815356 10282 raft_consensus.cc:3060] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.820803 10204 raft_consensus.cc:2468] T e35ad6dabd174fe29b0be23dbf63d97f P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 2.
I20260709 13:17:35.822441 10282 raft_consensus.cc:2468] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 2.
I20260709 13:17:35.822369 10323 leader_election.cc:304] T e35ad6dabd174fe29b0be23dbf63d97f P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, 9d6c512cfc2248c28e5ff72bf0fc06df; no voters: 
I20260709 13:17:35.822317 10351 raft_consensus.cc:515] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:35.823745 10656 raft_consensus.cc:2804] T e35ad6dabd174fe29b0be23dbf63d97f P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:35.824360 10656 raft_consensus.cc:697] T e35ad6dabd174fe29b0be23dbf63d97f P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 LEADER]: Becoming Leader. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Running, Role: LEADER
I20260709 13:17:35.826316 10656 consensus_queue.cc:237] T e35ad6dabd174fe29b0be23dbf63d97f P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:35.826886 10351 leader_election.cc:290] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 3 election: Requested vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427)
I20260709 13:17:35.827979 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1cf62842a6e4d3e8aba94cd94afb57b" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "21a517d52d81404f9ae245428d42fed8"
I20260709 13:17:35.828845 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1cf62842a6e4d3e8aba94cd94afb57b" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
I20260709 13:17:35.828953 10204 raft_consensus.cc:3055] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:35.829438 10204 raft_consensus.cc:740] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Running, Role: LEADER
I20260709 13:17:35.829466 10282 raft_consensus.cc:3060] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.830287 10204 consensus_queue.cc:260] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:35.831333 10204 raft_consensus.cc:3060] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.837014 10204 raft_consensus.cc:2468] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 3.
I20260709 13:17:35.838428 10323 leader_election.cc:304] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, 9d6c512cfc2248c28e5ff72bf0fc06df; no voters: 
I20260709 13:17:35.839401 10656 raft_consensus.cc:2804] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:35.840076 10656 raft_consensus.cc:697] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df [term 3 LEADER]: Becoming Leader. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Running, Role: LEADER
I20260709 13:17:35.840574 10282 raft_consensus.cc:2468] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 3.
I20260709 13:17:35.841044 10656 consensus_queue.cc:237] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:35.841575 10637 raft_consensus.cc:993] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8: : Instructing follower 9d6c512cfc2248c28e5ff72bf0fc06df to start an election
I20260709 13:17:35.842192 10637 raft_consensus.cc:1081] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8 [term 2 LEADER]: Signalling peer 9d6c512cfc2248c28e5ff72bf0fc06df to start an election
I20260709 13:17:35.844527 10351 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34e9bf7ab8d94fc992029d96d68291e4"
dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
 from {username='slave'} at 127.0.0.1:36810
I20260709 13:17:35.845073 10351 raft_consensus.cc:493] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:35.845381 10351 raft_consensus.cc:3060] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.847705 10106 catalog_manager.cc:5697] T e35ad6dabd174fe29b0be23dbf63d97f P 9d6c512cfc2248c28e5ff72bf0fc06df reported cstate change: term changed from 1 to 2, leader changed from e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2) to 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3). New cstate: current_term: 2 leader_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:35.851388 10351 raft_consensus.cc:515] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:35.853835 10351 leader_election.cc:290] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 3 election: Requested vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427)
I20260709 13:17:35.855424 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e9bf7ab8d94fc992029d96d68291e4" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
I20260709 13:17:35.857813 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e9bf7ab8d94fc992029d96d68291e4" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "21a517d52d81404f9ae245428d42fed8"
I20260709 13:17:35.858527 10282 raft_consensus.cc:3060] T 34e9bf7ab8d94fc992029d96d68291e4 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.858944 10204 raft_consensus.cc:3055] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:35.859339 10204 raft_consensus.cc:740] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 21a517d52d81404f9ae245428d42fed8, State: Running, Role: LEADER
I20260709 13:17:35.860185 10204 consensus_queue.cc:260] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:35.862911 10204 raft_consensus.cc:3060] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.867357 10106 catalog_manager.cc:5697] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df reported cstate change: term changed from 2 to 3, leader changed from 21a517d52d81404f9ae245428d42fed8 (127.30.63.1) to 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3). New cstate: current_term: 3 leader_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:35.870398 10282 raft_consensus.cc:2468] T 34e9bf7ab8d94fc992029d96d68291e4 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 3.
I20260709 13:17:35.870596 10204 raft_consensus.cc:2468] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 3.
I20260709 13:17:35.871651 10320 leader_election.cc:304] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6c512cfc2248c28e5ff72bf0fc06df, e7f9e723f3f54a4bb5e4c57869f40d7a; no voters: 
I20260709 13:17:35.872776 10656 raft_consensus.cc:2804] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:35.873246 10656 raft_consensus.cc:697] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 3 LEADER]: Becoming Leader. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Running, Role: LEADER
I20260709 13:17:35.874101 10656 consensus_queue.cc:237] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:35.877295 10598 raft_consensus.cc:993] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a: : Instructing follower 9d6c512cfc2248c28e5ff72bf0fc06df to start an election
I20260709 13:17:35.877835 10638 raft_consensus.cc:1081] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 LEADER]: Signalling peer 9d6c512cfc2248c28e5ff72bf0fc06df to start an election
I20260709 13:17:35.879482 10351 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "820297e85e1a490ea6da4d46b3f93f80"
dest_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df"
 from {username='slave'} at 127.0.0.1:36822
I20260709 13:17:35.880049 10351 raft_consensus.cc:493] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:35.880494 10351 raft_consensus.cc:3060] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.884330 10106 catalog_manager.cc:5697] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df reported cstate change: term changed from 2 to 3, leader changed from 21a517d52d81404f9ae245428d42fed8 (127.30.63.1) to 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3). New cstate: current_term: 3 leader_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:35.887933 10351 raft_consensus.cc:515] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:35.890036 10351 leader_election.cc:290] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 3 election: Requested vote from peers 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989), e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427)
I20260709 13:17:35.890790 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820297e85e1a490ea6da4d46b3f93f80" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "21a517d52d81404f9ae245428d42fed8"
I20260709 13:17:35.891530 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820297e85e1a490ea6da4d46b3f93f80" candidate_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a"
I20260709 13:17:35.892359 10282 raft_consensus.cc:3055] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:35.892797 10282 raft_consensus.cc:740] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e7f9e723f3f54a4bb5e4c57869f40d7a, State: Running, Role: LEADER
I20260709 13:17:35.892856 10204 raft_consensus.cc:3060] T 820297e85e1a490ea6da4d46b3f93f80 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.893916 10282 consensus_queue.cc:260] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:35.895229 10282 raft_consensus.cc:3060] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.900808 10204 raft_consensus.cc:2468] T 820297e85e1a490ea6da4d46b3f93f80 P 21a517d52d81404f9ae245428d42fed8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 3.
I20260709 13:17:35.902191 10323 leader_election.cc:304] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a517d52d81404f9ae245428d42fed8, 9d6c512cfc2248c28e5ff72bf0fc06df; no voters: 
I20260709 13:17:35.902304 10282 raft_consensus.cc:2468] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6c512cfc2248c28e5ff72bf0fc06df in term 3.
I20260709 13:17:35.903102 10656 raft_consensus.cc:2804] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:35.903666 10656 raft_consensus.cc:697] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 3 LEADER]: Becoming Leader. State: Replica: 9d6c512cfc2248c28e5ff72bf0fc06df, State: Running, Role: LEADER
I20260709 13:17:35.904489 10656 consensus_queue.cc:237] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } }
I20260709 13:17:35.912128 10106 catalog_manager.cc:5697] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df reported cstate change: term changed from 2 to 3, leader changed from e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2) to 9d6c512cfc2248c28e5ff72bf0fc06df (127.30.63.3). New cstate: current_term: 3 leader_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6c512cfc2248c28e5ff72bf0fc06df" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 41719 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:36.248461 10204 raft_consensus.cc:1275] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8 [term 3 FOLLOWER]: Refusing update from remote peer 9d6c512cfc2248c28e5ff72bf0fc06df: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:36.249763 10656 consensus_queue.cc:1048] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:36.260360 10280 raft_consensus.cc:1275] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [term 3 FOLLOWER]: Refusing update from remote peer 9d6c512cfc2248c28e5ff72bf0fc06df: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:36.262455 10656 consensus_queue.cc:1048] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:17:36.282379 10204 raft_consensus.cc:1275] T e35ad6dabd174fe29b0be23dbf63d97f P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Refusing update from remote peer 9d6c512cfc2248c28e5ff72bf0fc06df: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:36.284152 10666 consensus_queue.cc:1048] T e35ad6dabd174fe29b0be23dbf63d97f P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:36.299475 10280 raft_consensus.cc:1275] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Refusing update from remote peer 9d6c512cfc2248c28e5ff72bf0fc06df: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:36.305259 10666 consensus_queue.cc:1048] T e35ad6dabd174fe29b0be23dbf63d97f P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:36.356036 10280 raft_consensus.cc:1275] T 34e9bf7ab8d94fc992029d96d68291e4 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 3 FOLLOWER]: Refusing update from remote peer 9d6c512cfc2248c28e5ff72bf0fc06df: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:36.357388 10666 consensus_queue.cc:1048] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:36.362010 10204 raft_consensus.cc:1275] T 820297e85e1a490ea6da4d46b3f93f80 P 21a517d52d81404f9ae245428d42fed8 [term 3 FOLLOWER]: Refusing update from remote peer 9d6c512cfc2248c28e5ff72bf0fc06df: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:36.364547 10671 consensus_queue.cc:1048] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:36.366251 10204 raft_consensus.cc:1275] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8 [term 3 FOLLOWER]: Refusing update from remote peer 9d6c512cfc2248c28e5ff72bf0fc06df: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:36.371573 10671 consensus_queue.cc:1048] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a517d52d81404f9ae245428d42fed8" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 38989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:36.377158 10280 raft_consensus.cc:1275] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 3 FOLLOWER]: Refusing update from remote peer 9d6c512cfc2248c28e5ff72bf0fc06df: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:36.379029 10671 consensus_queue.cc:1048] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7f9e723f3f54a4bb5e4c57869f40d7a" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 46427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:36.615226 30972 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:17:36.620548 30972 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:17:36.621244 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:36.625972 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:17:36.626396 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:37.659991 30972 tablet_server.cc:179] TabletServer@127.30.63.1:0 shutting down...
I20260709 13:17:37.692085 30972 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:37.692965 30972 tablet_replica.cc:333] T fa6dd77092c7440ab9949cc582c38f52 P 21a517d52d81404f9ae245428d42fed8: stopping tablet replica
I20260709 13:17:37.693729 30972 raft_consensus.cc:2243] T fa6dd77092c7440ab9949cc582c38f52 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.694237 30972 raft_consensus.cc:2272] T fa6dd77092c7440ab9949cc582c38f52 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.696146 30972 tablet_replica.cc:333] T 7befc9a38bed4affbb60b2ac29a62328 P 21a517d52d81404f9ae245428d42fed8: stopping tablet replica
I20260709 13:17:37.696830 30972 raft_consensus.cc:2243] T 7befc9a38bed4affbb60b2ac29a62328 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.697342 30972 raft_consensus.cc:2272] T 7befc9a38bed4affbb60b2ac29a62328 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.699254 30972 tablet_replica.cc:333] T 820297e85e1a490ea6da4d46b3f93f80 P 21a517d52d81404f9ae245428d42fed8: stopping tablet replica
I20260709 13:17:37.699833 30972 raft_consensus.cc:2243] T 820297e85e1a490ea6da4d46b3f93f80 P 21a517d52d81404f9ae245428d42fed8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.700285 30972 raft_consensus.cc:2272] T 820297e85e1a490ea6da4d46b3f93f80 P 21a517d52d81404f9ae245428d42fed8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.702252 30972 tablet_replica.cc:333] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8: stopping tablet replica
I20260709 13:17:37.702838 30972 raft_consensus.cc:2243] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.703279 30972 raft_consensus.cc:2272] T 34e9bf7ab8d94fc992029d96d68291e4 P 21a517d52d81404f9ae245428d42fed8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.705268 30972 tablet_replica.cc:333] T 8d7a52940bd74fa4b2577722105b2f7e P 21a517d52d81404f9ae245428d42fed8: stopping tablet replica
I20260709 13:17:37.705827 30972 raft_consensus.cc:2243] T 8d7a52940bd74fa4b2577722105b2f7e P 21a517d52d81404f9ae245428d42fed8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.706589 30972 raft_consensus.cc:2272] T 8d7a52940bd74fa4b2577722105b2f7e P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.708680 30972 tablet_replica.cc:333] T 111172fb47f14e48baeee36903d67848 P 21a517d52d81404f9ae245428d42fed8: stopping tablet replica
I20260709 13:17:37.709275 30972 raft_consensus.cc:2243] T 111172fb47f14e48baeee36903d67848 P 21a517d52d81404f9ae245428d42fed8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.710011 30972 raft_consensus.cc:2272] T 111172fb47f14e48baeee36903d67848 P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.712136 30972 tablet_replica.cc:333] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 21a517d52d81404f9ae245428d42fed8: stopping tablet replica
I20260709 13:17:37.712781 30972 raft_consensus.cc:2243] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.713243 30972 raft_consensus.cc:2272] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.715023 30972 tablet_replica.cc:333] T 1fb9419407b247db8c0d9010e24e40e1 P 21a517d52d81404f9ae245428d42fed8: stopping tablet replica
I20260709 13:17:37.715565 30972 raft_consensus.cc:2243] T 1fb9419407b247db8c0d9010e24e40e1 P 21a517d52d81404f9ae245428d42fed8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.716382 30972 raft_consensus.cc:2272] T 1fb9419407b247db8c0d9010e24e40e1 P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.718364 30972 tablet_replica.cc:333] T 538fe68707244d72b1909ca4c2a6dd79 P 21a517d52d81404f9ae245428d42fed8: stopping tablet replica
I20260709 13:17:37.718909 30972 raft_consensus.cc:2243] T 538fe68707244d72b1909ca4c2a6dd79 P 21a517d52d81404f9ae245428d42fed8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.719656 30972 raft_consensus.cc:2272] T 538fe68707244d72b1909ca4c2a6dd79 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.721724 30972 tablet_replica.cc:333] T 01f1cef511614c43ae422c6fb06be9c4 P 21a517d52d81404f9ae245428d42fed8: stopping tablet replica
I20260709 13:17:37.722297 30972 raft_consensus.cc:2243] T 01f1cef511614c43ae422c6fb06be9c4 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.722750 30972 raft_consensus.cc:2272] T 01f1cef511614c43ae422c6fb06be9c4 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.724912 30972 tablet_replica.cc:333] T 86413c90120d4fae863df0ece3bebb3d P 21a517d52d81404f9ae245428d42fed8: stopping tablet replica
I20260709 13:17:37.725523 30972 raft_consensus.cc:2243] T 86413c90120d4fae863df0ece3bebb3d P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.725955 30972 raft_consensus.cc:2272] T 86413c90120d4fae863df0ece3bebb3d P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.728106 30972 tablet_replica.cc:333] T fc68869777e04563a9a887134320adf6 P 21a517d52d81404f9ae245428d42fed8: stopping tablet replica
I20260709 13:17:37.728732 30972 raft_consensus.cc:2243] T fc68869777e04563a9a887134320adf6 P 21a517d52d81404f9ae245428d42fed8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.729529 30972 raft_consensus.cc:2272] T fc68869777e04563a9a887134320adf6 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.731763 30972 tablet_replica.cc:333] T e35ad6dabd174fe29b0be23dbf63d97f P 21a517d52d81404f9ae245428d42fed8: stopping tablet replica
I20260709 13:17:37.732350 30972 raft_consensus.cc:2243] T e35ad6dabd174fe29b0be23dbf63d97f P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.732836 30972 raft_consensus.cc:2272] T e35ad6dabd174fe29b0be23dbf63d97f P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.735025 30972 tablet_replica.cc:333] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8: stopping tablet replica
I20260709 13:17:37.735688 30972 raft_consensus.cc:2243] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.736122 30972 raft_consensus.cc:2272] T 51391c6e644f4174b2a977865398bccd P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.737949 30972 tablet_replica.cc:333] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8: stopping tablet replica
I20260709 13:17:37.738458 30972 raft_consensus.cc:2243] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.738889 30972 raft_consensus.cc:2272] T a61096290231466cb5e7956f243a99a8 P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.741516 30972 tablet_replica.cc:333] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8: stopping tablet replica
I20260709 13:17:37.742156 30972 raft_consensus.cc:2243] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.742609 30972 raft_consensus.cc:2272] T c1cf62842a6e4d3e8aba94cd94afb57b P 21a517d52d81404f9ae245428d42fed8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.744694 30972 tablet_replica.cc:333] T 6f703c5bc8da416e9447e3c8d238725e P 21a517d52d81404f9ae245428d42fed8: stopping tablet replica
I20260709 13:17:37.745781 30972 raft_consensus.cc:2243] T 6f703c5bc8da416e9447e3c8d238725e P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.746429 30972 raft_consensus.cc:2272] T 6f703c5bc8da416e9447e3c8d238725e P 21a517d52d81404f9ae245428d42fed8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.748741 30972 tablet_replica.cc:333] T 7ce9af49a9d94f40bffa2d91089a906e P 21a517d52d81404f9ae245428d42fed8: stopping tablet replica
I20260709 13:17:37.749179 30972 raft_consensus.cc:2243] T 7ce9af49a9d94f40bffa2d91089a906e P 21a517d52d81404f9ae245428d42fed8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.750030 30972 raft_consensus.cc:2272] T 7ce9af49a9d94f40bffa2d91089a906e P 21a517d52d81404f9ae245428d42fed8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.795449 30972 tablet_server.cc:196] TabletServer@127.30.63.1:0 shutdown complete.
I20260709 13:17:37.830971 30972 tablet_server.cc:179] TabletServer@127.30.63.2:0 shutting down...
W20260709 13:17:37.841614 10320 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20260709 13:17:37.853847 10320 consensus_peers.cc:597] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df -> Peer e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427): Couldn't send request to peer e7f9e723f3f54a4bb5e4c57869f40d7a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.875699 30972 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:37.876561 30972 tablet_replica.cc:333] T 7befc9a38bed4affbb60b2ac29a62328 P e7f9e723f3f54a4bb5e4c57869f40d7a: stopping tablet replica
I20260709 13:17:37.877456 30972 raft_consensus.cc:2243] T 7befc9a38bed4affbb60b2ac29a62328 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.878206 30972 raft_consensus.cc:2272] T 7befc9a38bed4affbb60b2ac29a62328 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.880164 30972 tablet_replica.cc:333] T fa6dd77092c7440ab9949cc582c38f52 P e7f9e723f3f54a4bb5e4c57869f40d7a: stopping tablet replica
I20260709 13:17:37.880836 30972 raft_consensus.cc:2243] T fa6dd77092c7440ab9949cc582c38f52 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.881561 30972 raft_consensus.cc:2272] T fa6dd77092c7440ab9949cc582c38f52 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.883489 30972 tablet_replica.cc:333] T 111172fb47f14e48baeee36903d67848 P e7f9e723f3f54a4bb5e4c57869f40d7a: stopping tablet replica
I20260709 13:17:37.884054 30972 raft_consensus.cc:2243] T 111172fb47f14e48baeee36903d67848 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.884454 30972 raft_consensus.cc:2272] T 111172fb47f14e48baeee36903d67848 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.886670 30972 tablet_replica.cc:333] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a: stopping tablet replica
I20260709 13:17:37.887261 30972 raft_consensus.cc:2243] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.887697 30972 raft_consensus.cc:2272] T 820297e85e1a490ea6da4d46b3f93f80 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.889544 30972 tablet_replica.cc:333] T 34e9bf7ab8d94fc992029d96d68291e4 P e7f9e723f3f54a4bb5e4c57869f40d7a: stopping tablet replica
I20260709 13:17:37.890189 30972 raft_consensus.cc:2243] T 34e9bf7ab8d94fc992029d96d68291e4 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.890647 30972 raft_consensus.cc:2272] T 34e9bf7ab8d94fc992029d96d68291e4 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.892517 30972 tablet_replica.cc:333] T 8d7a52940bd74fa4b2577722105b2f7e P e7f9e723f3f54a4bb5e4c57869f40d7a: stopping tablet replica
I20260709 13:17:37.893114 30972 raft_consensus.cc:2243] T 8d7a52940bd74fa4b2577722105b2f7e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.893556 30972 raft_consensus.cc:2272] T 8d7a52940bd74fa4b2577722105b2f7e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.895444 30972 tablet_replica.cc:333] T 01f1cef511614c43ae422c6fb06be9c4 P e7f9e723f3f54a4bb5e4c57869f40d7a: stopping tablet replica
I20260709 13:17:37.896008 30972 raft_consensus.cc:2243] T 01f1cef511614c43ae422c6fb06be9c4 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.896883 30972 raft_consensus.cc:2272] T 01f1cef511614c43ae422c6fb06be9c4 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.898940 30972 tablet_replica.cc:333] T 86413c90120d4fae863df0ece3bebb3d P e7f9e723f3f54a4bb5e4c57869f40d7a: stopping tablet replica
I20260709 13:17:37.899467 30972 raft_consensus.cc:2243] T 86413c90120d4fae863df0ece3bebb3d P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.899930 30972 raft_consensus.cc:2272] T 86413c90120d4fae863df0ece3bebb3d P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.902050 30972 tablet_replica.cc:333] T fc68869777e04563a9a887134320adf6 P e7f9e723f3f54a4bb5e4c57869f40d7a: stopping tablet replica
I20260709 13:17:37.902590 30972 raft_consensus.cc:2243] T fc68869777e04563a9a887134320adf6 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.903043 30972 raft_consensus.cc:2272] T fc68869777e04563a9a887134320adf6 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.905061 30972 tablet_replica.cc:333] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a: stopping tablet replica
I20260709 13:17:37.905618 30972 raft_consensus.cc:2243] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.906033 30972 raft_consensus.cc:2272] T e35ad6dabd174fe29b0be23dbf63d97f P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.908366 30972 tablet_replica.cc:333] T 51391c6e644f4174b2a977865398bccd P e7f9e723f3f54a4bb5e4c57869f40d7a: stopping tablet replica
I20260709 13:17:37.909271 30972 raft_consensus.cc:2243] T 51391c6e644f4174b2a977865398bccd P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.909771 30972 raft_consensus.cc:2272] T 51391c6e644f4174b2a977865398bccd P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.912077 30972 tablet_replica.cc:333] T a61096290231466cb5e7956f243a99a8 P e7f9e723f3f54a4bb5e4c57869f40d7a: stopping tablet replica
W20260709 13:17:37.912683 10323 consensus_peers.cc:597] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df -> Peer 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989): Couldn't send request to peer 21a517d52d81404f9ae245428d42fed8. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:38989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.912988 30972 raft_consensus.cc:2243] T a61096290231466cb5e7956f243a99a8 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.913988 30972 raft_consensus.cc:2272] T a61096290231466cb5e7956f243a99a8 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.916029 30972 tablet_replica.cc:333] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P e7f9e723f3f54a4bb5e4c57869f40d7a: stopping tablet replica
I20260709 13:17:37.916508 30972 raft_consensus.cc:2243] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.917291 30972 raft_consensus.cc:2272] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.919018 30972 tablet_replica.cc:333] T 538fe68707244d72b1909ca4c2a6dd79 P e7f9e723f3f54a4bb5e4c57869f40d7a: stopping tablet replica
I20260709 13:17:37.919592 30972 raft_consensus.cc:2243] T 538fe68707244d72b1909ca4c2a6dd79 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.920099 30972 raft_consensus.cc:2272] T 538fe68707244d72b1909ca4c2a6dd79 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:37.922209 10320 consensus_peers.cc:597] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df -> Peer e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427): Couldn't send request to peer e7f9e723f3f54a4bb5e4c57869f40d7a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.922240 30972 tablet_replica.cc:333] T 1fb9419407b247db8c0d9010e24e40e1 P e7f9e723f3f54a4bb5e4c57869f40d7a: stopping tablet replica
I20260709 13:17:37.923319 30972 raft_consensus.cc:2243] T 1fb9419407b247db8c0d9010e24e40e1 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.923882 30972 raft_consensus.cc:2272] T 1fb9419407b247db8c0d9010e24e40e1 P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.926543 30972 tablet_replica.cc:333] T 6f703c5bc8da416e9447e3c8d238725e P e7f9e723f3f54a4bb5e4c57869f40d7a: stopping tablet replica
W20260709 13:17:37.927058 10323 consensus_peers.cc:597] T e35ad6dabd174fe29b0be23dbf63d97f P 9d6c512cfc2248c28e5ff72bf0fc06df -> Peer 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989): Couldn't send request to peer 21a517d52d81404f9ae245428d42fed8. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:38989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.927239 30972 raft_consensus.cc:2243] T 6f703c5bc8da416e9447e3c8d238725e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.928123 30972 raft_consensus.cc:2272] T 6f703c5bc8da416e9447e3c8d238725e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.930305 30972 tablet_replica.cc:333] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a: stopping tablet replica
I20260709 13:17:37.930744 30972 raft_consensus.cc:2243] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.931119 30972 raft_consensus.cc:2272] T c1cf62842a6e4d3e8aba94cd94afb57b P e7f9e723f3f54a4bb5e4c57869f40d7a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.933053 30972 tablet_replica.cc:333] T 7ce9af49a9d94f40bffa2d91089a906e P e7f9e723f3f54a4bb5e4c57869f40d7a: stopping tablet replica
I20260709 13:17:37.933488 30972 raft_consensus.cc:2243] T 7ce9af49a9d94f40bffa2d91089a906e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.933964 30972 raft_consensus.cc:2272] T 7ce9af49a9d94f40bffa2d91089a906e P e7f9e723f3f54a4bb5e4c57869f40d7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.965539 30972 tablet_server.cc:196] TabletServer@127.30.63.2:0 shutdown complete.
W20260709 13:17:37.991525 10320 consensus_peers.cc:597] T 51391c6e644f4174b2a977865398bccd P 9d6c512cfc2248c28e5ff72bf0fc06df -> Peer e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427): Couldn't send request to peer e7f9e723f3f54a4bb5e4c57869f40d7a. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:46427: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:38.001281 30972 tablet_server.cc:179] TabletServer@127.30.63.3:0 shutting down...
W20260709 13:17:38.023669 10323 consensus_peers.cc:597] T 51391c6e644f4174b2a977865398bccd P 9d6c512cfc2248c28e5ff72bf0fc06df -> Peer 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989): Couldn't send request to peer 21a517d52d81404f9ae245428d42fed8. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:38989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:38.031338 10323 consensus_peers.cc:597] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df -> Peer 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989): Couldn't send request to peer 21a517d52d81404f9ae245428d42fed8. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:38989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:38.035651 30972 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:38.036530 30972 tablet_replica.cc:333] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df: stopping tablet replica
I20260709 13:17:38.037238 30972 raft_consensus.cc:2243] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.037762 30972 raft_consensus.cc:2272] T 7befc9a38bed4affbb60b2ac29a62328 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.039865 30972 tablet_replica.cc:333] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df: stopping tablet replica
I20260709 13:17:38.040539 30972 raft_consensus.cc:2243] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.041077 30972 raft_consensus.cc:2272] T fa6dd77092c7440ab9949cc582c38f52 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.043159 30972 tablet_replica.cc:333] T 111172fb47f14e48baeee36903d67848 P 9d6c512cfc2248c28e5ff72bf0fc06df: stopping tablet replica
I20260709 13:17:38.043773 30972 raft_consensus.cc:2243] T 111172fb47f14e48baeee36903d67848 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:17:38.044167 10323 consensus_peers.cc:597] T 86413c90120d4fae863df0ece3bebb3d P 9d6c512cfc2248c28e5ff72bf0fc06df -> Peer 21a517d52d81404f9ae245428d42fed8 (127.30.63.1:38989): Couldn't send request to peer 21a517d52d81404f9ae245428d42fed8. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:38989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:38.044248 30972 raft_consensus.cc:2272] T 111172fb47f14e48baeee36903d67848 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.046515 30972 tablet_replica.cc:333] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df: stopping tablet replica
I20260709 13:17:38.047156 30972 raft_consensus.cc:2243] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:38.047928 30972 raft_consensus.cc:2272] T 820297e85e1a490ea6da4d46b3f93f80 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.049965 30972 tablet_replica.cc:333] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df: stopping tablet replica
I20260709 13:17:38.050536 30972 raft_consensus.cc:2243] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:38.051296 30972 raft_consensus.cc:2272] T 34e9bf7ab8d94fc992029d96d68291e4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.053673 30972 tablet_replica.cc:333] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df: stopping tablet replica
I20260709 13:17:38.054256 30972 raft_consensus.cc:2243] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.054843 30972 raft_consensus.cc:2272] T ec0d67d4e5a84f3ab998b18ddbdbe1e0 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:38.056419 10320 consensus_peers.cc:597] T 86413c90120d4fae863df0ece3bebb3d P 9d6c512cfc2248c28e5ff72bf0fc06df -> Peer e7f9e723f3f54a4bb5e4c57869f40d7a (127.30.63.2:46427): Couldn't send request to peer e7f9e723f3f54a4bb5e4c57869f40d7a. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.2:46427: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:38.056744 30972 tablet_replica.cc:333] T 1fb9419407b247db8c0d9010e24e40e1 P 9d6c512cfc2248c28e5ff72bf0fc06df: stopping tablet replica
I20260709 13:17:38.057457 30972 raft_consensus.cc:2243] T 1fb9419407b247db8c0d9010e24e40e1 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.057888 30972 raft_consensus.cc:2272] T 1fb9419407b247db8c0d9010e24e40e1 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.059932 30972 tablet_replica.cc:333] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df: stopping tablet replica
I20260709 13:17:38.060523 30972 raft_consensus.cc:2243] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.061038 30972 raft_consensus.cc:2272] T 538fe68707244d72b1909ca4c2a6dd79 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.063140 30972 tablet_replica.cc:333] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df: stopping tablet replica
I20260709 13:17:38.063834 30972 raft_consensus.cc:2243] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.064296 30972 raft_consensus.cc:2272] T 8d7a52940bd74fa4b2577722105b2f7e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.066319 30972 tablet_replica.cc:333] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df: stopping tablet replica
I20260709 13:17:38.066927 30972 raft_consensus.cc:2243] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.067402 30972 raft_consensus.cc:2272] T fc68869777e04563a9a887134320adf6 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.069527 30972 tablet_replica.cc:333] T e35ad6dabd174fe29b0be23dbf63d97f P 9d6c512cfc2248c28e5ff72bf0fc06df: stopping tablet replica
I20260709 13:17:38.070101 30972 raft_consensus.cc:2243] T e35ad6dabd174fe29b0be23dbf63d97f P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:38.071022 30972 raft_consensus.cc:2272] T e35ad6dabd174fe29b0be23dbf63d97f P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.073217 30972 tablet_replica.cc:333] T 86413c90120d4fae863df0ece3bebb3d P 9d6c512cfc2248c28e5ff72bf0fc06df: stopping tablet replica
I20260709 13:17:38.073731 30972 raft_consensus.cc:2243] T 86413c90120d4fae863df0ece3bebb3d P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:38.074488 30972 raft_consensus.cc:2272] T 86413c90120d4fae863df0ece3bebb3d P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.077497 30972 tablet_replica.cc:333] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df: stopping tablet replica
I20260709 13:17:38.078449 30972 raft_consensus.cc:2243] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.079141 30972 raft_consensus.cc:2272] T 01f1cef511614c43ae422c6fb06be9c4 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.082206 30972 tablet_replica.cc:333] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df: stopping tablet replica
I20260709 13:17:38.082811 30972 raft_consensus.cc:2243] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.083343 30972 raft_consensus.cc:2272] T 6f703c5bc8da416e9447e3c8d238725e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.086057 30972 tablet_replica.cc:333] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df: stopping tablet replica
I20260709 13:17:38.086872 30972 raft_consensus.cc:2243] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:38.087935 30972 raft_consensus.cc:2272] T c1cf62842a6e4d3e8aba94cd94afb57b P 9d6c512cfc2248c28e5ff72bf0fc06df [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.091079 30972 tablet_replica.cc:333] T 51391c6e644f4174b2a977865398bccd P 9d6c512cfc2248c28e5ff72bf0fc06df: stopping tablet replica
I20260709 13:17:38.091899 30972 raft_consensus.cc:2243] T 51391c6e644f4174b2a977865398bccd P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:38.093003 30972 raft_consensus.cc:2272] T 51391c6e644f4174b2a977865398bccd P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.095373 30972 tablet_replica.cc:333] T a61096290231466cb5e7956f243a99a8 P 9d6c512cfc2248c28e5ff72bf0fc06df: stopping tablet replica
I20260709 13:17:38.095904 30972 raft_consensus.cc:2243] T a61096290231466cb5e7956f243a99a8 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.096365 30972 raft_consensus.cc:2272] T a61096290231466cb5e7956f243a99a8 P 9d6c512cfc2248c28e5ff72bf0fc06df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.098699 30972 tablet_replica.cc:333] T 7ce9af49a9d94f40bffa2d91089a906e P 9d6c512cfc2248c28e5ff72bf0fc06df: stopping tablet replica
I20260709 13:17:38.099186 30972 raft_consensus.cc:2243] T 7ce9af49a9d94f40bffa2d91089a906e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.099584 30972 raft_consensus.cc:2272] T 7ce9af49a9d94f40bffa2d91089a906e P 9d6c512cfc2248c28e5ff72bf0fc06df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.151999 30972 tablet_server.cc:196] TabletServer@127.30.63.3:0 shutdown complete.
I20260709 13:17:38.184479 30972 master.cc:562] Master@127.30.63.62:39875 shutting down...
I20260709 13:17:38.213378 30972 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 52a24134fe5047e4bfaf109513392281 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:38.213948 30972 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 52a24134fe5047e4bfaf109513392281 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.214293 30972 tablet_replica.cc:333] T 00000000000000000000000000000000 P 52a24134fe5047e4bfaf109513392281: stopping tablet replica
I20260709 13:17:38.235212 30972 master.cc:584] Master@127.30.63.62:39875 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (13156 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:17:38.291723 30972 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.30.63.62:46421
I20260709 13:17:38.293059 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:38.299338 10678 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:38.299423 10679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:38.300393 10681 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:38.301432 30972 server_base.cc:1061] running on GCE node
I20260709 13:17:38.302426 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:38.302663 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:38.302850 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783603058302831 us; error 0 us; skew 500 ppm
I20260709 13:17:38.303416 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:38.306589 30972 webserver.cc:533] Webserver started at http://127.30.63.62:45279/ using document root <none> and password file <none>
I20260709 13:17:38.307138 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:38.307379 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:38.307675 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:38.308933 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602730526113-30972-0/minicluster-data/master-0-root/instance:
uuid: "54007ed6452045f4807f96f9f96bd4e2"
format_stamp: "Formatted at 2026-07-09 13:17:38 on dist-test-slave-c08m"
I20260709 13:17:38.314016 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:17:38.317690 10686 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:38.318641 30972 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:17:38.318904 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602730526113-30972-0/minicluster-data/master-0-root
uuid: "54007ed6452045f4807f96f9f96bd4e2"
format_stamp: "Formatted at 2026-07-09 13:17:38 on dist-test-slave-c08m"
I20260709 13:17:38.319152 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602730526113-30972-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602730526113-30972-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602730526113-30972-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:38.344045 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:38.345268 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:38.384313 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.62:46421
I20260709 13:17:38.384425 10737 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.62:46421 every 8 connection(s)
I20260709 13:17:38.388087 10738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:38.399705 10738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54007ed6452045f4807f96f9f96bd4e2: Bootstrap starting.
I20260709 13:17:38.404793 10738 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 54007ed6452045f4807f96f9f96bd4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:38.409231 10738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54007ed6452045f4807f96f9f96bd4e2: No bootstrap required, opened a new log
I20260709 13:17:38.411520 10738 raft_consensus.cc:359] T 00000000000000000000000000000000 P 54007ed6452045f4807f96f9f96bd4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54007ed6452045f4807f96f9f96bd4e2" member_type: VOTER }
I20260709 13:17:38.411937 10738 raft_consensus.cc:385] T 00000000000000000000000000000000 P 54007ed6452045f4807f96f9f96bd4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:38.412194 10738 raft_consensus.cc:740] T 00000000000000000000000000000000 P 54007ed6452045f4807f96f9f96bd4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54007ed6452045f4807f96f9f96bd4e2, State: Initialized, Role: FOLLOWER
I20260709 13:17:38.412990 10738 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54007ed6452045f4807f96f9f96bd4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54007ed6452045f4807f96f9f96bd4e2" member_type: VOTER }
I20260709 13:17:38.413468 10738 raft_consensus.cc:399] T 00000000000000000000000000000000 P 54007ed6452045f4807f96f9f96bd4e2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:17:38.413668 10738 raft_consensus.cc:493] T 00000000000000000000000000000000 P 54007ed6452045f4807f96f9f96bd4e2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:17:38.413975 10738 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 54007ed6452045f4807f96f9f96bd4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:38.418874 10738 raft_consensus.cc:515] T 00000000000000000000000000000000 P 54007ed6452045f4807f96f9f96bd4e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54007ed6452045f4807f96f9f96bd4e2" member_type: VOTER }
I20260709 13:17:38.419427 10738 leader_election.cc:304] T 00000000000000000000000000000000 P 54007ed6452045f4807f96f9f96bd4e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 54007ed6452045f4807f96f9f96bd4e2; no voters: 
I20260709 13:17:38.421134 10738 leader_election.cc:290] T 00000000000000000000000000000000 P 54007ed6452045f4807f96f9f96bd4e2 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:17:38.421525 10741 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 54007ed6452045f4807f96f9f96bd4e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:38.422873 10741 raft_consensus.cc:697] T 00000000000000000000000000000000 P 54007ed6452045f4807f96f9f96bd4e2 [term 1 LEADER]: Becoming Leader. State: Replica: 54007ed6452045f4807f96f9f96bd4e2, State: Running, Role: LEADER
I20260709 13:17:38.423542 10741 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54007ed6452045f4807f96f9f96bd4e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54007ed6452045f4807f96f9f96bd4e2" member_type: VOTER }
I20260709 13:17:38.424124 10738 sys_catalog.cc:565] T 00000000000000000000000000000000 P 54007ed6452045f4807f96f9f96bd4e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:17:38.427982 10742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54007ed6452045f4807f96f9f96bd4e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "54007ed6452045f4807f96f9f96bd4e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54007ed6452045f4807f96f9f96bd4e2" member_type: VOTER } }
I20260709 13:17:38.428866 10742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54007ed6452045f4807f96f9f96bd4e2 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:38.429021 10743 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54007ed6452045f4807f96f9f96bd4e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54007ed6452045f4807f96f9f96bd4e2. Latest consensus state: current_term: 1 leader_uuid: "54007ed6452045f4807f96f9f96bd4e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54007ed6452045f4807f96f9f96bd4e2" member_type: VOTER } }
I20260709 13:17:38.430680 10743 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54007ed6452045f4807f96f9f96bd4e2 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:38.432368 10748 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:17:38.440411 10748 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:17:38.441545 30972 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:17:38.449719 10748 catalog_manager.cc:1383] Generated new cluster ID: d13585aac5574c30b84771eb5949e83a
I20260709 13:17:38.450037 10748 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:17:38.475309 10748 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:17:38.476657 10748 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:17:38.494911 10748 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 54007ed6452045f4807f96f9f96bd4e2: Generated new TSK 0
I20260709 13:17:38.495589 10748 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:17:38.508777 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:38.515272 10759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:38.515976 10760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:38.518711 30972 server_base.cc:1061] running on GCE node
W20260709 13:17:38.518808 10762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:38.520238 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:38.520500 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:38.520706 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783603058520689 us; error 0 us; skew 500 ppm
I20260709 13:17:38.521281 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:38.523695 30972 webserver.cc:533] Webserver started at http://127.30.63.1:45635/ using document root <none> and password file <none>
I20260709 13:17:38.524163 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:38.524327 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:38.524534 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:38.525765 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602730526113-30972-0/minicluster-data/ts-0-root/instance:
uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
format_stamp: "Formatted at 2026-07-09 13:17:38 on dist-test-slave-c08m"
I20260709 13:17:38.530191 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:17:38.533890 10767 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:38.534966 30972 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:17:38.535347 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602730526113-30972-0/minicluster-data/ts-0-root
uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
format_stamp: "Formatted at 2026-07-09 13:17:38 on dist-test-slave-c08m"
I20260709 13:17:38.535763 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602730526113-30972-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602730526113-30972-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602730526113-30972-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:38.544868 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:38.546092 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:38.547639 30972 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:38.549981 30972 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:38.550225 30972 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:38.550484 30972 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:38.550674 30972 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:38.593535 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.1:42789
I20260709 13:17:38.593640 10829 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.1:42789 every 8 connection(s)
I20260709 13:17:38.598671 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:38.606134 10834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:38.608224 10835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:38.611617 10837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:38.612607 30972 server_base.cc:1061] running on GCE node
I20260709 13:17:38.614065 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:38.614301 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:38.614543 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783603058614523 us; error 0 us; skew 500 ppm
I20260709 13:17:38.614663 10830 heartbeater.cc:344] Connected to a master server at 127.30.63.62:46421
I20260709 13:17:38.615083 10830 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:38.615314 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:38.615939 10830 heartbeater.cc:507] Master 127.30.63.62:46421 requested a full tablet report, sending...
I20260709 13:17:38.618175 30972 webserver.cc:533] Webserver started at http://127.30.63.2:40375/ using document root <none> and password file <none>
I20260709 13:17:38.618626 10703 ts_manager.cc:194] Registered new tserver with Master: 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789)
I20260709 13:17:38.618923 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:38.619218 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:38.619537 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:38.620999 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602730526113-30972-0/minicluster-data/ts-1-root/instance:
uuid: "d567067363bd4266815405d14c8c42c4"
format_stamp: "Formatted at 2026-07-09 13:17:38 on dist-test-slave-c08m"
I20260709 13:17:38.621155 10703 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45640
I20260709 13:17:38.626575 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:17:38.629977 10842 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:38.630833 30972 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:17:38.631201 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602730526113-30972-0/minicluster-data/ts-1-root
uuid: "d567067363bd4266815405d14c8c42c4"
format_stamp: "Formatted at 2026-07-09 13:17:38 on dist-test-slave-c08m"
I20260709 13:17:38.631560 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602730526113-30972-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602730526113-30972-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602730526113-30972-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:38.677868 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:38.679100 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:38.680652 30972 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:38.682912 30972 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:38.683136 30972 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:38.683386 30972 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:38.683557 30972 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:38.725417 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.2:37809
I20260709 13:17:38.725533 10904 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.2:37809 every 8 connection(s)
I20260709 13:17:38.730460 30972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:38.739262 10908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:38.740151 10909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:38.743475 10905 heartbeater.cc:344] Connected to a master server at 127.30.63.62:46421
I20260709 13:17:38.744024 10905 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:38.745126 10905 heartbeater.cc:507] Master 127.30.63.62:46421 requested a full tablet report, sending...
I20260709 13:17:38.745299 30972 server_base.cc:1061] running on GCE node
W20260709 13:17:38.747624 10911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:38.747822 10703 ts_manager.cc:194] Registered new tserver with Master: d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809)
I20260709 13:17:38.748754 30972 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:38.748997 30972 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:38.749177 30972 hybrid_clock.cc:648] HybridClock initialized: now 1783603058749164 us; error 0 us; skew 500 ppm
I20260709 13:17:38.749568 10703 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45652
I20260709 13:17:38.749771 30972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:38.752637 30972 webserver.cc:533] Webserver started at http://127.30.63.3:33397/ using document root <none> and password file <none>
I20260709 13:17:38.753149 30972 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:38.753381 30972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:38.753660 30972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:38.754828 30972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602730526113-30972-0/minicluster-data/ts-2-root/instance:
uuid: "b47d3fdd5d61449593b05bde3b67069f"
format_stamp: "Formatted at 2026-07-09 13:17:38 on dist-test-slave-c08m"
I20260709 13:17:38.759588 30972 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:17:38.763029 10916 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:38.763976 30972 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:17:38.764403 30972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602730526113-30972-0/minicluster-data/ts-2-root
uuid: "b47d3fdd5d61449593b05bde3b67069f"
format_stamp: "Formatted at 2026-07-09 13:17:38 on dist-test-slave-c08m"
I20260709 13:17:38.764783 30972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602730526113-30972-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602730526113-30972-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskdU7IdQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602730526113-30972-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:38.904076 30972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:38.919075 30972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:38.946262 30972 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:39.165759 30972 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:39.166158 30972 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:17:39.166481 30972 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:39.166708 30972 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:39.249401 30972 rpc_server.cc:307] RPC server started. Bound to: 127.30.63.3:42139
I20260709 13:17:39.249516 10978 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.63.3:42139 every 8 connection(s)
I20260709 13:17:39.267182 10979 heartbeater.cc:344] Connected to a master server at 127.30.63.62:46421
I20260709 13:17:39.267679 10979 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:39.268417 10979 heartbeater.cc:507] Master 127.30.63.62:46421 requested a full tablet report, sending...
I20260709 13:17:39.270769 10703 ts_manager.cc:194] Registered new tserver with Master: b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:39.271672 30972 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019014994s
I20260709 13:17:39.272300 10703 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45666
I20260709 13:17:39.300212 10703 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45676:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:39.303032 10703 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:39.386806 10795 tablet_service.cc:1511] Processing CreateTablet for tablet 7a876d18e09a4577a85ca26975da0e8d (DEFAULT_TABLE table=test-workload [id=2b505cf9a43847438e72354eb2b67854]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:39.388298 10795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a876d18e09a4577a85ca26975da0e8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.389508 10793 tablet_service.cc:1511] Processing CreateTablet for tablet 11aa1269fea7424ea33a0e9bcd4e64fb (DEFAULT_TABLE table=test-workload [id=2b505cf9a43847438e72354eb2b67854]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:39.390859 10793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11aa1269fea7424ea33a0e9bcd4e64fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.391700 10791 tablet_service.cc:1511] Processing CreateTablet for tablet 40f935f4b4a54f5d9b3093d4f5e1b058 (DEFAULT_TABLE table=test-workload [id=2b505cf9a43847438e72354eb2b67854]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:39.392661 10792 tablet_service.cc:1511] Processing CreateTablet for tablet 81eef65db7ff4e8cb37f06a3decd4320 (DEFAULT_TABLE table=test-workload [id=2b505cf9a43847438e72354eb2b67854]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:39.387888 10794 tablet_service.cc:1511] Processing CreateTablet for tablet 26ad1205065a48b29567ed4c89b20059 (DEFAULT_TABLE table=test-workload [id=2b505cf9a43847438e72354eb2b67854]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:39.394778 10944 tablet_service.cc:1511] Processing CreateTablet for tablet 7a876d18e09a4577a85ca26975da0e8d (DEFAULT_TABLE table=test-workload [id=2b505cf9a43847438e72354eb2b67854]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:39.396137 10944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a876d18e09a4577a85ca26975da0e8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.396327 10941 tablet_service.cc:1511] Processing CreateTablet for tablet 81eef65db7ff4e8cb37f06a3decd4320 (DEFAULT_TABLE table=test-workload [id=2b505cf9a43847438e72354eb2b67854]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:39.396201 10791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f935f4b4a54f5d9b3093d4f5e1b058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.397791 10941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81eef65db7ff4e8cb37f06a3decd4320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.398160 10792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81eef65db7ff4e8cb37f06a3decd4320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.401513 10794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26ad1205065a48b29567ed4c89b20059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.401238 10942 tablet_service.cc:1511] Processing CreateTablet for tablet 11aa1269fea7424ea33a0e9bcd4e64fb (DEFAULT_TABLE table=test-workload [id=2b505cf9a43847438e72354eb2b67854]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:39.402657 10942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11aa1269fea7424ea33a0e9bcd4e64fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.405540 10943 tablet_service.cc:1511] Processing CreateTablet for tablet 26ad1205065a48b29567ed4c89b20059 (DEFAULT_TABLE table=test-workload [id=2b505cf9a43847438e72354eb2b67854]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:39.406987 10943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26ad1205065a48b29567ed4c89b20059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.428731 10940 tablet_service.cc:1511] Processing CreateTablet for tablet 40f935f4b4a54f5d9b3093d4f5e1b058 (DEFAULT_TABLE table=test-workload [id=2b505cf9a43847438e72354eb2b67854]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:39.430338 10940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f935f4b4a54f5d9b3093d4f5e1b058. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:39.436163 10751 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:39.440493 10870 tablet_service.cc:1511] Processing CreateTablet for tablet 7a876d18e09a4577a85ca26975da0e8d (DEFAULT_TABLE table=test-workload [id=2b505cf9a43847438e72354eb2b67854]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:39.441625 10869 tablet_service.cc:1511] Processing CreateTablet for tablet 26ad1205065a48b29567ed4c89b20059 (DEFAULT_TABLE table=test-workload [id=2b505cf9a43847438e72354eb2b67854]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:39.442682 10868 tablet_service.cc:1511] Processing CreateTablet for tablet 11aa1269fea7424ea33a0e9bcd4e64fb (DEFAULT_TABLE table=test-workload [id=2b505cf9a43847438e72354eb2b67854]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:39.451081 10939 tablet_service.cc:1511] Processing CreateTablet for tablet bea59f51efa648ea8d820e99be4bc7d3 (DEFAULT_TABLE table=test-workload [id=2b505cf9a43847438e72354eb2b67854]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:39.450860 10791 tablet_service.cc:1511] Processing CreateTablet for tablet bea59f51efa648ea8d820e99be4bc7d3 (DEFAULT_TABLE table=test-workload [id=2b505cf9a43847438e72354eb2b67854]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:39.466389 10939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bea59f51efa648ea8d820e99be4bc7d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.466815 10791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bea59f51efa648ea8d820e99be4bc7d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.466988 10865 tablet_service.cc:1511] Processing CreateTablet for tablet bea59f51efa648ea8d820e99be4bc7d3 (DEFAULT_TABLE table=test-workload [id=2b505cf9a43847438e72354eb2b67854]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:39.454917 10938 tablet_service.cc:1511] Processing CreateTablet for tablet c7d24f498cb84dd2b9139031f8e00a57 (DEFAULT_TABLE table=test-workload [id=2b505cf9a43847438e72354eb2b67854]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:39.459015 10867 tablet_service.cc:1511] Processing CreateTablet for tablet 81eef65db7ff4e8cb37f06a3decd4320 (DEFAULT_TABLE table=test-workload [id=2b505cf9a43847438e72354eb2b67854]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:39.470518 10938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7d24f498cb84dd2b9139031f8e00a57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.470170 10864 tablet_service.cc:1511] Processing CreateTablet for tablet c7d24f498cb84dd2b9139031f8e00a57 (DEFAULT_TABLE table=test-workload [id=2b505cf9a43847438e72354eb2b67854]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:39.457237 10866 tablet_service.cc:1511] Processing CreateTablet for tablet 40f935f4b4a54f5d9b3093d4f5e1b058 (DEFAULT_TABLE table=test-workload [id=2b505cf9a43847438e72354eb2b67854]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:39.453471 10793 tablet_service.cc:1511] Processing CreateTablet for tablet c7d24f498cb84dd2b9139031f8e00a57 (DEFAULT_TABLE table=test-workload [id=2b505cf9a43847438e72354eb2b67854]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:39.460472 10794 tablet_service.cc:1511] Processing CreateTablet for tablet f1a15aa0b7ce423386027dfe9aced682 (DEFAULT_TABLE table=test-workload [id=2b505cf9a43847438e72354eb2b67854]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:39.464174 10870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a876d18e09a4577a85ca26975da0e8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.473902 10793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7d24f498cb84dd2b9139031f8e00a57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.473555 10863 tablet_service.cc:1511] Processing CreateTablet for tablet f1a15aa0b7ce423386027dfe9aced682 (DEFAULT_TABLE table=test-workload [id=2b505cf9a43847438e72354eb2b67854]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:39.474941 10863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a15aa0b7ce423386027dfe9aced682. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.476202 10864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7d24f498cb84dd2b9139031f8e00a57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.478489 10999 tablet_bootstrap.cc:492] T 7a876d18e09a4577a85ca26975da0e8d P 4b7d4704a4404bb19c3053c6b0af4d90: Bootstrap starting.
I20260709 13:17:39.481150 10869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26ad1205065a48b29567ed4c89b20059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.484978 10867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81eef65db7ff4e8cb37f06a3decd4320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.490072 10865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bea59f51efa648ea8d820e99be4bc7d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.490343 10795 tablet_service.cc:1511] Processing CreateTablet for tablet e373165d4f2844d882994be5887e5ddf (DEFAULT_TABLE table=test-workload [id=2b505cf9a43847438e72354eb2b67854]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:39.492568 10866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f935f4b4a54f5d9b3093d4f5e1b058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.493431 10795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e373165d4f2844d882994be5887e5ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.496275 10868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11aa1269fea7424ea33a0e9bcd4e64fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.499948 10998 tablet_bootstrap.cc:492] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f: Bootstrap starting.
I20260709 13:17:39.500378 10862 tablet_service.cc:1511] Processing CreateTablet for tablet e373165d4f2844d882994be5887e5ddf (DEFAULT_TABLE table=test-workload [id=2b505cf9a43847438e72354eb2b67854]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:39.501787 10862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e373165d4f2844d882994be5887e5ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.500815 10794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a15aa0b7ce423386027dfe9aced682. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.504550 10937 tablet_service.cc:1511] Processing CreateTablet for tablet e373165d4f2844d882994be5887e5ddf (DEFAULT_TABLE table=test-workload [id=2b505cf9a43847438e72354eb2b67854]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:39.506037 10937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e373165d4f2844d882994be5887e5ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.522776 10944 tablet_service.cc:1511] Processing CreateTablet for tablet f1a15aa0b7ce423386027dfe9aced682 (DEFAULT_TABLE table=test-workload [id=2b505cf9a43847438e72354eb2b67854]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:39.529978 10999 tablet_bootstrap.cc:654] T 7a876d18e09a4577a85ca26975da0e8d P 4b7d4704a4404bb19c3053c6b0af4d90: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.530815 10944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a15aa0b7ce423386027dfe9aced682. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.533771 10998 tablet_bootstrap.cc:654] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.543246 10999 tablet_bootstrap.cc:492] T 7a876d18e09a4577a85ca26975da0e8d P 4b7d4704a4404bb19c3053c6b0af4d90: No bootstrap required, opened a new log
I20260709 13:17:39.543972 10999 ts_tablet_manager.cc:1403] T 7a876d18e09a4577a85ca26975da0e8d P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent bootstrapping tablet: real 0.066s	user 0.013s	sys 0.000s
I20260709 13:17:39.547611 10999 raft_consensus.cc:359] T 7a876d18e09a4577a85ca26975da0e8d P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } }
I20260709 13:17:39.548288 10999 raft_consensus.cc:385] T 7a876d18e09a4577a85ca26975da0e8d P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.548537 10999 raft_consensus.cc:740] T 7a876d18e09a4577a85ca26975da0e8d P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.549503 10999 consensus_queue.cc:260] T 7a876d18e09a4577a85ca26975da0e8d P 4b7d4704a4404bb19c3053c6b0af4d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } }
I20260709 13:17:39.550415 10998 tablet_bootstrap.cc:492] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f: No bootstrap required, opened a new log
I20260709 13:17:39.551136 10998 ts_tablet_manager.cc:1403] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.009s
I20260709 13:17:39.555276 10998 raft_consensus.cc:359] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } }
I20260709 13:17:39.556318 10998 raft_consensus.cc:385] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.556802 10998 raft_consensus.cc:740] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b47d3fdd5d61449593b05bde3b67069f, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.557801 10998 consensus_queue.cc:260] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } }
I20260709 13:17:39.558621 10999 ts_tablet_manager.cc:1434] T 7a876d18e09a4577a85ca26975da0e8d P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.008s
I20260709 13:17:39.559535 10830 heartbeater.cc:499] Master 127.30.63.62:46421 was elected leader, sending a full tablet report...
I20260709 13:17:39.563589 11002 tablet_bootstrap.cc:492] T e373165d4f2844d882994be5887e5ddf P d567067363bd4266815405d14c8c42c4: Bootstrap starting.
I20260709 13:17:39.571609 11002 tablet_bootstrap.cc:654] T e373165d4f2844d882994be5887e5ddf P d567067363bd4266815405d14c8c42c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.573549 10999 tablet_bootstrap.cc:492] T 11aa1269fea7424ea33a0e9bcd4e64fb P 4b7d4704a4404bb19c3053c6b0af4d90: Bootstrap starting.
I20260709 13:17:39.577936 11002 tablet_bootstrap.cc:492] T e373165d4f2844d882994be5887e5ddf P d567067363bd4266815405d14c8c42c4: No bootstrap required, opened a new log
I20260709 13:17:39.578552 11002 ts_tablet_manager.cc:1403] T e373165d4f2844d882994be5887e5ddf P d567067363bd4266815405d14c8c42c4: Time spent bootstrapping tablet: real 0.015s	user 0.000s	sys 0.011s
I20260709 13:17:39.581681 11002 raft_consensus.cc:359] T e373165d4f2844d882994be5887e5ddf P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.582437 11002 raft_consensus.cc:385] T e373165d4f2844d882994be5887e5ddf P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.582738 11002 raft_consensus.cc:740] T e373165d4f2844d882994be5887e5ddf P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d567067363bd4266815405d14c8c42c4, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.583601 11002 consensus_queue.cc:260] T e373165d4f2844d882994be5887e5ddf P d567067363bd4266815405d14c8c42c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.592283 10905 heartbeater.cc:499] Master 127.30.63.62:46421 was elected leader, sending a full tablet report...
I20260709 13:17:39.593384 11002 ts_tablet_manager.cc:1434] T e373165d4f2844d882994be5887e5ddf P d567067363bd4266815405d14c8c42c4: Time spent starting tablet: real 0.015s	user 0.011s	sys 0.004s
I20260709 13:17:39.593448 10998 ts_tablet_manager.cc:1434] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f: Time spent starting tablet: real 0.042s	user 0.020s	sys 0.020s
I20260709 13:17:39.594561 10979 heartbeater.cc:499] Master 127.30.63.62:46421 was elected leader, sending a full tablet report...
I20260709 13:17:39.594624 11002 tablet_bootstrap.cc:492] T 7a876d18e09a4577a85ca26975da0e8d P d567067363bd4266815405d14c8c42c4: Bootstrap starting.
I20260709 13:17:39.602151 11002 tablet_bootstrap.cc:654] T 7a876d18e09a4577a85ca26975da0e8d P d567067363bd4266815405d14c8c42c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.602512 10999 tablet_bootstrap.cc:654] T 11aa1269fea7424ea33a0e9bcd4e64fb P 4b7d4704a4404bb19c3053c6b0af4d90: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.611928 10998 tablet_bootstrap.cc:492] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f: Bootstrap starting.
I20260709 13:17:39.619922 10998 tablet_bootstrap.cc:654] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.643847 10999 tablet_bootstrap.cc:492] T 11aa1269fea7424ea33a0e9bcd4e64fb P 4b7d4704a4404bb19c3053c6b0af4d90: No bootstrap required, opened a new log
I20260709 13:17:39.644482 10999 ts_tablet_manager.cc:1403] T 11aa1269fea7424ea33a0e9bcd4e64fb P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent bootstrapping tablet: real 0.071s	user 0.019s	sys 0.014s
I20260709 13:17:39.649860 11002 tablet_bootstrap.cc:492] T 7a876d18e09a4577a85ca26975da0e8d P d567067363bd4266815405d14c8c42c4: No bootstrap required, opened a new log
I20260709 13:17:39.650534 11002 ts_tablet_manager.cc:1403] T 7a876d18e09a4577a85ca26975da0e8d P d567067363bd4266815405d14c8c42c4: Time spent bootstrapping tablet: real 0.056s	user 0.024s	sys 0.011s
I20260709 13:17:39.647961 10999 raft_consensus.cc:359] T 11aa1269fea7424ea33a0e9bcd4e64fb P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.651587 10999 raft_consensus.cc:385] T 11aa1269fea7424ea33a0e9bcd4e64fb P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.651918 10999 raft_consensus.cc:740] T 11aa1269fea7424ea33a0e9bcd4e64fb P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.652712 10999 consensus_queue.cc:260] T 11aa1269fea7424ea33a0e9bcd4e64fb P 4b7d4704a4404bb19c3053c6b0af4d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.653875 11002 raft_consensus.cc:359] T 7a876d18e09a4577a85ca26975da0e8d P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } }
I20260709 13:17:39.654754 11002 raft_consensus.cc:385] T 7a876d18e09a4577a85ca26975da0e8d P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.655103 11002 raft_consensus.cc:740] T 7a876d18e09a4577a85ca26975da0e8d P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d567067363bd4266815405d14c8c42c4, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.655270 10999 ts_tablet_manager.cc:1434] T 11aa1269fea7424ea33a0e9bcd4e64fb P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:17:39.656363 10999 tablet_bootstrap.cc:492] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90: Bootstrap starting.
I20260709 13:17:39.656021 11002 consensus_queue.cc:260] T 7a876d18e09a4577a85ca26975da0e8d P d567067363bd4266815405d14c8c42c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } }
I20260709 13:17:39.658342 11002 ts_tablet_manager.cc:1434] T 7a876d18e09a4577a85ca26975da0e8d P d567067363bd4266815405d14c8c42c4: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:39.659478 11002 tablet_bootstrap.cc:492] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4: Bootstrap starting.
I20260709 13:17:39.663364 10999 tablet_bootstrap.cc:654] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.665951 11002 tablet_bootstrap.cc:654] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.675266 10998 tablet_bootstrap.cc:492] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f: No bootstrap required, opened a new log
I20260709 13:17:39.675305 11002 tablet_bootstrap.cc:492] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4: No bootstrap required, opened a new log
I20260709 13:17:39.675947 11002 ts_tablet_manager.cc:1403] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:17:39.676129 10999 tablet_bootstrap.cc:492] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90: No bootstrap required, opened a new log
I20260709 13:17:39.676043 10998 ts_tablet_manager.cc:1403] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f: Time spent bootstrapping tablet: real 0.064s	user 0.013s	sys 0.008s
I20260709 13:17:39.676863 10999 ts_tablet_manager.cc:1403] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent bootstrapping tablet: real 0.021s	user 0.002s	sys 0.016s
I20260709 13:17:39.678210 11002 raft_consensus.cc:359] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.678764 11002 raft_consensus.cc:385] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.678984 11002 raft_consensus.cc:740] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d567067363bd4266815405d14c8c42c4, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.679593 11002 consensus_queue.cc:260] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.679875 10998 raft_consensus.cc:359] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.679940 10999 raft_consensus.cc:359] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.681006 10998 raft_consensus.cc:385] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.681026 10999 raft_consensus.cc:385] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.681578 10998 raft_consensus.cc:740] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b47d3fdd5d61449593b05bde3b67069f, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.681607 10999 raft_consensus.cc:740] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.682015 11002 ts_tablet_manager.cc:1434] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:39.683205 11002 tablet_bootstrap.cc:492] T 11aa1269fea7424ea33a0e9bcd4e64fb P d567067363bd4266815405d14c8c42c4: Bootstrap starting.
I20260709 13:17:39.682757 10999 consensus_queue.cc:260] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.682782 10998 consensus_queue.cc:260] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.687350 10999 ts_tablet_manager.cc:1434] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:17:39.688414 10999 tablet_bootstrap.cc:492] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90: Bootstrap starting.
I20260709 13:17:39.689980 11002 tablet_bootstrap.cc:654] T 11aa1269fea7424ea33a0e9bcd4e64fb P d567067363bd4266815405d14c8c42c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.690433 11004 raft_consensus.cc:493] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.690943 11004 raft_consensus.cc:515] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.694607 10999 tablet_bootstrap.cc:654] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.698467 11004 leader_election.cc:290] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809)
I20260709 13:17:39.707285 10998 ts_tablet_manager.cc:1434] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.001s
I20260709 13:17:39.708518 10998 tablet_bootstrap.cc:492] T 81eef65db7ff4e8cb37f06a3decd4320 P b47d3fdd5d61449593b05bde3b67069f: Bootstrap starting.
I20260709 13:17:39.713142 10998 tablet_bootstrap.cc:654] T 81eef65db7ff4e8cb37f06a3decd4320 P b47d3fdd5d61449593b05bde3b67069f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.719595 11002 tablet_bootstrap.cc:492] T 11aa1269fea7424ea33a0e9bcd4e64fb P d567067363bd4266815405d14c8c42c4: No bootstrap required, opened a new log
I20260709 13:17:39.720345 11002 ts_tablet_manager.cc:1403] T 11aa1269fea7424ea33a0e9bcd4e64fb P d567067363bd4266815405d14c8c42c4: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.023s
I20260709 13:17:39.734898 11002 raft_consensus.cc:359] T 11aa1269fea7424ea33a0e9bcd4e64fb P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.736332 11002 raft_consensus.cc:385] T 11aa1269fea7424ea33a0e9bcd4e64fb P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.736685 10805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ad1205065a48b29567ed4c89b20059" candidate_uuid: "b47d3fdd5d61449593b05bde3b67069f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" is_pre_election: true
W20260709 13:17:39.739591 10917 leader_election.cc:343] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:39.736846 11002 raft_consensus.cc:740] T 11aa1269fea7424ea33a0e9bcd4e64fb P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d567067363bd4266815405d14c8c42c4, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.741840 11002 consensus_queue.cc:260] T 11aa1269fea7424ea33a0e9bcd4e64fb P d567067363bd4266815405d14c8c42c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.745249 11002 ts_tablet_manager.cc:1434] T 11aa1269fea7424ea33a0e9bcd4e64fb P d567067363bd4266815405d14c8c42c4: Time spent starting tablet: real 0.024s	user 0.011s	sys 0.000s
I20260709 13:17:39.747467 11002 tablet_bootstrap.cc:492] T bea59f51efa648ea8d820e99be4bc7d3 P d567067363bd4266815405d14c8c42c4: Bootstrap starting.
W20260709 13:17:39.756366 10980 tablet.cc:2406] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:17:39.761196 11003 raft_consensus.cc:493] T 11aa1269fea7424ea33a0e9bcd4e64fb P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.761718 11003 raft_consensus.cc:515] T 11aa1269fea7424ea33a0e9bcd4e64fb P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.760218 10998 tablet_bootstrap.cc:492] T 81eef65db7ff4e8cb37f06a3decd4320 P b47d3fdd5d61449593b05bde3b67069f: No bootstrap required, opened a new log
I20260709 13:17:39.762849 10998 ts_tablet_manager.cc:1403] T 81eef65db7ff4e8cb37f06a3decd4320 P b47d3fdd5d61449593b05bde3b67069f: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.031s
I20260709 13:17:39.766475 11003 leader_election.cc:290] T 11aa1269fea7424ea33a0e9bcd4e64fb P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:39.766324 10998 raft_consensus.cc:359] T 81eef65db7ff4e8cb37f06a3decd4320 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.767283 10998 raft_consensus.cc:385] T 81eef65db7ff4e8cb37f06a3decd4320 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.767702 10998 raft_consensus.cc:740] T 81eef65db7ff4e8cb37f06a3decd4320 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b47d3fdd5d61449593b05bde3b67069f, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.768733 10998 consensus_queue.cc:260] T 81eef65db7ff4e8cb37f06a3decd4320 P b47d3fdd5d61449593b05bde3b67069f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.773850 10880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ad1205065a48b29567ed4c89b20059" candidate_uuid: "b47d3fdd5d61449593b05bde3b67069f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d567067363bd4266815405d14c8c42c4" is_pre_election: true
I20260709 13:17:39.774780 10998 ts_tablet_manager.cc:1434] T 81eef65db7ff4e8cb37f06a3decd4320 P b47d3fdd5d61449593b05bde3b67069f: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
W20260709 13:17:39.775622 10919 leader_election.cc:343] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:39.776039 10998 tablet_bootstrap.cc:492] T 11aa1269fea7424ea33a0e9bcd4e64fb P b47d3fdd5d61449593b05bde3b67069f: Bootstrap starting.
I20260709 13:17:39.776165 10919 leader_election.cc:304] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b47d3fdd5d61449593b05bde3b67069f; no voters: 4b7d4704a4404bb19c3053c6b0af4d90, d567067363bd4266815405d14c8c42c4
I20260709 13:17:39.777581 11004 raft_consensus.cc:2749] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:39.778788 11003 raft_consensus.cc:493] T 7a876d18e09a4577a85ca26975da0e8d P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.779368 11003 raft_consensus.cc:515] T 7a876d18e09a4577a85ca26975da0e8d P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } }
I20260709 13:17:39.781772 11003 leader_election.cc:290] T 7a876d18e09a4577a85ca26975da0e8d P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139), d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809)
I20260709 13:17:39.784849 11004 raft_consensus.cc:493] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.785215 10998 tablet_bootstrap.cc:654] T 11aa1269fea7424ea33a0e9bcd4e64fb P b47d3fdd5d61449593b05bde3b67069f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.785502 11004 raft_consensus.cc:515] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } }
I20260709 13:17:39.787787 11004 leader_election.cc:290] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809)
I20260709 13:17:39.789705 11002 tablet_bootstrap.cc:654] T bea59f51efa648ea8d820e99be4bc7d3 P d567067363bd4266815405d14c8c42c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.789849 10805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a876d18e09a4577a85ca26975da0e8d" candidate_uuid: "b47d3fdd5d61449593b05bde3b67069f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" is_pre_election: true
I20260709 13:17:39.790395 10880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a876d18e09a4577a85ca26975da0e8d" candidate_uuid: "b47d3fdd5d61449593b05bde3b67069f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d567067363bd4266815405d14c8c42c4" is_pre_election: true
I20260709 13:17:39.790879 10805 raft_consensus.cc:2468] T 7a876d18e09a4577a85ca26975da0e8d P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b47d3fdd5d61449593b05bde3b67069f in term 0.
I20260709 13:17:39.791182 10880 raft_consensus.cc:2468] T 7a876d18e09a4577a85ca26975da0e8d P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b47d3fdd5d61449593b05bde3b67069f in term 0.
I20260709 13:17:39.794950 10919 leader_election.cc:304] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b47d3fdd5d61449593b05bde3b67069f, d567067363bd4266815405d14c8c42c4; no voters: 
I20260709 13:17:39.795359 10999 tablet_bootstrap.cc:492] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90: No bootstrap required, opened a new log
I20260709 13:17:39.795806 11004 raft_consensus.cc:2804] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:39.795969 10999 ts_tablet_manager.cc:1403] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent bootstrapping tablet: real 0.108s	user 0.031s	sys 0.048s
I20260709 13:17:39.796227 11004 raft_consensus.cc:493] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.796779 11004 raft_consensus.cc:3060] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:39.799079 10999 raft_consensus.cc:359] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.799888 10999 raft_consensus.cc:385] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.800235 10999 raft_consensus.cc:740] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.801061 10999 consensus_queue.cc:260] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.803349 10999 ts_tablet_manager.cc:1434] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:39.804407 10999 tablet_bootstrap.cc:492] T bea59f51efa648ea8d820e99be4bc7d3 P 4b7d4704a4404bb19c3053c6b0af4d90: Bootstrap starting.
I20260709 13:17:39.807165 11004 raft_consensus.cc:515] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } }
I20260709 13:17:39.810694 10880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a876d18e09a4577a85ca26975da0e8d" candidate_uuid: "b47d3fdd5d61449593b05bde3b67069f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d567067363bd4266815405d14c8c42c4"
I20260709 13:17:39.811344 10880 raft_consensus.cc:3060] T 7a876d18e09a4577a85ca26975da0e8d P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:39.813586 10998 tablet_bootstrap.cc:492] T 11aa1269fea7424ea33a0e9bcd4e64fb P b47d3fdd5d61449593b05bde3b67069f: No bootstrap required, opened a new log
I20260709 13:17:39.814198 10998 ts_tablet_manager.cc:1403] T 11aa1269fea7424ea33a0e9bcd4e64fb P b47d3fdd5d61449593b05bde3b67069f: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.008s
I20260709 13:17:39.817299 10998 raft_consensus.cc:359] T 11aa1269fea7424ea33a0e9bcd4e64fb P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.817978 10879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11aa1269fea7424ea33a0e9bcd4e64fb" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d567067363bd4266815405d14c8c42c4" is_pre_election: true
I20260709 13:17:39.818929 10879 raft_consensus.cc:2468] T 11aa1269fea7424ea33a0e9bcd4e64fb P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 0.
I20260709 13:17:39.820308 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a876d18e09a4577a85ca26975da0e8d" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d567067363bd4266815405d14c8c42c4" is_pre_election: true
I20260709 13:17:39.821213 11020 raft_consensus.cc:493] T 81eef65db7ff4e8cb37f06a3decd4320 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.821743 10954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11aa1269fea7424ea33a0e9bcd4e64fb" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f" is_pre_election: true
I20260709 13:17:39.821897 11020 raft_consensus.cc:515] T 81eef65db7ff4e8cb37f06a3decd4320 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.822541 10770 leader_election.cc:304] T 11aa1269fea7424ea33a0e9bcd4e64fb P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, d567067363bd4266815405d14c8c42c4; no voters: 
I20260709 13:17:39.823371 10953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a876d18e09a4577a85ca26975da0e8d" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f" is_pre_election: true
I20260709 13:17:39.824239 10953 raft_consensus.cc:2393] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b7d4704a4404bb19c3053c6b0af4d90 in current term 1: Already voted for candidate b47d3fdd5d61449593b05bde3b67069f in this term.
I20260709 13:17:39.825095 11003 raft_consensus.cc:2804] T 11aa1269fea7424ea33a0e9bcd4e64fb P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:39.825511 11003 raft_consensus.cc:493] T 11aa1269fea7424ea33a0e9bcd4e64fb P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.825870 11003 raft_consensus.cc:3060] T 11aa1269fea7424ea33a0e9bcd4e64fb P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:39.826323 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81eef65db7ff4e8cb37f06a3decd4320" candidate_uuid: "b47d3fdd5d61449593b05bde3b67069f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d567067363bd4266815405d14c8c42c4" is_pre_election: true
I20260709 13:17:39.826992 10999 tablet_bootstrap.cc:654] T bea59f51efa648ea8d820e99be4bc7d3 P 4b7d4704a4404bb19c3053c6b0af4d90: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:39.828357 10919 leader_election.cc:343] T 81eef65db7ff4e8cb37f06a3decd4320 P b47d3fdd5d61449593b05bde3b67069f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:39.818048 10998 raft_consensus.cc:385] T 11aa1269fea7424ea33a0e9bcd4e64fb P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.829071 10998 raft_consensus.cc:740] T 11aa1269fea7424ea33a0e9bcd4e64fb P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b47d3fdd5d61449593b05bde3b67069f, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.829217 11004 leader_election.cc:290] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f [CANDIDATE]: Term 1 election: Requested vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809)
I20260709 13:17:39.829840 10998 consensus_queue.cc:260] T 11aa1269fea7424ea33a0e9bcd4e64fb P b47d3fdd5d61449593b05bde3b67069f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.830238 10880 raft_consensus.cc:2468] T 7a876d18e09a4577a85ca26975da0e8d P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b47d3fdd5d61449593b05bde3b67069f in term 1.
I20260709 13:17:39.830874 10954 raft_consensus.cc:2468] T 11aa1269fea7424ea33a0e9bcd4e64fb P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 0.
I20260709 13:17:39.832288 10998 ts_tablet_manager.cc:1434] T 11aa1269fea7424ea33a0e9bcd4e64fb P b47d3fdd5d61449593b05bde3b67069f: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:17:39.831938 10919 leader_election.cc:304] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b47d3fdd5d61449593b05bde3b67069f, d567067363bd4266815405d14c8c42c4; no voters: 
I20260709 13:17:39.833492 10998 tablet_bootstrap.cc:492] T c7d24f498cb84dd2b9139031f8e00a57 P b47d3fdd5d61449593b05bde3b67069f: Bootstrap starting.
I20260709 13:17:39.834038 11006 raft_consensus.cc:493] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.834640 11006 raft_consensus.cc:515] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.838272 11003 raft_consensus.cc:515] T 11aa1269fea7424ea33a0e9bcd4e64fb P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.841355 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11aa1269fea7424ea33a0e9bcd4e64fb" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d567067363bd4266815405d14c8c42c4"
I20260709 13:17:39.841993 10878 raft_consensus.cc:3060] T 11aa1269fea7424ea33a0e9bcd4e64fb P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:39.842201 10805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a876d18e09a4577a85ca26975da0e8d" candidate_uuid: "b47d3fdd5d61449593b05bde3b67069f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
I20260709 13:17:39.842788 10805 raft_consensus.cc:3060] T 7a876d18e09a4577a85ca26975da0e8d P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:39.843134 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81eef65db7ff4e8cb37f06a3decd4320" candidate_uuid: "b47d3fdd5d61449593b05bde3b67069f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" is_pre_election: true
I20260709 13:17:39.839967 11006 leader_election.cc:290] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:39.845582 10768 leader_election.cc:304] T 7a876d18e09a4577a85ca26975da0e8d P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90; no voters: b47d3fdd5d61449593b05bde3b67069f, d567067363bd4266815405d14c8c42c4
W20260709 13:17:39.847997 10734 debug-util.cc:398] Leaking SignalData structure 0x7b080018c340 after lost signal to thread 30975
W20260709 13:17:39.859624 10917 leader_election.cc:343] T 81eef65db7ff4e8cb37f06a3decd4320 P b47d3fdd5d61449593b05bde3b67069f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:39.860611 10917 leader_election.cc:304] T 81eef65db7ff4e8cb37f06a3decd4320 P b47d3fdd5d61449593b05bde3b67069f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b47d3fdd5d61449593b05bde3b67069f; no voters: 4b7d4704a4404bb19c3053c6b0af4d90, d567067363bd4266815405d14c8c42c4
I20260709 13:17:39.867599 11004 raft_consensus.cc:2804] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:39.868103 11004 raft_consensus.cc:697] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f [term 1 LEADER]: Becoming Leader. State: Replica: b47d3fdd5d61449593b05bde3b67069f, State: Running, Role: LEADER
I20260709 13:17:39.873077 10878 raft_consensus.cc:2468] T 11aa1269fea7424ea33a0e9bcd4e64fb P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 1.
I20260709 13:17:39.875841 10770 leader_election.cc:304] T 11aa1269fea7424ea33a0e9bcd4e64fb P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, d567067363bd4266815405d14c8c42c4; no voters: 
I20260709 13:17:39.858471 11003 leader_election.cc:290] T 11aa1269fea7424ea33a0e9bcd4e64fb P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 election: Requested vote from peers d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:39.885604 10805 raft_consensus.cc:2468] T 7a876d18e09a4577a85ca26975da0e8d P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b47d3fdd5d61449593b05bde3b67069f in term 1.
I20260709 13:17:39.885452 11004 consensus_queue.cc:237] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } }
I20260709 13:17:39.888885 11003 raft_consensus.cc:2749] T 7a876d18e09a4577a85ca26975da0e8d P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:39.891754 10998 tablet_bootstrap.cc:654] T c7d24f498cb84dd2b9139031f8e00a57 P b47d3fdd5d61449593b05bde3b67069f: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:39.894138 10768 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:42139, user_credentials={real_user=slave}} blocked reactor thread for 48857.3us
I20260709 13:17:39.896384 11020 leader_election.cc:290] T 81eef65db7ff4e8cb37f06a3decd4320 P b47d3fdd5d61449593b05bde3b67069f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809)
I20260709 13:17:39.899156 11002 tablet_bootstrap.cc:492] T bea59f51efa648ea8d820e99be4bc7d3 P d567067363bd4266815405d14c8c42c4: No bootstrap required, opened a new log
I20260709 13:17:39.903791 11002 ts_tablet_manager.cc:1403] T bea59f51efa648ea8d820e99be4bc7d3 P d567067363bd4266815405d14c8c42c4: Time spent bootstrapping tablet: real 0.157s	user 0.034s	sys 0.030s
I20260709 13:17:39.908802 10954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11aa1269fea7424ea33a0e9bcd4e64fb" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
I20260709 13:17:39.909440 10954 raft_consensus.cc:3060] T 11aa1269fea7424ea33a0e9bcd4e64fb P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:39.909219 11002 raft_consensus.cc:359] T bea59f51efa648ea8d820e99be4bc7d3 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.910142 11002 raft_consensus.cc:385] T bea59f51efa648ea8d820e99be4bc7d3 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.910494 11002 raft_consensus.cc:740] T bea59f51efa648ea8d820e99be4bc7d3 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d567067363bd4266815405d14c8c42c4, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.911453 11002 consensus_queue.cc:260] T bea59f51efa648ea8d820e99be4bc7d3 P d567067363bd4266815405d14c8c42c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.904829 11025 raft_consensus.cc:2804] T 11aa1269fea7424ea33a0e9bcd4e64fb P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:39.913770 11025 raft_consensus.cc:697] T 11aa1269fea7424ea33a0e9bcd4e64fb P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Becoming Leader. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Running, Role: LEADER
W20260709 13:17:39.901208 10919 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:37809, user_credentials={real_user=slave}} blocked reactor thread for 69387.4us
I20260709 13:17:39.914656 11025 consensus_queue.cc:237] T 11aa1269fea7424ea33a0e9bcd4e64fb P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.904320 11020 raft_consensus.cc:2749] T 81eef65db7ff4e8cb37f06a3decd4320 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:39.917258 10954 raft_consensus.cc:2468] T 11aa1269fea7424ea33a0e9bcd4e64fb P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 1.
I20260709 13:17:39.927438 11002 ts_tablet_manager.cc:1434] T bea59f51efa648ea8d820e99be4bc7d3 P d567067363bd4266815405d14c8c42c4: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:17:39.929425 11002 tablet_bootstrap.cc:492] T f1a15aa0b7ce423386027dfe9aced682 P d567067363bd4266815405d14c8c42c4: Bootstrap starting.
I20260709 13:17:39.927599 10701 catalog_manager.cc:5697] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f reported cstate change: term changed from 0 to 1, leader changed from <none> to b47d3fdd5d61449593b05bde3b67069f (127.30.63.3). New cstate: current_term: 1 leader_uuid: "b47d3fdd5d61449593b05bde3b67069f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:39.938340 10702 catalog_manager.cc:5697] T 11aa1269fea7424ea33a0e9bcd4e64fb P 4b7d4704a4404bb19c3053c6b0af4d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:39.939674 11002 tablet_bootstrap.cc:654] T f1a15aa0b7ce423386027dfe9aced682 P d567067363bd4266815405d14c8c42c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.949599 10999 tablet_bootstrap.cc:492] T bea59f51efa648ea8d820e99be4bc7d3 P 4b7d4704a4404bb19c3053c6b0af4d90: No bootstrap required, opened a new log
I20260709 13:17:39.950270 10999 ts_tablet_manager.cc:1403] T bea59f51efa648ea8d820e99be4bc7d3 P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent bootstrapping tablet: real 0.146s	user 0.039s	sys 0.034s
I20260709 13:17:39.951763 10805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d24f498cb84dd2b9139031f8e00a57" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" is_pre_election: true
W20260709 13:17:39.953869 10843 leader_election.cc:343] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:39.954159 10999 raft_consensus.cc:359] T bea59f51efa648ea8d820e99be4bc7d3 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.955219 10999 raft_consensus.cc:385] T bea59f51efa648ea8d820e99be4bc7d3 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.955557 10999 raft_consensus.cc:740] T bea59f51efa648ea8d820e99be4bc7d3 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.956343 10999 consensus_queue.cc:260] T bea59f51efa648ea8d820e99be4bc7d3 P 4b7d4704a4404bb19c3053c6b0af4d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.961861 10954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d24f498cb84dd2b9139031f8e00a57" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f" is_pre_election: true
I20260709 13:17:39.963011 10999 ts_tablet_manager.cc:1434] T bea59f51efa648ea8d820e99be4bc7d3 P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
W20260709 13:17:39.963639 10843 leader_election.cc:343] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:39.964067 10998 tablet_bootstrap.cc:492] T c7d24f498cb84dd2b9139031f8e00a57 P b47d3fdd5d61449593b05bde3b67069f: No bootstrap required, opened a new log
I20260709 13:17:39.964195 10843 leader_election.cc:304] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d567067363bd4266815405d14c8c42c4; no voters: 4b7d4704a4404bb19c3053c6b0af4d90, b47d3fdd5d61449593b05bde3b67069f
I20260709 13:17:39.964664 10998 ts_tablet_manager.cc:1403] T c7d24f498cb84dd2b9139031f8e00a57 P b47d3fdd5d61449593b05bde3b67069f: Time spent bootstrapping tablet: real 0.131s	user 0.024s	sys 0.001s
I20260709 13:17:39.965199 11006 raft_consensus.cc:2749] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:39.964114 10999 tablet_bootstrap.cc:492] T e373165d4f2844d882994be5887e5ddf P 4b7d4704a4404bb19c3053c6b0af4d90: Bootstrap starting.
I20260709 13:17:39.969074 11025 raft_consensus.cc:493] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.969650 11025 raft_consensus.cc:515] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.971974 11025 leader_election.cc:290] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:39.973604 10954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ad1205065a48b29567ed4c89b20059" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f" is_pre_election: true
I20260709 13:17:39.973987 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ad1205065a48b29567ed4c89b20059" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d567067363bd4266815405d14c8c42c4" is_pre_election: true
I20260709 13:17:39.973980 10998 raft_consensus.cc:359] T c7d24f498cb84dd2b9139031f8e00a57 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.975591 10998 raft_consensus.cc:385] T c7d24f498cb84dd2b9139031f8e00a57 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.974309 10954 raft_consensus.cc:2468] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 0.
I20260709 13:17:39.976099 10998 raft_consensus.cc:740] T c7d24f498cb84dd2b9139031f8e00a57 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b47d3fdd5d61449593b05bde3b67069f, State: Initialized, Role: FOLLOWER
W20260709 13:17:39.976014 10770 leader_election.cc:343] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:39.976874 10999 tablet_bootstrap.cc:654] T e373165d4f2844d882994be5887e5ddf P 4b7d4704a4404bb19c3053c6b0af4d90: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.977281 10768 leader_election.cc:304] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, b47d3fdd5d61449593b05bde3b67069f; no voters: d567067363bd4266815405d14c8c42c4
I20260709 13:17:39.978345 11025 raft_consensus.cc:2804] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:39.978780 11025 raft_consensus.cc:493] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.977856 10998 consensus_queue.cc:260] T c7d24f498cb84dd2b9139031f8e00a57 P b47d3fdd5d61449593b05bde3b67069f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.979138 11025 raft_consensus.cc:3060] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:39.983212 10998 ts_tablet_manager.cc:1434] T c7d24f498cb84dd2b9139031f8e00a57 P b47d3fdd5d61449593b05bde3b67069f: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:17:39.984417 10998 tablet_bootstrap.cc:492] T bea59f51efa648ea8d820e99be4bc7d3 P b47d3fdd5d61449593b05bde3b67069f: Bootstrap starting.
I20260709 13:17:39.991430 10998 tablet_bootstrap.cc:654] T bea59f51efa648ea8d820e99be4bc7d3 P b47d3fdd5d61449593b05bde3b67069f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.981053 11002 tablet_bootstrap.cc:492] T f1a15aa0b7ce423386027dfe9aced682 P d567067363bd4266815405d14c8c42c4: No bootstrap required, opened a new log
I20260709 13:17:39.994093 11002 ts_tablet_manager.cc:1403] T f1a15aa0b7ce423386027dfe9aced682 P d567067363bd4266815405d14c8c42c4: Time spent bootstrapping tablet: real 0.065s	user 0.006s	sys 0.016s
I20260709 13:17:39.996971 11006 raft_consensus.cc:493] T e373165d4f2844d882994be5887e5ddf P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.997635 11006 raft_consensus.cc:515] T e373165d4f2844d882994be5887e5ddf P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:39.999989 11006 leader_election.cc:290] T e373165d4f2844d882994be5887e5ddf P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:40.002054 10805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e373165d4f2844d882994be5887e5ddf" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" is_pre_election: true
I20260709 13:17:40.002193 10954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e373165d4f2844d882994be5887e5ddf" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f" is_pre_election: true
W20260709 13:17:40.003743 10843 leader_election.cc:343] T e373165d4f2844d882994be5887e5ddf P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:40.004662 10843 leader_election.cc:343] T e373165d4f2844d882994be5887e5ddf P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:40.005106 10843 leader_election.cc:304] T e373165d4f2844d882994be5887e5ddf P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d567067363bd4266815405d14c8c42c4; no voters: 4b7d4704a4404bb19c3053c6b0af4d90, b47d3fdd5d61449593b05bde3b67069f
I20260709 13:17:40.006354 11006 raft_consensus.cc:2749] T e373165d4f2844d882994be5887e5ddf P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:40.000159 11025 raft_consensus.cc:515] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.009930 10998 tablet_bootstrap.cc:492] T bea59f51efa648ea8d820e99be4bc7d3 P b47d3fdd5d61449593b05bde3b67069f: No bootstrap required, opened a new log
I20260709 13:17:40.009665 11002 raft_consensus.cc:359] T f1a15aa0b7ce423386027dfe9aced682 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.010802 10998 ts_tablet_manager.cc:1403] T bea59f51efa648ea8d820e99be4bc7d3 P b47d3fdd5d61449593b05bde3b67069f: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.010s
I20260709 13:17:40.010895 11002 raft_consensus.cc:385] T f1a15aa0b7ce423386027dfe9aced682 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.011448 11002 raft_consensus.cc:740] T f1a15aa0b7ce423386027dfe9aced682 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d567067363bd4266815405d14c8c42c4, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.014281 10998 raft_consensus.cc:359] T bea59f51efa648ea8d820e99be4bc7d3 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.015297 10998 raft_consensus.cc:385] T bea59f51efa648ea8d820e99be4bc7d3 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.015681 10998 raft_consensus.cc:740] T bea59f51efa648ea8d820e99be4bc7d3 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b47d3fdd5d61449593b05bde3b67069f, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.015937 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ad1205065a48b29567ed4c89b20059" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d567067363bd4266815405d14c8c42c4"
I20260709 13:17:40.017001 10998 consensus_queue.cc:260] T bea59f51efa648ea8d820e99be4bc7d3 P b47d3fdd5d61449593b05bde3b67069f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
W20260709 13:17:40.018031 10770 leader_election.cc:343] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:40.020844 11025 leader_election.cc:290] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 election: Requested vote from peers d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:40.020974 10954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ad1205065a48b29567ed4c89b20059" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
I20260709 13:17:40.021727 10954 raft_consensus.cc:3060] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.022902 10998 ts_tablet_manager.cc:1434] T bea59f51efa648ea8d820e99be4bc7d3 P b47d3fdd5d61449593b05bde3b67069f: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.006s
I20260709 13:17:40.012387 11002 consensus_queue.cc:260] T f1a15aa0b7ce423386027dfe9aced682 P d567067363bd4266815405d14c8c42c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.024214 10998 tablet_bootstrap.cc:492] T 40f935f4b4a54f5d9b3093d4f5e1b058 P b47d3fdd5d61449593b05bde3b67069f: Bootstrap starting.
I20260709 13:17:40.031054 10954 raft_consensus.cc:2468] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 1.
I20260709 13:17:40.032179 10998 tablet_bootstrap.cc:654] T 40f935f4b4a54f5d9b3093d4f5e1b058 P b47d3fdd5d61449593b05bde3b67069f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.032570 10768 leader_election.cc:304] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, b47d3fdd5d61449593b05bde3b67069f; no voters: d567067363bd4266815405d14c8c42c4
I20260709 13:17:40.035955 11025 raft_consensus.cc:2804] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:40.037592 11025 raft_consensus.cc:697] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Becoming Leader. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Running, Role: LEADER
I20260709 13:17:40.038908 11025 consensus_queue.cc:237] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.042480 11002 ts_tablet_manager.cc:1434] T f1a15aa0b7ce423386027dfe9aced682 P d567067363bd4266815405d14c8c42c4: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.001s
I20260709 13:17:40.048113 10999 tablet_bootstrap.cc:492] T e373165d4f2844d882994be5887e5ddf P 4b7d4704a4404bb19c3053c6b0af4d90: No bootstrap required, opened a new log
I20260709 13:17:40.048753 10999 ts_tablet_manager.cc:1403] T e373165d4f2844d882994be5887e5ddf P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent bootstrapping tablet: real 0.085s	user 0.035s	sys 0.033s
I20260709 13:17:40.050931 11002 tablet_bootstrap.cc:492] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4: Bootstrap starting.
I20260709 13:17:40.051786 10999 raft_consensus.cc:359] T e373165d4f2844d882994be5887e5ddf P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.052574 10999 raft_consensus.cc:385] T e373165d4f2844d882994be5887e5ddf P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.052898 10999 raft_consensus.cc:740] T e373165d4f2844d882994be5887e5ddf P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.053792 10999 consensus_queue.cc:260] T e373165d4f2844d882994be5887e5ddf P 4b7d4704a4404bb19c3053c6b0af4d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.056488 10999 ts_tablet_manager.cc:1434] T e373165d4f2844d882994be5887e5ddf P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:40.057607 10999 tablet_bootstrap.cc:492] T 81eef65db7ff4e8cb37f06a3decd4320 P 4b7d4704a4404bb19c3053c6b0af4d90: Bootstrap starting.
I20260709 13:17:40.060495 11002 tablet_bootstrap.cc:654] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.063760 10999 tablet_bootstrap.cc:654] T 81eef65db7ff4e8cb37f06a3decd4320 P 4b7d4704a4404bb19c3053c6b0af4d90: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.065840 10998 tablet_bootstrap.cc:492] T 40f935f4b4a54f5d9b3093d4f5e1b058 P b47d3fdd5d61449593b05bde3b67069f: No bootstrap required, opened a new log
I20260709 13:17:40.066504 10998 ts_tablet_manager.cc:1403] T 40f935f4b4a54f5d9b3093d4f5e1b058 P b47d3fdd5d61449593b05bde3b67069f: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.008s
I20260709 13:17:40.068011 11002 tablet_bootstrap.cc:492] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4: No bootstrap required, opened a new log
I20260709 13:17:40.068562 11002 ts_tablet_manager.cc:1403] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.005s
I20260709 13:17:40.070183 10998 raft_consensus.cc:359] T 40f935f4b4a54f5d9b3093d4f5e1b058 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.072304 11002 raft_consensus.cc:359] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.076385 11002 raft_consensus.cc:385] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.074525 10999 tablet_bootstrap.cc:492] T 81eef65db7ff4e8cb37f06a3decd4320 P 4b7d4704a4404bb19c3053c6b0af4d90: No bootstrap required, opened a new log
I20260709 13:17:40.076963 11002 raft_consensus.cc:740] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d567067363bd4266815405d14c8c42c4, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.077270 10999 ts_tablet_manager.cc:1403] T 81eef65db7ff4e8cb37f06a3decd4320 P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.008s
I20260709 13:17:40.078006 11002 consensus_queue.cc:260] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.076050 10998 raft_consensus.cc:385] T 40f935f4b4a54f5d9b3093d4f5e1b058 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.080457 10999 raft_consensus.cc:359] T 81eef65db7ff4e8cb37f06a3decd4320 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.082262 10999 raft_consensus.cc:385] T 81eef65db7ff4e8cb37f06a3decd4320 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.082576 10999 raft_consensus.cc:740] T 81eef65db7ff4e8cb37f06a3decd4320 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.081826 10998 raft_consensus.cc:740] T 40f935f4b4a54f5d9b3093d4f5e1b058 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b47d3fdd5d61449593b05bde3b67069f, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.083405 10999 consensus_queue.cc:260] T 81eef65db7ff4e8cb37f06a3decd4320 P 4b7d4704a4404bb19c3053c6b0af4d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.083663 10998 consensus_queue.cc:260] T 40f935f4b4a54f5d9b3093d4f5e1b058 P b47d3fdd5d61449593b05bde3b67069f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.085727 10999 ts_tablet_manager.cc:1434] T 81eef65db7ff4e8cb37f06a3decd4320 P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 13:17:40.086197 11002 ts_tablet_manager.cc:1434] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260709 13:17:40.086444 10998 ts_tablet_manager.cc:1434] T 40f935f4b4a54f5d9b3093d4f5e1b058 P b47d3fdd5d61449593b05bde3b67069f: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:17:40.086839 10999 tablet_bootstrap.cc:492] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90: Bootstrap starting.
I20260709 13:17:40.087984 11002 tablet_bootstrap.cc:492] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4: Bootstrap starting.
I20260709 13:17:40.099086 10998 tablet_bootstrap.cc:492] T e373165d4f2844d882994be5887e5ddf P b47d3fdd5d61449593b05bde3b67069f: Bootstrap starting.
I20260709 13:17:40.100782 11002 tablet_bootstrap.cc:654] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.106748 10998 tablet_bootstrap.cc:654] T e373165d4f2844d882994be5887e5ddf P b47d3fdd5d61449593b05bde3b67069f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.111274 10999 tablet_bootstrap.cc:654] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.128371 10700 catalog_manager.cc:5697] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:40.138533 11002 tablet_bootstrap.cc:492] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4: No bootstrap required, opened a new log
I20260709 13:17:40.138643 10998 tablet_bootstrap.cc:492] T e373165d4f2844d882994be5887e5ddf P b47d3fdd5d61449593b05bde3b67069f: No bootstrap required, opened a new log
I20260709 13:17:40.139374 10998 ts_tablet_manager.cc:1403] T e373165d4f2844d882994be5887e5ddf P b47d3fdd5d61449593b05bde3b67069f: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.008s
I20260709 13:17:40.139374 11002 ts_tablet_manager.cc:1403] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4: Time spent bootstrapping tablet: real 0.052s	user 0.019s	sys 0.025s
I20260709 13:17:40.142246 10998 raft_consensus.cc:359] T e373165d4f2844d882994be5887e5ddf P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.142988 10998 raft_consensus.cc:385] T e373165d4f2844d882994be5887e5ddf P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.142665 11002 raft_consensus.cc:359] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.143307 10998 raft_consensus.cc:740] T e373165d4f2844d882994be5887e5ddf P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b47d3fdd5d61449593b05bde3b67069f, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.143666 11002 raft_consensus.cc:385] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.144001 11002 raft_consensus.cc:740] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d567067363bd4266815405d14c8c42c4, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.144166 10998 consensus_queue.cc:260] T e373165d4f2844d882994be5887e5ddf P b47d3fdd5d61449593b05bde3b67069f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.144850 11002 consensus_queue.cc:260] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.149997 11002 ts_tablet_manager.cc:1434] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:17:40.151397 11002 tablet_bootstrap.cc:492] T 26ad1205065a48b29567ed4c89b20059 P d567067363bd4266815405d14c8c42c4: Bootstrap starting.
I20260709 13:17:40.151645 10999 tablet_bootstrap.cc:492] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90: No bootstrap required, opened a new log
I20260709 13:17:40.152258 10999 ts_tablet_manager.cc:1403] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent bootstrapping tablet: real 0.066s	user 0.009s	sys 0.020s
I20260709 13:17:40.150032 10998 ts_tablet_manager.cc:1434] T e373165d4f2844d882994be5887e5ddf P b47d3fdd5d61449593b05bde3b67069f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:17:40.153381 10998 tablet_bootstrap.cc:492] T f1a15aa0b7ce423386027dfe9aced682 P b47d3fdd5d61449593b05bde3b67069f: Bootstrap starting.
I20260709 13:17:40.155260 10999 raft_consensus.cc:359] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.156046 10999 raft_consensus.cc:385] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.156335 10999 raft_consensus.cc:740] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.157061 10999 consensus_queue.cc:260] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.159310 10999 ts_tablet_manager.cc:1434] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:17:40.160298 11025 raft_consensus.cc:493] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.160858 11025 raft_consensus.cc:515] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.162624 11002 tablet_bootstrap.cc:654] T 26ad1205065a48b29567ed4c89b20059 P d567067363bd4266815405d14c8c42c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.162989 11025 leader_election.cc:290] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:40.164359 10954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d24f498cb84dd2b9139031f8e00a57" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f" is_pre_election: true
I20260709 13:17:40.164669 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d24f498cb84dd2b9139031f8e00a57" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d567067363bd4266815405d14c8c42c4" is_pre_election: true
I20260709 13:17:40.165082 10954 raft_consensus.cc:2468] T c7d24f498cb84dd2b9139031f8e00a57 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 0.
I20260709 13:17:40.165241 10878 raft_consensus.cc:2468] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 0.
I20260709 13:17:40.166431 10768 leader_election.cc:304] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, b47d3fdd5d61449593b05bde3b67069f; no voters: 
I20260709 13:17:40.166853 11025 raft_consensus.cc:493] T bea59f51efa648ea8d820e99be4bc7d3 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.167408 11003 raft_consensus.cc:2804] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:40.167883 11003 raft_consensus.cc:493] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.167577 11025 raft_consensus.cc:515] T bea59f51efa648ea8d820e99be4bc7d3 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.169993 11006 raft_consensus.cc:493] T bea59f51efa648ea8d820e99be4bc7d3 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.168265 11003 raft_consensus.cc:3060] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.170506 11006 raft_consensus.cc:515] T bea59f51efa648ea8d820e99be4bc7d3 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.172518 11006 leader_election.cc:290] T bea59f51efa648ea8d820e99be4bc7d3 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:40.173911 11025 leader_election.cc:290] T bea59f51efa648ea8d820e99be4bc7d3 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:40.160337 10999 tablet_bootstrap.cc:492] T f1a15aa0b7ce423386027dfe9aced682 P 4b7d4704a4404bb19c3053c6b0af4d90: Bootstrap starting.
I20260709 13:17:40.175849 10953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea59f51efa648ea8d820e99be4bc7d3" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f" is_pre_election: true
I20260709 13:17:40.176864 10953 raft_consensus.cc:2468] T bea59f51efa648ea8d820e99be4bc7d3 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 0.
I20260709 13:17:40.177237 11006 raft_consensus.cc:493] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.177726 11006 raft_consensus.cc:515] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.178179 10843 leader_election.cc:304] T bea59f51efa648ea8d820e99be4bc7d3 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b47d3fdd5d61449593b05bde3b67069f, d567067363bd4266815405d14c8c42c4; no voters: 
I20260709 13:17:40.179891 11006 leader_election.cc:290] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:40.180438 11006 raft_consensus.cc:2804] T bea59f51efa648ea8d820e99be4bc7d3 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:40.180948 11006 raft_consensus.cc:493] T bea59f51efa648ea8d820e99be4bc7d3 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.181334 11006 raft_consensus.cc:3060] T bea59f51efa648ea8d820e99be4bc7d3 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.185024 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea59f51efa648ea8d820e99be4bc7d3" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d567067363bd4266815405d14c8c42c4" is_pre_election: true
I20260709 13:17:40.186039 10954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea59f51efa648ea8d820e99be4bc7d3" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f" is_pre_election: true
I20260709 13:17:40.186681 10954 raft_consensus.cc:2468] T bea59f51efa648ea8d820e99be4bc7d3 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 0.
I20260709 13:17:40.187884 10768 leader_election.cc:304] T bea59f51efa648ea8d820e99be4bc7d3 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, b47d3fdd5d61449593b05bde3b67069f; no voters: 
I20260709 13:17:40.189059 10805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea59f51efa648ea8d820e99be4bc7d3" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" is_pre_election: true
I20260709 13:17:40.189742 10805 raft_consensus.cc:2468] T bea59f51efa648ea8d820e99be4bc7d3 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 0.
I20260709 13:17:40.190335 11024 raft_consensus.cc:493] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.190834 11024 raft_consensus.cc:515] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.195500 10880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f935f4b4a54f5d9b3093d4f5e1b058" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d567067363bd4266815405d14c8c42c4" is_pre_election: true
I20260709 13:17:40.196446 10880 raft_consensus.cc:2468] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 0.
I20260709 13:17:40.198355 10770 leader_election.cc:304] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, d567067363bd4266815405d14c8c42c4; no voters: 
I20260709 13:17:40.212781 11025 raft_consensus.cc:2804] T bea59f51efa648ea8d820e99be4bc7d3 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:40.213210 11025 raft_consensus.cc:493] T bea59f51efa648ea8d820e99be4bc7d3 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.213627 11020 raft_consensus.cc:493] T e373165d4f2844d882994be5887e5ddf P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.219694 10954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f935f4b4a54f5d9b3093d4f5e1b058" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f" is_pre_election: true
I20260709 13:17:40.221987 11020 raft_consensus.cc:515] T e373165d4f2844d882994be5887e5ddf P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.222203 10954 raft_consensus.cc:2468] T 40f935f4b4a54f5d9b3093d4f5e1b058 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 0.
I20260709 13:17:40.226590 11020 leader_election.cc:290] T e373165d4f2844d882994be5887e5ddf P b47d3fdd5d61449593b05bde3b67069f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809)
I20260709 13:17:40.227167 11025 raft_consensus.cc:3060] T bea59f51efa648ea8d820e99be4bc7d3 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.227707 10805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e373165d4f2844d882994be5887e5ddf" candidate_uuid: "b47d3fdd5d61449593b05bde3b67069f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" is_pre_election: true
I20260709 13:17:40.227415 10880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e373165d4f2844d882994be5887e5ddf" candidate_uuid: "b47d3fdd5d61449593b05bde3b67069f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d567067363bd4266815405d14c8c42c4" is_pre_election: true
I20260709 13:17:40.228824 10880 raft_consensus.cc:2468] T e373165d4f2844d882994be5887e5ddf P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b47d3fdd5d61449593b05bde3b67069f in term 0.
I20260709 13:17:40.230206 10919 leader_election.cc:304] T e373165d4f2844d882994be5887e5ddf P b47d3fdd5d61449593b05bde3b67069f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b47d3fdd5d61449593b05bde3b67069f, d567067363bd4266815405d14c8c42c4; no voters: 
I20260709 13:17:40.231235 10805 raft_consensus.cc:2468] T e373165d4f2844d882994be5887e5ddf P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b47d3fdd5d61449593b05bde3b67069f in term 0.
I20260709 13:17:40.232206 11020 raft_consensus.cc:2804] T e373165d4f2844d882994be5887e5ddf P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:40.232755 11020 raft_consensus.cc:493] T e373165d4f2844d882994be5887e5ddf P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.233136 11020 raft_consensus.cc:3060] T e373165d4f2844d882994be5887e5ddf P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.184083 11003 raft_consensus.cc:515] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.237011 10998 tablet_bootstrap.cc:654] T f1a15aa0b7ce423386027dfe9aced682 P b47d3fdd5d61449593b05bde3b67069f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.237500 10954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d24f498cb84dd2b9139031f8e00a57" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
I20260709 13:17:40.238252 10954 raft_consensus.cc:3060] T c7d24f498cb84dd2b9139031f8e00a57 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.239969 11024 leader_election.cc:290] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:40.240635 11024 raft_consensus.cc:2804] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:40.241042 11024 raft_consensus.cc:493] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.241552 11024 raft_consensus.cc:3060] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.253978 11006 raft_consensus.cc:515] T bea59f51efa648ea8d820e99be4bc7d3 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.257107 11006 leader_election.cc:290] T bea59f51efa648ea8d820e99be4bc7d3 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 election: Requested vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:40.257155 10878 raft_consensus.cc:2393] T bea59f51efa648ea8d820e99be4bc7d3 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b7d4704a4404bb19c3053c6b0af4d90 in current term 1: Already voted for candidate d567067363bd4266815405d14c8c42c4 in this term.
I20260709 13:17:40.260708 10999 tablet_bootstrap.cc:654] T f1a15aa0b7ce423386027dfe9aced682 P 4b7d4704a4404bb19c3053c6b0af4d90: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.264708 11003 leader_election.cc:290] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 election: Requested vote from peers d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
W20260709 13:17:40.265455 10770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:37809, user_credentials={real_user=slave}} blocked reactor thread for 67230.2us
I20260709 13:17:40.266994 11024 raft_consensus.cc:515] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
W20260709 13:17:40.271179 10843 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:42139, user_credentials={real_user=slave}} blocked reactor thread for 93088.6us
I20260709 13:17:40.265347 11020 raft_consensus.cc:515] T e373165d4f2844d882994be5887e5ddf P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.279673 10998 tablet_bootstrap.cc:492] T f1a15aa0b7ce423386027dfe9aced682 P b47d3fdd5d61449593b05bde3b67069f: No bootstrap required, opened a new log
I20260709 13:17:40.286080 10805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f935f4b4a54f5d9b3093d4f5e1b058" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" is_pre_election: true
I20260709 13:17:40.286690 10998 ts_tablet_manager.cc:1403] T f1a15aa0b7ce423386027dfe9aced682 P b47d3fdd5d61449593b05bde3b67069f: Time spent bootstrapping tablet: real 0.134s	user 0.008s	sys 0.005s
I20260709 13:17:40.281603 10999 tablet_bootstrap.cc:492] T f1a15aa0b7ce423386027dfe9aced682 P 4b7d4704a4404bb19c3053c6b0af4d90: No bootstrap required, opened a new log
I20260709 13:17:40.287746 10999 ts_tablet_manager.cc:1403] T f1a15aa0b7ce423386027dfe9aced682 P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent bootstrapping tablet: real 0.128s	user 0.010s	sys 0.004s
I20260709 13:17:40.283169 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d24f498cb84dd2b9139031f8e00a57" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d567067363bd4266815405d14c8c42c4"
I20260709 13:17:40.279233 10954 raft_consensus.cc:2468] T c7d24f498cb84dd2b9139031f8e00a57 P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 1.
I20260709 13:17:40.288632 10878 raft_consensus.cc:3060] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.288861 10805 raft_consensus.cc:2393] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d567067363bd4266815405d14c8c42c4 in current term 1: Already voted for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in this term.
I20260709 13:17:40.292410 10768 leader_election.cc:304] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, b47d3fdd5d61449593b05bde3b67069f; no voters: 
I20260709 13:17:40.293085 10999 raft_consensus.cc:359] T f1a15aa0b7ce423386027dfe9aced682 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.293615 11003 raft_consensus.cc:2804] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:40.293821 10999 raft_consensus.cc:385] T f1a15aa0b7ce423386027dfe9aced682 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.294152 10999 raft_consensus.cc:740] T f1a15aa0b7ce423386027dfe9aced682 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.294821 11003 raft_consensus.cc:697] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Becoming Leader. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Running, Role: LEADER
I20260709 13:17:40.296729 10805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e373165d4f2844d882994be5887e5ddf" candidate_uuid: "b47d3fdd5d61449593b05bde3b67069f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
I20260709 13:17:40.296897 11020 leader_election.cc:290] T e373165d4f2844d882994be5887e5ddf P b47d3fdd5d61449593b05bde3b67069f [CANDIDATE]: Term 1 election: Requested vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809)
I20260709 13:17:40.297043 11024 leader_election.cc:290] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 election: Requested vote from peers d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:40.297384 10805 raft_consensus.cc:3060] T e373165d4f2844d882994be5887e5ddf P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.299503 10954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f935f4b4a54f5d9b3093d4f5e1b058" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f" is_pre_election: true
I20260709 13:17:40.300278 10954 raft_consensus.cc:2468] T 40f935f4b4a54f5d9b3093d4f5e1b058 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 0.
I20260709 13:17:40.300628 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea59f51efa648ea8d820e99be4bc7d3" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
I20260709 13:17:40.299539 11002 tablet_bootstrap.cc:492] T 26ad1205065a48b29567ed4c89b20059 P d567067363bd4266815405d14c8c42c4: No bootstrap required, opened a new log
I20260709 13:17:40.301811 10880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f935f4b4a54f5d9b3093d4f5e1b058" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d567067363bd4266815405d14c8c42c4"
I20260709 13:17:40.296449 11003 consensus_queue.cc:237] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.302426 10880 raft_consensus.cc:3060] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.302256 11025 raft_consensus.cc:515] T bea59f51efa648ea8d820e99be4bc7d3 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.303548 10804 raft_consensus.cc:2393] T bea59f51efa648ea8d820e99be4bc7d3 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d567067363bd4266815405d14c8c42c4 in current term 1: Already voted for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in this term.
I20260709 13:17:40.304217 10954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea59f51efa648ea8d820e99be4bc7d3" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
I20260709 13:17:40.305761 10954 raft_consensus.cc:3060] T bea59f51efa648ea8d820e99be4bc7d3 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.307531 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea59f51efa648ea8d820e99be4bc7d3" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d567067363bd4266815405d14c8c42c4"
I20260709 13:17:40.308542 10877 raft_consensus.cc:2393] T bea59f51efa648ea8d820e99be4bc7d3 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b7d4704a4404bb19c3053c6b0af4d90 in current term 1: Already voted for candidate d567067363bd4266815405d14c8c42c4 in this term.
I20260709 13:17:40.310452 11025 leader_election.cc:290] T bea59f51efa648ea8d820e99be4bc7d3 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 election: Requested vote from peers d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:40.302009 11002 ts_tablet_manager.cc:1403] T 26ad1205065a48b29567ed4c89b20059 P d567067363bd4266815405d14c8c42c4: Time spent bootstrapping tablet: real 0.151s	user 0.053s	sys 0.072s
I20260709 13:17:40.304975 10879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e373165d4f2844d882994be5887e5ddf" candidate_uuid: "b47d3fdd5d61449593b05bde3b67069f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d567067363bd4266815405d14c8c42c4"
I20260709 13:17:40.311364 10879 raft_consensus.cc:3060] T e373165d4f2844d882994be5887e5ddf P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.313994 11002 raft_consensus.cc:359] T 26ad1205065a48b29567ed4c89b20059 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.314908 11002 raft_consensus.cc:385] T 26ad1205065a48b29567ed4c89b20059 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.315219 11002 raft_consensus.cc:740] T 26ad1205065a48b29567ed4c89b20059 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d567067363bd4266815405d14c8c42c4, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.306488 10953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f935f4b4a54f5d9b3093d4f5e1b058" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
I20260709 13:17:40.316015 11002 consensus_queue.cc:260] T 26ad1205065a48b29567ed4c89b20059 P d567067363bd4266815405d14c8c42c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.318409 11002 ts_tablet_manager.cc:1434] T 26ad1205065a48b29567ed4c89b20059 P d567067363bd4266815405d14c8c42c4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:40.321059 10954 raft_consensus.cc:2468] T bea59f51efa648ea8d820e99be4bc7d3 P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 1.
I20260709 13:17:40.321532 10843 leader_election.cc:304] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b47d3fdd5d61449593b05bde3b67069f, d567067363bd4266815405d14c8c42c4; no voters: 4b7d4704a4404bb19c3053c6b0af4d90
I20260709 13:17:40.321751 10878 raft_consensus.cc:2468] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 1.
I20260709 13:17:40.324942 10954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea59f51efa648ea8d820e99be4bc7d3" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
I20260709 13:17:40.326000 10954 raft_consensus.cc:2393] T bea59f51efa648ea8d820e99be4bc7d3 P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b7d4704a4404bb19c3053c6b0af4d90 in current term 1: Already voted for candidate d567067363bd4266815405d14c8c42c4 in this term.
I20260709 13:17:40.327797 10843 leader_election.cc:304] T bea59f51efa648ea8d820e99be4bc7d3 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b47d3fdd5d61449593b05bde3b67069f, d567067363bd4266815405d14c8c42c4; no voters: 4b7d4704a4404bb19c3053c6b0af4d90
I20260709 13:17:40.328840 11046 raft_consensus.cc:2804] T bea59f51efa648ea8d820e99be4bc7d3 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:40.316777 10953 raft_consensus.cc:3060] T 40f935f4b4a54f5d9b3093d4f5e1b058 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.333164 10768 leader_election.cc:304] T bea59f51efa648ea8d820e99be4bc7d3 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90; no voters: b47d3fdd5d61449593b05bde3b67069f, d567067363bd4266815405d14c8c42c4
I20260709 13:17:40.336408 11025 raft_consensus.cc:2749] T bea59f51efa648ea8d820e99be4bc7d3 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:40.346328 11052 raft_consensus.cc:493] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.347856 11052 raft_consensus.cc:515] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.352919 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81eef65db7ff4e8cb37f06a3decd4320" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" is_pre_election: true
I20260709 13:17:40.353578 10804 raft_consensus.cc:2468] T 81eef65db7ff4e8cb37f06a3decd4320 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 0.
I20260709 13:17:40.355103 10843 leader_election.cc:304] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, d567067363bd4266815405d14c8c42c4; no voters: 
I20260709 13:17:40.355185 10953 raft_consensus.cc:2468] T 40f935f4b4a54f5d9b3093d4f5e1b058 P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 1.
I20260709 13:17:40.356982 10768 leader_election.cc:304] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, b47d3fdd5d61449593b05bde3b67069f; no voters: 
I20260709 13:17:40.358024 11025 raft_consensus.cc:2804] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:40.358495 11025 raft_consensus.cc:697] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Becoming Leader. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Running, Role: LEADER
I20260709 13:17:40.358865 10954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81eef65db7ff4e8cb37f06a3decd4320" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f" is_pre_election: true
I20260709 13:17:40.359583 10954 raft_consensus.cc:2468] T 81eef65db7ff4e8cb37f06a3decd4320 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 0.
I20260709 13:17:40.359318 11025 consensus_queue.cc:237] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.361865 11052 leader_election.cc:290] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:40.365846 11052 raft_consensus.cc:2804] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:40.367223 11052 raft_consensus.cc:493] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.367460 10880 raft_consensus.cc:2468] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 1.
I20260709 13:17:40.368225 11006 raft_consensus.cc:2764] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:17:40.295169 10998 raft_consensus.cc:359] T f1a15aa0b7ce423386027dfe9aced682 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.369071 10998 raft_consensus.cc:385] T f1a15aa0b7ce423386027dfe9aced682 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.369369 10998 raft_consensus.cc:740] T f1a15aa0b7ce423386027dfe9aced682 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b47d3fdd5d61449593b05bde3b67069f, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.294842 10999 consensus_queue.cc:260] T f1a15aa0b7ce423386027dfe9aced682 P 4b7d4704a4404bb19c3053c6b0af4d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.370313 11052 raft_consensus.cc:3060] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.377503 11025 consensus_queue.cc:1048] T 11aa1269fea7424ea33a0e9bcd4e64fb P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:40.370373 10998 consensus_queue.cc:260] T f1a15aa0b7ce423386027dfe9aced682 P b47d3fdd5d61449593b05bde3b67069f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.372406 10999 ts_tablet_manager.cc:1434] T f1a15aa0b7ce423386027dfe9aced682 P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent starting tablet: real 0.084s	user 0.006s	sys 0.000s
I20260709 13:17:40.380157 10805 raft_consensus.cc:2468] T e373165d4f2844d882994be5887e5ddf P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b47d3fdd5d61449593b05bde3b67069f in term 1.
I20260709 13:17:40.386533 10998 ts_tablet_manager.cc:1434] T f1a15aa0b7ce423386027dfe9aced682 P b47d3fdd5d61449593b05bde3b67069f: Time spent starting tablet: real 0.099s	user 0.001s	sys 0.009s
I20260709 13:17:40.386616 10917 leader_election.cc:304] T e373165d4f2844d882994be5887e5ddf P b47d3fdd5d61449593b05bde3b67069f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, b47d3fdd5d61449593b05bde3b67069f; no voters: 
I20260709 13:17:40.376293 10879 raft_consensus.cc:2468] T e373165d4f2844d882994be5887e5ddf P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b47d3fdd5d61449593b05bde3b67069f in term 1.
I20260709 13:17:40.387615 11020 raft_consensus.cc:2804] T e373165d4f2844d882994be5887e5ddf P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:40.388267 11020 raft_consensus.cc:697] T e373165d4f2844d882994be5887e5ddf P b47d3fdd5d61449593b05bde3b67069f [term 1 LEADER]: Becoming Leader. State: Replica: b47d3fdd5d61449593b05bde3b67069f, State: Running, Role: LEADER
I20260709 13:17:40.387637 10702 catalog_manager.cc:5697] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:40.389748 11020 consensus_queue.cc:237] T e373165d4f2844d882994be5887e5ddf P b47d3fdd5d61449593b05bde3b67069f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.395968 11052 raft_consensus.cc:515] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.400636 11046 raft_consensus.cc:697] T bea59f51efa648ea8d820e99be4bc7d3 P d567067363bd4266815405d14c8c42c4 [term 1 LEADER]: Becoming Leader. State: Replica: d567067363bd4266815405d14c8c42c4, State: Running, Role: LEADER
I20260709 13:17:40.402122 11046 consensus_queue.cc:237] T bea59f51efa648ea8d820e99be4bc7d3 P d567067363bd4266815405d14c8c42c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.411477 10702 catalog_manager.cc:5697] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:40.412194 10805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81eef65db7ff4e8cb37f06a3decd4320" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
I20260709 13:17:40.414045 10805 raft_consensus.cc:3060] T 81eef65db7ff4e8cb37f06a3decd4320 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.431375 10953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81eef65db7ff4e8cb37f06a3decd4320" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
I20260709 13:17:40.434504 11052 leader_election.cc:290] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 election: Requested vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:40.435716 10953 raft_consensus.cc:3060] T 81eef65db7ff4e8cb37f06a3decd4320 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.439388 11024 consensus_queue.cc:1048] T 11aa1269fea7424ea33a0e9bcd4e64fb P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:40.446080 10700 catalog_manager.cc:5697] T e373165d4f2844d882994be5887e5ddf P b47d3fdd5d61449593b05bde3b67069f reported cstate change: term changed from 0 to 1, leader changed from <none> to b47d3fdd5d61449593b05bde3b67069f (127.30.63.3). New cstate: current_term: 1 leader_uuid: "b47d3fdd5d61449593b05bde3b67069f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:40.447471 11020 consensus_queue.cc:1048] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:40.446367 10701 catalog_manager.cc:5697] T bea59f51efa648ea8d820e99be4bc7d3 P d567067363bd4266815405d14c8c42c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d567067363bd4266815405d14c8c42c4 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "d567067363bd4266815405d14c8c42c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:40.452757 10751 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:40.474638 10953 raft_consensus.cc:2468] T 81eef65db7ff4e8cb37f06a3decd4320 P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 1.
I20260709 13:17:40.476132 10805 raft_consensus.cc:2468] T 81eef65db7ff4e8cb37f06a3decd4320 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 1.
I20260709 13:17:40.476146 10843 leader_election.cc:304] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b47d3fdd5d61449593b05bde3b67069f, d567067363bd4266815405d14c8c42c4; no voters: 
I20260709 13:17:40.477438 11052 raft_consensus.cc:2804] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:40.477952 11052 raft_consensus.cc:697] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4 [term 1 LEADER]: Becoming Leader. State: Replica: d567067363bd4266815405d14c8c42c4, State: Running, Role: LEADER
I20260709 13:17:40.478978 11052 consensus_queue.cc:237] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.487818 11020 consensus_queue.cc:1048] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:40.511409 11052 raft_consensus.cc:493] T f1a15aa0b7ce423386027dfe9aced682 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.512102 11052 raft_consensus.cc:515] T f1a15aa0b7ce423386027dfe9aced682 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.514276 11003 raft_consensus.cc:493] T f1a15aa0b7ce423386027dfe9aced682 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.515084 11003 raft_consensus.cc:515] T f1a15aa0b7ce423386027dfe9aced682 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.515975 11052 leader_election.cc:290] T f1a15aa0b7ce423386027dfe9aced682 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:40.518136 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a15aa0b7ce423386027dfe9aced682" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" is_pre_election: true
I20260709 13:17:40.519112 10804 raft_consensus.cc:2468] T f1a15aa0b7ce423386027dfe9aced682 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 0.
I20260709 13:17:40.521148 10843 leader_election.cc:304] T f1a15aa0b7ce423386027dfe9aced682 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, d567067363bd4266815405d14c8c42c4; no voters: 
I20260709 13:17:40.522189 11052 raft_consensus.cc:2804] T f1a15aa0b7ce423386027dfe9aced682 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:40.522572 11052 raft_consensus.cc:493] T f1a15aa0b7ce423386027dfe9aced682 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.522913 11052 raft_consensus.cc:3060] T f1a15aa0b7ce423386027dfe9aced682 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.526755 10879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a15aa0b7ce423386027dfe9aced682" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d567067363bd4266815405d14c8c42c4" is_pre_election: true
I20260709 13:17:40.528605 10954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a15aa0b7ce423386027dfe9aced682" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f" is_pre_election: true
I20260709 13:17:40.529389 10954 raft_consensus.cc:2468] T f1a15aa0b7ce423386027dfe9aced682 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 0.
I20260709 13:17:40.529551 10953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a15aa0b7ce423386027dfe9aced682" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f" is_pre_election: true
I20260709 13:17:40.530144 10953 raft_consensus.cc:2468] T f1a15aa0b7ce423386027dfe9aced682 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 0.
I20260709 13:17:40.530784 10768 leader_election.cc:304] T f1a15aa0b7ce423386027dfe9aced682 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, b47d3fdd5d61449593b05bde3b67069f; no voters: 
I20260709 13:17:40.531685 11024 raft_consensus.cc:2804] T f1a15aa0b7ce423386027dfe9aced682 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:40.532044 11024 raft_consensus.cc:493] T f1a15aa0b7ce423386027dfe9aced682 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.532372 11024 raft_consensus.cc:3060] T f1a15aa0b7ce423386027dfe9aced682 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.535207 11052 raft_consensus.cc:515] T f1a15aa0b7ce423386027dfe9aced682 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.532407 11003 leader_election.cc:290] T f1a15aa0b7ce423386027dfe9aced682 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:40.540028 11052 leader_election.cc:290] T f1a15aa0b7ce423386027dfe9aced682 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 election: Requested vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:40.540479 10879 raft_consensus.cc:2393] T f1a15aa0b7ce423386027dfe9aced682 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b7d4704a4404bb19c3053c6b0af4d90 in current term 1: Already voted for candidate d567067363bd4266815405d14c8c42c4 in this term.
I20260709 13:17:40.544469 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a15aa0b7ce423386027dfe9aced682" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
I20260709 13:17:40.544656 10701 catalog_manager.cc:5697] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d567067363bd4266815405d14c8c42c4 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "d567067363bd4266815405d14c8c42c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:40.551884 11024 raft_consensus.cc:515] T f1a15aa0b7ce423386027dfe9aced682 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.546090 10953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a15aa0b7ce423386027dfe9aced682" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
I20260709 13:17:40.553315 10953 raft_consensus.cc:3060] T f1a15aa0b7ce423386027dfe9aced682 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.554761 11024 leader_election.cc:290] T f1a15aa0b7ce423386027dfe9aced682 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 election: Requested vote from peers d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:40.555948 10804 raft_consensus.cc:2393] T f1a15aa0b7ce423386027dfe9aced682 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d567067363bd4266815405d14c8c42c4 in current term 1: Already voted for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in this term.
I20260709 13:17:40.556366 10954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a15aa0b7ce423386027dfe9aced682" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
I20260709 13:17:40.558162 10879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a15aa0b7ce423386027dfe9aced682" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d567067363bd4266815405d14c8c42c4"
I20260709 13:17:40.559010 10879 raft_consensus.cc:2393] T f1a15aa0b7ce423386027dfe9aced682 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b7d4704a4404bb19c3053c6b0af4d90 in current term 1: Already voted for candidate d567067363bd4266815405d14c8c42c4 in this term.
I20260709 13:17:40.561300 10770 leader_election.cc:304] T f1a15aa0b7ce423386027dfe9aced682 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90; no voters: b47d3fdd5d61449593b05bde3b67069f, d567067363bd4266815405d14c8c42c4
I20260709 13:17:40.565739 11024 raft_consensus.cc:2749] T f1a15aa0b7ce423386027dfe9aced682 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:40.570057 10953 raft_consensus.cc:2468] T f1a15aa0b7ce423386027dfe9aced682 P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 1.
I20260709 13:17:40.571643 10843 leader_election.cc:304] T f1a15aa0b7ce423386027dfe9aced682 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b47d3fdd5d61449593b05bde3b67069f, d567067363bd4266815405d14c8c42c4; no voters: 4b7d4704a4404bb19c3053c6b0af4d90
I20260709 13:17:40.572532 11052 raft_consensus.cc:2804] T f1a15aa0b7ce423386027dfe9aced682 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:40.573020 11052 raft_consensus.cc:697] T f1a15aa0b7ce423386027dfe9aced682 P d567067363bd4266815405d14c8c42c4 [term 1 LEADER]: Becoming Leader. State: Replica: d567067363bd4266815405d14c8c42c4, State: Running, Role: LEADER
I20260709 13:17:40.573820 11052 consensus_queue.cc:237] T f1a15aa0b7ce423386027dfe9aced682 P d567067363bd4266815405d14c8c42c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.581187 10699 catalog_manager.cc:5697] T f1a15aa0b7ce423386027dfe9aced682 P d567067363bd4266815405d14c8c42c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d567067363bd4266815405d14c8c42c4 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "d567067363bd4266815405d14c8c42c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:40.606732 11052 raft_consensus.cc:493] T 26ad1205065a48b29567ed4c89b20059 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.607429 11052 raft_consensus.cc:515] T 26ad1205065a48b29567ed4c89b20059 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.609404 11052 leader_election.cc:290] T 26ad1205065a48b29567ed4c89b20059 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:40.610772 10953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ad1205065a48b29567ed4c89b20059" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f" is_pre_election: true
I20260709 13:17:40.610663 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ad1205065a48b29567ed4c89b20059" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" is_pre_election: true
I20260709 13:17:40.611814 10953 raft_consensus.cc:2393] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d567067363bd4266815405d14c8c42c4 in current term 1: Already voted for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in this term.
I20260709 13:17:40.612970 10843 leader_election.cc:304] T 26ad1205065a48b29567ed4c89b20059 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d567067363bd4266815405d14c8c42c4; no voters: 4b7d4704a4404bb19c3053c6b0af4d90, b47d3fdd5d61449593b05bde3b67069f
I20260709 13:17:40.613740 11052 raft_consensus.cc:3060] T 26ad1205065a48b29567ed4c89b20059 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.619856 11052 raft_consensus.cc:2749] T 26ad1205065a48b29567ed4c89b20059 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:40.629724 11024 consensus_queue.cc:1048] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:40.644834 11047 consensus_queue.cc:1048] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:40.768252 11047 consensus_queue.cc:1048] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:40.787459 11020 consensus_queue.cc:1048] T e373165d4f2844d882994be5887e5ddf P b47d3fdd5d61449593b05bde3b67069f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:40.789063 11047 consensus_queue.cc:1048] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:40.809262 11065 consensus_queue.cc:1048] T e373165d4f2844d882994be5887e5ddf P b47d3fdd5d61449593b05bde3b67069f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:40.848290 10953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a876d18e09a4577a85ca26975da0e8d"
dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
mode: GRACEFUL
new_leader_uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
 from {username='slave'} at 127.0.0.1:33030
I20260709 13:17:40.849043 10953 raft_consensus.cc:606] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f [term 1 LEADER]: Received request to transfer leadership to TS 4b7d4704a4404bb19c3053c6b0af4d90
I20260709 13:17:40.873571 10879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81eef65db7ff4e8cb37f06a3decd4320"
dest_uuid: "d567067363bd4266815405d14c8c42c4"
mode: GRACEFUL
new_leader_uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
 from {username='slave'} at 127.0.0.1:52438
I20260709 13:17:40.874185 10879 raft_consensus.cc:606] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4 [term 1 LEADER]: Received request to transfer leadership to TS 4b7d4704a4404bb19c3053c6b0af4d90
I20260709 13:17:40.890959 10804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40f935f4b4a54f5d9b3093d4f5e1b058"
dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
mode: GRACEFUL
new_leader_uuid: "d567067363bd4266815405d14c8c42c4"
 from {username='slave'} at 127.0.0.1:58660
I20260709 13:17:40.891537 10804 raft_consensus.cc:606] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Received request to transfer leadership to TS d567067363bd4266815405d14c8c42c4
I20260709 13:17:40.901362 10804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7d24f498cb84dd2b9139031f8e00a57"
dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
mode: GRACEFUL
new_leader_uuid: "d567067363bd4266815405d14c8c42c4"
 from {username='slave'} at 127.0.0.1:58660
I20260709 13:17:40.902002 10804 raft_consensus.cc:606] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Received request to transfer leadership to TS d567067363bd4266815405d14c8c42c4
I20260709 13:17:40.915395 11052 consensus_queue.cc:1048] T bea59f51efa648ea8d820e99be4bc7d3 P d567067363bd4266815405d14c8c42c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:40.918608 11003 consensus_queue.cc:1048] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:40.929036 11052 consensus_queue.cc:1048] T bea59f51efa648ea8d820e99be4bc7d3 P d567067363bd4266815405d14c8c42c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:40.940778 11047 consensus_queue.cc:1048] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:40.975061 11047 raft_consensus.cc:993] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90: : Instructing follower d567067363bd4266815405d14c8c42c4 to start an election
I20260709 13:17:40.975569 11047 raft_consensus.cc:1081] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Signalling peer d567067363bd4266815405d14c8c42c4 to start an election
I20260709 13:17:40.978307 10879 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40f935f4b4a54f5d9b3093d4f5e1b058"
dest_uuid: "d567067363bd4266815405d14c8c42c4"
 from {username='slave'} at 127.0.0.1:52434
I20260709 13:17:40.978943 10879 raft_consensus.cc:493] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:40.979337 10879 raft_consensus.cc:3060] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:40.980165 11052 consensus_queue.cc:1048] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:40.988603 10879 raft_consensus.cc:515] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:40.989959 11079 consensus_queue.cc:1048] T f1a15aa0b7ce423386027dfe9aced682 P d567067363bd4266815405d14c8c42c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:40.993110 10879 leader_election.cc:290] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 2 election: Requested vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:40.994560 10954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f935f4b4a54f5d9b3093d4f5e1b058" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
I20260709 13:17:40.995605 10954 raft_consensus.cc:3060] T 40f935f4b4a54f5d9b3093d4f5e1b058 P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.041185 10954 raft_consensus.cc:2468] T 40f935f4b4a54f5d9b3093d4f5e1b058 P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 2.
I20260709 13:17:41.051997 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f935f4b4a54f5d9b3093d4f5e1b058" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
I20260709 13:17:41.053493 10804 raft_consensus.cc:3055] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:41.072242 10804 raft_consensus.cc:740] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Running, Role: LEADER
I20260709 13:17:41.074513 11026 raft_consensus.cc:993] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f: : Instructing follower 4b7d4704a4404bb19c3053c6b0af4d90 to start an election
I20260709 13:17:41.074115 10804 consensus_queue.cc:260] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:41.075543 11026 raft_consensus.cc:1081] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f [term 1 LEADER]: Signalling peer 4b7d4704a4404bb19c3053c6b0af4d90 to start an election
I20260709 13:17:41.078110 10804 raft_consensus.cc:3060] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.079010 10803 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a876d18e09a4577a85ca26975da0e8d"
dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
 from {username='slave'} at 127.0.0.1:58648
I20260709 13:17:41.080157 10803 raft_consensus.cc:493] T 7a876d18e09a4577a85ca26975da0e8d P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:41.080649 10803 raft_consensus.cc:3060] T 7a876d18e09a4577a85ca26975da0e8d P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.080551 11079 consensus_queue.cc:1048] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:41.083129 10843 leader_election.cc:304] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b47d3fdd5d61449593b05bde3b67069f, d567067363bd4266815405d14c8c42c4; no voters: 
I20260709 13:17:41.086848 11052 raft_consensus.cc:2804] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:41.087930 11052 raft_consensus.cc:697] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [term 2 LEADER]: Becoming Leader. State: Replica: d567067363bd4266815405d14c8c42c4, State: Running, Role: LEADER
I20260709 13:17:41.093482 11052 consensus_queue.cc:237] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:41.099232 10804 raft_consensus.cc:2468] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 2.
I20260709 13:17:41.109349 10803 raft_consensus.cc:515] T 7a876d18e09a4577a85ca26975da0e8d P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } }
I20260709 13:17:41.119622 11046 consensus_queue.cc:1048] T f1a15aa0b7ce423386027dfe9aced682 P d567067363bd4266815405d14c8c42c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:41.123962 10701 catalog_manager.cc:5697] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 reported cstate change: term changed from 1 to 2, leader changed from 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1) to d567067363bd4266815405d14c8c42c4 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "d567067363bd4266815405d14c8c42c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:41.134328 10953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a876d18e09a4577a85ca26975da0e8d" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
I20260709 13:17:41.135218 10953 raft_consensus.cc:3055] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:41.135623 10953 raft_consensus.cc:740] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b47d3fdd5d61449593b05bde3b67069f, State: Running, Role: LEADER
I20260709 13:17:41.137089 10953 consensus_queue.cc:260] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } }
I20260709 13:17:41.138903 10953 raft_consensus.cc:3060] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.142055 11046 raft_consensus.cc:993] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4: : Instructing follower 4b7d4704a4404bb19c3053c6b0af4d90 to start an election
I20260709 13:17:41.142810 11046 raft_consensus.cc:1081] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4 [term 1 LEADER]: Signalling peer 4b7d4704a4404bb19c3053c6b0af4d90 to start an election
I20260709 13:17:41.145506 10805 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81eef65db7ff4e8cb37f06a3decd4320"
dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
 from {username='slave'} at 127.0.0.1:58656
I20260709 13:17:41.146118 10805 raft_consensus.cc:493] T 81eef65db7ff4e8cb37f06a3decd4320 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:41.146503 10805 raft_consensus.cc:3060] T 81eef65db7ff4e8cb37f06a3decd4320 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.150430 10803 leader_election.cc:290] T 7a876d18e09a4577a85ca26975da0e8d P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 2 election: Requested vote from peers b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139), d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809)
I20260709 13:17:41.151966 10879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a876d18e09a4577a85ca26975da0e8d" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d567067363bd4266815405d14c8c42c4"
I20260709 13:17:41.152918 10879 raft_consensus.cc:3060] T 7a876d18e09a4577a85ca26975da0e8d P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.161818 10805 raft_consensus.cc:515] T 81eef65db7ff4e8cb37f06a3decd4320 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:41.164686 10805 leader_election.cc:290] T 81eef65db7ff4e8cb37f06a3decd4320 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 2 election: Requested vote from peers d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:41.165519 10880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81eef65db7ff4e8cb37f06a3decd4320" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d567067363bd4266815405d14c8c42c4"
I20260709 13:17:41.166206 10954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81eef65db7ff4e8cb37f06a3decd4320" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
I20260709 13:17:41.167181 10954 raft_consensus.cc:3060] T 81eef65db7ff4e8cb37f06a3decd4320 P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.166383 10880 raft_consensus.cc:3055] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:41.167930 10880 raft_consensus.cc:740] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d567067363bd4266815405d14c8c42c4, State: Running, Role: LEADER
I20260709 13:17:41.169039 10880 consensus_queue.cc:260] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:41.171200 10880 raft_consensus.cc:3060] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.176245 10954 raft_consensus.cc:2468] T 81eef65db7ff4e8cb37f06a3decd4320 P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 2.
I20260709 13:17:41.177560 10879 raft_consensus.cc:2468] T 7a876d18e09a4577a85ca26975da0e8d P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 2.
I20260709 13:17:41.178179 10768 leader_election.cc:304] T 81eef65db7ff4e8cb37f06a3decd4320 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, b47d3fdd5d61449593b05bde3b67069f; no voters: 
I20260709 13:17:41.179934 11024 raft_consensus.cc:2804] T 81eef65db7ff4e8cb37f06a3decd4320 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:41.180646 11024 raft_consensus.cc:697] T 81eef65db7ff4e8cb37f06a3decd4320 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 LEADER]: Becoming Leader. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Running, Role: LEADER
I20260709 13:17:41.182175 11024 consensus_queue.cc:237] T 81eef65db7ff4e8cb37f06a3decd4320 P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:41.185788 10953 raft_consensus.cc:2468] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 2.
I20260709 13:17:41.186069 10770 leader_election.cc:304] T 7a876d18e09a4577a85ca26975da0e8d P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, d567067363bd4266815405d14c8c42c4; no voters: 
I20260709 13:17:41.188717 11025 raft_consensus.cc:2804] T 7a876d18e09a4577a85ca26975da0e8d P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:41.189422 11025 raft_consensus.cc:697] T 7a876d18e09a4577a85ca26975da0e8d P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 LEADER]: Becoming Leader. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Running, Role: LEADER
I20260709 13:17:41.191098 11025 consensus_queue.cc:237] T 7a876d18e09a4577a85ca26975da0e8d P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } }
I20260709 13:17:41.196211 10880 raft_consensus.cc:2468] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 2.
I20260709 13:17:41.220755 10699 catalog_manager.cc:5697] T 81eef65db7ff4e8cb37f06a3decd4320 P 4b7d4704a4404bb19c3053c6b0af4d90 reported cstate change: term changed from 1 to 2, leader changed from d567067363bd4266815405d14c8c42c4 (127.30.63.2) to 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1). New cstate: current_term: 2 leader_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:41.223227 10699 catalog_manager.cc:5697] T 7a876d18e09a4577a85ca26975da0e8d P 4b7d4704a4404bb19c3053c6b0af4d90 reported cstate change: term changed from 1 to 2, leader changed from b47d3fdd5d61449593b05bde3b67069f (127.30.63.3) to 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1). New cstate: current_term: 2 leader_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:41.226529 11025 raft_consensus.cc:993] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90: : Instructing follower d567067363bd4266815405d14c8c42c4 to start an election
I20260709 13:17:41.227324 11024 raft_consensus.cc:1081] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Signalling peer d567067363bd4266815405d14c8c42c4 to start an election
I20260709 13:17:41.229815 10880 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7d24f498cb84dd2b9139031f8e00a57"
dest_uuid: "d567067363bd4266815405d14c8c42c4"
 from {username='slave'} at 127.0.0.1:52434
I20260709 13:17:41.230600 10880 raft_consensus.cc:493] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:41.231093 10880 raft_consensus.cc:3060] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.240514 10880 raft_consensus.cc:515] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:41.244422 10805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d24f498cb84dd2b9139031f8e00a57" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
I20260709 13:17:41.245167 10805 raft_consensus.cc:3055] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:41.245680 10805 raft_consensus.cc:740] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Running, Role: LEADER
I20260709 13:17:41.245923 10880 leader_election.cc:290] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 2 election: Requested vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:41.246865 10805 consensus_queue.cc:260] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:41.247968 10805 raft_consensus.cc:3060] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.248721 10953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d24f498cb84dd2b9139031f8e00a57" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
I20260709 13:17:41.249378 10953 raft_consensus.cc:3060] T c7d24f498cb84dd2b9139031f8e00a57 P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.256289 10805 raft_consensus.cc:2468] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 2.
I20260709 13:17:41.257157 10953 raft_consensus.cc:2468] T c7d24f498cb84dd2b9139031f8e00a57 P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 2.
I20260709 13:17:41.258858 10843 leader_election.cc:304] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b47d3fdd5d61449593b05bde3b67069f, d567067363bd4266815405d14c8c42c4; no voters: 
I20260709 13:17:41.259824 11052 raft_consensus.cc:2804] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:41.260334 11052 raft_consensus.cc:697] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4 [term 2 LEADER]: Becoming Leader. State: Replica: d567067363bd4266815405d14c8c42c4, State: Running, Role: LEADER
I20260709 13:17:41.261445 11052 consensus_queue.cc:237] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:41.271081 10699 catalog_manager.cc:5697] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4 reported cstate change: term changed from 1 to 2, leader changed from 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1) to d567067363bd4266815405d14c8c42c4 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "d567067363bd4266815405d14c8c42c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:41.566608 10880 raft_consensus.cc:1275] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Refusing update from remote peer 4b7d4704a4404bb19c3053c6b0af4d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:41.568068 11024 consensus_queue.cc:1048] T 81eef65db7ff4e8cb37f06a3decd4320 P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:41.578075 10953 raft_consensus.cc:1275] T 81eef65db7ff4e8cb37f06a3decd4320 P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Refusing update from remote peer 4b7d4704a4404bb19c3053c6b0af4d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:41.579843 11003 consensus_queue.cc:1048] T 81eef65db7ff4e8cb37f06a3decd4320 P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:41.604180 10953 raft_consensus.cc:1275] T 40f935f4b4a54f5d9b3093d4f5e1b058 P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Refusing update from remote peer d567067363bd4266815405d14c8c42c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:41.605541 11052 consensus_queue.cc:1048] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:41.614854 10805 raft_consensus.cc:1275] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Refusing update from remote peer d567067363bd4266815405d14c8c42c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:41.619433 11046 consensus_queue.cc:1048] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:41.675863 10953 raft_consensus.cc:1275] T c7d24f498cb84dd2b9139031f8e00a57 P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Refusing update from remote peer d567067363bd4266815405d14c8c42c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:41.677280 11079 consensus_queue.cc:1048] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:41.687207 10805 raft_consensus.cc:1275] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Refusing update from remote peer d567067363bd4266815405d14c8c42c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:41.689113 11079 consensus_queue.cc:1048] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:41.710000 10954 raft_consensus.cc:1275] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Refusing update from remote peer 4b7d4704a4404bb19c3053c6b0af4d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:41.711872 11003 consensus_queue.cc:1048] T 7a876d18e09a4577a85ca26975da0e8d P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:41.727357 10880 raft_consensus.cc:1275] T 7a876d18e09a4577a85ca26975da0e8d P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Refusing update from remote peer 4b7d4704a4404bb19c3053c6b0af4d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:41.728737 11025 consensus_queue.cc:1048] T 7a876d18e09a4577a85ca26975da0e8d P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:43.943496 10701 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45684:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:43.946013 10701 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:43.995396 10794 tablet_service.cc:1511] Processing CreateTablet for tablet f62d1d32fe7e48cb97f4a3a34344a783 (DEFAULT_TABLE table=soft_deleted_table [id=95f862aa7233487a901acfa3657b78bf]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:43.996622 10869 tablet_service.cc:1511] Processing CreateTablet for tablet f62d1d32fe7e48cb97f4a3a34344a783 (DEFAULT_TABLE table=soft_deleted_table [id=95f862aa7233487a901acfa3657b78bf]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:43.997380 10794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f62d1d32fe7e48cb97f4a3a34344a783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.997841 10944 tablet_service.cc:1511] Processing CreateTablet for tablet f62d1d32fe7e48cb97f4a3a34344a783 (DEFAULT_TABLE table=soft_deleted_table [id=95f862aa7233487a901acfa3657b78bf]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:43.998330 10869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f62d1d32fe7e48cb97f4a3a34344a783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:43.999387 10944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f62d1d32fe7e48cb97f4a3a34344a783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:44.003119 10863 tablet_service.cc:1511] Processing CreateTablet for tablet 499fadc1dd974c6588cedb5301e3d71d (DEFAULT_TABLE table=soft_deleted_table [id=95f862aa7233487a901acfa3657b78bf]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:44.004659 10863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 499fadc1dd974c6588cedb5301e3d71d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:44.010838 10793 tablet_service.cc:1511] Processing CreateTablet for tablet 499fadc1dd974c6588cedb5301e3d71d (DEFAULT_TABLE table=soft_deleted_table [id=95f862aa7233487a901acfa3657b78bf]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:44.011533 10792 tablet_service.cc:1511] Processing CreateTablet for tablet d29baf3eb63d4bb6b0f9baa028d1fc01 (DEFAULT_TABLE table=soft_deleted_table [id=95f862aa7233487a901acfa3657b78bf]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:44.012497 10793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 499fadc1dd974c6588cedb5301e3d71d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:44.013717 10937 tablet_service.cc:1511] Processing CreateTablet for tablet 499fadc1dd974c6588cedb5301e3d71d (DEFAULT_TABLE table=soft_deleted_table [id=95f862aa7233487a901acfa3657b78bf]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:44.016566 10940 tablet_service.cc:1511] Processing CreateTablet for tablet d29baf3eb63d4bb6b0f9baa028d1fc01 (DEFAULT_TABLE table=soft_deleted_table [id=95f862aa7233487a901acfa3657b78bf]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:44.019098 10939 tablet_service.cc:1511] Processing CreateTablet for tablet debc9febb2c34accb753acbebaf990cb (DEFAULT_TABLE table=soft_deleted_table [id=95f862aa7233487a901acfa3657b78bf]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:44.021659 10795 tablet_service.cc:1511] Processing CreateTablet for tablet debc9febb2c34accb753acbebaf990cb (DEFAULT_TABLE table=soft_deleted_table [id=95f862aa7233487a901acfa3657b78bf]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:44.022024 10791 tablet_service.cc:1511] Processing CreateTablet for tablet 1d4899a931c04cc5bd67c793cc9cc6af (DEFAULT_TABLE table=soft_deleted_table [id=95f862aa7233487a901acfa3657b78bf]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:44.023288 10795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet debc9febb2c34accb753acbebaf990cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:44.024049 10866 tablet_service.cc:1511] Processing CreateTablet for tablet d29baf3eb63d4bb6b0f9baa028d1fc01 (DEFAULT_TABLE table=soft_deleted_table [id=95f862aa7233487a901acfa3657b78bf]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:44.024732 10867 tablet_service.cc:1511] Processing CreateTablet for tablet debc9febb2c34accb753acbebaf990cb (DEFAULT_TABLE table=soft_deleted_table [id=95f862aa7233487a901acfa3657b78bf]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:44.025597 10866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d29baf3eb63d4bb6b0f9baa028d1fc01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:44.031473 10868 tablet_service.cc:1511] Processing CreateTablet for tablet 1d4899a931c04cc5bd67c793cc9cc6af (DEFAULT_TABLE table=soft_deleted_table [id=95f862aa7233487a901acfa3657b78bf]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:44.033679 10790 tablet_service.cc:1511] Processing CreateTablet for tablet b6d87d86b4b14d52b62593c268fb4f11 (DEFAULT_TABLE table=soft_deleted_table [id=95f862aa7233487a901acfa3657b78bf]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:44.035169 10790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6d87d86b4b14d52b62593c268fb4f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:44.032481 10938 tablet_service.cc:1511] Processing CreateTablet for tablet 1d4899a931c04cc5bd67c793cc9cc6af (DEFAULT_TABLE table=soft_deleted_table [id=95f862aa7233487a901acfa3657b78bf]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:44.037181 10868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d4899a931c04cc5bd67c793cc9cc6af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:44.040089 10865 tablet_service.cc:1511] Processing CreateTablet for tablet b6d87d86b4b14d52b62593c268fb4f11 (DEFAULT_TABLE table=soft_deleted_table [id=95f862aa7233487a901acfa3657b78bf]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:44.041612 10865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6d87d86b4b14d52b62593c268fb4f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:44.041781 10792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d29baf3eb63d4bb6b0f9baa028d1fc01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:44.049981 10864 tablet_service.cc:1511] Processing CreateTablet for tablet 7d4cb37a6d7e41b694224878fbf001ed (DEFAULT_TABLE table=soft_deleted_table [id=95f862aa7233487a901acfa3657b78bf]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:44.051597 10864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d4cb37a6d7e41b694224878fbf001ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:44.054109 10791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d4899a931c04cc5bd67c793cc9cc6af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:44.056906 10867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet debc9febb2c34accb753acbebaf990cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:44.061115 10940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d29baf3eb63d4bb6b0f9baa028d1fc01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:44.063911 10942 tablet_service.cc:1511] Processing CreateTablet for tablet b6d87d86b4b14d52b62593c268fb4f11 (DEFAULT_TABLE table=soft_deleted_table [id=95f862aa7233487a901acfa3657b78bf]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:44.066537 10942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6d87d86b4b14d52b62593c268fb4f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:44.069656 10937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 499fadc1dd974c6588cedb5301e3d71d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:44.075141 10793 tablet_service.cc:1511] Processing CreateTablet for tablet 7d4cb37a6d7e41b694224878fbf001ed (DEFAULT_TABLE table=soft_deleted_table [id=95f862aa7233487a901acfa3657b78bf]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:44.076891 10938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d4899a931c04cc5bd67c793cc9cc6af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:44.080163 10939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet debc9febb2c34accb753acbebaf990cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:44.080957 10941 tablet_service.cc:1511] Processing CreateTablet for tablet 7d4cb37a6d7e41b694224878fbf001ed (DEFAULT_TABLE table=soft_deleted_table [id=95f862aa7233487a901acfa3657b78bf]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:44.082369 10941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d4cb37a6d7e41b694224878fbf001ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:44.085904 10862 tablet_service.cc:1511] Processing CreateTablet for tablet faf115b3d896416ebcf05ad97638f1aa (DEFAULT_TABLE table=soft_deleted_table [id=95f862aa7233487a901acfa3657b78bf]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:44.076530 10793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d4cb37a6d7e41b694224878fbf001ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:44.087393 10862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faf115b3d896416ebcf05ad97638f1aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:44.080854 10789 tablet_service.cc:1511] Processing CreateTablet for tablet faf115b3d896416ebcf05ad97638f1aa (DEFAULT_TABLE table=soft_deleted_table [id=95f862aa7233487a901acfa3657b78bf]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:44.089983 10789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faf115b3d896416ebcf05ad97638f1aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:44.095674 10788 tablet_service.cc:1511] Processing CreateTablet for tablet a5b1bb21e67345058c7484c5e8540859 (DEFAULT_TABLE table=soft_deleted_table [id=95f862aa7233487a901acfa3657b78bf]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:44.097258 10788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5b1bb21e67345058c7484c5e8540859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:44.098012 10943 tablet_service.cc:1511] Processing CreateTablet for tablet faf115b3d896416ebcf05ad97638f1aa (DEFAULT_TABLE table=soft_deleted_table [id=95f862aa7233487a901acfa3657b78bf]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:44.099432 10943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faf115b3d896416ebcf05ad97638f1aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:44.105899 10936 tablet_service.cc:1511] Processing CreateTablet for tablet a5b1bb21e67345058c7484c5e8540859 (DEFAULT_TABLE table=soft_deleted_table [id=95f862aa7233487a901acfa3657b78bf]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:44.107465 10936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5b1bb21e67345058c7484c5e8540859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:44.108312 10864 tablet_service.cc:1511] Processing CreateTablet for tablet a5b1bb21e67345058c7484c5e8540859 (DEFAULT_TABLE table=soft_deleted_table [id=95f862aa7233487a901acfa3657b78bf]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:44.119549 10864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5b1bb21e67345058c7484c5e8540859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:44.173424 11104 tablet_bootstrap.cc:492] T f62d1d32fe7e48cb97f4a3a34344a783 P d567067363bd4266815405d14c8c42c4: Bootstrap starting.
I20260709 13:17:44.194181 11105 tablet_bootstrap.cc:492] T d29baf3eb63d4bb6b0f9baa028d1fc01 P b47d3fdd5d61449593b05bde3b67069f: Bootstrap starting.
I20260709 13:17:44.209853 11103 tablet_bootstrap.cc:492] T f62d1d32fe7e48cb97f4a3a34344a783 P 4b7d4704a4404bb19c3053c6b0af4d90: Bootstrap starting.
I20260709 13:17:44.217509 11103 tablet_bootstrap.cc:654] T f62d1d32fe7e48cb97f4a3a34344a783 P 4b7d4704a4404bb19c3053c6b0af4d90: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.217811 11104 tablet_bootstrap.cc:654] T f62d1d32fe7e48cb97f4a3a34344a783 P d567067363bd4266815405d14c8c42c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.224421 11105 tablet_bootstrap.cc:654] T d29baf3eb63d4bb6b0f9baa028d1fc01 P b47d3fdd5d61449593b05bde3b67069f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.225121 11103 tablet_bootstrap.cc:492] T f62d1d32fe7e48cb97f4a3a34344a783 P 4b7d4704a4404bb19c3053c6b0af4d90: No bootstrap required, opened a new log
I20260709 13:17:44.225389 11104 tablet_bootstrap.cc:492] T f62d1d32fe7e48cb97f4a3a34344a783 P d567067363bd4266815405d14c8c42c4: No bootstrap required, opened a new log
I20260709 13:17:44.225775 11103 ts_tablet_manager.cc:1403] T f62d1d32fe7e48cb97f4a3a34344a783 P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.005s
I20260709 13:17:44.225838 11104 ts_tablet_manager.cc:1403] T f62d1d32fe7e48cb97f4a3a34344a783 P d567067363bd4266815405d14c8c42c4: Time spent bootstrapping tablet: real 0.053s	user 0.008s	sys 0.005s
I20260709 13:17:44.230746 11103 raft_consensus.cc:359] T f62d1d32fe7e48cb97f4a3a34344a783 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.231441 11103 raft_consensus.cc:385] T f62d1d32fe7e48cb97f4a3a34344a783 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.230207 11104 raft_consensus.cc:359] T f62d1d32fe7e48cb97f4a3a34344a783 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.231848 11103 raft_consensus.cc:740] T f62d1d32fe7e48cb97f4a3a34344a783 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.232067 11104 raft_consensus.cc:385] T f62d1d32fe7e48cb97f4a3a34344a783 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.232445 11104 raft_consensus.cc:740] T f62d1d32fe7e48cb97f4a3a34344a783 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d567067363bd4266815405d14c8c42c4, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.233238 11104 consensus_queue.cc:260] T f62d1d32fe7e48cb97f4a3a34344a783 P d567067363bd4266815405d14c8c42c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.234340 11105 tablet_bootstrap.cc:492] T d29baf3eb63d4bb6b0f9baa028d1fc01 P b47d3fdd5d61449593b05bde3b67069f: No bootstrap required, opened a new log
I20260709 13:17:44.234871 11105 ts_tablet_manager.cc:1403] T d29baf3eb63d4bb6b0f9baa028d1fc01 P b47d3fdd5d61449593b05bde3b67069f: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.005s
I20260709 13:17:44.235795 11104 ts_tablet_manager.cc:1434] T f62d1d32fe7e48cb97f4a3a34344a783 P d567067363bd4266815405d14c8c42c4: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:17:44.236972 11104 tablet_bootstrap.cc:492] T 7d4cb37a6d7e41b694224878fbf001ed P d567067363bd4266815405d14c8c42c4: Bootstrap starting.
I20260709 13:17:44.237200 11103 consensus_queue.cc:260] T f62d1d32fe7e48cb97f4a3a34344a783 P 4b7d4704a4404bb19c3053c6b0af4d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.241060 11105 raft_consensus.cc:359] T d29baf3eb63d4bb6b0f9baa028d1fc01 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.241932 11105 raft_consensus.cc:385] T d29baf3eb63d4bb6b0f9baa028d1fc01 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.242030 11103 ts_tablet_manager.cc:1434] T f62d1d32fe7e48cb97f4a3a34344a783 P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.004s
I20260709 13:17:44.242291 11105 raft_consensus.cc:740] T d29baf3eb63d4bb6b0f9baa028d1fc01 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b47d3fdd5d61449593b05bde3b67069f, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.243445 11103 tablet_bootstrap.cc:492] T 499fadc1dd974c6588cedb5301e3d71d P 4b7d4704a4404bb19c3053c6b0af4d90: Bootstrap starting.
I20260709 13:17:44.243100 11105 consensus_queue.cc:260] T d29baf3eb63d4bb6b0f9baa028d1fc01 P b47d3fdd5d61449593b05bde3b67069f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.244019 11104 tablet_bootstrap.cc:654] T 7d4cb37a6d7e41b694224878fbf001ed P d567067363bd4266815405d14c8c42c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.245852 11105 ts_tablet_manager.cc:1434] T d29baf3eb63d4bb6b0f9baa028d1fc01 P b47d3fdd5d61449593b05bde3b67069f: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:17:44.247012 11105 tablet_bootstrap.cc:492] T debc9febb2c34accb753acbebaf990cb P b47d3fdd5d61449593b05bde3b67069f: Bootstrap starting.
I20260709 13:17:44.252662 11103 tablet_bootstrap.cc:654] T 499fadc1dd974c6588cedb5301e3d71d P 4b7d4704a4404bb19c3053c6b0af4d90: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.256814 11105 tablet_bootstrap.cc:654] T debc9febb2c34accb753acbebaf990cb P b47d3fdd5d61449593b05bde3b67069f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.258466 11104 tablet_bootstrap.cc:492] T 7d4cb37a6d7e41b694224878fbf001ed P d567067363bd4266815405d14c8c42c4: No bootstrap required, opened a new log
I20260709 13:17:44.259039 11104 ts_tablet_manager.cc:1403] T 7d4cb37a6d7e41b694224878fbf001ed P d567067363bd4266815405d14c8c42c4: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.000s
I20260709 13:17:44.262259 11104 raft_consensus.cc:359] T 7d4cb37a6d7e41b694224878fbf001ed P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.263018 11104 raft_consensus.cc:385] T 7d4cb37a6d7e41b694224878fbf001ed P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.263317 11104 raft_consensus.cc:740] T 7d4cb37a6d7e41b694224878fbf001ed P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d567067363bd4266815405d14c8c42c4, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.264027 11104 consensus_queue.cc:260] T 7d4cb37a6d7e41b694224878fbf001ed P d567067363bd4266815405d14c8c42c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.266485 11104 ts_tablet_manager.cc:1434] T 7d4cb37a6d7e41b694224878fbf001ed P d567067363bd4266815405d14c8c42c4: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:17:44.269433 11104 tablet_bootstrap.cc:492] T 1d4899a931c04cc5bd67c793cc9cc6af P d567067363bd4266815405d14c8c42c4: Bootstrap starting.
I20260709 13:17:44.269955 11105 tablet_bootstrap.cc:492] T debc9febb2c34accb753acbebaf990cb P b47d3fdd5d61449593b05bde3b67069f: No bootstrap required, opened a new log
I20260709 13:17:44.270541 11105 ts_tablet_manager.cc:1403] T debc9febb2c34accb753acbebaf990cb P b47d3fdd5d61449593b05bde3b67069f: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.007s
I20260709 13:17:44.270610 11103 tablet_bootstrap.cc:492] T 499fadc1dd974c6588cedb5301e3d71d P 4b7d4704a4404bb19c3053c6b0af4d90: No bootstrap required, opened a new log
I20260709 13:17:44.271205 11103 ts_tablet_manager.cc:1403] T 499fadc1dd974c6588cedb5301e3d71d P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.004s
I20260709 13:17:44.274016 11105 raft_consensus.cc:359] T debc9febb2c34accb753acbebaf990cb P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.274979 11105 raft_consensus.cc:385] T debc9febb2c34accb753acbebaf990cb P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.274569 11103 raft_consensus.cc:359] T 499fadc1dd974c6588cedb5301e3d71d P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.275362 11105 raft_consensus.cc:740] T debc9febb2c34accb753acbebaf990cb P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b47d3fdd5d61449593b05bde3b67069f, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.275658 11103 raft_consensus.cc:385] T 499fadc1dd974c6588cedb5301e3d71d P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.276012 11103 raft_consensus.cc:740] T 499fadc1dd974c6588cedb5301e3d71d P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.276202 11105 consensus_queue.cc:260] T debc9febb2c34accb753acbebaf990cb P b47d3fdd5d61449593b05bde3b67069f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.276762 11103 consensus_queue.cc:260] T 499fadc1dd974c6588cedb5301e3d71d P 4b7d4704a4404bb19c3053c6b0af4d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.277444 11104 tablet_bootstrap.cc:654] T 1d4899a931c04cc5bd67c793cc9cc6af P d567067363bd4266815405d14c8c42c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.279358 11103 ts_tablet_manager.cc:1434] T 499fadc1dd974c6588cedb5301e3d71d P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:17:44.280439 11103 tablet_bootstrap.cc:492] T debc9febb2c34accb753acbebaf990cb P 4b7d4704a4404bb19c3053c6b0af4d90: Bootstrap starting.
I20260709 13:17:44.287533 11103 tablet_bootstrap.cc:654] T debc9febb2c34accb753acbebaf990cb P 4b7d4704a4404bb19c3053c6b0af4d90: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.292876 11105 ts_tablet_manager.cc:1434] T debc9febb2c34accb753acbebaf990cb P b47d3fdd5d61449593b05bde3b67069f: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.003s
I20260709 13:17:44.294092 11105 tablet_bootstrap.cc:492] T f62d1d32fe7e48cb97f4a3a34344a783 P b47d3fdd5d61449593b05bde3b67069f: Bootstrap starting.
I20260709 13:17:44.298666 11104 tablet_bootstrap.cc:492] T 1d4899a931c04cc5bd67c793cc9cc6af P d567067363bd4266815405d14c8c42c4: No bootstrap required, opened a new log
I20260709 13:17:44.299444 11104 ts_tablet_manager.cc:1403] T 1d4899a931c04cc5bd67c793cc9cc6af P d567067363bd4266815405d14c8c42c4: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.014s
I20260709 13:17:44.299979 11103 tablet_bootstrap.cc:492] T debc9febb2c34accb753acbebaf990cb P 4b7d4704a4404bb19c3053c6b0af4d90: No bootstrap required, opened a new log
I20260709 13:17:44.300617 11103 ts_tablet_manager.cc:1403] T debc9febb2c34accb753acbebaf990cb P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.007s
I20260709 13:17:44.301530 11105 tablet_bootstrap.cc:654] T f62d1d32fe7e48cb97f4a3a34344a783 P b47d3fdd5d61449593b05bde3b67069f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.303136 11104 raft_consensus.cc:359] T 1d4899a931c04cc5bd67c793cc9cc6af P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.304055 11104 raft_consensus.cc:385] T 1d4899a931c04cc5bd67c793cc9cc6af P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.305001 11104 raft_consensus.cc:740] T 1d4899a931c04cc5bd67c793cc9cc6af P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d567067363bd4266815405d14c8c42c4, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.303846 11103 raft_consensus.cc:359] T debc9febb2c34accb753acbebaf990cb P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.306936 11103 raft_consensus.cc:385] T debc9febb2c34accb753acbebaf990cb P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.306402 11104 consensus_queue.cc:260] T 1d4899a931c04cc5bd67c793cc9cc6af P d567067363bd4266815405d14c8c42c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.307298 11103 raft_consensus.cc:740] T debc9febb2c34accb753acbebaf990cb P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.308145 11103 consensus_queue.cc:260] T debc9febb2c34accb753acbebaf990cb P 4b7d4704a4404bb19c3053c6b0af4d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.310479 11104 ts_tablet_manager.cc:1434] T 1d4899a931c04cc5bd67c793cc9cc6af P d567067363bd4266815405d14c8c42c4: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:17:44.310838 11103 ts_tablet_manager.cc:1434] T debc9febb2c34accb753acbebaf990cb P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:17:44.312101 11103 tablet_bootstrap.cc:492] T 1d4899a931c04cc5bd67c793cc9cc6af P 4b7d4704a4404bb19c3053c6b0af4d90: Bootstrap starting.
I20260709 13:17:44.312266 11104 tablet_bootstrap.cc:492] T 499fadc1dd974c6588cedb5301e3d71d P d567067363bd4266815405d14c8c42c4: Bootstrap starting.
I20260709 13:17:44.315971 11105 tablet_bootstrap.cc:492] T f62d1d32fe7e48cb97f4a3a34344a783 P b47d3fdd5d61449593b05bde3b67069f: No bootstrap required, opened a new log
I20260709 13:17:44.316605 11105 ts_tablet_manager.cc:1403] T f62d1d32fe7e48cb97f4a3a34344a783 P b47d3fdd5d61449593b05bde3b67069f: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.000s
I20260709 13:17:44.319590 11103 tablet_bootstrap.cc:654] T 1d4899a931c04cc5bd67c793cc9cc6af P 4b7d4704a4404bb19c3053c6b0af4d90: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.320454 11104 tablet_bootstrap.cc:654] T 499fadc1dd974c6588cedb5301e3d71d P d567067363bd4266815405d14c8c42c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.319907 11105 raft_consensus.cc:359] T f62d1d32fe7e48cb97f4a3a34344a783 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.321091 11105 raft_consensus.cc:385] T f62d1d32fe7e48cb97f4a3a34344a783 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.321403 11105 raft_consensus.cc:740] T f62d1d32fe7e48cb97f4a3a34344a783 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b47d3fdd5d61449593b05bde3b67069f, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.322499 11105 consensus_queue.cc:260] T f62d1d32fe7e48cb97f4a3a34344a783 P b47d3fdd5d61449593b05bde3b67069f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.330144 11105 ts_tablet_manager.cc:1434] T f62d1d32fe7e48cb97f4a3a34344a783 P b47d3fdd5d61449593b05bde3b67069f: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:17:44.331151 11104 tablet_bootstrap.cc:492] T 499fadc1dd974c6588cedb5301e3d71d P d567067363bd4266815405d14c8c42c4: No bootstrap required, opened a new log
I20260709 13:17:44.331506 11103 tablet_bootstrap.cc:492] T 1d4899a931c04cc5bd67c793cc9cc6af P 4b7d4704a4404bb19c3053c6b0af4d90: No bootstrap required, opened a new log
I20260709 13:17:44.331188 11105 tablet_bootstrap.cc:492] T 1d4899a931c04cc5bd67c793cc9cc6af P b47d3fdd5d61449593b05bde3b67069f: Bootstrap starting.
I20260709 13:17:44.332337 11104 ts_tablet_manager.cc:1403] T 499fadc1dd974c6588cedb5301e3d71d P d567067363bd4266815405d14c8c42c4: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 13:17:44.332451 11103 ts_tablet_manager.cc:1403] T 1d4899a931c04cc5bd67c793cc9cc6af P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.000s
I20260709 13:17:44.336288 11103 raft_consensus.cc:359] T 1d4899a931c04cc5bd67c793cc9cc6af P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.337060 11103 raft_consensus.cc:385] T 1d4899a931c04cc5bd67c793cc9cc6af P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.337361 11103 raft_consensus.cc:740] T 1d4899a931c04cc5bd67c793cc9cc6af P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.338094 11103 consensus_queue.cc:260] T 1d4899a931c04cc5bd67c793cc9cc6af P 4b7d4704a4404bb19c3053c6b0af4d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.339713 11104 raft_consensus.cc:359] T 499fadc1dd974c6588cedb5301e3d71d P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.340494 11103 ts_tablet_manager.cc:1434] T 1d4899a931c04cc5bd67c793cc9cc6af P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:17:44.342326 11103 tablet_bootstrap.cc:492] T d29baf3eb63d4bb6b0f9baa028d1fc01 P 4b7d4704a4404bb19c3053c6b0af4d90: Bootstrap starting.
I20260709 13:17:44.345165 11105 tablet_bootstrap.cc:654] T 1d4899a931c04cc5bd67c793cc9cc6af P b47d3fdd5d61449593b05bde3b67069f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.350425 11103 tablet_bootstrap.cc:654] T d29baf3eb63d4bb6b0f9baa028d1fc01 P 4b7d4704a4404bb19c3053c6b0af4d90: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.352682 11104 raft_consensus.cc:385] T 499fadc1dd974c6588cedb5301e3d71d P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.353323 11104 raft_consensus.cc:740] T 499fadc1dd974c6588cedb5301e3d71d P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d567067363bd4266815405d14c8c42c4, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.354382 11104 consensus_queue.cc:260] T 499fadc1dd974c6588cedb5301e3d71d P d567067363bd4266815405d14c8c42c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.373343 11104 ts_tablet_manager.cc:1434] T 499fadc1dd974c6588cedb5301e3d71d P d567067363bd4266815405d14c8c42c4: Time spent starting tablet: real 0.040s	user 0.010s	sys 0.011s
I20260709 13:17:44.374414 11104 tablet_bootstrap.cc:492] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4: Bootstrap starting.
I20260709 13:17:44.374779 11105 tablet_bootstrap.cc:492] T 1d4899a931c04cc5bd67c793cc9cc6af P b47d3fdd5d61449593b05bde3b67069f: No bootstrap required, opened a new log
I20260709 13:17:44.375360 11105 ts_tablet_manager.cc:1403] T 1d4899a931c04cc5bd67c793cc9cc6af P b47d3fdd5d61449593b05bde3b67069f: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.023s
I20260709 13:17:44.380561 11103 tablet_bootstrap.cc:492] T d29baf3eb63d4bb6b0f9baa028d1fc01 P 4b7d4704a4404bb19c3053c6b0af4d90: No bootstrap required, opened a new log
I20260709 13:17:44.380167 11105 raft_consensus.cc:359] T 1d4899a931c04cc5bd67c793cc9cc6af P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.381121 11105 raft_consensus.cc:385] T 1d4899a931c04cc5bd67c793cc9cc6af P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.381208 11103 ts_tablet_manager.cc:1403] T d29baf3eb63d4bb6b0f9baa028d1fc01 P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.000s
I20260709 13:17:44.381461 11105 raft_consensus.cc:740] T 1d4899a931c04cc5bd67c793cc9cc6af P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b47d3fdd5d61449593b05bde3b67069f, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.382155 11105 consensus_queue.cc:260] T 1d4899a931c04cc5bd67c793cc9cc6af P b47d3fdd5d61449593b05bde3b67069f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.384135 11105 ts_tablet_manager.cc:1434] T 1d4899a931c04cc5bd67c793cc9cc6af P b47d3fdd5d61449593b05bde3b67069f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:17:44.384086 11103 raft_consensus.cc:359] T d29baf3eb63d4bb6b0f9baa028d1fc01 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.384994 11103 raft_consensus.cc:385] T d29baf3eb63d4bb6b0f9baa028d1fc01 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.385295 11103 raft_consensus.cc:740] T d29baf3eb63d4bb6b0f9baa028d1fc01 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.385449 11105 tablet_bootstrap.cc:492] T b6d87d86b4b14d52b62593c268fb4f11 P b47d3fdd5d61449593b05bde3b67069f: Bootstrap starting.
I20260709 13:17:44.386061 11103 consensus_queue.cc:260] T d29baf3eb63d4bb6b0f9baa028d1fc01 P 4b7d4704a4404bb19c3053c6b0af4d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.391309 11104 tablet_bootstrap.cc:654] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.393111 11105 tablet_bootstrap.cc:654] T b6d87d86b4b14d52b62593c268fb4f11 P b47d3fdd5d61449593b05bde3b67069f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.388469 11103 ts_tablet_manager.cc:1434] T d29baf3eb63d4bb6b0f9baa028d1fc01 P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:17:44.395797 11103 tablet_bootstrap.cc:492] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90: Bootstrap starting.
I20260709 13:17:44.402925 11103 tablet_bootstrap.cc:654] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.403690 11120 raft_consensus.cc:493] T 1d4899a931c04cc5bd67c793cc9cc6af P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.404291 11120 raft_consensus.cc:515] T 1d4899a931c04cc5bd67c793cc9cc6af P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.406570 11120 leader_election.cc:290] T 1d4899a931c04cc5bd67c793cc9cc6af P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:44.407279 11105 tablet_bootstrap.cc:492] T b6d87d86b4b14d52b62593c268fb4f11 P b47d3fdd5d61449593b05bde3b67069f: No bootstrap required, opened a new log
I20260709 13:17:44.407932 11105 ts_tablet_manager.cc:1403] T b6d87d86b4b14d52b62593c268fb4f11 P b47d3fdd5d61449593b05bde3b67069f: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.006s
I20260709 13:17:44.408239 11104 tablet_bootstrap.cc:492] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4: No bootstrap required, opened a new log
I20260709 13:17:44.409024 11104 ts_tablet_manager.cc:1403] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.005s
I20260709 13:17:44.409262 10805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4899a931c04cc5bd67c793cc9cc6af" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" is_pre_election: true
I20260709 13:17:44.409989 10805 raft_consensus.cc:2468] T 1d4899a931c04cc5bd67c793cc9cc6af P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 0.
I20260709 13:17:44.411227 10954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4899a931c04cc5bd67c793cc9cc6af" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f" is_pre_election: true
I20260709 13:17:44.411926 10954 raft_consensus.cc:2468] T 1d4899a931c04cc5bd67c793cc9cc6af P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 0.
I20260709 13:17:44.411485 11105 raft_consensus.cc:359] T b6d87d86b4b14d52b62593c268fb4f11 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.412468 11105 raft_consensus.cc:385] T b6d87d86b4b14d52b62593c268fb4f11 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.412490 11110 raft_consensus.cc:493] T f62d1d32fe7e48cb97f4a3a34344a783 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.412890 11105 raft_consensus.cc:740] T b6d87d86b4b14d52b62593c268fb4f11 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b47d3fdd5d61449593b05bde3b67069f, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.413166 11110 raft_consensus.cc:515] T f62d1d32fe7e48cb97f4a3a34344a783 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.413730 11105 consensus_queue.cc:260] T b6d87d86b4b14d52b62593c268fb4f11 P b47d3fdd5d61449593b05bde3b67069f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.414758 10843 leader_election.cc:304] T 1d4899a931c04cc5bd67c793cc9cc6af P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, d567067363bd4266815405d14c8c42c4; no voters: 
I20260709 13:17:44.415606 11103 tablet_bootstrap.cc:492] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90: No bootstrap required, opened a new log
I20260709 13:17:44.416116 11103 ts_tablet_manager.cc:1403] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 13:17:44.416366 11052 raft_consensus.cc:2804] T 1d4899a931c04cc5bd67c793cc9cc6af P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:44.416711 11105 ts_tablet_manager.cc:1434] T b6d87d86b4b14d52b62593c268fb4f11 P b47d3fdd5d61449593b05bde3b67069f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:17:44.416828 11052 raft_consensus.cc:493] T 1d4899a931c04cc5bd67c793cc9cc6af P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.417219 11052 raft_consensus.cc:3060] T 1d4899a931c04cc5bd67c793cc9cc6af P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.418392 11105 tablet_bootstrap.cc:492] T 499fadc1dd974c6588cedb5301e3d71d P b47d3fdd5d61449593b05bde3b67069f: Bootstrap starting.
I20260709 13:17:44.419433 11110 leader_election.cc:290] T f62d1d32fe7e48cb97f4a3a34344a783 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:44.420965 11104 raft_consensus.cc:359] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.421777 11104 raft_consensus.cc:385] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.422053 11104 raft_consensus.cc:740] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d567067363bd4266815405d14c8c42c4, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.422247 10880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62d1d32fe7e48cb97f4a3a34344a783" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d567067363bd4266815405d14c8c42c4" is_pre_election: true
I20260709 13:17:44.423019 10880 raft_consensus.cc:2468] T f62d1d32fe7e48cb97f4a3a34344a783 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 0.
I20260709 13:17:44.422821 11104 consensus_queue.cc:260] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.424171 11118 raft_consensus.cc:493] T f62d1d32fe7e48cb97f4a3a34344a783 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.424654 11118 raft_consensus.cc:515] T f62d1d32fe7e48cb97f4a3a34344a783 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.425673 11104 ts_tablet_manager.cc:1434] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.001s
I20260709 13:17:44.426929 11118 leader_election.cc:290] T f62d1d32fe7e48cb97f4a3a34344a783 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:44.427052 11104 tablet_bootstrap.cc:492] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4: Bootstrap starting.
I20260709 13:17:44.428610 10770 leader_election.cc:304] T f62d1d32fe7e48cb97f4a3a34344a783 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, d567067363bd4266815405d14c8c42c4; no voters: 
I20260709 13:17:44.429587 11110 raft_consensus.cc:2804] T f62d1d32fe7e48cb97f4a3a34344a783 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:44.429948 11110 raft_consensus.cc:493] T f62d1d32fe7e48cb97f4a3a34344a783 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.430276 11110 raft_consensus.cc:3060] T f62d1d32fe7e48cb97f4a3a34344a783 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.435309 11103 raft_consensus.cc:359] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.436486 11105 tablet_bootstrap.cc:654] T 499fadc1dd974c6588cedb5301e3d71d P b47d3fdd5d61449593b05bde3b67069f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.436630 11103 raft_consensus.cc:385] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.437136 11103 raft_consensus.cc:740] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.437098 10954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62d1d32fe7e48cb97f4a3a34344a783" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f" is_pre_election: true
I20260709 13:17:44.437949 11104 tablet_bootstrap.cc:654] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.438036 10954 raft_consensus.cc:2468] T f62d1d32fe7e48cb97f4a3a34344a783 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 0.
I20260709 13:17:44.438253 11103 consensus_queue.cc:260] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.440795 11103 ts_tablet_manager.cc:1434] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent starting tablet: real 0.024s	user 0.011s	sys 0.000s
I20260709 13:17:44.441884 11103 tablet_bootstrap.cc:492] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90: Bootstrap starting.
I20260709 13:17:44.443779 10805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62d1d32fe7e48cb97f4a3a34344a783" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" is_pre_election: true
I20260709 13:17:44.450578 11104 tablet_bootstrap.cc:492] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4: No bootstrap required, opened a new log
I20260709 13:17:44.451148 11103 tablet_bootstrap.cc:654] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.451164 11104 ts_tablet_manager.cc:1403] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.003s
I20260709 13:17:44.454561 11104 raft_consensus.cc:359] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.469015 11104 raft_consensus.cc:385] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.469509 11104 raft_consensus.cc:740] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d567067363bd4266815405d14c8c42c4, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.471825 11105 tablet_bootstrap.cc:492] T 499fadc1dd974c6588cedb5301e3d71d P b47d3fdd5d61449593b05bde3b67069f: No bootstrap required, opened a new log
I20260709 13:17:44.470784 11104 consensus_queue.cc:260] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.472460 11105 ts_tablet_manager.cc:1403] T 499fadc1dd974c6588cedb5301e3d71d P b47d3fdd5d61449593b05bde3b67069f: Time spent bootstrapping tablet: real 0.054s	user 0.023s	sys 0.016s
I20260709 13:17:44.475162 11104 ts_tablet_manager.cc:1434] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:17:44.476737 11104 tablet_bootstrap.cc:492] T a5b1bb21e67345058c7484c5e8540859 P d567067363bd4266815405d14c8c42c4: Bootstrap starting.
I20260709 13:17:44.476895 11105 raft_consensus.cc:359] T 499fadc1dd974c6588cedb5301e3d71d P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.477843 11105 raft_consensus.cc:385] T 499fadc1dd974c6588cedb5301e3d71d P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.478156 11105 raft_consensus.cc:740] T 499fadc1dd974c6588cedb5301e3d71d P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b47d3fdd5d61449593b05bde3b67069f, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.478927 11105 consensus_queue.cc:260] T 499fadc1dd974c6588cedb5301e3d71d P b47d3fdd5d61449593b05bde3b67069f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.481479 11105 ts_tablet_manager.cc:1434] T 499fadc1dd974c6588cedb5301e3d71d P b47d3fdd5d61449593b05bde3b67069f: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:17:44.452198 10954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62d1d32fe7e48cb97f4a3a34344a783" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f" is_pre_election: true
I20260709 13:17:44.483469 10954 raft_consensus.cc:2468] T f62d1d32fe7e48cb97f4a3a34344a783 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 0.
I20260709 13:17:44.482782 11105 tablet_bootstrap.cc:492] T a5b1bb21e67345058c7484c5e8540859 P b47d3fdd5d61449593b05bde3b67069f: Bootstrap starting.
I20260709 13:17:44.485816 11104 tablet_bootstrap.cc:654] T a5b1bb21e67345058c7484c5e8540859 P d567067363bd4266815405d14c8c42c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.489913 10843 leader_election.cc:304] T f62d1d32fe7e48cb97f4a3a34344a783 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b47d3fdd5d61449593b05bde3b67069f, d567067363bd4266815405d14c8c42c4; no voters: 
I20260709 13:17:44.490890 11120 raft_consensus.cc:2804] T f62d1d32fe7e48cb97f4a3a34344a783 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:44.491264 11120 raft_consensus.cc:493] T f62d1d32fe7e48cb97f4a3a34344a783 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.491606 11120 raft_consensus.cc:3060] T f62d1d32fe7e48cb97f4a3a34344a783 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.496835 11105 tablet_bootstrap.cc:654] T a5b1bb21e67345058c7484c5e8540859 P b47d3fdd5d61449593b05bde3b67069f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.497174 11118 raft_consensus.cc:493] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.488487 11103 tablet_bootstrap.cc:492] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90: No bootstrap required, opened a new log
I20260709 13:17:44.498783 11103 ts_tablet_manager.cc:1403] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent bootstrapping tablet: real 0.057s	user 0.020s	sys 0.016s
W20260709 13:17:44.499337 10751 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:44.500036 11118 raft_consensus.cc:515] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.503300 11118 leader_election.cc:290] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:44.502980 11103 raft_consensus.cc:359] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.505610 11103 raft_consensus.cc:385] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.505662 10803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debc9febb2c34accb753acbebaf990cb" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" is_pre_election: true
I20260709 13:17:44.506079 11103 raft_consensus.cc:740] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.506038 10953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debc9febb2c34accb753acbebaf990cb" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f" is_pre_election: true
I20260709 13:17:44.506481 10803 raft_consensus.cc:2468] T debc9febb2c34accb753acbebaf990cb P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 0.
I20260709 13:17:44.506965 10953 raft_consensus.cc:2468] T debc9febb2c34accb753acbebaf990cb P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 0.
I20260709 13:17:44.507217 11103 consensus_queue.cc:260] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.508383 11104 tablet_bootstrap.cc:492] T a5b1bb21e67345058c7484c5e8540859 P d567067363bd4266815405d14c8c42c4: No bootstrap required, opened a new log
I20260709 13:17:44.508993 11104 ts_tablet_manager.cc:1403] T a5b1bb21e67345058c7484c5e8540859 P d567067363bd4266815405d14c8c42c4: Time spent bootstrapping tablet: real 0.033s	user 0.019s	sys 0.006s
I20260709 13:17:44.509809 11103 ts_tablet_manager.cc:1434] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:17:44.511456 11103 tablet_bootstrap.cc:492] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90: Bootstrap starting.
I20260709 13:17:44.512001 11104 raft_consensus.cc:359] T a5b1bb21e67345058c7484c5e8540859 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.512849 11104 raft_consensus.cc:385] T a5b1bb21e67345058c7484c5e8540859 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.513126 11104 raft_consensus.cc:740] T a5b1bb21e67345058c7484c5e8540859 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d567067363bd4266815405d14c8c42c4, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.513887 11104 consensus_queue.cc:260] T a5b1bb21e67345058c7484c5e8540859 P d567067363bd4266815405d14c8c42c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.514964 10843 leader_election.cc:304] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b47d3fdd5d61449593b05bde3b67069f, d567067363bd4266815405d14c8c42c4; no voters: 
I20260709 13:17:44.518160 11104 ts_tablet_manager.cc:1434] T a5b1bb21e67345058c7484c5e8540859 P d567067363bd4266815405d14c8c42c4: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:17:44.519263 11104 tablet_bootstrap.cc:492] T faf115b3d896416ebcf05ad97638f1aa P d567067363bd4266815405d14c8c42c4: Bootstrap starting.
I20260709 13:17:44.525453 11130 raft_consensus.cc:2804] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:44.526037 11130 raft_consensus.cc:493] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.526360 11130 raft_consensus.cc:3060] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.527190 11103 tablet_bootstrap.cc:654] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.528420 11024 raft_consensus.cc:493] T 499fadc1dd974c6588cedb5301e3d71d P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.529040 11024 raft_consensus.cc:515] T 499fadc1dd974c6588cedb5301e3d71d P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.538862 11024 leader_election.cc:290] T 499fadc1dd974c6588cedb5301e3d71d P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:44.539417 11024 raft_consensus.cc:493] T d29baf3eb63d4bb6b0f9baa028d1fc01 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.539891 11024 raft_consensus.cc:515] T d29baf3eb63d4bb6b0f9baa028d1fc01 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.541096 11103 tablet_bootstrap.cc:492] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90: No bootstrap required, opened a new log
I20260709 13:17:44.541673 11103 ts_tablet_manager.cc:1403] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.004s
I20260709 13:17:44.543468 11104 tablet_bootstrap.cc:654] T faf115b3d896416ebcf05ad97638f1aa P d567067363bd4266815405d14c8c42c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.545145 11024 leader_election.cc:290] T d29baf3eb63d4bb6b0f9baa028d1fc01 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:44.551084 10953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d29baf3eb63d4bb6b0f9baa028d1fc01" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f" is_pre_election: true
I20260709 13:17:44.551157 11103 raft_consensus.cc:359] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.552143 11103 raft_consensus.cc:385] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.552452 11103 raft_consensus.cc:740] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.552220 10953 raft_consensus.cc:2468] T d29baf3eb63d4bb6b0f9baa028d1fc01 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 0.
I20260709 13:17:44.553340 11103 consensus_queue.cc:260] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.554617 10954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499fadc1dd974c6588cedb5301e3d71d" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f" is_pre_election: true
I20260709 13:17:44.555567 11103 ts_tablet_manager.cc:1434] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:17:44.556800 11103 tablet_bootstrap.cc:492] T 7d4cb37a6d7e41b694224878fbf001ed P 4b7d4704a4404bb19c3053c6b0af4d90: Bootstrap starting.
I20260709 13:17:44.555563 10954 raft_consensus.cc:2468] T 499fadc1dd974c6588cedb5301e3d71d P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 0.
I20260709 13:17:44.557905 11130 raft_consensus.cc:515] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.558760 11118 raft_consensus.cc:493] T 499fadc1dd974c6588cedb5301e3d71d P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.559307 11118 raft_consensus.cc:515] T 499fadc1dd974c6588cedb5301e3d71d P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.559993 11130 leader_election.cc:290] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 election: Requested vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:44.561465 11118 leader_election.cc:290] T 499fadc1dd974c6588cedb5301e3d71d P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:44.563109 11103 tablet_bootstrap.cc:654] T 7d4cb37a6d7e41b694224878fbf001ed P 4b7d4704a4404bb19c3053c6b0af4d90: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.564000 11104 tablet_bootstrap.cc:492] T faf115b3d896416ebcf05ad97638f1aa P d567067363bd4266815405d14c8c42c4: No bootstrap required, opened a new log
I20260709 13:17:44.564543 11104 ts_tablet_manager.cc:1403] T faf115b3d896416ebcf05ad97638f1aa P d567067363bd4266815405d14c8c42c4: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.000s
I20260709 13:17:44.568075 11104 raft_consensus.cc:359] T faf115b3d896416ebcf05ad97638f1aa P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.568846 11104 raft_consensus.cc:385] T faf115b3d896416ebcf05ad97638f1aa P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.569118 11104 raft_consensus.cc:740] T faf115b3d896416ebcf05ad97638f1aa P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d567067363bd4266815405d14c8c42c4, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.569923 10768 leader_election.cc:304] T d29baf3eb63d4bb6b0f9baa028d1fc01 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, b47d3fdd5d61449593b05bde3b67069f; no voters: 
I20260709 13:17:44.570951 11133 raft_consensus.cc:2804] T d29baf3eb63d4bb6b0f9baa028d1fc01 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:44.571342 11133 raft_consensus.cc:493] T d29baf3eb63d4bb6b0f9baa028d1fc01 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.571689 11133 raft_consensus.cc:3060] T d29baf3eb63d4bb6b0f9baa028d1fc01 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.574694 11052 raft_consensus.cc:515] T 1d4899a931c04cc5bd67c793cc9cc6af P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.576835 11052 leader_election.cc:290] T 1d4899a931c04cc5bd67c793cc9cc6af P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 election: Requested vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:44.578610 11110 raft_consensus.cc:515] T f62d1d32fe7e48cb97f4a3a34344a783 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.579733 10805 raft_consensus.cc:2393] T f62d1d32fe7e48cb97f4a3a34344a783 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d567067363bd4266815405d14c8c42c4 in current term 1: Already voted for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in this term.
I20260709 13:17:44.580745 11103 tablet_bootstrap.cc:492] T 7d4cb37a6d7e41b694224878fbf001ed P 4b7d4704a4404bb19c3053c6b0af4d90: No bootstrap required, opened a new log
I20260709 13:17:44.581311 11103 ts_tablet_manager.cc:1403] T 7d4cb37a6d7e41b694224878fbf001ed P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.000s
I20260709 13:17:44.581178 11133 raft_consensus.cc:515] T d29baf3eb63d4bb6b0f9baa028d1fc01 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.582408 11104 consensus_queue.cc:260] T faf115b3d896416ebcf05ad97638f1aa P d567067363bd4266815405d14c8c42c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.584484 11104 ts_tablet_manager.cc:1434] T faf115b3d896416ebcf05ad97638f1aa P d567067363bd4266815405d14c8c42c4: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:17:44.584187 11103 raft_consensus.cc:359] T 7d4cb37a6d7e41b694224878fbf001ed P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.584893 11103 raft_consensus.cc:385] T 7d4cb37a6d7e41b694224878fbf001ed P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.585173 11103 raft_consensus.cc:740] T 7d4cb37a6d7e41b694224878fbf001ed P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.585551 11104 tablet_bootstrap.cc:492] T d29baf3eb63d4bb6b0f9baa028d1fc01 P d567067363bd4266815405d14c8c42c4: Bootstrap starting.
I20260709 13:17:44.589177 10880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499fadc1dd974c6588cedb5301e3d71d" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d567067363bd4266815405d14c8c42c4" is_pre_election: true
W20260709 13:17:44.585398 10843 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:42139, user_credentials={real_user=slave}} blocked reactor thread for 70574.4us
I20260709 13:17:44.591279 10880 raft_consensus.cc:2468] T 499fadc1dd974c6588cedb5301e3d71d P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 0.
I20260709 13:17:44.592842 10880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d29baf3eb63d4bb6b0f9baa028d1fc01" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d567067363bd4266815405d14c8c42c4" is_pre_election: true
I20260709 13:17:44.585853 11103 consensus_queue.cc:260] T 7d4cb37a6d7e41b694224878fbf001ed P 4b7d4704a4404bb19c3053c6b0af4d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.597747 11103 ts_tablet_manager.cc:1434] T 7d4cb37a6d7e41b694224878fbf001ed P 4b7d4704a4404bb19c3053c6b0af4d90: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:17:44.598994 11104 tablet_bootstrap.cc:654] T d29baf3eb63d4bb6b0f9baa028d1fc01 P d567067363bd4266815405d14c8c42c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.602553 11133 leader_election.cc:290] T d29baf3eb63d4bb6b0f9baa028d1fc01 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 election: Requested vote from peers d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:44.605690 10954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debc9febb2c34accb753acbebaf990cb" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
I20260709 13:17:44.606654 10954 raft_consensus.cc:3060] T debc9febb2c34accb753acbebaf990cb P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.570961 10768 leader_election.cc:304] T 499fadc1dd974c6588cedb5301e3d71d P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, b47d3fdd5d61449593b05bde3b67069f; no voters: 
W20260709 13:17:44.622682 10768 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.3:42139, user_credentials={real_user=slave}} blocked reactor thread for 51787.9us
I20260709 13:17:44.624773 10880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d29baf3eb63d4bb6b0f9baa028d1fc01" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d567067363bd4266815405d14c8c42c4"
I20260709 13:17:44.628202 10953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d29baf3eb63d4bb6b0f9baa028d1fc01" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
W20260709 13:17:44.628312 10770 leader_election.cc:343] T d29baf3eb63d4bb6b0f9baa028d1fc01 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.629094 10953 raft_consensus.cc:3060] T d29baf3eb63d4bb6b0f9baa028d1fc01 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.630316 11024 raft_consensus.cc:2804] T 499fadc1dd974c6588cedb5301e3d71d P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:17:44.630451 10770 leader_election.cc:343] T d29baf3eb63d4bb6b0f9baa028d1fc01 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.632001 11052 raft_consensus.cc:493] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.632577 11052 raft_consensus.cc:515] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.635013 11052 leader_election.cc:290] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:44.635479 11052 raft_consensus.cc:493] T 7d4cb37a6d7e41b694224878fbf001ed P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.635902 11052 raft_consensus.cc:515] T 7d4cb37a6d7e41b694224878fbf001ed P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.630981 11024 raft_consensus.cc:493] T 499fadc1dd974c6588cedb5301e3d71d P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.637045 11024 raft_consensus.cc:3060] T 499fadc1dd974c6588cedb5301e3d71d P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.638268 11052 leader_election.cc:290] T 7d4cb37a6d7e41b694224878fbf001ed P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:44.641140 10805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debc9febb2c34accb753acbebaf990cb" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
I20260709 13:17:44.642191 10805 raft_consensus.cc:3060] T debc9febb2c34accb753acbebaf990cb P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.642891 10880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62d1d32fe7e48cb97f4a3a34344a783" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d567067363bd4266815405d14c8c42c4"
I20260709 13:17:44.644672 11110 leader_election.cc:290] T f62d1d32fe7e48cb97f4a3a34344a783 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 election: Requested vote from peers d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:44.645797 10954 raft_consensus.cc:2468] T debc9febb2c34accb753acbebaf990cb P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 1.
I20260709 13:17:44.619711 11120 raft_consensus.cc:515] T f62d1d32fe7e48cb97f4a3a34344a783 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.651484 10880 raft_consensus.cc:2393] T f62d1d32fe7e48cb97f4a3a34344a783 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b7d4704a4404bb19c3053c6b0af4d90 in current term 1: Already voted for candidate d567067363bd4266815405d14c8c42c4 in this term.
I20260709 13:17:44.651506 10803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499fadc1dd974c6588cedb5301e3d71d" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" is_pre_election: true
I20260709 13:17:44.652979 11104 tablet_bootstrap.cc:492] T d29baf3eb63d4bb6b0f9baa028d1fc01 P d567067363bd4266815405d14c8c42c4: No bootstrap required, opened a new log
I20260709 13:17:44.653501 11104 ts_tablet_manager.cc:1403] T d29baf3eb63d4bb6b0f9baa028d1fc01 P d567067363bd4266815405d14c8c42c4: Time spent bootstrapping tablet: real 0.068s	user 0.017s	sys 0.036s
I20260709 13:17:44.653666 10953 raft_consensus.cc:2468] T d29baf3eb63d4bb6b0f9baa028d1fc01 P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 1.
I20260709 13:17:44.655289 10768 leader_election.cc:304] T d29baf3eb63d4bb6b0f9baa028d1fc01 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, b47d3fdd5d61449593b05bde3b67069f; no voters: d567067363bd4266815405d14c8c42c4
I20260709 13:17:44.655692 11110 raft_consensus.cc:493] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.656104 11105 tablet_bootstrap.cc:492] T a5b1bb21e67345058c7484c5e8540859 P b47d3fdd5d61449593b05bde3b67069f: No bootstrap required, opened a new log
I20260709 13:17:44.656383 11110 raft_consensus.cc:515] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.656795 11105 ts_tablet_manager.cc:1403] T a5b1bb21e67345058c7484c5e8540859 P b47d3fdd5d61449593b05bde3b67069f: Time spent bootstrapping tablet: real 0.174s	user 0.037s	sys 0.081s
I20260709 13:17:44.658337 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4899a931c04cc5bd67c793cc9cc6af" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
I20260709 13:17:44.658838 10952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4899a931c04cc5bd67c793cc9cc6af" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
I20260709 13:17:44.659058 10804 raft_consensus.cc:3060] T 1d4899a931c04cc5bd67c793cc9cc6af P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.659533 10952 raft_consensus.cc:3060] T 1d4899a931c04cc5bd67c793cc9cc6af P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.656723 10954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62d1d32fe7e48cb97f4a3a34344a783" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
I20260709 13:17:44.658517 11133 raft_consensus.cc:2804] T d29baf3eb63d4bb6b0f9baa028d1fc01 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:44.660804 10880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf115b3d896416ebcf05ad97638f1aa" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d567067363bd4266815405d14c8c42c4" is_pre_election: true
I20260709 13:17:44.661520 10880 raft_consensus.cc:2468] T faf115b3d896416ebcf05ad97638f1aa P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 0.
I20260709 13:17:44.660851 10954 raft_consensus.cc:3060] T f62d1d32fe7e48cb97f4a3a34344a783 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.663034 10770 leader_election.cc:304] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, d567067363bd4266815405d14c8c42c4; no voters: 
I20260709 13:17:44.664809 11110 leader_election.cc:290] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:44.666659 11110 raft_consensus.cc:2804] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:44.667737 11110 raft_consensus.cc:493] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.668524 10952 raft_consensus.cc:2468] T 1d4899a931c04cc5bd67c793cc9cc6af P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 1.
I20260709 13:17:44.668602 11110 raft_consensus.cc:3060] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.666486 11024 raft_consensus.cc:515] T 499fadc1dd974c6588cedb5301e3d71d P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.670253 10803 raft_consensus.cc:2393] T 499fadc1dd974c6588cedb5301e3d71d P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d567067363bd4266815405d14c8c42c4 in current term 1: Already voted for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in this term.
I20260709 13:17:44.670023 10951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf115b3d896416ebcf05ad97638f1aa" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f" is_pre_election: true
I20260709 13:17:44.671617 10953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499fadc1dd974c6588cedb5301e3d71d" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f" is_pre_election: true
I20260709 13:17:44.672405 10953 raft_consensus.cc:2468] T 499fadc1dd974c6588cedb5301e3d71d P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 0.
I20260709 13:17:44.674329 11120 leader_election.cc:290] T f62d1d32fe7e48cb97f4a3a34344a783 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 election: Requested vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:44.671656 10804 raft_consensus.cc:2468] T 1d4899a931c04cc5bd67c793cc9cc6af P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 1.
I20260709 13:17:44.674110 11105 raft_consensus.cc:359] T a5b1bb21e67345058c7484c5e8540859 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
W20260709 13:17:44.672410 10768 leader_election.cc:343] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.675851 11105 raft_consensus.cc:385] T a5b1bb21e67345058c7484c5e8540859 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.676302 11105 raft_consensus.cc:740] T a5b1bb21e67345058c7484c5e8540859 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b47d3fdd5d61449593b05bde3b67069f, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.676960 10951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d87d86b4b14d52b62593c268fb4f11" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f" is_pre_election: true
I20260709 13:17:44.677211 11105 consensus_queue.cc:260] T a5b1bb21e67345058c7484c5e8540859 P b47d3fdd5d61449593b05bde3b67069f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.677786 10951 raft_consensus.cc:2468] T b6d87d86b4b14d52b62593c268fb4f11 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 0.
I20260709 13:17:44.677876 11024 leader_election.cc:290] T 499fadc1dd974c6588cedb5301e3d71d P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 election: Requested vote from peers d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:44.679520 10951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499fadc1dd974c6588cedb5301e3d71d" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
I20260709 13:17:44.680114 10951 raft_consensus.cc:3060] T 499fadc1dd974c6588cedb5301e3d71d P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.680719 10950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4cb37a6d7e41b694224878fbf001ed" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f" is_pre_election: true
I20260709 13:17:44.688938 10950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62d1d32fe7e48cb97f4a3a34344a783" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
I20260709 13:17:44.689785 10843 leader_election.cc:304] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b47d3fdd5d61449593b05bde3b67069f, d567067363bd4266815405d14c8c42c4; no voters: 
I20260709 13:17:44.687026 11110 raft_consensus.cc:515] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.689383 11105 ts_tablet_manager.cc:1434] T a5b1bb21e67345058c7484c5e8540859 P b47d3fdd5d61449593b05bde3b67069f: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.003s
I20260709 13:17:44.691422 11120 raft_consensus.cc:2804] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:44.692106 11120 raft_consensus.cc:697] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4 [term 1 LEADER]: Becoming Leader. State: Replica: d567067363bd4266815405d14c8c42c4, State: Running, Role: LEADER
I20260709 13:17:44.693185 11120 consensus_queue.cc:237] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.656224 11104 raft_consensus.cc:359] T d29baf3eb63d4bb6b0f9baa028d1fc01 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.694427 11104 raft_consensus.cc:385] T d29baf3eb63d4bb6b0f9baa028d1fc01 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.694826 11104 raft_consensus.cc:740] T d29baf3eb63d4bb6b0f9baa028d1fc01 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d567067363bd4266815405d14c8c42c4, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.695369 11110 leader_election.cc:290] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 election: Requested vote from peers d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:44.697523 10950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf115b3d896416ebcf05ad97638f1aa" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
W20260709 13:17:44.699213 10768 leader_election.cc:343] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.700199 11105 tablet_bootstrap.cc:492] T 7d4cb37a6d7e41b694224878fbf001ed P b47d3fdd5d61449593b05bde3b67069f: Bootstrap starting.
I20260709 13:17:44.695839 10951 raft_consensus.cc:2468] T 499fadc1dd974c6588cedb5301e3d71d P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 1.
I20260709 13:17:44.700429 11133 raft_consensus.cc:697] T d29baf3eb63d4bb6b0f9baa028d1fc01 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Becoming Leader. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Running, Role: LEADER
I20260709 13:17:44.695705 11104 consensus_queue.cc:260] T d29baf3eb63d4bb6b0f9baa028d1fc01 P d567067363bd4266815405d14c8c42c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.701910 11133 consensus_queue.cc:237] T d29baf3eb63d4bb6b0f9baa028d1fc01 P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.703853 11104 ts_tablet_manager.cc:1434] T d29baf3eb63d4bb6b0f9baa028d1fc01 P d567067363bd4266815405d14c8c42c4: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 13:17:44.699713 10843 leader_election.cc:304] T 499fadc1dd974c6588cedb5301e3d71d P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b47d3fdd5d61449593b05bde3b67069f, d567067363bd4266815405d14c8c42c4; no voters: 
I20260709 13:17:44.705590 11132 raft_consensus.cc:2804] T 499fadc1dd974c6588cedb5301e3d71d P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:44.706033 11132 raft_consensus.cc:493] T 499fadc1dd974c6588cedb5301e3d71d P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.705808 10843 leader_election.cc:304] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b47d3fdd5d61449593b05bde3b67069f, d567067363bd4266815405d14c8c42c4; no voters: 
I20260709 13:17:44.706456 11132 raft_consensus.cc:3060] T 499fadc1dd974c6588cedb5301e3d71d P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.707285 11131 raft_consensus.cc:2804] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:17:44.707311 10843 leader_election.cc:343] T 7d4cb37a6d7e41b694224878fbf001ed P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.707799 11131 raft_consensus.cc:493] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.708046 11105 tablet_bootstrap.cc:654] T 7d4cb37a6d7e41b694224878fbf001ed P b47d3fdd5d61449593b05bde3b67069f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.708216 11131 raft_consensus.cc:3060] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.708525 10843 leader_election.cc:304] T 1d4899a931c04cc5bd67c793cc9cc6af P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b47d3fdd5d61449593b05bde3b67069f, d567067363bd4266815405d14c8c42c4; no voters: 
I20260709 13:17:44.709738 11052 raft_consensus.cc:2804] T 1d4899a931c04cc5bd67c793cc9cc6af P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:44.710459 11052 raft_consensus.cc:697] T 1d4899a931c04cc5bd67c793cc9cc6af P d567067363bd4266815405d14c8c42c4 [term 1 LEADER]: Becoming Leader. State: Replica: d567067363bd4266815405d14c8c42c4, State: Running, Role: LEADER
I20260709 13:17:44.711707 11052 consensus_queue.cc:237] T 1d4899a931c04cc5bd67c793cc9cc6af P d567067363bd4266815405d14c8c42c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
W20260709 13:17:44.720965 10770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.2:37809, user_credentials={real_user=slave}} blocked reactor thread for 58008.9us
I20260709 13:17:44.675354 10805 raft_consensus.cc:2468] T debc9febb2c34accb753acbebaf990cb P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 1.
I20260709 13:17:44.724340 10880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499fadc1dd974c6588cedb5301e3d71d" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d567067363bd4266815405d14c8c42c4"
I20260709 13:17:44.727953 11105 tablet_bootstrap.cc:492] T 7d4cb37a6d7e41b694224878fbf001ed P b47d3fdd5d61449593b05bde3b67069f: No bootstrap required, opened a new log
I20260709 13:17:44.728642 11105 ts_tablet_manager.cc:1403] T 7d4cb37a6d7e41b694224878fbf001ed P b47d3fdd5d61449593b05bde3b67069f: Time spent bootstrapping tablet: real 0.029s	user 0.004s	sys 0.014s
I20260709 13:17:44.729737 10768 leader_election.cc:304] T 499fadc1dd974c6588cedb5301e3d71d P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, b47d3fdd5d61449593b05bde3b67069f; no voters: 
I20260709 13:17:44.731712 11139 raft_consensus.cc:2804] T 499fadc1dd974c6588cedb5301e3d71d P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:44.732324 11139 raft_consensus.cc:697] T 499fadc1dd974c6588cedb5301e3d71d P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Becoming Leader. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Running, Role: LEADER
I20260709 13:17:44.733206 11139 consensus_queue.cc:237] T 499fadc1dd974c6588cedb5301e3d71d P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.735690 11105 raft_consensus.cc:359] T 7d4cb37a6d7e41b694224878fbf001ed P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.736501 11105 raft_consensus.cc:385] T 7d4cb37a6d7e41b694224878fbf001ed P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.736807 11105 raft_consensus.cc:740] T 7d4cb37a6d7e41b694224878fbf001ed P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b47d3fdd5d61449593b05bde3b67069f, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.737231 10879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf115b3d896416ebcf05ad97638f1aa" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d567067363bd4266815405d14c8c42c4"
I20260709 13:17:44.737739 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4cb37a6d7e41b694224878fbf001ed" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" is_pre_election: true
I20260709 13:17:44.738242 10879 raft_consensus.cc:3060] T faf115b3d896416ebcf05ad97638f1aa P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.738444 10804 raft_consensus.cc:2468] T 7d4cb37a6d7e41b694224878fbf001ed P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 0.
I20260709 13:17:44.740113 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62d1d32fe7e48cb97f4a3a34344a783" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
I20260709 13:17:44.736521 11138 raft_consensus.cc:493] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.740928 10804 raft_consensus.cc:2393] T f62d1d32fe7e48cb97f4a3a34344a783 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d567067363bd4266815405d14c8c42c4 in current term 1: Already voted for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in this term.
I20260709 13:17:44.741174 11138 raft_consensus.cc:515] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.743464 11138 leader_election.cc:290] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:44.744225 10843 leader_election.cc:304] T 7d4cb37a6d7e41b694224878fbf001ed P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, d567067363bd4266815405d14c8c42c4; no voters: b47d3fdd5d61449593b05bde3b67069f
I20260709 13:17:44.746708 11130 raft_consensus.cc:2804] T 7d4cb37a6d7e41b694224878fbf001ed P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:44.747502 11130 raft_consensus.cc:493] T 7d4cb37a6d7e41b694224878fbf001ed P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.747660 10843 leader_election.cc:304] T f62d1d32fe7e48cb97f4a3a34344a783 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d567067363bd4266815405d14c8c42c4; no voters: 4b7d4704a4404bb19c3053c6b0af4d90, b47d3fdd5d61449593b05bde3b67069f
I20260709 13:17:44.747895 11130 raft_consensus.cc:3060] T 7d4cb37a6d7e41b694224878fbf001ed P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.745324 11105 consensus_queue.cc:260] T 7d4cb37a6d7e41b694224878fbf001ed P b47d3fdd5d61449593b05bde3b67069f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.753178 11105 ts_tablet_manager.cc:1434] T 7d4cb37a6d7e41b694224878fbf001ed P b47d3fdd5d61449593b05bde3b67069f: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:17:44.754514 11105 tablet_bootstrap.cc:492] T faf115b3d896416ebcf05ad97638f1aa P b47d3fdd5d61449593b05bde3b67069f: Bootstrap starting.
I20260709 13:17:44.752883 10805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d87d86b4b14d52b62593c268fb4f11" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" is_pre_election: true
I20260709 13:17:44.755908 10805 raft_consensus.cc:2468] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 0.
I20260709 13:17:44.754381 10951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d87d86b4b14d52b62593c268fb4f11" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f" is_pre_election: true
I20260709 13:17:44.756996 10951 raft_consensus.cc:2468] T b6d87d86b4b14d52b62593c268fb4f11 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 0.
I20260709 13:17:44.757618 10699 catalog_manager.cc:5697] T d29baf3eb63d4bb6b0f9baa028d1fc01 P 4b7d4704a4404bb19c3053c6b0af4d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.759173 10768 leader_election.cc:304] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, b47d3fdd5d61449593b05bde3b67069f; no voters: 
I20260709 13:17:44.760778 11024 raft_consensus.cc:2804] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:44.761173 11024 raft_consensus.cc:493] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.761780 11105 tablet_bootstrap.cc:654] T faf115b3d896416ebcf05ad97638f1aa P b47d3fdd5d61449593b05bde3b67069f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.762507 11024 raft_consensus.cc:3060] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.753019 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d87d86b4b14d52b62593c268fb4f11" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d567067363bd4266815405d14c8c42c4" is_pre_election: true
I20260709 13:17:44.768916 11131 raft_consensus.cc:515] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.773386 11118 raft_consensus.cc:2749] T f62d1d32fe7e48cb97f4a3a34344a783 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:44.776775 10703 catalog_manager.cc:5697] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d567067363bd4266815405d14c8c42c4 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "d567067363bd4266815405d14c8c42c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.767987 11132 raft_consensus.cc:515] T 499fadc1dd974c6588cedb5301e3d71d P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.781996 10880 raft_consensus.cc:2393] T 499fadc1dd974c6588cedb5301e3d71d P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b7d4704a4404bb19c3053c6b0af4d90 in current term 1: Already voted for candidate d567067363bd4266815405d14c8c42c4 in this term.
I20260709 13:17:44.782804 11024 raft_consensus.cc:515] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.785324 11024 leader_election.cc:290] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 election: Requested vote from peers d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:44.786916 10879 raft_consensus.cc:2468] T faf115b3d896416ebcf05ad97638f1aa P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 1.
I20260709 13:17:44.787935 10951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d87d86b4b14d52b62593c268fb4f11" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
I20260709 13:17:44.788411 10878 raft_consensus.cc:2393] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b7d4704a4404bb19c3053c6b0af4d90 in current term 1: Already voted for candidate d567067363bd4266815405d14c8c42c4 in this term.
I20260709 13:17:44.788640 10951 raft_consensus.cc:3060] T b6d87d86b4b14d52b62593c268fb4f11 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.788143 11118 raft_consensus.cc:493] T d29baf3eb63d4bb6b0f9baa028d1fc01 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.791841 11118 raft_consensus.cc:515] T d29baf3eb63d4bb6b0f9baa028d1fc01 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
W20260709 13:17:44.791989 10843 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.63.1:42789, user_credentials={real_user=slave}} blocked reactor thread for 44421us
I20260709 13:17:44.794071 11118 leader_election.cc:290] T d29baf3eb63d4bb6b0f9baa028d1fc01 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:44.795250 11131 leader_election.cc:290] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 election: Requested vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:44.796202 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d87d86b4b14d52b62593c268fb4f11" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d567067363bd4266815405d14c8c42c4"
I20260709 13:17:44.797302 10878 raft_consensus.cc:2393] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b7d4704a4404bb19c3053c6b0af4d90 in current term 1: Already voted for candidate d567067363bd4266815405d14c8c42c4 in this term.
I20260709 13:17:44.763737 10954 raft_consensus.cc:2468] T f62d1d32fe7e48cb97f4a3a34344a783 P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 1.
I20260709 13:17:44.791047 10770 leader_election.cc:304] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, d567067363bd4266815405d14c8c42c4; no voters: b47d3fdd5d61449593b05bde3b67069f
I20260709 13:17:44.809202 10950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d29baf3eb63d4bb6b0f9baa028d1fc01" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f" is_pre_election: true
I20260709 13:17:44.810525 10950 raft_consensus.cc:2393] T d29baf3eb63d4bb6b0f9baa028d1fc01 P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d567067363bd4266815405d14c8c42c4 in current term 1: Already voted for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in this term.
I20260709 13:17:44.810927 11139 raft_consensus.cc:2804] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:44.811236 10805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d29baf3eb63d4bb6b0f9baa028d1fc01" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" is_pre_election: true
I20260709 13:17:44.811563 11139 raft_consensus.cc:697] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Becoming Leader. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Running, Role: LEADER
I20260709 13:17:44.814393 11132 leader_election.cc:290] T 499fadc1dd974c6588cedb5301e3d71d P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 election: Requested vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:44.812520 11139 consensus_queue.cc:237] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.814584 10950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d87d86b4b14d52b62593c268fb4f11" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
I20260709 13:17:44.804250 11130 raft_consensus.cc:515] T 7d4cb37a6d7e41b694224878fbf001ed P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.822685 11130 leader_election.cc:290] T 7d4cb37a6d7e41b694224878fbf001ed P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 election: Requested vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:44.802068 10951 raft_consensus.cc:2468] T b6d87d86b4b14d52b62593c268fb4f11 P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 1.
I20260709 13:17:44.824097 10768 leader_election.cc:304] T f62d1d32fe7e48cb97f4a3a34344a783 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, b47d3fdd5d61449593b05bde3b67069f; no voters: d567067363bd4266815405d14c8c42c4
I20260709 13:17:44.827438 11133 raft_consensus.cc:2804] T f62d1d32fe7e48cb97f4a3a34344a783 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:44.827940 11133 raft_consensus.cc:697] T f62d1d32fe7e48cb97f4a3a34344a783 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Becoming Leader. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Running, Role: LEADER
I20260709 13:17:44.828141 10768 leader_election.cc:304] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, b47d3fdd5d61449593b05bde3b67069f; no voters: d567067363bd4266815405d14c8c42c4
I20260709 13:17:44.829135 11133 consensus_queue.cc:237] T f62d1d32fe7e48cb97f4a3a34344a783 P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.830044 10950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499fadc1dd974c6588cedb5301e3d71d" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
I20260709 13:17:44.831455 10805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d87d86b4b14d52b62593c268fb4f11" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
I20260709 13:17:44.835207 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499fadc1dd974c6588cedb5301e3d71d" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
I20260709 13:17:44.832075 11024 raft_consensus.cc:2804] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:44.850014 10951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4cb37a6d7e41b694224878fbf001ed" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
I20260709 13:17:44.851003 10951 raft_consensus.cc:3060] T 7d4cb37a6d7e41b694224878fbf001ed P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.855588 10843 leader_election.cc:304] T d29baf3eb63d4bb6b0f9baa028d1fc01 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d567067363bd4266815405d14c8c42c4; no voters: 4b7d4704a4404bb19c3053c6b0af4d90, b47d3fdd5d61449593b05bde3b67069f
I20260709 13:17:44.856912 11052 raft_consensus.cc:3060] T d29baf3eb63d4bb6b0f9baa028d1fc01 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.840845 10950 raft_consensus.cc:2393] T 499fadc1dd974c6588cedb5301e3d71d P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d567067363bd4266815405d14c8c42c4 in current term 1: Already voted for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in this term.
I20260709 13:17:44.860376 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4cb37a6d7e41b694224878fbf001ed" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
I20260709 13:17:44.860574 11024 raft_consensus.cc:697] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Becoming Leader. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Running, Role: LEADER
I20260709 13:17:44.861841 11024 consensus_queue.cc:237] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.863040 10804 raft_consensus.cc:3060] T 7d4cb37a6d7e41b694224878fbf001ed P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.865160 11052 raft_consensus.cc:2749] T d29baf3eb63d4bb6b0f9baa028d1fc01 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:44.864960 10843 leader_election.cc:304] T 499fadc1dd974c6588cedb5301e3d71d P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d567067363bd4266815405d14c8c42c4; no voters: 4b7d4704a4404bb19c3053c6b0af4d90, b47d3fdd5d61449593b05bde3b67069f
I20260709 13:17:44.868768 11105 tablet_bootstrap.cc:492] T faf115b3d896416ebcf05ad97638f1aa P b47d3fdd5d61449593b05bde3b67069f: No bootstrap required, opened a new log
I20260709 13:17:44.868805 11131 raft_consensus.cc:2749] T 499fadc1dd974c6588cedb5301e3d71d P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:44.869422 11105 ts_tablet_manager.cc:1403] T faf115b3d896416ebcf05ad97638f1aa P b47d3fdd5d61449593b05bde3b67069f: Time spent bootstrapping tablet: real 0.115s	user 0.022s	sys 0.015s
I20260709 13:17:44.871307 10843 leader_election.cc:304] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d567067363bd4266815405d14c8c42c4; no voters: 4b7d4704a4404bb19c3053c6b0af4d90, b47d3fdd5d61449593b05bde3b67069f
I20260709 13:17:44.871973 10804 raft_consensus.cc:2468] T 7d4cb37a6d7e41b694224878fbf001ed P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 1.
I20260709 13:17:44.872686 11131 raft_consensus.cc:2749] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:44.872355 11105 raft_consensus.cc:359] T faf115b3d896416ebcf05ad97638f1aa P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.873430 11105 raft_consensus.cc:385] T faf115b3d896416ebcf05ad97638f1aa P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.873812 11105 raft_consensus.cc:740] T faf115b3d896416ebcf05ad97638f1aa P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b47d3fdd5d61449593b05bde3b67069f, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.874468 10843 leader_election.cc:304] T 7d4cb37a6d7e41b694224878fbf001ed P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, d567067363bd4266815405d14c8c42c4; no voters: 
I20260709 13:17:44.874713 11105 consensus_queue.cc:260] T faf115b3d896416ebcf05ad97638f1aa P b47d3fdd5d61449593b05bde3b67069f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.875358 11131 raft_consensus.cc:2804] T 7d4cb37a6d7e41b694224878fbf001ed P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:44.875775 11131 raft_consensus.cc:697] T 7d4cb37a6d7e41b694224878fbf001ed P d567067363bd4266815405d14c8c42c4 [term 1 LEADER]: Becoming Leader. State: Replica: d567067363bd4266815405d14c8c42c4, State: Running, Role: LEADER
I20260709 13:17:44.876425 11131 consensus_queue.cc:237] T 7d4cb37a6d7e41b694224878fbf001ed P d567067363bd4266815405d14c8c42c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.876855 11105 ts_tablet_manager.cc:1434] T faf115b3d896416ebcf05ad97638f1aa P b47d3fdd5d61449593b05bde3b67069f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:17:44.885082 10951 raft_consensus.cc:2468] T 7d4cb37a6d7e41b694224878fbf001ed P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 1.
I20260709 13:17:44.899307 10703 catalog_manager.cc:5697] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.899415 10702 catalog_manager.cc:5697] T 1d4899a931c04cc5bd67c793cc9cc6af P d567067363bd4266815405d14c8c42c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d567067363bd4266815405d14c8c42c4 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "d567067363bd4266815405d14c8c42c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.900887 10703 catalog_manager.cc:5697] T 499fadc1dd974c6588cedb5301e3d71d P 4b7d4704a4404bb19c3053c6b0af4d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.901171 10702 catalog_manager.cc:5697] T 7d4cb37a6d7e41b694224878fbf001ed P d567067363bd4266815405d14c8c42c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d567067363bd4266815405d14c8c42c4 (127.30.63.2). New cstate: current_term: 1 leader_uuid: "d567067363bd4266815405d14c8c42c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.902243 10703 catalog_manager.cc:5697] T f62d1d32fe7e48cb97f4a3a34344a783 P 4b7d4704a4404bb19c3053c6b0af4d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.903601 10703 catalog_manager.cc:5697] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.917639 11024 raft_consensus.cc:493] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.918318 11024 raft_consensus.cc:515] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.920728 11024 leader_election.cc:290] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:44.921476 10879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5b1bb21e67345058c7484c5e8540859" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d567067363bd4266815405d14c8c42c4" is_pre_election: true
I20260709 13:17:44.921830 10951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5b1bb21e67345058c7484c5e8540859" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f" is_pre_election: true
I20260709 13:17:44.922279 10879 raft_consensus.cc:2468] T a5b1bb21e67345058c7484c5e8540859 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 0.
I20260709 13:17:44.922463 10951 raft_consensus.cc:2468] T a5b1bb21e67345058c7484c5e8540859 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 0.
I20260709 13:17:44.923503 10770 leader_election.cc:304] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, d567067363bd4266815405d14c8c42c4; no voters: 
I20260709 13:17:44.924219 11024 raft_consensus.cc:2804] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:44.924638 11024 raft_consensus.cc:493] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.924939 11024 raft_consensus.cc:3060] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.930352 11024 raft_consensus.cc:515] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.931972 11024 leader_election.cc:290] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 election: Requested vote from peers d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:44.932870 10879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5b1bb21e67345058c7484c5e8540859" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d567067363bd4266815405d14c8c42c4"
I20260709 13:17:44.933025 10951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5b1bb21e67345058c7484c5e8540859" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
I20260709 13:17:44.933480 10879 raft_consensus.cc:3060] T a5b1bb21e67345058c7484c5e8540859 P d567067363bd4266815405d14c8c42c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.933661 10951 raft_consensus.cc:3060] T a5b1bb21e67345058c7484c5e8540859 P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.938676 10879 raft_consensus.cc:2468] T a5b1bb21e67345058c7484c5e8540859 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 1.
I20260709 13:17:44.938800 10951 raft_consensus.cc:2468] T a5b1bb21e67345058c7484c5e8540859 P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 1.
I20260709 13:17:44.939893 10770 leader_election.cc:304] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, d567067363bd4266815405d14c8c42c4; no voters: 
I20260709 13:17:44.940760 11024 raft_consensus.cc:2804] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:44.941203 11024 raft_consensus.cc:697] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Becoming Leader. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Running, Role: LEADER
I20260709 13:17:44.941951 11024 consensus_queue.cc:237] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:44.951023 10703 catalog_manager.cc:5697] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1). New cstate: current_term: 1 leader_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:45.016250 10879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "debc9febb2c34accb753acbebaf990cb"
dest_uuid: "d567067363bd4266815405d14c8c42c4"
mode: GRACEFUL
new_leader_uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
 from {username='slave'} at 127.0.0.1:52438
I20260709 13:17:45.016916 10879 raft_consensus.cc:606] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4 [term 1 LEADER]: Received request to transfer leadership to TS 4b7d4704a4404bb19c3053c6b0af4d90
I20260709 13:17:45.025424 10804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6d87d86b4b14d52b62593c268fb4f11"
dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
mode: GRACEFUL
new_leader_uuid: "d567067363bd4266815405d14c8c42c4"
 from {username='slave'} at 127.0.0.1:58660
I20260709 13:17:45.026129 10804 raft_consensus.cc:606] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Received request to transfer leadership to TS d567067363bd4266815405d14c8c42c4
I20260709 13:17:45.034893 10804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "faf115b3d896416ebcf05ad97638f1aa"
dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
mode: GRACEFUL
new_leader_uuid: "d567067363bd4266815405d14c8c42c4"
 from {username='slave'} at 127.0.0.1:58660
I20260709 13:17:45.035473 10804 raft_consensus.cc:606] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Received request to transfer leadership to TS d567067363bd4266815405d14c8c42c4
I20260709 13:17:45.040773 10804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5b1bb21e67345058c7484c5e8540859"
dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
mode: GRACEFUL
new_leader_uuid: "b47d3fdd5d61449593b05bde3b67069f"
 from {username='slave'} at 127.0.0.1:58660
I20260709 13:17:45.041337 10804 raft_consensus.cc:606] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Received request to transfer leadership to TS b47d3fdd5d61449593b05bde3b67069f
I20260709 13:17:45.125671 11133 consensus_queue.cc:1048] T 499fadc1dd974c6588cedb5301e3d71d P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:45.138176 11024 consensus_queue.cc:1048] T 499fadc1dd974c6588cedb5301e3d71d P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:45.148102 11131 consensus_queue.cc:1048] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:45.164041 11024 consensus_queue.cc:1048] T d29baf3eb63d4bb6b0f9baa028d1fc01 P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:45.164175 11131 consensus_queue.cc:1048] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:45.183813 11110 consensus_queue.cc:1048] T d29baf3eb63d4bb6b0f9baa028d1fc01 P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:45.189185 11131 raft_consensus.cc:993] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4: : Instructing follower 4b7d4704a4404bb19c3053c6b0af4d90 to start an election
I20260709 13:17:45.189688 11130 raft_consensus.cc:1081] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4 [term 1 LEADER]: Signalling peer 4b7d4704a4404bb19c3053c6b0af4d90 to start an election
I20260709 13:17:45.191738 10804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "debc9febb2c34accb753acbebaf990cb"
dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
 from {username='slave'} at 127.0.0.1:58656
I20260709 13:17:45.192863 10804 raft_consensus.cc:493] T debc9febb2c34accb753acbebaf990cb P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.193394 10804 raft_consensus.cc:3060] T debc9febb2c34accb753acbebaf990cb P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.203250 10804 raft_consensus.cc:515] T debc9febb2c34accb753acbebaf990cb P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:45.206732 10804 leader_election.cc:290] T debc9febb2c34accb753acbebaf990cb P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 2 election: Requested vote from peers d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:45.206897 10879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debc9febb2c34accb753acbebaf990cb" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d567067363bd4266815405d14c8c42c4"
I20260709 13:17:45.207657 10879 raft_consensus.cc:3055] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:45.208266 10879 raft_consensus.cc:740] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d567067363bd4266815405d14c8c42c4, State: Running, Role: LEADER
I20260709 13:17:45.208737 10950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debc9febb2c34accb753acbebaf990cb" candidate_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
I20260709 13:17:45.209442 10950 raft_consensus.cc:3060] T debc9febb2c34accb753acbebaf990cb P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.210567 10879 consensus_queue.cc:260] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:45.211716 10879 raft_consensus.cc:3060] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.216339 10950 raft_consensus.cc:2468] T debc9febb2c34accb753acbebaf990cb P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 2.
I20260709 13:17:45.217482 10879 raft_consensus.cc:2468] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d4704a4404bb19c3053c6b0af4d90 in term 2.
I20260709 13:17:45.217671 10768 leader_election.cc:304] T debc9febb2c34accb753acbebaf990cb P 4b7d4704a4404bb19c3053c6b0af4d90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, b47d3fdd5d61449593b05bde3b67069f; no voters: 
I20260709 13:17:45.218593 11110 raft_consensus.cc:2804] T debc9febb2c34accb753acbebaf990cb P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:45.219175 11110 raft_consensus.cc:697] T debc9febb2c34accb753acbebaf990cb P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 LEADER]: Becoming Leader. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Running, Role: LEADER
I20260709 13:17:45.219964 11110 consensus_queue.cc:237] T debc9febb2c34accb753acbebaf990cb P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:45.227101 10703 catalog_manager.cc:5697] T debc9febb2c34accb753acbebaf990cb P 4b7d4704a4404bb19c3053c6b0af4d90 reported cstate change: term changed from 1 to 2, leader changed from d567067363bd4266815405d14c8c42c4 (127.30.63.2) to 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1). New cstate: current_term: 2 leader_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:45.227689 11110 consensus_queue.cc:1048] T f62d1d32fe7e48cb97f4a3a34344a783 P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:45.235364 11130 consensus_queue.cc:1048] T 1d4899a931c04cc5bd67c793cc9cc6af P d567067363bd4266815405d14c8c42c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:45.247041 11024 consensus_queue.cc:1048] T f62d1d32fe7e48cb97f4a3a34344a783 P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:45.260572 11024 consensus_queue.cc:1048] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:45.264190 11118 consensus_queue.cc:1048] T 1d4899a931c04cc5bd67c793cc9cc6af P d567067363bd4266815405d14c8c42c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:45.273648 11118 consensus_queue.cc:1048] T 7d4cb37a6d7e41b694224878fbf001ed P d567067363bd4266815405d14c8c42c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:45.275787 11024 raft_consensus.cc:993] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90: : Instructing follower d567067363bd4266815405d14c8c42c4 to start an election
I20260709 13:17:45.276369 11024 raft_consensus.cc:1081] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Signalling peer d567067363bd4266815405d14c8c42c4 to start an election
I20260709 13:17:45.278733 10878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "faf115b3d896416ebcf05ad97638f1aa"
dest_uuid: "d567067363bd4266815405d14c8c42c4"
 from {username='slave'} at 127.0.0.1:52434
I20260709 13:17:45.280697 10878 raft_consensus.cc:493] T faf115b3d896416ebcf05ad97638f1aa P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.281153 10878 raft_consensus.cc:3060] T faf115b3d896416ebcf05ad97638f1aa P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.285167 10954 raft_consensus.cc:3060] T faf115b3d896416ebcf05ad97638f1aa P b47d3fdd5d61449593b05bde3b67069f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:45.290740 10878 raft_consensus.cc:515] T faf115b3d896416ebcf05ad97638f1aa P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:45.298482 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf115b3d896416ebcf05ad97638f1aa" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
I20260709 13:17:45.298909 10878 leader_election.cc:290] T faf115b3d896416ebcf05ad97638f1aa P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 2 election: Requested vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:45.299163 10804 raft_consensus.cc:3055] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:45.299787 10804 raft_consensus.cc:740] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Running, Role: LEADER
I20260709 13:17:45.300129 10950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf115b3d896416ebcf05ad97638f1aa" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
I20260709 13:17:45.303617 11110 consensus_queue.cc:1048] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:45.305606 10804 consensus_queue.cc:260] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:45.306636 10804 raft_consensus.cc:3060] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.318974 11131 consensus_queue.cc:1048] T 7d4cb37a6d7e41b694224878fbf001ed P d567067363bd4266815405d14c8c42c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:45.331377 10804 raft_consensus.cc:2468] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 2.
I20260709 13:17:45.333259 10843 leader_election.cc:304] T faf115b3d896416ebcf05ad97638f1aa P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, d567067363bd4266815405d14c8c42c4; no voters: b47d3fdd5d61449593b05bde3b67069f
I20260709 13:17:45.334014 11118 raft_consensus.cc:2804] T faf115b3d896416ebcf05ad97638f1aa P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:45.334553 11118 raft_consensus.cc:697] T faf115b3d896416ebcf05ad97638f1aa P d567067363bd4266815405d14c8c42c4 [term 2 LEADER]: Becoming Leader. State: Replica: d567067363bd4266815405d14c8c42c4, State: Running, Role: LEADER
I20260709 13:17:45.335398 11118 consensus_queue.cc:237] T faf115b3d896416ebcf05ad97638f1aa P d567067363bd4266815405d14c8c42c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:45.342499 10699 catalog_manager.cc:5697] T faf115b3d896416ebcf05ad97638f1aa P d567067363bd4266815405d14c8c42c4 reported cstate change: term changed from 1 to 2, leader changed from 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1) to d567067363bd4266815405d14c8c42c4 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "d567067363bd4266815405d14c8c42c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:45.351094 11110 consensus_queue.cc:1048] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:45.364091 11110 consensus_queue.cc:1048] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:45.373068 11133 raft_consensus.cc:993] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90: : Instructing follower d567067363bd4266815405d14c8c42c4 to start an election
I20260709 13:17:45.373593 11110 raft_consensus.cc:1081] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Signalling peer d567067363bd4266815405d14c8c42c4 to start an election
I20260709 13:17:45.375185 10878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6d87d86b4b14d52b62593c268fb4f11"
dest_uuid: "d567067363bd4266815405d14c8c42c4"
 from {username='slave'} at 127.0.0.1:52434
I20260709 13:17:45.375788 10878 raft_consensus.cc:493] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.376152 10878 raft_consensus.cc:3060] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.383638 10878 raft_consensus.cc:515] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:45.385710 10878 leader_election.cc:290] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 2 election: Requested vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), b47d3fdd5d61449593b05bde3b67069f (127.30.63.3:42139)
I20260709 13:17:45.387769 10805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d87d86b4b14d52b62593c268fb4f11" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
I20260709 13:17:45.388432 10805 raft_consensus.cc:3055] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:45.388747 10805 raft_consensus.cc:740] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Running, Role: LEADER
I20260709 13:17:45.387773 10950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d87d86b4b14d52b62593c268fb4f11" candidate_uuid: "d567067363bd4266815405d14c8c42c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
I20260709 13:17:45.389606 10950 raft_consensus.cc:3060] T b6d87d86b4b14d52b62593c268fb4f11 P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.389897 10805 consensus_queue.cc:260] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:45.391309 10805 raft_consensus.cc:3060] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.397418 10950 raft_consensus.cc:2468] T b6d87d86b4b14d52b62593c268fb4f11 P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 2.
I20260709 13:17:45.398763 10805 raft_consensus.cc:2468] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d567067363bd4266815405d14c8c42c4 in term 2.
I20260709 13:17:45.398834 10843 leader_election.cc:304] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b47d3fdd5d61449593b05bde3b67069f, d567067363bd4266815405d14c8c42c4; no voters: 
I20260709 13:17:45.399780 11118 raft_consensus.cc:2804] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:45.400275 11118 raft_consensus.cc:697] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4 [term 2 LEADER]: Becoming Leader. State: Replica: d567067363bd4266815405d14c8c42c4, State: Running, Role: LEADER
I20260709 13:17:45.401105 11118 consensus_queue.cc:237] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:45.408144 10699 catalog_manager.cc:5697] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4 reported cstate change: term changed from 1 to 2, leader changed from 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1) to d567067363bd4266815405d14c8c42c4 (127.30.63.2). New cstate: current_term: 2 leader_uuid: "d567067363bd4266815405d14c8c42c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:45.494469 11110 consensus_queue.cc:1048] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:45.501817 11133 raft_consensus.cc:993] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90: : Instructing follower b47d3fdd5d61449593b05bde3b67069f to start an election
I20260709 13:17:45.502282 11133 raft_consensus.cc:1081] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Signalling peer b47d3fdd5d61449593b05bde3b67069f to start an election
I20260709 13:17:45.504088 10951 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5b1bb21e67345058c7484c5e8540859"
dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
 from {username='slave'} at 127.0.0.1:33022
I20260709 13:17:45.504696 10951 raft_consensus.cc:493] T a5b1bb21e67345058c7484c5e8540859 P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.505093 10951 raft_consensus.cc:3060] T a5b1bb21e67345058c7484c5e8540859 P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.512164 11133 consensus_queue.cc:1048] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:45.512853 10951 raft_consensus.cc:515] T a5b1bb21e67345058c7484c5e8540859 P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:45.514880 10950 raft_consensus.cc:1240] T a5b1bb21e67345058c7484c5e8540859 P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Rejecting Update request from peer 4b7d4704a4404bb19c3053c6b0af4d90 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:45.515945 10805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5b1bb21e67345058c7484c5e8540859" candidate_uuid: "b47d3fdd5d61449593b05bde3b67069f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
I20260709 13:17:45.516639 10805 raft_consensus.cc:3055] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:45.516959 10805 raft_consensus.cc:740] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Running, Role: LEADER
I20260709 13:17:45.517267 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5b1bb21e67345058c7484c5e8540859" candidate_uuid: "b47d3fdd5d61449593b05bde3b67069f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d567067363bd4266815405d14c8c42c4"
I20260709 13:17:45.517863 10878 raft_consensus.cc:3060] T a5b1bb21e67345058c7484c5e8540859 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.517783 10805 consensus_queue.cc:260] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:45.519091 10805 raft_consensus.cc:3060] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.524358 10878 raft_consensus.cc:2468] T a5b1bb21e67345058c7484c5e8540859 P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b47d3fdd5d61449593b05bde3b67069f in term 2.
I20260709 13:17:45.525045 10951 leader_election.cc:290] T a5b1bb21e67345058c7484c5e8540859 P b47d3fdd5d61449593b05bde3b67069f [CANDIDATE]: Term 2 election: Requested vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809)
I20260709 13:17:45.525692 10879 raft_consensus.cc:1240] T a5b1bb21e67345058c7484c5e8540859 P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Rejecting Update request from peer 4b7d4704a4404bb19c3053c6b0af4d90 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:17:45.527313 10805 raft_consensus.cc:2468] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b47d3fdd5d61449593b05bde3b67069f in term 2.
I20260709 13:17:45.528129 10919 leader_election.cc:304] T a5b1bb21e67345058c7484c5e8540859 P b47d3fdd5d61449593b05bde3b67069f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b47d3fdd5d61449593b05bde3b67069f, d567067363bd4266815405d14c8c42c4; no voters: 
I20260709 13:17:45.529213 11065 raft_consensus.cc:2804] T a5b1bb21e67345058c7484c5e8540859 P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:45.530290 11065 raft_consensus.cc:697] T a5b1bb21e67345058c7484c5e8540859 P b47d3fdd5d61449593b05bde3b67069f [term 2 LEADER]: Becoming Leader. State: Replica: b47d3fdd5d61449593b05bde3b67069f, State: Running, Role: LEADER
I20260709 13:17:45.531145 11065 consensus_queue.cc:237] T a5b1bb21e67345058c7484c5e8540859 P b47d3fdd5d61449593b05bde3b67069f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:45.539214 10699 catalog_manager.cc:5697] T a5b1bb21e67345058c7484c5e8540859 P b47d3fdd5d61449593b05bde3b67069f reported cstate change: term changed from 1 to 2, leader changed from 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1) to b47d3fdd5d61449593b05bde3b67069f (127.30.63.3). New cstate: current_term: 2 leader_uuid: "b47d3fdd5d61449593b05bde3b67069f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:45.600881 10951 raft_consensus.cc:1275] T debc9febb2c34accb753acbebaf990cb P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Refusing update from remote peer 4b7d4704a4404bb19c3053c6b0af4d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:45.602350 11133 consensus_queue.cc:1048] T debc9febb2c34accb753acbebaf990cb P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:45.610605 10879 raft_consensus.cc:1275] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Refusing update from remote peer 4b7d4704a4404bb19c3053c6b0af4d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:45.612532 11024 consensus_queue.cc:1048] T debc9febb2c34accb753acbebaf990cb P 4b7d4704a4404bb19c3053c6b0af4d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:45.834653 10951 raft_consensus.cc:1275] T b6d87d86b4b14d52b62593c268fb4f11 P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Refusing update from remote peer d567067363bd4266815405d14c8c42c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:45.835902 11120 consensus_queue.cc:1048] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:45.841598 10805 raft_consensus.cc:1275] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Refusing update from remote peer d567067363bd4266815405d14c8c42c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:45.845849 11118 consensus_queue.cc:1048] T faf115b3d896416ebcf05ad97638f1aa P d567067363bd4266815405d14c8c42c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:45.847071 10805 raft_consensus.cc:1275] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Refusing update from remote peer d567067363bd4266815405d14c8c42c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:45.849241 11131 consensus_queue.cc:1048] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:45.858423 10951 raft_consensus.cc:3060] T faf115b3d896416ebcf05ad97638f1aa P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.868269 10951 raft_consensus.cc:1275] T faf115b3d896416ebcf05ad97638f1aa P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Refusing update from remote peer d567067363bd4266815405d14c8c42c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:45.869668 11120 consensus_queue.cc:1048] T faf115b3d896416ebcf05ad97638f1aa P d567067363bd4266815405d14c8c42c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:45.980898 10804 raft_consensus.cc:1275] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Refusing update from remote peer b47d3fdd5d61449593b05bde3b67069f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:45.982352 11065 consensus_queue.cc:1048] T a5b1bb21e67345058c7484c5e8540859 P b47d3fdd5d61449593b05bde3b67069f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:45.992005 10879 raft_consensus.cc:1275] T a5b1bb21e67345058c7484c5e8540859 P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Refusing update from remote peer b47d3fdd5d61449593b05bde3b67069f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:45.993489 11176 consensus_queue.cc:1048] T a5b1bb21e67345058c7484c5e8540859 P b47d3fdd5d61449593b05bde3b67069f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:48.044744 10699 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45684:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:17:48.065562 10699 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45684:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:17:48.122402 30972 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:48.308887 11216 log.cc:927] Time spent T 1d4899a931c04cc5bd67c793cc9cc6af P b47d3fdd5d61449593b05bde3b67069f: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:17:48.431411 11228 log.cc:927] Time spent T 7d4cb37a6d7e41b694224878fbf001ed P b47d3fdd5d61449593b05bde3b67069f: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:17:48.455473 11234 tablet.cc:1724] T d29baf3eb63d4bb6b0f9baa028d1fc01 P 4b7d4704a4404bb19c3053c6b0af4d90: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:48.474200 11232 tablet.cc:1724] T 7d4cb37a6d7e41b694224878fbf001ed P d567067363bd4266815405d14c8c42c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:48.482216 11236 tablet.cc:1724] T d29baf3eb63d4bb6b0f9baa028d1fc01 P b47d3fdd5d61449593b05bde3b67069f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:48.467869 11229 tablet.cc:1724] T 1d4899a931c04cc5bd67c793cc9cc6af P b47d3fdd5d61449593b05bde3b67069f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:48.533985 11247 tablet.cc:1724] T 499fadc1dd974c6588cedb5301e3d71d P 4b7d4704a4404bb19c3053c6b0af4d90: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:48.535795 11243 tablet.cc:1724] T faf115b3d896416ebcf05ad97638f1aa P d567067363bd4266815405d14c8c42c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:48.515729 11249 tablet.cc:1724] T 7d4cb37a6d7e41b694224878fbf001ed P 4b7d4704a4404bb19c3053c6b0af4d90: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:17:48.561621 11230 log.cc:927] Time spent T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90: Append to log took a long time: real 0.135s	user 0.005s	sys 0.000s
I20260709 13:17:48.564844 11234 tablet.cc:1724] T debc9febb2c34accb753acbebaf990cb P 4b7d4704a4404bb19c3053c6b0af4d90: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:48.539629 11245 tablet.cc:1724] T 7d4cb37a6d7e41b694224878fbf001ed P b47d3fdd5d61449593b05bde3b67069f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:48.560454 11246 tablet.cc:1724] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:48.634080 10803 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26ad1205065a48b29567ed4c89b20059"
dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
mode: GRACEFUL
new_leader_uuid: "b47d3fdd5d61449593b05bde3b67069f"
 from {username='slave'} at 127.0.0.1:58674
I20260709 13:17:48.639875 10803 raft_consensus.cc:606] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Received request to transfer leadership to TS b47d3fdd5d61449593b05bde3b67069f
I20260709 13:17:48.587092 11248 tablet.cc:1724] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:48.667958 11229 tablet.cc:1724] T a5b1bb21e67345058c7484c5e8540859 P b47d3fdd5d61449593b05bde3b67069f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:17:48.670306 11242 log.cc:927] Time spent T d29baf3eb63d4bb6b0f9baa028d1fc01 P d567067363bd4266815405d14c8c42c4: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:17:48.672936 11232 tablet.cc:1724] T d29baf3eb63d4bb6b0f9baa028d1fc01 P d567067363bd4266815405d14c8c42c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:48.681241 11250 tablet.cc:1724] T faf115b3d896416ebcf05ad97638f1aa P b47d3fdd5d61449593b05bde3b67069f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:48.689646 11249 tablet.cc:1724] T f62d1d32fe7e48cb97f4a3a34344a783 P 4b7d4704a4404bb19c3053c6b0af4d90: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:48.675812 11243 tablet.cc:1724] T a5b1bb21e67345058c7484c5e8540859 P d567067363bd4266815405d14c8c42c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:48.704531 11247 tablet.cc:1724] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:17:48.706946 10770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.63.2:37809, user_credentials={real_user=slave}} blocked reactor thread for 161140us
I20260709 13:17:48.730263 11246 tablet.cc:1724] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:48.730530 11234 tablet.cc:1724] T 1d4899a931c04cc5bd67c793cc9cc6af P 4b7d4704a4404bb19c3053c6b0af4d90: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:48.746285 11236 tablet.cc:1724] T b6d87d86b4b14d52b62593c268fb4f11 P b47d3fdd5d61449593b05bde3b67069f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:48.750181 11232 tablet.cc:1724] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:48.751343 11250 tablet.cc:1724] T 499fadc1dd974c6588cedb5301e3d71d P b47d3fdd5d61449593b05bde3b67069f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:48.752817 10879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40f935f4b4a54f5d9b3093d4f5e1b058"
dest_uuid: "d567067363bd4266815405d14c8c42c4"
mode: GRACEFUL
new_leader_uuid: "b47d3fdd5d61449593b05bde3b67069f"
 from {username='slave'} at 127.0.0.1:60952
I20260709 13:17:48.753414 10879 raft_consensus.cc:606] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [term 2 LEADER]: Received request to transfer leadership to TS b47d3fdd5d61449593b05bde3b67069f
I20260709 13:17:48.750967 11243 tablet.cc:1724] T f62d1d32fe7e48cb97f4a3a34344a783 P d567067363bd4266815405d14c8c42c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:48.754937 30972 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:48.758880 30972 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:48.756240 11251 tablet.cc:1724] T 1d4899a931c04cc5bd67c793cc9cc6af P d567067363bd4266815405d14c8c42c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:48.779418 11248 tablet.cc:1724] T 499fadc1dd974c6588cedb5301e3d71d P d567067363bd4266815405d14c8c42c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:48.781662 11250 tablet.cc:1724] T f62d1d32fe7e48cb97f4a3a34344a783 P b47d3fdd5d61449593b05bde3b67069f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:48.785303 11245 tablet.cc:1724] T debc9febb2c34accb753acbebaf990cb P b47d3fdd5d61449593b05bde3b67069f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:48.812945 10699 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 54007ed6452045f4807f96f9f96bd4e2: soft_deleted_table [id=95f862aa7233487a901acfa3657b78bf] alter complete (version 1)
I20260709 13:17:48.914528 11225 raft_consensus.cc:993] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90: : Instructing follower b47d3fdd5d61449593b05bde3b67069f to start an election
I20260709 13:17:48.915189 11252 raft_consensus.cc:1081] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Signalling peer b47d3fdd5d61449593b05bde3b67069f to start an election
I20260709 13:17:48.916684 10950 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26ad1205065a48b29567ed4c89b20059"
dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
 from {username='slave'} at 127.0.0.1:33022
I20260709 13:17:48.917176 10950 raft_consensus.cc:493] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:48.917508 10950 raft_consensus.cc:3060] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.923686 10950 raft_consensus.cc:515] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:48.925765 10950 leader_election.cc:290] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f [CANDIDATE]: Term 2 election: Requested vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809)
I20260709 13:17:48.926468 10803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ad1205065a48b29567ed4c89b20059" candidate_uuid: "b47d3fdd5d61449593b05bde3b67069f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
I20260709 13:17:48.926748 10879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ad1205065a48b29567ed4c89b20059" candidate_uuid: "b47d3fdd5d61449593b05bde3b67069f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d567067363bd4266815405d14c8c42c4"
I20260709 13:17:48.927351 10879 raft_consensus.cc:3060] T 26ad1205065a48b29567ed4c89b20059 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.927228 10803 raft_consensus.cc:3055] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:48.928295 10803 raft_consensus.cc:740] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b7d4704a4404bb19c3053c6b0af4d90, State: Running, Role: LEADER
I20260709 13:17:48.929173 10803 consensus_queue.cc:260] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:48.930759 10803 raft_consensus.cc:3060] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.932951 10879 raft_consensus.cc:2468] T 26ad1205065a48b29567ed4c89b20059 P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b47d3fdd5d61449593b05bde3b67069f in term 2.
I20260709 13:17:48.933949 10919 leader_election.cc:304] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b47d3fdd5d61449593b05bde3b67069f, d567067363bd4266815405d14c8c42c4; no voters: 
I20260709 13:17:48.934631 11176 raft_consensus.cc:2804] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:48.935107 11176 raft_consensus.cc:697] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f [term 2 LEADER]: Becoming Leader. State: Replica: b47d3fdd5d61449593b05bde3b67069f, State: Running, Role: LEADER
I20260709 13:17:48.935938 11176 consensus_queue.cc:237] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:48.937044 10803 raft_consensus.cc:2468] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b47d3fdd5d61449593b05bde3b67069f in term 2.
I20260709 13:17:48.944337 10700 catalog_manager.cc:5697] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f reported cstate change: term changed from 1 to 2, leader changed from 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1) to b47d3fdd5d61449593b05bde3b67069f (127.30.63.3). New cstate: current_term: 2 leader_uuid: "b47d3fdd5d61449593b05bde3b67069f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:49.010349 11207 raft_consensus.cc:993] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4: : Instructing follower b47d3fdd5d61449593b05bde3b67069f to start an election
I20260709 13:17:49.011060 11179 raft_consensus.cc:1081] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [term 2 LEADER]: Signalling peer b47d3fdd5d61449593b05bde3b67069f to start an election
I20260709 13:17:49.012759 10950 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40f935f4b4a54f5d9b3093d4f5e1b058"
dest_uuid: "b47d3fdd5d61449593b05bde3b67069f"
 from {username='slave'} at 127.0.0.1:33024
I20260709 13:17:49.013339 10950 raft_consensus.cc:493] T 40f935f4b4a54f5d9b3093d4f5e1b058 P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:49.013710 10950 raft_consensus.cc:3060] T 40f935f4b4a54f5d9b3093d4f5e1b058 P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:49.019982 10950 raft_consensus.cc:515] T 40f935f4b4a54f5d9b3093d4f5e1b058 P b47d3fdd5d61449593b05bde3b67069f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:49.022516 10950 leader_election.cc:290] T 40f935f4b4a54f5d9b3093d4f5e1b058 P b47d3fdd5d61449593b05bde3b67069f [CANDIDATE]: Term 3 election: Requested vote from peers 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789), d567067363bd4266815405d14c8c42c4 (127.30.63.2:37809)
I20260709 13:17:49.023038 10805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f935f4b4a54f5d9b3093d4f5e1b058" candidate_uuid: "b47d3fdd5d61449593b05bde3b67069f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b7d4704a4404bb19c3053c6b0af4d90"
I20260709 13:17:49.023666 10805 raft_consensus.cc:3060] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:49.024115 10879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f935f4b4a54f5d9b3093d4f5e1b058" candidate_uuid: "b47d3fdd5d61449593b05bde3b67069f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d567067363bd4266815405d14c8c42c4"
I20260709 13:17:49.024674 10879 raft_consensus.cc:3055] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:49.024993 10879 raft_consensus.cc:740] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d567067363bd4266815405d14c8c42c4, State: Running, Role: LEADER
I20260709 13:17:49.025797 10879 consensus_queue.cc:260] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:49.026667 10879 raft_consensus.cc:3060] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:49.028862 10805 raft_consensus.cc:2468] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b47d3fdd5d61449593b05bde3b67069f in term 3.
I20260709 13:17:49.030073 10917 leader_election.cc:304] T 40f935f4b4a54f5d9b3093d4f5e1b058 P b47d3fdd5d61449593b05bde3b67069f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7d4704a4404bb19c3053c6b0af4d90, b47d3fdd5d61449593b05bde3b67069f; no voters: 
I20260709 13:17:49.030836 11176 raft_consensus.cc:2804] T 40f935f4b4a54f5d9b3093d4f5e1b058 P b47d3fdd5d61449593b05bde3b67069f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:49.031266 11176 raft_consensus.cc:697] T 40f935f4b4a54f5d9b3093d4f5e1b058 P b47d3fdd5d61449593b05bde3b67069f [term 3 LEADER]: Becoming Leader. State: Replica: b47d3fdd5d61449593b05bde3b67069f, State: Running, Role: LEADER
I20260709 13:17:49.031774 10879 raft_consensus.cc:2468] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b47d3fdd5d61449593b05bde3b67069f in term 3.
I20260709 13:17:49.032060 11176 consensus_queue.cc:237] T 40f935f4b4a54f5d9b3093d4f5e1b058 P b47d3fdd5d61449593b05bde3b67069f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } }
I20260709 13:17:49.039376 10700 catalog_manager.cc:5697] T 40f935f4b4a54f5d9b3093d4f5e1b058 P b47d3fdd5d61449593b05bde3b67069f reported cstate change: term changed from 2 to 3, leader changed from d567067363bd4266815405d14c8c42c4 (127.30.63.2) to b47d3fdd5d61449593b05bde3b67069f (127.30.63.3). New cstate: current_term: 3 leader_uuid: "b47d3fdd5d61449593b05bde3b67069f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b47d3fdd5d61449593b05bde3b67069f" member_type: VOTER last_known_addr { host: "127.30.63.3" port: 42139 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:49.394411 10805 raft_consensus.cc:1275] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Refusing update from remote peer b47d3fdd5d61449593b05bde3b67069f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:49.395681 11176 consensus_queue.cc:1048] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:49.411046 10879 raft_consensus.cc:1275] T 26ad1205065a48b29567ed4c89b20059 P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Refusing update from remote peer b47d3fdd5d61449593b05bde3b67069f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:49.412806 11261 consensus_queue.cc:1048] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:49.435245 10805 raft_consensus.cc:1275] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 3 FOLLOWER]: Refusing update from remote peer b47d3fdd5d61449593b05bde3b67069f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:49.436717 11237 consensus_queue.cc:1048] T 40f935f4b4a54f5d9b3093d4f5e1b058 P b47d3fdd5d61449593b05bde3b67069f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d4704a4404bb19c3053c6b0af4d90" member_type: VOTER last_known_addr { host: "127.30.63.1" port: 42789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:49.453156 10879 raft_consensus.cc:1275] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [term 3 FOLLOWER]: Refusing update from remote peer b47d3fdd5d61449593b05bde3b67069f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:49.455385 11176 consensus_queue.cc:1048] T 40f935f4b4a54f5d9b3093d4f5e1b058 P b47d3fdd5d61449593b05bde3b67069f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d567067363bd4266815405d14c8c42c4" member_type: VOTER last_known_addr { host: "127.30.63.2" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:49.819340 30972 tablet_server.cc:179] TabletServer@127.30.63.1:0 shutting down...
W20260709 13:17:49.850750 10917 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 8 similar messages]
I20260709 13:17:49.852228 30972 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:49.853159 30972 tablet_replica.cc:333] T 7d4cb37a6d7e41b694224878fbf001ed P 4b7d4704a4404bb19c3053c6b0af4d90: stopping tablet replica
I20260709 13:17:49.853901 30972 raft_consensus.cc:2243] T 7d4cb37a6d7e41b694224878fbf001ed P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.854393 30972 raft_consensus.cc:2272] T 7d4cb37a6d7e41b694224878fbf001ed P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:49.854780 10917 consensus_peers.cc:597] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f -> Peer 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789): Couldn't send request to peer 4b7d4704a4404bb19c3053c6b0af4d90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:49.856365 30972 tablet_replica.cc:333] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90: stopping tablet replica
I20260709 13:17:49.857051 30972 raft_consensus.cc:2243] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.857518 30972 raft_consensus.cc:2272] T a5b1bb21e67345058c7484c5e8540859 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.859396 30972 tablet_replica.cc:333] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90: stopping tablet replica
I20260709 13:17:49.859965 30972 raft_consensus.cc:2243] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.860456 30972 raft_consensus.cc:2272] T b6d87d86b4b14d52b62593c268fb4f11 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.862501 30972 tablet_replica.cc:333] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90: stopping tablet replica
I20260709 13:17:49.863109 30972 raft_consensus.cc:2243] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.863552 30972 raft_consensus.cc:2272] T faf115b3d896416ebcf05ad97638f1aa P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.865530 30972 tablet_replica.cc:333] T 1d4899a931c04cc5bd67c793cc9cc6af P 4b7d4704a4404bb19c3053c6b0af4d90: stopping tablet replica
I20260709 13:17:49.866113 30972 raft_consensus.cc:2243] T 1d4899a931c04cc5bd67c793cc9cc6af P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.866547 30972 raft_consensus.cc:2272] T 1d4899a931c04cc5bd67c793cc9cc6af P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.868310 30972 tablet_replica.cc:333] T f62d1d32fe7e48cb97f4a3a34344a783 P 4b7d4704a4404bb19c3053c6b0af4d90: stopping tablet replica
I20260709 13:17:49.868914 30972 raft_consensus.cc:2243] T f62d1d32fe7e48cb97f4a3a34344a783 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:49.869684 30972 raft_consensus.cc:2272] T f62d1d32fe7e48cb97f4a3a34344a783 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.871970 30972 tablet_replica.cc:333] T debc9febb2c34accb753acbebaf990cb P 4b7d4704a4404bb19c3053c6b0af4d90: stopping tablet replica
I20260709 13:17:49.872764 30972 raft_consensus.cc:2243] T debc9febb2c34accb753acbebaf990cb P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:49.873607 30972 raft_consensus.cc:2272] T debc9febb2c34accb753acbebaf990cb P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:49.875506 10917 consensus_peers.cc:597] T 40f935f4b4a54f5d9b3093d4f5e1b058 P b47d3fdd5d61449593b05bde3b67069f -> Peer 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789): Couldn't send request to peer 4b7d4704a4404bb19c3053c6b0af4d90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:49.876266 30972 tablet_replica.cc:333] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90: stopping tablet replica
W20260709 13:17:49.876394 10843 consensus_peers.cc:597] T bea59f51efa648ea8d820e99be4bc7d3 P d567067363bd4266815405d14c8c42c4 -> Peer 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789): Couldn't send request to peer 4b7d4704a4404bb19c3053c6b0af4d90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:49.877106 30972 raft_consensus.cc:2243] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.877578 30972 raft_consensus.cc:2272] T c7d24f498cb84dd2b9139031f8e00a57 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.879801 30972 tablet_replica.cc:333] T 81eef65db7ff4e8cb37f06a3decd4320 P 4b7d4704a4404bb19c3053c6b0af4d90: stopping tablet replica
I20260709 13:17:49.880434 30972 raft_consensus.cc:2243] T 81eef65db7ff4e8cb37f06a3decd4320 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:49.881224 30972 raft_consensus.cc:2272] T 81eef65db7ff4e8cb37f06a3decd4320 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.883174 30972 tablet_replica.cc:333] T e373165d4f2844d882994be5887e5ddf P 4b7d4704a4404bb19c3053c6b0af4d90: stopping tablet replica
I20260709 13:17:49.883710 30972 raft_consensus.cc:2243] T e373165d4f2844d882994be5887e5ddf P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.884092 30972 raft_consensus.cc:2272] T e373165d4f2844d882994be5887e5ddf P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.886200 30972 tablet_replica.cc:333] T f1a15aa0b7ce423386027dfe9aced682 P 4b7d4704a4404bb19c3053c6b0af4d90: stopping tablet replica
I20260709 13:17:49.886765 30972 raft_consensus.cc:2243] T f1a15aa0b7ce423386027dfe9aced682 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.887166 30972 raft_consensus.cc:2272] T f1a15aa0b7ce423386027dfe9aced682 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.889053 30972 tablet_replica.cc:333] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90: stopping tablet replica
I20260709 13:17:49.889568 30972 raft_consensus.cc:2243] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.889914 30972 raft_consensus.cc:2272] T 26ad1205065a48b29567ed4c89b20059 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.892360 30972 tablet_replica.cc:333] T 11aa1269fea7424ea33a0e9bcd4e64fb P 4b7d4704a4404bb19c3053c6b0af4d90: stopping tablet replica
I20260709 13:17:49.893003 30972 raft_consensus.cc:2243] T 11aa1269fea7424ea33a0e9bcd4e64fb P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:49.893754 30972 raft_consensus.cc:2272] T 11aa1269fea7424ea33a0e9bcd4e64fb P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.896467 30972 tablet_replica.cc:333] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90: stopping tablet replica
I20260709 13:17:49.897306 30972 raft_consensus.cc:2243] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.897871 30972 raft_consensus.cc:2272] T 40f935f4b4a54f5d9b3093d4f5e1b058 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:49.898259 10917 consensus_peers.cc:597] T e373165d4f2844d882994be5887e5ddf P b47d3fdd5d61449593b05bde3b67069f -> Peer 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789): Couldn't send request to peer 4b7d4704a4404bb19c3053c6b0af4d90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:49.901118 30972 tablet_replica.cc:333] T d29baf3eb63d4bb6b0f9baa028d1fc01 P 4b7d4704a4404bb19c3053c6b0af4d90: stopping tablet replica
I20260709 13:17:49.901716 30972 raft_consensus.cc:2243] T d29baf3eb63d4bb6b0f9baa028d1fc01 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:49.902397 30972 raft_consensus.cc:2272] T d29baf3eb63d4bb6b0f9baa028d1fc01 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.904201 30972 tablet_replica.cc:333] T bea59f51efa648ea8d820e99be4bc7d3 P 4b7d4704a4404bb19c3053c6b0af4d90: stopping tablet replica
I20260709 13:17:49.904743 30972 raft_consensus.cc:2243] T bea59f51efa648ea8d820e99be4bc7d3 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.905128 30972 raft_consensus.cc:2272] T bea59f51efa648ea8d820e99be4bc7d3 P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.907058 30972 tablet_replica.cc:333] T 499fadc1dd974c6588cedb5301e3d71d P 4b7d4704a4404bb19c3053c6b0af4d90: stopping tablet replica
I20260709 13:17:49.907537 30972 raft_consensus.cc:2243] T 499fadc1dd974c6588cedb5301e3d71d P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:49.908211 30972 raft_consensus.cc:2272] T 499fadc1dd974c6588cedb5301e3d71d P 4b7d4704a4404bb19c3053c6b0af4d90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.910001 30972 tablet_replica.cc:333] T 7a876d18e09a4577a85ca26975da0e8d P 4b7d4704a4404bb19c3053c6b0af4d90: stopping tablet replica
I20260709 13:17:49.910442 30972 raft_consensus.cc:2243] T 7a876d18e09a4577a85ca26975da0e8d P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:49.911128 30972 raft_consensus.cc:2272] T 7a876d18e09a4577a85ca26975da0e8d P 4b7d4704a4404bb19c3053c6b0af4d90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.953299 30972 tablet_server.cc:196] TabletServer@127.30.63.1:0 shutdown complete.
I20260709 13:17:49.988760 30972 tablet_server.cc:179] TabletServer@127.30.63.2:0 shutting down...
I20260709 13:17:50.018899 30972 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:50.019632 30972 tablet_replica.cc:333] T faf115b3d896416ebcf05ad97638f1aa P d567067363bd4266815405d14c8c42c4: stopping tablet replica
I20260709 13:17:50.020247 30972 raft_consensus.cc:2243] T faf115b3d896416ebcf05ad97638f1aa P d567067363bd4266815405d14c8c42c4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:50.021206 30972 raft_consensus.cc:2272] T faf115b3d896416ebcf05ad97638f1aa P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.023407 30972 tablet_replica.cc:333] T a5b1bb21e67345058c7484c5e8540859 P d567067363bd4266815405d14c8c42c4: stopping tablet replica
I20260709 13:17:50.024081 30972 raft_consensus.cc:2243] T a5b1bb21e67345058c7484c5e8540859 P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.024571 30972 raft_consensus.cc:2272] T a5b1bb21e67345058c7484c5e8540859 P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:50.026782 10843 consensus_peers.cc:597] T f1a15aa0b7ce423386027dfe9aced682 P d567067363bd4266815405d14c8c42c4 -> Peer 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789): Couldn't send request to peer 4b7d4704a4404bb19c3053c6b0af4d90. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42789: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:50.026938 30972 tablet_replica.cc:333] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4: stopping tablet replica
I20260709 13:17:50.027755 30972 raft_consensus.cc:2243] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:50.028539 30972 raft_consensus.cc:2272] T b6d87d86b4b14d52b62593c268fb4f11 P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.030660 30972 tablet_replica.cc:333] T 499fadc1dd974c6588cedb5301e3d71d P d567067363bd4266815405d14c8c42c4: stopping tablet replica
I20260709 13:17:50.031297 30972 raft_consensus.cc:2243] T 499fadc1dd974c6588cedb5301e3d71d P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.031769 30972 raft_consensus.cc:2272] T 499fadc1dd974c6588cedb5301e3d71d P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.033828 30972 tablet_replica.cc:333] T 1d4899a931c04cc5bd67c793cc9cc6af P d567067363bd4266815405d14c8c42c4: stopping tablet replica
I20260709 13:17:50.034394 30972 raft_consensus.cc:2243] T 1d4899a931c04cc5bd67c793cc9cc6af P d567067363bd4266815405d14c8c42c4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:50.035168 30972 raft_consensus.cc:2272] T 1d4899a931c04cc5bd67c793cc9cc6af P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.037144 30972 tablet_replica.cc:333] T f62d1d32fe7e48cb97f4a3a34344a783 P d567067363bd4266815405d14c8c42c4: stopping tablet replica
I20260709 13:17:50.037726 30972 raft_consensus.cc:2243] T f62d1d32fe7e48cb97f4a3a34344a783 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.038177 30972 raft_consensus.cc:2272] T f62d1d32fe7e48cb97f4a3a34344a783 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.040001 30972 tablet_replica.cc:333] T 26ad1205065a48b29567ed4c89b20059 P d567067363bd4266815405d14c8c42c4: stopping tablet replica
I20260709 13:17:50.040633 30972 raft_consensus.cc:2243] T 26ad1205065a48b29567ed4c89b20059 P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.041080 30972 raft_consensus.cc:2272] T 26ad1205065a48b29567ed4c89b20059 P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.044159 30972 tablet_replica.cc:333] T f1a15aa0b7ce423386027dfe9aced682 P d567067363bd4266815405d14c8c42c4: stopping tablet replica
I20260709 13:17:50.044826 30972 raft_consensus.cc:2243] T f1a15aa0b7ce423386027dfe9aced682 P d567067363bd4266815405d14c8c42c4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:50.045655 30972 raft_consensus.cc:2272] T f1a15aa0b7ce423386027dfe9aced682 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.047950 30972 tablet_replica.cc:333] T 11aa1269fea7424ea33a0e9bcd4e64fb P d567067363bd4266815405d14c8c42c4: stopping tablet replica
I20260709 13:17:50.048525 30972 raft_consensus.cc:2243] T 11aa1269fea7424ea33a0e9bcd4e64fb P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.049074 30972 raft_consensus.cc:2272] T 11aa1269fea7424ea33a0e9bcd4e64fb P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.051138 30972 tablet_replica.cc:333] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4: stopping tablet replica
I20260709 13:17:50.051700 30972 raft_consensus.cc:2243] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.052130 30972 raft_consensus.cc:2272] T 40f935f4b4a54f5d9b3093d4f5e1b058 P d567067363bd4266815405d14c8c42c4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.054773 30972 tablet_replica.cc:333] T d29baf3eb63d4bb6b0f9baa028d1fc01 P d567067363bd4266815405d14c8c42c4: stopping tablet replica
I20260709 13:17:50.055392 30972 raft_consensus.cc:2243] T d29baf3eb63d4bb6b0f9baa028d1fc01 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.055866 30972 raft_consensus.cc:2272] T d29baf3eb63d4bb6b0f9baa028d1fc01 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.057742 30972 tablet_replica.cc:333] T bea59f51efa648ea8d820e99be4bc7d3 P d567067363bd4266815405d14c8c42c4: stopping tablet replica
I20260709 13:17:50.058293 30972 raft_consensus.cc:2243] T bea59f51efa648ea8d820e99be4bc7d3 P d567067363bd4266815405d14c8c42c4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:50.059067 30972 raft_consensus.cc:2272] T bea59f51efa648ea8d820e99be4bc7d3 P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.061180 30972 tablet_replica.cc:333] T 7d4cb37a6d7e41b694224878fbf001ed P d567067363bd4266815405d14c8c42c4: stopping tablet replica
I20260709 13:17:50.061710 30972 raft_consensus.cc:2243] T 7d4cb37a6d7e41b694224878fbf001ed P d567067363bd4266815405d14c8c42c4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:50.062453 30972 raft_consensus.cc:2272] T 7d4cb37a6d7e41b694224878fbf001ed P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.064213 30972 tablet_replica.cc:333] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4: stopping tablet replica
I20260709 13:17:50.064858 30972 raft_consensus.cc:2243] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.065438 30972 raft_consensus.cc:2272] T debc9febb2c34accb753acbebaf990cb P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.067545 30972 tablet_replica.cc:333] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4: stopping tablet replica
I20260709 13:17:50.068116 30972 raft_consensus.cc:2243] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:50.068948 30972 raft_consensus.cc:2272] T c7d24f498cb84dd2b9139031f8e00a57 P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.071736 30972 tablet_replica.cc:333] T 7a876d18e09a4577a85ca26975da0e8d P d567067363bd4266815405d14c8c42c4: stopping tablet replica
I20260709 13:17:50.072357 30972 raft_consensus.cc:2243] T 7a876d18e09a4577a85ca26975da0e8d P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.072881 30972 raft_consensus.cc:2272] T 7a876d18e09a4577a85ca26975da0e8d P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:50.075098 10917 consensus_peers.cc:597] T a5b1bb21e67345058c7484c5e8540859 P b47d3fdd5d61449593b05bde3b67069f -> Peer 4b7d4704a4404bb19c3053c6b0af4d90 (127.30.63.1:42789): Couldn't send request to peer 4b7d4704a4404bb19c3053c6b0af4d90. Status: Network error: Client connection negotiation failed: client connection to 127.30.63.1:42789: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:50.075285 30972 tablet_replica.cc:333] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4: stopping tablet replica
I20260709 13:17:50.075963 30972 raft_consensus.cc:2243] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.076361 30972 raft_consensus.cc:2272] T 81eef65db7ff4e8cb37f06a3decd4320 P d567067363bd4266815405d14c8c42c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.078454 30972 tablet_replica.cc:333] T e373165d4f2844d882994be5887e5ddf P d567067363bd4266815405d14c8c42c4: stopping tablet replica
I20260709 13:17:50.078897 30972 raft_consensus.cc:2243] T e373165d4f2844d882994be5887e5ddf P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.079279 30972 raft_consensus.cc:2272] T e373165d4f2844d882994be5887e5ddf P d567067363bd4266815405d14c8c42c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.119252 30972 tablet_server.cc:196] TabletServer@127.30.63.2:0 shutdown complete.
I20260709 13:17:50.148842 30972 tablet_server.cc:179] TabletServer@127.30.63.3:0 shutting down...
I20260709 13:17:50.179177 30972 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:50.180028 30972 tablet_replica.cc:333] T faf115b3d896416ebcf05ad97638f1aa P b47d3fdd5d61449593b05bde3b67069f: stopping tablet replica
I20260709 13:17:50.180764 30972 raft_consensus.cc:2243] T faf115b3d896416ebcf05ad97638f1aa P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.181250 30972 raft_consensus.cc:2272] T faf115b3d896416ebcf05ad97638f1aa P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.183115 30972 tablet_replica.cc:333] T 7d4cb37a6d7e41b694224878fbf001ed P b47d3fdd5d61449593b05bde3b67069f: stopping tablet replica
I20260709 13:17:50.183694 30972 raft_consensus.cc:2243] T 7d4cb37a6d7e41b694224878fbf001ed P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.184144 30972 raft_consensus.cc:2272] T 7d4cb37a6d7e41b694224878fbf001ed P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.185961 30972 tablet_replica.cc:333] T a5b1bb21e67345058c7484c5e8540859 P b47d3fdd5d61449593b05bde3b67069f: stopping tablet replica
I20260709 13:17:50.186487 30972 raft_consensus.cc:2243] T a5b1bb21e67345058c7484c5e8540859 P b47d3fdd5d61449593b05bde3b67069f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:50.187268 30972 raft_consensus.cc:2272] T a5b1bb21e67345058c7484c5e8540859 P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.189210 30972 tablet_replica.cc:333] T 499fadc1dd974c6588cedb5301e3d71d P b47d3fdd5d61449593b05bde3b67069f: stopping tablet replica
I20260709 13:17:50.189776 30972 raft_consensus.cc:2243] T 499fadc1dd974c6588cedb5301e3d71d P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.190217 30972 raft_consensus.cc:2272] T 499fadc1dd974c6588cedb5301e3d71d P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.191963 30972 tablet_replica.cc:333] T b6d87d86b4b14d52b62593c268fb4f11 P b47d3fdd5d61449593b05bde3b67069f: stopping tablet replica
I20260709 13:17:50.192512 30972 raft_consensus.cc:2243] T b6d87d86b4b14d52b62593c268fb4f11 P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.193027 30972 raft_consensus.cc:2272] T b6d87d86b4b14d52b62593c268fb4f11 P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.194779 30972 tablet_replica.cc:333] T 1d4899a931c04cc5bd67c793cc9cc6af P b47d3fdd5d61449593b05bde3b67069f: stopping tablet replica
I20260709 13:17:50.195333 30972 raft_consensus.cc:2243] T 1d4899a931c04cc5bd67c793cc9cc6af P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.195766 30972 raft_consensus.cc:2272] T 1d4899a931c04cc5bd67c793cc9cc6af P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.197583 30972 tablet_replica.cc:333] T f62d1d32fe7e48cb97f4a3a34344a783 P b47d3fdd5d61449593b05bde3b67069f: stopping tablet replica
I20260709 13:17:50.198146 30972 raft_consensus.cc:2243] T f62d1d32fe7e48cb97f4a3a34344a783 P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.198601 30972 raft_consensus.cc:2272] T f62d1d32fe7e48cb97f4a3a34344a783 P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.200412 30972 tablet_replica.cc:333] T c7d24f498cb84dd2b9139031f8e00a57 P b47d3fdd5d61449593b05bde3b67069f: stopping tablet replica
I20260709 13:17:50.201022 30972 raft_consensus.cc:2243] T c7d24f498cb84dd2b9139031f8e00a57 P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.201462 30972 raft_consensus.cc:2272] T c7d24f498cb84dd2b9139031f8e00a57 P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.203382 30972 tablet_replica.cc:333] T debc9febb2c34accb753acbebaf990cb P b47d3fdd5d61449593b05bde3b67069f: stopping tablet replica
I20260709 13:17:50.203923 30972 raft_consensus.cc:2243] T debc9febb2c34accb753acbebaf990cb P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.204355 30972 raft_consensus.cc:2272] T debc9febb2c34accb753acbebaf990cb P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.206176 30972 tablet_replica.cc:333] T bea59f51efa648ea8d820e99be4bc7d3 P b47d3fdd5d61449593b05bde3b67069f: stopping tablet replica
I20260709 13:17:50.206861 30972 raft_consensus.cc:2243] T bea59f51efa648ea8d820e99be4bc7d3 P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.207304 30972 raft_consensus.cc:2272] T bea59f51efa648ea8d820e99be4bc7d3 P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.209196 30972 tablet_replica.cc:333] T d29baf3eb63d4bb6b0f9baa028d1fc01 P b47d3fdd5d61449593b05bde3b67069f: stopping tablet replica
I20260709 13:17:50.209705 30972 raft_consensus.cc:2243] T d29baf3eb63d4bb6b0f9baa028d1fc01 P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.210132 30972 raft_consensus.cc:2272] T d29baf3eb63d4bb6b0f9baa028d1fc01 P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.211827 30972 tablet_replica.cc:333] T 40f935f4b4a54f5d9b3093d4f5e1b058 P b47d3fdd5d61449593b05bde3b67069f: stopping tablet replica
I20260709 13:17:50.212357 30972 raft_consensus.cc:2243] T 40f935f4b4a54f5d9b3093d4f5e1b058 P b47d3fdd5d61449593b05bde3b67069f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:50.213124 30972 raft_consensus.cc:2272] T 40f935f4b4a54f5d9b3093d4f5e1b058 P b47d3fdd5d61449593b05bde3b67069f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.215683 30972 tablet_replica.cc:333] T 11aa1269fea7424ea33a0e9bcd4e64fb P b47d3fdd5d61449593b05bde3b67069f: stopping tablet replica
I20260709 13:17:50.216262 30972 raft_consensus.cc:2243] T 11aa1269fea7424ea33a0e9bcd4e64fb P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.216753 30972 raft_consensus.cc:2272] T 11aa1269fea7424ea33a0e9bcd4e64fb P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.218634 30972 tablet_replica.cc:333] T e373165d4f2844d882994be5887e5ddf P b47d3fdd5d61449593b05bde3b67069f: stopping tablet replica
I20260709 13:17:50.219331 30972 raft_consensus.cc:2243] T e373165d4f2844d882994be5887e5ddf P b47d3fdd5d61449593b05bde3b67069f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:50.220239 30972 raft_consensus.cc:2272] T e373165d4f2844d882994be5887e5ddf P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.222476 30972 tablet_replica.cc:333] T 81eef65db7ff4e8cb37f06a3decd4320 P b47d3fdd5d61449593b05bde3b67069f: stopping tablet replica
I20260709 13:17:50.223116 30972 raft_consensus.cc:2243] T 81eef65db7ff4e8cb37f06a3decd4320 P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.223595 30972 raft_consensus.cc:2272] T 81eef65db7ff4e8cb37f06a3decd4320 P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.225710 30972 tablet_replica.cc:333] T f1a15aa0b7ce423386027dfe9aced682 P b47d3fdd5d61449593b05bde3b67069f: stopping tablet replica
I20260709 13:17:50.226233 30972 raft_consensus.cc:2243] T f1a15aa0b7ce423386027dfe9aced682 P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.226709 30972 raft_consensus.cc:2272] T f1a15aa0b7ce423386027dfe9aced682 P b47d3fdd5d61449593b05bde3b67069f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.228752 30972 tablet_replica.cc:333] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f: stopping tablet replica
I20260709 13:17:50.229312 30972 raft_consensus.cc:2243] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:50.230306 30972 raft_consensus.cc:2272] T 26ad1205065a48b29567ed4c89b20059 P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.233203 30972 tablet_replica.cc:333] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f: stopping tablet replica
I20260709 13:17:50.233675 30972 raft_consensus.cc:2243] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.234066 30972 raft_consensus.cc:2272] T 7a876d18e09a4577a85ca26975da0e8d P b47d3fdd5d61449593b05bde3b67069f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.265754 30972 tablet_server.cc:196] TabletServer@127.30.63.3:0 shutdown complete.
I20260709 13:17:50.295574 30972 master.cc:562] Master@127.30.63.62:46421 shutting down...
I20260709 13:17:50.317528 30972 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 54007ed6452045f4807f96f9f96bd4e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:50.318094 30972 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 54007ed6452045f4807f96f9f96bd4e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.318428 30972 tablet_replica.cc:333] T 00000000000000000000000000000000 P 54007ed6452045f4807f96f9f96bd4e2: stopping tablet replica
I20260709 13:17:50.357223 30972 master.cc:584] Master@127.30.63.62:46421 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (12122 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (25279 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (339716 ms total)
[  PASSED  ] 8 tests.
I20260709 13:17:50.416730 30972 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 418 messages since previous log ~15 seconds ago
I20260709 13:17:50.416992 30972 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 418 messages since previous log ~15 seconds ago
I20260709 13:17:50.417184 30972 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 415 messages since previous log ~15 seconds ago
I20260709 13:17:50.417407 30972 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~34 seconds ago
I20260709 13:17:50.417603 30972 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~34 seconds ago
I20260709 13:17:50.417794 30972 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:4755: suppressed but not reported on 1 messages since previous log ~76 seconds ago
I20260709 13:17:50.418017 30972 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 5 messages since previous log ~178 seconds ago
I20260709 13:17:50.418215 30972 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 1 messages since previous log ~190 seconds ago
I20260709 13:17:50.418423 30972 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 1 messages since previous log ~190 seconds ago
I20260709 13:17:50.418679 30972 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 5 messages since previous log ~0 seconds ago
I20260709 13:17:50.418978 30972 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 47 messages since previous log ~10 seconds ago
